Plane tracking & body tracking XR mode via phone camera?

I really like the AR face filter sample and its working for me really well. Is it possible to flip the camera mode to the world and do plane tracking & body tracking so i can place virtual objects/virtual fashion in the world via phone camera? I’ve tried quicklook ar and it seems very limited.

If it is no currently possible with Needle, would i be able to do it with Unity? I’m new to Unity so any idea / packages would be really helpful. Thanks

@Tamrat please post in the :cactus: Needle Engine category

We currently don’t have builtin support for body tracking but image tracking - we can prioritize feature requests for PRO users.

1 Like

I see thanks. I was planning to become PRO user anyway so that’s good to know. I am currently comparing multiple platforms and planning to pick one to commit to in order to create a Web AR camera filters app similar to Snapchat or Instagram.

So just to confirm it is possible to do world/plane/body tracking on the phone with needle engine in the future, correct?

Hi, pro user here, I’m +1 to look into body tracking feature. Wanted to know what’s the best approach to do it. Maybe send a websocket with tracking info if needle is not able to handle it on its own?

Could you send a feature request via Needle Roadmap? Thank you

It can be implemented with e.g. mediapipe. We currently have adding facefilter support for core needle engine on the roadmap. Adding facefilter support would allow us to add bodytracking support later (since we would add mediapipe as a dependency then)

1 Like

This topic was automatically closed 13 days after the last reply. New replies are no longer allowed.