Object tracking with Needle?

Hello, I am currently testing the Sample Scene for Image Tracking.

At the Futurium in Berlin, I saw years ago that they were not only using Image Tracking but also 3D Model Tracking. With this, you can move the tablet around the object, and the information/images, etc., remain fixed in relation to the object.

I tried to achieve something similar with the Image Tracking Scene, but of course, it doesn’t work as expected. When my camera is positioned exactly like in the saved image, the AR content appears. However, if the viewing angle changes, the AR content shifts/drifts immediately.

Is Needle capable of doing this kind of Object Tracking? Or do we have a Sample Scene for it?

Hello Luxvideri,

Needle Engine supports WebXR Image Tracking, which allows you to track images and overlay 3D content. However, as you’ve noticed, if the camera’s angle changes significantly from the reference image, it can cause drifting of the AR content.

Currently, Needle does not have built-in support for 3D Model Tracking, which tracks the position and orientation of real-world objects instead of images. This could explain the challenges you’re facing in maintaining the AR content’s position relative to your object from different angles.

To enhance stability in image tracking, consider the following tips:

  1. Smoothing: Enable the smooth property in the WebXRImageTracking component. This can help reduce jitter in the tracking.
  2. Marker Size: Ensure that the markers you use are appropriately sized. The WidthInMeters property must accurately represent the size of the physical marker for more stable tracking.
  3. Image Quality: Select high-contrast and unique images for tracking to improve detection quality.

For your use case involving objects, you might look into libraries that support 3D Model Tracking if Needle does not meet your needs. Some suggestions are:

  • AR.js
  • Mind AR

You can view the documentation and live demo for image tracking here: Needle Image Tracking Documentation (see xr).

If you are exploring other capabilities or have specific implementation questions, feel free to ask!

1 replies left - Get a PRO license for more AI replies.
thread_qDWgtva93rqBrsdMhtvqg9Yw
Reply to this message to continue the conversation