WebXR Image Tracking

🌵 Needle Engine
1

how does the setup look like in your unity scene? I didn’t find anything in the documentation.

image.png
image.png1116Ă—1033 168 KB

Original Post on Discord

by user 684154017479524352

2

You can find the sample scene here right now on the image-tracking branch: https://github.com/needle-tools/needle-engine-samples/tree/samples/image-tracking

3

can you already estimate how long it will take for iOS devices to be supported?

by user 684154017479524352

4

cc @herbst🌵

5

What do you think, is the Samsung S8+ too old? Couldn’t do Image AR tracking with this device. EDBYTO – E-Learning-Anwendungen für das WebXR.

by user 684154017479524352

6

Did you enable the webxr incubations flag? via chrome://flags/

7

image.png
image.png817Ă—184 21.4 KB

8

Image tracking does require it right now

9

IOS works, but without Textures. Crazy (Chrome)

AJFCJaWQXV-BKQ-Ag-yVeH9yob0IvqzAZBDp60ELzzMenrAIQKTeuZK8GAjq4EuKU1SWueO5RRbX7-YyKD4_62Yar20GQQHEwdKTeeZm8XUhu8zQ2tp0lyM2A4waJfLRiI5airy4qpomQtG7p4zVrI9wCciQlQ-MBmIsihTuUEsTA-FaKn6zxtH6GHq8XLkoeLySDvUn74UgIunQKCjtzIgNkE3HYxYDbpbQKGZhBFlyF_2eXzMuRZNuDiGUM97FZjhlxoIkWTUGkujVPEFYCdNA2z7AxLNzEl2bRILYJpDEAvQACZ5yVJlvof9xdvJSy9GWLLnf_I-lRb7uXd6Cw-IAfR8-HW00S11CEkQQ6igvPjFVQ523MvfUOQ3LWIos7nusCr1rV09TjT9tmksFvCpMOEhc2DDJqHLik_WysCPajgfBJBM1hEiMHyvowS9-nwn1Sv_EHdWUeGQWcQloO3LKNzEfzM7wJhjgM1PS8gERtjMvZ7FVN9Ez8NyI..png
AJFCJaWQXV-BKQ-Ag-yVeH9yob0IvqzAZBDp60ELzzMenrAIQKTeuZK8GAjq4EuKU1SWueO5RRbX7-YyKD4_62Yar20GQQHEwdKTeeZm8XUhu8zQ2tp0lyM2A4waJfLRiI5airy4qpomQtG7p4zVrI9wCciQlQ-MBmIsihTuUEsTA-FaKn6zxtH6GHq8XLkoeLySDvUn74UgIunQKCjtzIgNkE3HYxYDbpbQKGZhBFlyF_2eXzMuRZNuDiGUM97FZjhlxoIkWTUGkujVPEFYCdNA2z7AxLNzEl2bRILYJpDEAvQACZ5yVJlvof9xdvJSy9GWLLnf_I-lRb7uXd6Cw-IAfR8-HW00S11CEkQQ6igvPjFVQ523MvfUOQ3LWIos7nusCr1rV09TjT9tmksFvCpMOEhc2DDJqHLik_WysCPajgfBJBM1hEiMHyvowS9-nwn1Sv_EHdWUeGQWcQloO3LKNzEfzM7wJhjgM1PS8gERtjMvZ7FVN9Ez8NyI..png2532Ă—1170 69.4 KB

by user 684154017479524352

10

The scene doesnt use textures but vertex colors and that’s not supported by quicklook I believe

11

Yes, I had already set that.

by user 684154017479524352

12

I actually added image tracking support for QuickLook yesterday :eyes:
Have to clean it up a bit but works already.

There are some QuickLook on iOS limitations unfortunately, so the above sample won’t work:

  • scene extends below floor plane - QuickLook pushes it up, non-trivial to work around
  • scene occlusion can’t be turned off - so “hole in the wall / hole in the floor” scenarios are not possible
  • vertex colors as mentioned above
13

I’ll take a glance if baking vertex colors to texture is feasible at runtime.
At some point we’ll potentially have a validator of sorts in the editor to show when a scene will / will not work in QuickLook

14

I was wrong there. There is NO image tracking on IOS, only AR.

by user 684154017479524352

15

Image Tracking on iOS is not released yet. Felix just worked on it yesterday :slightly_smiling_face:

16

Image tracking on IOS works great. My textures are also displayed. Many thanks to Halle :):+1:

by user 684154017479524352

17

Thanks great to hear

18

My own workaround is to use an AnimateBy preliminary…Action to jettison the asset in place at Scene start. ARQL handles both well designed scenes and badly authored assets with the origin/pivot in wild places. Therefore it first calculates a bounding box of the whole scene - wrongly assuming, the bottom lies on the ground plane.

by user 277531393297350676