WebXR - AR image tracking sample not working + more

đŸŒ” Needle Engine
61

Have tried implementing some of the tips u have mentioned and it’s already looking much better and consistent, best attempt I have had so far, I have sent the link to some friends with varying devices both android and ios to test it out

https://cdn.discordapp.com/attachments/1159449373923627099/1159590271181394041/az_recorder_20231006_020353.mp4?ex=65d7b098&is=65c53b98&hm=d3023b41a535b5d8a76235309bc8243636b1f71c58544d7226b4b2847f5a2396&(image larger than 4 MB)

by user 392979063620501504

62

Glad I could help - must say, a shiny dark floor is indeed a challenge for all tracking algorithms :sweat_smile:

63

Hence the testing must continue :laughing:

by user 392979063620501504

64

Hey any updates on the annotation and website url things?

by user 392979063620501504

65

Annotations ate something we need to expose first in some way. Will try to look at that next week.
URL opening from an object is what I shared a few posts up -

66

To use that from blender,

  1. open the workspace from the Needle Engine component
  2. in the src directory, add that script with extension .ts
  3. in Blender you should now be able to use that new component.
67

Alright, looking forward to it

by user 392979063620501504

68

Hey, any update on exposing everyday actions/image tracking features to blender?

by user 392979063620501504

69

Just wanted to know if it was happening anytime soon, or if I should take the time to pivot to Unity which I am dreading :cry:

by user 392979063620501504

70

Hey @herbstđŸŒ” I was testing performance between ios and android for image tracking and they work great both ways, ios is faster and more consistent so far on the sample project on the website (the cactus one)

But when I open the animated character model on my iPad, I don’t get the option to open with quick look, is there any particular setting or requirement for?

by user 392979063620501504

71

The difference

IMG_1257.png
IMG_1257.png1640×2360 275 KB

IMG_1258.png
IMG_1258.png1640×2360 260 KB

by user 392979063620501504

72

Image tracking from iPad is great right now on the example

IMG_1255.jpg
IMG_1255.jpg1640×2360 210 KB

by user 392979063620501504

73

And last question, what’s the best workflow to integrate html, css and Js Ui elements into the build?

by user 392979063620501504

74

Similar to what’s been done on the example ss?

by user 392979063620501504

75

For editing HTML and CSS you can just open the web project directory and edit the files to your liking. You can modify it however you like - the whole 3D part is inside the <needle-engine> html element so wherever you put this HTML element that’s where you’ll see the 3D scene
image.png

image.png
image.png1219×874 98.3 KB

76

Got it, I’m looking to add UI elements inside the 3D the space

Something like here in this site, when you click on a object and it reveals text and other buttons

by user 392979063620501504

77

The camera motion zooming into the object is something I’m looking to do too but that’s another day, rn need to focus on the AR stuff

by user 392979063620501504

78

Right now you’ll need an USDZExporter component too (which is already exposed in Blender)

79

One thing to note that you’ll run into though is that USDZ export doesn’t support skinned meshes right now
 so for testing I’d recommend you remove the Armature from the character (otherwise it won’t show up at the moment)

80

Hmm that’s rough

by user 392979063620501504