Integration ARjs or MindARjs

Sry for posting so late, but it took some time to make the final adjustments. Could at least reduce the tracking offset. Pls mind the issues mentioned in the readme.md. AR.js is not working perfectly atm, but hopefully MindAR (If I ever have the time ^^) will do a better job. But here is the promised repo link :slightly_smiling_face: GitHub - FireDragonGameStudio/NeedleAndARjs

by user 474974683163394049

Thanks a lot for making this! I’ll have a look at it later :slightly_smiling_face:

Short update on MindAR: Basically working, but I can’t show the tracked 3D content, as MindAR creates it’s own THREE components (scene, camera, renderer) and THREE can’t switch between contexts. As long as I can’t replace these components with the ones from NeedleEngine, MindAR will not be usable. Already opened an issue on github, but I’m not really confident. Maybe someone, with better JS skills than me, can disassemble the mindar-image-three.prod.js and extract the MindARThree class for making THREE camera, scene and renderer replaceable :slightly_smiling_face:

by user 474974683163394049

Sounds good. I think you should be able to use the mindjs objects or at least blit the result of that to the needle canvas. But would be better if we just could tell it to use our stuff. Thanks for your effort!

Ive only had time to briefly checkout your repo yesterday, looks pretty straightforward. I think ideally we could integrate it somehow with the Start AR button too instead of starting immediately - what do you think? So someone can setup the AR.js stuff in Unity and then have the same flow as before but with AR.js running in the background

I’d agree. A simple check for WebXR support and if that fails using AR.js, at least for image tracking ^^

by user 474974683163394049

A question that came to my mind, but it’s obviously nonsene: Are you planning to add support for aframe as well (in any form)? :thinking: Most of the existing solutions are built supporting aframe, so supporting that, would make it easy to integrate existing stuff. My head just can’t figure out, how this support could be done, as aframe is a layer built on top of threejs, but i like the idea :sweat_smile:

by user 474974683163394049

We’ve been thinking about that a bit but didnt look further into it yet. I personally haven’t used AFrame much so far so my experience is mostly from an outsiders perspective so can’t say much about how easy or hard that would be but I can definitely see the benefit.

You can open a discussion on github maybe so we can have that as an idea tracked somewhere else: needle-tools/needle-engine-support Ā· Discussions Ā· GitHub

I’ll do that, thx :slightly_smiling_face: I’ll further mark this post as solved. As a conclusion: AR.js is basically working (needs some tweaking), MindAR has technical issues.

by user 474974683163394049

Hi, so, for the forum
With FireDragonSt we tried to update his repo : GitHub - FireDragonGameStudio/NeedleAndARjs
To use Needle + AR, we have some issues so we will add the news here when it will be alright

by user 224464722878005248

Issue fixed, repo updated. I will add a few more steps to the getting started section, to avoid errors in future cases :slightly_smiling_face:

by user 474974683163394049

by user 474974683163394049

Thank you thats awesome! :fire:

PS @Marcel_Wiessler1 :cactus: What’s the name of the AR sample in the sample list of needle ?
I’m trying a Needle Vanilla AR object projection but I have some difficulties with the ā€œBasic capabilitiesā€ in the doc
I add my WebXR, my TeleportTarget component but it doesn’t works and I doesn’t understand the ā€œEnable going into Miniature Modeā€ part

by user 224464722878005248

I tried to add the XR flag too

by user 224464722878005248

What AR sample are you referring to?

I’m trying to make this :

by user 224464722878005248

by user 224464722878005248

I was wondering if there is a sample

by user 224464722878005248