Hi team, I am currently working with the official Multiset VPS integration in Needle Engine. However, the VPS localization is failing on iOS devices. The reason for this is that the Needle Go App Clip does not include the native iOS SDK from Multiset ( GitHub - MultiSet-AI/multiset-ios-sdk: MultiSet iOS Native SDK for using MultiSet Visual Positioning System · GitHub ), which is strictly required to capture and extract the raw camera frame directly from ARKit. Would it be possible to integrate this native SDK into the Needle Go App Clip in a future update, or is there any plan to expose the raw camera frame directly to the WebXR bridge so we can handle it from JS? Thank you!
Hey Luciano,
You’re right: the Needle Go App Clip doesn’t include the Multiset iOS SDK, and currently raw camera frames aren’t exposed to the WebXR bridge on iOS — that’s a known limitation (see the docs). The WebARCameraBackground component won’t help there and can actually break things on iOS.
So there’s no workaround from JS today. Integrating Multiset’s native SDK into the App Clip would be needed. This isn’t publicly on the roadmap yet, but the team is open to feedback. If you need this, email hi@needle.tools to help prioritize it.
In the meantime, you could test with Android (where camera frames are accessible via WebXR) to isolate the VPS logic, or fall back to GPS-based positioning where it works.
Sources: Needle Engine Docs (63%), Needle Engine Docs (60%), Needle Engine Docs (58%), Needle Engine Docs (58%), Needle Engine Docs (57%), Needle Engine Docs (57%), Needle Engine Docs (57%), Needle Engine Docs (56%), Needle Engine Docs (56%), Needle Engine Docs (55%)
1 replies left - Become PRO for more replies.
Reply to this post directly if you need further help (bottom right button)