Static button display

Hello, I’m trying to find a solution to display two buttons in a static position on the screen of quicklook users in AR on iOS. The buttons appear for now on android devices, which will then allow to change scene on click. I really want the two buttons to be fixed on the user’s screen and not appear as an AR object. I’ve added an example of what I expect, so far it’s displayed correctly with android.
Capture_decran_2023-12-04_095535.png


Original Post on Discord

by user 529307655622230016

Hello there – we have an experimental AI bot :robot: that might be able to help you with your question. Would you like to try this out?

Hey is that what u r looking for?

by user 392979063620501504

There is documentation in its description on how to do it

by user 392979063620501504

Just adding a simple class attribute to a html tag

by user 392979063620501504

thanks a lot ! it seems to work on android devices but not with iOS devices with Quicklook. I don’t know if I’m wrong, but it doesn’t seem possible to have your own interactive overlay buttons with apple and Quicklook (on left android, on right iOS/Quicklook)


by user 529307655622230016

as a workaround have a look at the everywhere actions. you cannot have real overlay ui with quicklook but you can pin two buttons to the 3d model: QuickLook Characters | Needle Engine

by user 395602247196737546

Quicklook has alot of restriction and these are guys are doing their best to create implementations around them. They recently made great strides in adding more features which I look forward to updating some of my projects with soon. Apple is just … ugh sometimes :+1: It affected my college pre-thesis project too when I demo-ing my work in front of the jury a few days ago (tho it was also the bad wifi’s fault too)

by user 392979063620501504

Yeah everywhere actions are the right tool here :slightly_smiling_face: There’s a number of components for enabling/disabling objects, playing animations and audio, and so on – aligned to the (relatively basic) interaction model Apple allows for iOS AR without installations.

If something is missing there I’m happy to help find solutions, combining everywhere actions sometimes requires a bit of thinking outside of the box.

But that wouldn’t work inside AR Quick Look as ARQL does not support screen positioned UI, except for the now disfunctional “Pay with ApplePay” UI at the bottom.

by user 277531393297350676

Yeah that point was discussed above, it also doesn’t multi image tracking and other features. We will just gonna have to make adjustments around them, can’t be helped.

by user 392979063620501504

My rigged characters also don’t show on quicklook, but I believe that was added in a recent update, so need to run it back and deploy

by user 392979063620501504

ARQL only supports up to 4 bones influencing any vertex in weightmapping for USDSkelAnim. I have many more bones, but just the first 4 will be processed.

by user 277531393297350676

Rigged meshes (yes with up to 4 weights) and animations are supported since a few releases, finally

There are workarounds you can do for UI, e.g. the Material Menu Demo here: Augmented Reality Showcase

@Thomas Kumlehn before you start reporting issues for that :slightly_smiling_face:, some of the scenes on that page crash the visionOS simulator (regression in the simulator unfortunately)

The ARQL part of the Simulator or the WebXR in Safari ? Last time I checked, your landing page scene had all textures crippled in WebXR.

by user 277531393297350676

Yeah that’s another simulator bug I reported long ago, same on the iOS simulator (but not the real device). I mean ARQL scenes though