Facial Animation problem

🌵 Needle Engine
1

Hi, to get round the problem of not being able to have more than one animation track in a timeline our artist is combining all animations for a track into one.

Unfortunately we are having a problem - the eye animation is not playing. Mouth animations play, but not blinks or other facial animations.

Here is a video of the preview in Unity of the blink animation (as it should appear)
blink.mp4

Original Post on Discord

by user 420944948767227905

2

Here is an animation of the build - no blinking, as you see!
noblink.mp4

by user 420944948767227905

3

I will upload a minimal scene showcasing the problem.

by user 420944948767227905

4

By not more animation per timeline you mean not more animation track per timeline affecting one target object, right?

5

As discussed here? Discord

6

Do you get any error or warning in the browser console?

7

Thank you

8

Yes, not more than one animation track per character per timeline.

by user 420944948767227905

9

Here’s what I see in the console:

image.png
image.png776×484 29.9 KB

by user 420944948767227905

10

Ok thank you, it doesnt contain what i was looking for. I guess the facial animations are done with blendshapes? Do you see any special errors or warnings in Unity when exporting?

11

Yes, we use blendshapes for facial animations. Both for lip shapes and blinks and other expressions.

image.png
image.png1362×818 182 KB

by user 420944948767227905

12

No particular errors on export

image.png
image.png1457×759 112 KB

by user 420944948767227905

13

Hi just a quick update: a fix is in progress.
It was/is actually a multi-part problem that requires changes in three.js as well as UnityGLTF.
Then the result looks like this in the browser (The suit was just disabled for iteration speed^^)
20230803-130929_Frontline_Demo_-_Google_Chrome-logo.mp4

14

If I may ask @JanG , where’s the model from? I wanted to put a facial animation demo / sample up for a while but haven’t found one that was good enough quality wise

15

Thanks for your attention to this bug! The model is custom made for us using Character Creator 4.

by user 420944948767227905

16

Hi can you re-try with 3.11.4 @JanG ? Thank you

17

Yes, she blinks now!
blink-good.mp4

by user 420944948767227905

18

However I do get a lot of errors when exporting:

image.png
image.png1173×749 143 KB

by user 420944948767227905

19

These are annoying and we’ll look at them but shouldn’t affect the result you get –
at most these should be warnings. Basically the IK targets can’t be found since they don’t really exist as objects that can be exported in Unity

20

Thanks so much for fixing this so quickly @herbst🌵 ! :gentleblob:

by user 420944948767227905