• Showcase
  • Spine script for face tracking

Hi!
Now I can animate a 2D character in Spine using my face for the motion tracking 😎
Just a face reference with tracking markers and the Python script magic ✨

So… I’m not a developer. I used Ai for script writing.
But now I have a Tracking script that reads the markers' coordinates from the video reference (PNG sequence) and converts them into json format with bone animation in Spine.
I did it 🙌
✅ PNG sequence → Marker coordinates → JSON → Bone animation in Spine.
❌ No manual keyframing - just tracking → JSON → Spine animation
More details on my LinkedIn

It’s not perfect yet. The Tracking script still needs polishing.
But it already works and opens up exciting new possibilities for bringing face tracking into 2D animation pipelines in Spine software.

You can now animate a character’s with your face🎭
More to come. Stay tuned...

ps. I used face video reference from Nagapimocap channel: https://lnkd.in/eiqGdmmY

Related Discussions
...
SvissBro a renommé le titre en Spine script for face tracking le .

SvissBro That sounds great, but it looks like we do not have permission to access the share link you posted. Could you please check the permission setting?

    Misaki The link should be working now — could you please check again and confirm if you can access it?

    Mario Thank you. Glad you like it! I'm currently actively working on improving the script and have already managed to implement tracking markers from video instead of just PNG sequences.

      SvissBro Now I was able to watch your video! The tracking accuracy seems very high, which is great! I think there is a demand for this as there are quite a few Spine users looking for an easier way to do lip sync. I saw your post on LinkedIn, but you haven't published or distributed this script yet, have you? I'd love to try it once it's available to the public.

        Misaki Thank you! At the moment, the script isn’t publicly available yet, as it still needs further refinement and improvements. I’m actively working on it and will share it once it’s ready for release.