I was researching how to get FaceRig to work on Linux, and eventually concluded that it is pretty much impossible. So I thought, hey, why not just code it myself? It can’t be that difficult, right? I mean, it probably won’t be as feature-rich as the original, but all I need / want is the basic “avatar moving along with my face” functionality.
So I spent a couple weekends, digging up the (very poorly translated) Live2D docs (but still, kudos to Live2D Inc for actually translating them), struggled with some questionable anti-patterns, and arrived with this:
With some input and suggestions from another user I have also created a spin-off project, where instead of using facial tracking, the avatar is controlled by mouse cursor position and customizable via a UI.
Some more demos (not really that important so I haven’t bothered self-hosting them):
- Comparing facial tracking and mouse tracking
- CLI controls for mouse tracking
- GUI controls for mouse tracking
Please feel free to get in touch for any comments, suggestions, bug reports, questions, or any kind of feedback!