In addition to IOBT, Meta is launching Generative Legs, an AI model that estimates leg positions. While it can detect jumping and crouching, it won't pick up many actual movements like raising your knees. Together, these features enable plausible full bodies in VR, called Full Body Synthesis, without the need for external hardware. Full Body Synthesis will be integrated into several games, and the SDK will be available for other developers in December.
Key takeaways:
- Quest 3 is set to receive a software update in December that will include upper body tracking and AI estimated legs, a feature not seen in any other VR headset to date.
- The new Inside-Out Body Tracking (IOBT) feature will use side cameras to track the user's wrist, elbows, shoulder, and torso, improving the accuracy of arm and torso representation in VR.
- Meta is also launching a feature called Generative Legs, which uses AI to estimate leg positions. While it can detect jumping and crouching, it won't pick up many actual movements like raising your knees.
- These updates will enable a feature called Full Body Synthesis, allowing for more realistic full body representation in VR without external hardware. This will be available in games like Supernatural, Swordsman VR, Drunken Bar Fight, and for other developers in December.