→Art-Sync Fusion Interactive System
Jiaying Fu2023
→ interactive system
somatosensory
Art-Sync Fusion Interactive System
Jiaying Fu
Art-Sync Fusion interactive system leverages markerless motion capture technology to enhance interactive development and motion capture applications. Developed using the Unity engine and a Kinect depth sensor, the system captures human data in real-time, driving character model movements. It visualizes user avatars and movement trajectories through Shader creation and VFX particle effects, complete with a UI interface for controlling effect parameters. Additionally, a monocular RGB video motion capture model is integrated, enabling dynamic pose scoring capabilities. The system supports two interaction modes: a free interaction mode and a game training mode, facilitating user engagement with the virtual scene. Applicable to various interactive development scenarios, this system boosts development efficiency and supports the production process in areas such as physical games, interactive performances, and virtual humans.
Awards & Exhibitions
2023, 11th National College Digital Art Design Competition (NCDA) Third Prize, Beijing