Audio Matters Too! Enhancing Markerless Motion Capture with Audio Signals for String Performance Capture
Audio Matters Too! Enhancing Markerless Motion Capture with Audio Signals for String Performance Capture
In this paper, we touch on the problem of markerless multi-modal human motion capture especially for string performance capture which involves inherently subtle hand-string contacts and intricate movements. To fulfill this goal, we first collect a dataset, named String Performance Dataset (SPD), featuring cello and violin performances. The dataset includes …