Gesture Analysis and Recognition of Multi-modal Music Performances

• Developed a machine learning model, on MATLAB, capable of instrument recognition via musician posture data.
• Trained a deep learning model, on Keras, to classify bowing movement of musicians playing the violin, viola, cello and more.
• Built and trained instrument specific deep learning models, Long Short-term Memory (LSTM) on PyTorch, to detect musical onsets.
• Built multi-dataset compatible API-like framework for data extraction from 1500+ video and audio files.