Audio classification of musical instruments

Musical instruments lie jumbled on the table: Cymbals, maracas, and a tambourine lie on top of a triangle.

Working with Dr. Elaine Biddiss, I used machine learning to classify musical instruments from audio mixtures. In mixed-reality video games for music therapy, these algorithms can be paired with camera tracking to detect and reward the motions of music-making. These movements may be missed by camera tracking alone.