Indian developer turns hand gestures into music

An Indian independent developer, Shubhra Saha, has created Sonari, a digital musical instrument that allows users to make music simply by moving their hands in the air. The software uses a Mac’s built-in camera to track hand movements and convert gestures into musical notes, eliminating the need for a conventional physical instrument or external controller.

Designed for Apple silicon Macs, Sonari offers 17 different playing styles, allowing users to experiment with instruments and musical formats ranging from piano, guitar, drums and strings to theremin-style sound generation. The application also features a library of nearly 10,000 built-in sounds.

The concept is based on translating physical movements into musical expression. Raising a hand changes the pitch, while opening or closing the fingers alters the sound. Different gestures can be used to play melodies, create chords, produce percussion and control other musical elements.

The application also offers a One Hand mode, allowing users to play without coordinating both hands. Other options include Face and Head modes, which use facial movements and head positioning to control music.

Sonari goes beyond being a standalone virtual instrument. It can also function as a MIDI controller, allowing musicians to send their gestures to compatible music production software. It supports MIDI 2.0, standard MIDI, MIDI Polyphonic Expression (MPE) and Open Sound Control (OSC), making it possible to integrate gesture-based performances into existing studio workflows.

The software is compatible with music applications including Logic Pro, GarageBand, Ableton Live, FL Studio and Pro Tools.

Another feature is Sonari Remote, a free companion application for iPhone. It adds additional control options through touch, motion, facial expressions and breath. The sound generation, however, takes place on the Mac rather than the phone.

The developer’s website also highlights the instrument’s ability to accommodate different musical traditions, offering hundreds of scales and rhythm cycles, including Indian ragas, Arabic maqams and microtonal tunings.

Sonari was first listed on the Mac App Store on September 13, 2026. It offers a 14-day free trial, after which users can unlock the software through a one-time payment of US$99, without a recurring subscription. It requires macOS 26 or later and an Apple silicon Mac.

Saha describes Sonari as an instrument that allows people to play music through movement rather than relying on traditional keys, strings or physical controls. The project brings together gesture recognition, digital sound generation and music production technology in an attempt to offer a different way of creating and performing music.

You might also like