Sing or beatbox into a microphone and play instruments with your voice. A real-time voice-to-MIDI plugin written in Rust (CLAP / VST3).
Hum a melody and get MIDI notes or chords, snapped to your key. Beatbox and get drum hits on pads trained on your own sounds. Play the built-in sounds, or send the MIDI to any synth in your DAW.
- Notes: real-time pitch tracking (YIN) turns your voice into MIDI notes, snapped to the key and scale you pick. Median note latency is about 28 ms with the default settings (27 ms on Fast).
- Chords: every sung note plays a chord that fits the key.
- Beatbox: train 8 pads on your own kick, snare and hat sounds, then beatbox to trigger them.
- Notes + Beatbox at once.
- 12 built-in sounds (Keys, Organ, Lead, Supersaw, Bass, Acid, Reese, Pad, Strings, Pluck, Bell, Sine) with a Shape row (tone, attack, release, drive, width, space, glide), plus 6 drum kits and your own samples.
- Expression: pitch bend (Off / Slides / Exact), stickiness, vowel-shape control, a mic gate that learns the room's noise.
- Capture: record what you sang and save it as a MIDI file to drag into your DAW.
- MIDI out to any instrument, and MIDI pass-through so recorded takes replay.
- Profiles to save and load your whole setup.
- Download
VoiceKeys.clap(or the VST3) from Releases. - Copy it to
C:\Program Files\Common Files\CLAP\(VST3:C:\Program Files\Common Files\VST3\). - Put it on a track with your microphone as the input, and record-arm or monitor the track.
Developed and tested on Windows with REAPER. Other platforms are untested.
You need a stable Rust toolchain.
cargo xtask bundle voicekeys --release
Run the tests:
cargo test --lib
The audio thread is checked never to allocate (src/alloc_audit.rs).
Bug reports, ideas and pull requests are welcome. See CONTRIBUTING.md.
GPL-3.0. See LICENSE.