Lightweight minimal speech recognition?

July 12th, 2023
jammer, music, tech
I currently control my rhythm stage setup with a USB keyboard. This works, except that my hands are often busy playing instruments when I want to change something. I already have a microphone in front of my mouth running to a computer, which I use for my whistle-controlled bass synthesizer: could I use speech recognition?

Another way to look at this is that a lot of my exploration here has been finding some way to play bass and mandolin at the same time: whistle bass, bass pedals, bass and drum pedals. With speech recognition I could call chords to the computer!

I'm currently running on a Raspberry Pi 3B. I tried OpenAI's Whisper and then the C++ port (which should work on the 4B), and then the much older software Julius but my Pi 3B couldn't handle real time with any of these. Is there some existing software that would be a good fit for this? People were running speech recognition back when this computer would have been top of the line.

I'm also considering giving up on the idea of using speech: all I really need is some sound I can make consistently enough that the computer can recognize. I'm already running a system that can mostly decode whistling, so maybe I should figure out how to phrase my commands as simple whistle patterns? I'm a bit nervous about doing this while playing, though, since unless I choose patterns that can sound musical in any key it's going to be pretty hard to combine with playing something else. Maybe alternating low and high notes, but I can choose which notes in response to the key?

Comment via: facebook, lesswrong, mastodon

Recent posts on blogs I like:

Jealousy In Polyamory Isn't A Big Problem And I'm Tired Of Being Gaslit By Big Self-Help

The nuance is in the post, guys

via Thing of Things July 18, 2024

Trust as a bottleneck to growing teams quickly

non-trust is reasonable • trust lets collaboration scale • symptoms of trust deficit • how to proactively build trust

via benkuhn.net July 13, 2024

Coaching kids as they learn to climb

Helping kids learn to climb things that are at the edge of their ability The post Coaching kids as they learn to climb appeared first on Otherwise.

via Otherwise July 10, 2024

more     (via openring)