Open-vocabulary speech on $5 chips threatens cloud voice licensing
Offline speech recognition for appliances and devices without cloud fees, paid for by hardware OEMs per unit.
Competitive · Speech model runs on $5 ESP32-S3
Written for: Investor or analyst
Next step
Thesis: embedded voice moves from cloud licences to on-chip models, which squeezes per-device voice royalties. Confirming signal: a microcontroller vendor ships open-vocabulary speech as a reference SDK, or an appliance OEM drops cloud voice. Already building: the Oído and Whistle projects in the open, with Espressif-class chip vendors best placed to bundle it.
Why now
Small speech models are shrinking fast: Whistle does speech-to-text in 16.9 MB, and a 0.8B vision model now reads receipts on a phone. Voice executives say voice AI has not had its ChatGPT moment because the context layer breaks. Money is going into ambient capture (Ambi's $26M) and Apple is licensing voice-adjacent tech from Huxe. If open-vocabulary recognition works on commodity chips, appliance makers no longer need cloud voice contracts.
What became possible
Oído runs open-vocabulary English speech recognition, a 13M-parameter int8 Conformer-CTC model, entirely on an ESP32-S3 microcontroller with no neural accelerator. Until now, chips at this price could only spot keywords or fixed commands.
Two ways in
- Offline voice SDK for appliance OEMs
Open-vocabulary commands and dictation on commodity microcontrollers, tuned for each product's vocabulary.
- Customer
- Mid-size appliance and industrial equipment makers
- Model
- Per-unit royalty
- Privacy-first voice for regulated sites
On-device transcription for clinics, factories and banks where audio cannot leave the room.
- Customer
- Healthcare and industrial device vendors
- Model
- Licence plus support contract
Competition
Fixed-command offline voice on microcontrollers is effectively a commodity. Espressif gives it away with its chips, NXP and Cyberon license it, and Unisound modules cost a few dollars.
Full competition notes (9 competitors)
Fixed-command offline voice on microcontrollers is effectively a commodity. Espressif gives it away with its chips, NXP and Cyberon license it, and Unisound modules cost a few dollars. The thing nobody clearly offers yet is real open-vocabulary dictation on a microcontroller that costs a few dollars. Picovoice's open-vocabulary engines need application-class processors and an online license check. Sensory TrulyNatural needs higher-end Cortex-M55 and NPU parts. Moonshine Micro fits on a chip under $1 but is still limited to about 50 commands. A new entrant could win by pairing an open model with a service that tunes it to each product's vocabulary, with accuracy guarantees, simple per-unit pricing and no online licence check, which matters for sealed industrial devices. The window is short, because open-source models like Moonshine will push the engine price toward zero, so the value has to come from tuning, integration help and support for appliance makers rather than from owning the recognizer. The regulated-sites idea is weaker on its own: clinic transcription already runs on tablets and PCs through Argmax, Speechmatics and Picovoice, so it fits better as a factory and industrial add-on to the appliance SDK. Public per-unit royalty prices could not be found, so how much room there is to undercut incumbents on price is unverified.
- Picovoice (Porcupine, Rhino, Cheetah, Leopard)
Offline voice stack. Rhino (speech-to-intent) runs on MCUs such as STM32. Cheetah and Leopard (open-vocabulary speech-to-text) target desktop, mobile and boards like the Raspberry Pi, not MCUs. Commercial and custom-vocabulary use needs a paid license, and an AccessKey is validated online. Also markets a HIPAA-oriented on-device medical voice agent.
- Sensory TrulyNatural
Embedded large-vocabulary speech recognition plus natural-language understanding, fully offline, licensed to OEMs. Runs on Alif Ensemble E3 (Cortex-M55 with Ethos-U55). Long-time incumbent in appliance voice.
- Moonshine Micro (Useful Sensors / Pete Warden)
MIT-licensed voice detection, speech-to-text and text-to-speech in about 470 KB on an RP2350 chip that costs under $1. Currently about 50 retrainable commands, with known accuracy limits. A free open-source option that is moving toward open vocabulary.
- Espressif ESP-SR MultiNet
Free offline command recognition on ESP32-S3: up to 200-300 English or Chinese commands, changeable without retraining. Makes basic offline appliance voice effectively free.
- NXP i.MX RT106S local voice control
Production-ready offline voice control SDK for appliance OEMs on an NXP MCU, with a run-time license model.
- Cyberon DSpotter
Offline keyword and command recognition SDK for microcontrollers in 40+ languages, licensed commercially to OEMs.
- Unisound US516P6
Low-cost offline voice chip used in modules priced around $2-4, widely used in Chinese appliances. Custom word sets go through the vendor.
- Argmax WhisperKit Pro
On-device transcription engine powering the ModMed medical scribe. Competes on the privacy-first clinical side, though on tablets and PCs rather than MCUs.
- Speechmatics
Speech-to-text vendor with medical transcription and EHR partnerships in 2025-26, and a newly announced on-device model.
Checked 2026-10-12
Risks
- Accuracy in noise and in languages other than English is unproven
- Speech recognition is one piece, and understanding still needs a larger model
- Chip vendors may bundle this for free, leaving no room for a startup
Best on open space and team fit; tech readiness and market pull and buildability are the weak point (5).
tech 5 · pull 5 · space 6 · fit 6 · build 5
Exposed
Companies that could benefit or be threatened. News and context, not investment advice.
Momentum of its main topic
Sources
- Oído: Open-Vocabulary Speech Recognition on a $5 Microcontroller without a Neural AcceleratorarXiv
- Whistle: speech to text in 16.9 MBr/LocalLLaMA
- These execs think voice AI hasn’t reached its ChatGPT moment yetTechCrunch AI
- Former Plaud exec raises $26M for AI app that listens to you in the backgroundTechCrunch AI
- Apple discloses deal to hire team and license tech from personalized podcast startup HuxeTechCrunch AI
- Receipt scanner that runs a fine-tuned 0.8B vision model on the phone (free) - detailed cost trackingr/LocalLLaMA
Status history
- 2026-10-12 Added to the watchlist