Guide 25 · Tutorial
Muse Voice Mode: Talking to Your Agent
Muse listens, talks back, and is gaining a face. How voice mode works today and what's coming next.
By Abhit T. · Updated October 6, 2026 · 10 min read
Short answer
Muse supports voice conversations with real-time speech, plus newly added live video chat with customizable voices. Voice is becoming the primary way to direct your agent.
What voice mode does today
The simplest way to use Muse may be to stop typing. Voice support, dictation, and voice notes are built into the app: hold to talk, and Muse transcribes, understands, and replies out loud while it keeps working on your task in the background. It's the difference between operating software and briefing a colleague.
Voice shines for the fuzzy stuff — brainstorming, thinking through a decision, describing a complicated errand while your hands are busy. Save the keyboard for precision work like reviewing a contract or editing a draft line by line.
Live video chat and custom voices
Voice just leveled up. Around September 23, Meta added live video chat and real-time voice conversations with customizable voice options to Muse, demonstrated publicly by Alexandr Wang on September 24. Instead of a voice in a chat window, you talk to an animated presence — the Realtime Avatar system.
The technical trick is that speech and video generate from a shared stream, so the avatar's voice, lip movement, and expressions stay synchronized. Strikingly, the system can animate a reference image during a live conversation — a photographic portrait, an illustration, an animal, or even an everyday object. Pair that with Jolly, and your agent is well on its way to having a face you chose.
The tech underneath: Muse Voice Transcribe
Meta's voice push rests on Muse Voice Transcribe, a real-time audio perception model its Superintelligence Labs launched on September 1, 2026. It evaluates streaming audio every 80 milliseconds and handles speech-to-text, speaker identification, and endpoint detection in a single model — following conversations across more than 20 speakers and 25 validated languages, including mid-sentence language switching.
This is what powers dictation in the Muse apps today. The model was built for exactly the messy reality of talking to an agent: interruptions, accents, overlapping speech, hour-long sessions. When Muse seems to “just get” what you said, this is usually why.
Custom voices: coming, not here yet
The most requested voice feature — generating your own custom voice for Muse, saved to a personal library — is reportedly in internal testing only, according to TestingCatalog's September 2026 reporting. It is disabled for public users and Meta has announced no release date.
Treat this as a roadmap item, not a feature. The early access program is the official channel for raising your hand for upcoming capabilities like this one.
Getting the most out of voice
- Speak in outcomes, not menus: “book me a table for two Friday at 7 near downtown” beats “open OpenTable.”
- Think out loud. Voice is ideal for rambling first drafts of a task — Muse is good at extracting the actual request.
- Confirm before consequences. If a voice request could spend money or send messages, ask Muse to read back the plan first.
- Use it hands-free moments: cooking, driving (parked or via car audio), walking — anywhere typing is awkward.
- Switch to text for anything you need quoted precisely: addresses, numbers, names with unusual spellings.
Voice questions, answered
Does Muse have voice chat? Yes. Voice mode is built into the Muse app: hold to talk, and Muse transcribes your speech and replies out loud while it keeps working on your task in the background. Live video chat with real-time voice was added around September 23, 2026 — see ‘Live video chat and custom voices’ above.
Does voice chat work on WhatsApp? No — voice mode is an app and web feature. On WhatsApp, Muse is text-only; see our WhatsApp guide.