39 Mistral AI

1. Company and research division. Mistral AI (audio/speech team).

2. Date of publication / announcement. 20 October 2026 (launch; benchmark charts state 'generated 2026-10-20'). Earlier context: Timestral time-series foundation models, 15 October 2026.

3. Research title and field. Voxtral 3: speech-to-text and text-to-speech model family plus a voice-agent SDK. Field: speech recognition, speech synthesis, real-time agents.

4. Research background. Voice agents must listen, reason, speak and act simultaneously with low latency. Cascaded pipelines typically add delay at each stage.

5. Scientific innovation. A streaming pipeline (on LiveKit) in which transcription with end-of-turn detection, LLM reasoning with tool calling, and expressive TTS overlap, so no stage waits for the previous one. Contextual TTS infers emotion from the text, and 'Pro Voice' adaptation works from about 30 minutes of audio.

6. Methodology. Benchmarks used:

• Transcription: FLEURS (45 and 35 languages), diarisation cpWER (AMI-IHM/SDM, Switchboard, CallHome, AISHELL-4) and Earnings-22 keyphrase recall
• Artificial Analysis WER index
• TTS: Voice Code Bench (BeSimple AI) plus internal pronunciation, multilingual and expressive evaluations, judged by gemini-3.8-flash

7. Results. Voxtral Small Transcribe 3 is claimed state-of-the-art versus Whisper, Scribe v2 and Gemini 3.5 Transcribe (the exact WER values are in charts not captured in text). The Mini transcriber has 4B parameters and costs $0.0035/min; Realtime runs at under 500 ms at $0.008/min; Small costs $0.0040/min. TTS covers 35+ languages and 50+ dialects at $13 per 1M characters. Agent turns complete in under 1 s. The voice-agent API costs $0.04/min with Mistral Small 4.

8. Scientific significance. An integrated, sovereign-deployable voice-agent stack with broad Indic language coverage is relevant for multilingual public services.

9. Technical limitations. Most comparisons are internal evaluations, and several are judged by an LLM. Exact numbers were provided only in charts. Voice adaptation raises consent and impersonation risks, and the safeguards were not detailed in the sources reviewed.

10. Technology readiness and evidence type. Commercial (API) with a self-deployment option. Evidence type: company announcement (marketing claims with partly public benchmarks).

11. Competitive comparison. Comparators named by Mistral are Whisper, ElevenLabs Scribe v2 and Flash, Deepgram, OpenAI TTS-1 and Gemini. No independent leaderboard confirmation was seen at the time of writing.

12. Future research (1–5 years) — FORECAST. FORECAST (1–5 years): sub-second multilingual voice agents in contact centres; regulatory requirements for voice-clone consent and watermarking; growth of Indic-language voice services.

13. Original references.

• https://mistral.ai/news/voxtral-3/
• https://mistral.ai/news/timestral/