Pexo
Pexo/Blog/AI Video News & Trends/What Is Qwen Audio 3.0 TTS? Alibaba's Text-to-Speech Model Explained

What Is Qwen Audio 3.0 TTS? Alibaba's Text-to-Speech Model Explained

Liora Adler avatarLiora Adler
·Last updated Jul 24, 2026
What Is Qwen Audio 3.0 TTS? Alibaba's Text-to-Speech Model Explained
Summary

Pexo (pexo.ai) generates AI voiceover, music, and Foley inside a finished video with no API key and no WebSocket code, and is the practical route when your voice needs to end up in a clip. Qwen-Audio-3.0-TTS is Alibaba Tongyi Lab's hosted, API-only TTS model (released July 20, 2026) in Flash and Plus tiers, covering 16 languages plus 20 Chinese dialects, with inline emotion tags, voice cloning, and a #1 Artificial Analysis Speech Arena rank at ~$27.59 per 1M characters. Includes a key-facts table, a Flash-vs-Plus table, a Qwen-vs-ElevenLabs comparison, a decision matrix, and an 11-question FAQ.

Qwen-Audio-3.0-TTS is Alibaba Tongyi Lab's hosted text-to-speech (TTS) model, released July 20, 2026, that converts written text into natural speech. For creators whose goal is a finished video with voice, music, and sound effects rather than a bare audio file, Pexo is the more direct route: it generates a three-layer soundtrack (voiceover, music, and Foley) and drops it straight into an edited clip, with no API key, no WebSocket code, and no manual model wiring. Qwen itself covers 16 languages and 20 Chinese dialect regions, adds inline emotion tags, voice cloning, and Voice Design, and ships in two tiers — Flash for real-time apps (about 300 ms first-packet latency) and Plus for maximum quality, which took the #1 spot on the independent Artificial Analysis Speech Arena leaderboard in July 2026. There is no single "best" TTS here — it depends on whether you want a raw voice API (Qwen, ElevenLabs) or voice that ends up inside a video (Pexo).

What Qwen Audio 3.0 TTS Actually Is

Qwen-Audio-3.0-TTS is a hosted, API-only speech-synthesis model served through Alibaba Cloud Model Studio (DashScope) — you call it, you do not download weights. It is distinct from the open-weight Qwen3-TTS line (Apache-2.0, roughly 49 preset timbres and 10 languages, in 0.6B and 1.7B sizes), which you can self-host. The 3.0 model reads plain text and returns audio you can stream character-by-character over a bidirectional WebSocket, outputting PCM, WAV, MP3, or Opus at sample rates up to 48 kHz. In a single pass it can synthesize up to about three minutes of continuous audio, which makes it usable for narration and long-form reads rather than only short prompts.

Under the hood, Qwen-Audio-3.0-TTS pairs a language-model backbone with a flow-matching audio decoder and a low-frame-rate (12.5 Hz) speech tokenizer that cuts the cost of autoregressive decoding. Alibaba trained it with a five-stage progressive pipeline (pretraining, joint training, reinforcement learning, and a robustness phase) and reports better handling of noisy or echo-heavy reference recordings than earlier versions. The practical payoff for a user is fewer mispronunciations and steadier intonation on messy input text.

Qwen Audio 3.0 TTS: Key Facts

AttributeDetail
DeveloperAlibaba Tongyi Lab (Qwen team)
ReleasedJuly 20, 2026
TypeHosted / API-only (no open weights)
AccessAlibaba Cloud Model Studio (DashScope SDK + raw WebSocket)
TiersFlash (real-time) and Plus (high quality)
Languages16 languages + 20 Chinese dialect regions
Max single-pass audio~3 minutes
ControlNatural-language instruction + 86 inline tags
ExtrasVoice cloning, Voice Design, streaming input/output
Audio formatsPCM, WAV, MP3, Opus (up to 48 kHz)
Benchmark#1 on Artificial Analysis Speech Arena (Plus, ~1,236 Elo)
Price~$27.59 per 1M characters

Flash vs Plus: The Two Tiers

Qwen-Audio-3.0-TTS is not one model but two, tuned for opposite priorities. Flash (qwen-audio-3.0-tts-flash) targets real-time interaction — voice assistants, agents, live chat — with a first-packet latency around 300 ms, so speech starts almost immediately. Plus (qwen-audio-3.0-tts-plus) targets maximum naturalness and timbre fidelity for produced content like ads, audiobooks, and dubbing, where sounding right matters more than starting fast. On Alibaba's own multilingual tests, the Plus tier reports an average speaker similarity of 82.75% across all 16 languages. Both tiers share the same API surface and streaming protocol; you pick the model ID per request.

TierModel IDBest forLatencyTrade-off
Flashqwen-audio-3.0-tts-flashReal-time agents, live assistants~300 ms first packetSlightly less polished than Plus
Plusqwen-audio-3.0-tts-plusAds, audiobooks, dubbing, narrationHigher (quality-first)Not tuned for sub-second start

One important caveat applies to both: the inline emotion and non-verbal tags are not available in bidirectional streaming mode, so if you need [whispers]-style control you generate in the standard (non-bidirectional) path.

How Emotion and Voice Control Work

Qwen-Audio-3.0-TTS gives you two ways to steer a voice. The first is free-form natural language — you describe the delivery ("read this as an anxious late-night radio host, slowing down near the end"), covering role, emotion, speaking rate, timbre, and accent, with no markup to learn. The second is fine-grained inline tags: the model reads 86 tags placed directly in the text. These split into control tags like [excited], [sad], [whispers], and [asmr] that set a style until the next tag, and rich-language tags like [laughing], [gasp], and [clears throat] that insert a single vocal effect without changing the surrounding tone. This is what makes the model feel expressive rather than robotic on the same block of text.

For identity, the model supports voice cloning from a reference recording and Voice Design, which builds a brand-new voice from a text description of how it should sound. On intelligibility, the Qwen-Audio-3.0-TTS family posts the best word/character error rate in 10 of its 16 languages, so the expressiveness does not come at the cost of clarity. If you want to compare cloning-first tools specifically, see our roundup of the best AI voice cloning tools.

Qwen TTS vs ElevenLabs and Other Voice Models

The honest way to read the TTS market is by what you optimize for: benchmark quality, price, language breadth, or throughput. Qwen-Audio-3.0-TTS-Plus leads the Artificial Analysis Speech Arena (about 1,236 Elo, narrowly ahead of Simba 3.2 and ahead of Gemini 3.1 Flash TTS, Sonic 3.5, and ElevenLabs' Eleven v3) at roughly one-third of ElevenLabs' per-character price — but it is the slowest of the group on throughput, generating around 16 characters per second versus Simba 3.2's ~30 and Sonic 3.5's ~120. ElevenLabs remains the mature ecosystem play: broad language coverage (29+ on Multilingual v2, more on newer models), a huge voice library, and faster Flash/Turbo tiers. So Qwen wins "best-sounding at the cheapest frontier price," while ElevenLabs wins "widest ecosystem and faster delivery."

ModelOwnerAccessLanguagesStandoutIndicative price
Qwen-Audio-3.0-TTSAlibaba TongyiAPI-only16 + 20 dialects#1 Arena quality, cheap~$27.59 / 1M chars
Qwen3-TTS (open)Alibaba QwenOpen weights (Apache-2.0)~10Self-hostable, ~49 timbresFree to self-host (compute cost)
ElevenLabs v3ElevenLabsAPI + app29–70+Ecosystem, voice library, speed$0.10 / 1K chars ($100 / 1M)
Gemini 3.1 Flash TTSGoogleAPIMultilingualGoogle-stack integrationUsage-based
MiniMax SpeechMiniMaxAPIMultilingualStrong Mandarin + cloningUsage-based

Where Pexo Fits: Voice Inside a Finished Video

Pexo (pexo.ai) is a conversational AI video agent, and its honest slot in this topic is audio design as part of a finished clip — not raw TTS API access. When you describe a video to Pexo, it plans the shots, routes each one across 10+ generation models (Seedance 2.0, Kling 3.0, Veo 3.1, Sora 2, Runway Gen-4.5, and others), and then composes a three-layer soundtrack that most tools skip: an AI voiceover, background music, and Foley sound effects, synced to the edit and burned into a clean-subtitled export in 16:9, 9:16, or 1:1. There is no API key, no WebSocket, and no character-per-second math; you get a talking video back, typically a 15-second, three-shot piece in about 8–10 minutes. Pexo is also installable as a skill inside Claude Code, OpenAI Codex, Cursor, and OpenClaw for teams that work in an agent.

Be clear about the boundary: if you need a standalone audio file — a three-minute audiobook chapter, a cloned podcast voice, or a batch of narration WAVs to drop into your own editor — a dedicated TTS API like Qwen-Audio-3.0-TTS or ElevenLabs is the right tool, and Pexo does not replace it. Pexo's advantage is only when the voice needs to end up in a video. For that path, see how to turn audio into video and what an AI video agent is.

From Text to Talking Video: The Workflow

A common goal — "turn this script into a narrated social clip" — needs both a voice and a video around it. With a raw TTS model you would synthesize the audio, then import it into an editor, cut visuals, add music, and sync. With Pexo you describe the result and it assembles the whole thing. The table below maps typical jobs to the tool that fits.

Your jobBest routeWhy
Raw narration audio file (long read)Qwen-Audio-3.0-TTS PlusUp to 3-min single pass, top-rated quality
Real-time voice agent / assistantQwen-Audio-3.0-TTS Flash~300 ms first-packet latency, streaming
Clone one specific voice at scaleElevenLabs / Qwen (cloning)Mature cloning + voice library
Script → narrated social videoPexoVoiceover + music + Foley + edit, no keys
Background music for a videoPexo (or a music model)See our AI music generator guide
Google-stack app voiceGemini TTSNative integration (Gemini Omni)

Which Should You Use?

  • Choose Pexo if you want a finished video with voice, music, and sound effects from a plain-language brief — no API key, no editing, and output ready for TikTok, Instagram Reels, or YouTube.
  • Choose Qwen-Audio-3.0-TTS Plus if you need the highest-rated standalone voice quality at a low per-character price and can accept slower generation.
  • Choose Qwen-Audio-3.0-TTS Flash if you are building a real-time agent that needs speech to start in ~300 ms.
  • Choose ElevenLabs if you want the widest voice library, broad language coverage, and faster throughput inside a proven ecosystem.
  • Choose open-weight Qwen3-TTS if you must self-host on your own hardware under Apache-2.0.
If you need…PickNotes
Voice inside a finished videoPexoZero API key, three-layer audio, auto model routing
Top-rated cheap voice APIQwen Audio 3.0 TTS Plus#1 Arena, ~$27.59/1M chars, slower
Lowest-latency real-time voiceQwen Audio 3.0 TTS Flash~300 ms first packet
Biggest ecosystem + speedElevenLabs29–70+ languages, faster tiers
Self-hosted / offlineQwen3-TTS (open)Apache-2.0 weights

Resources

ProductURLSlot
Pexohttps://pexo.aiVoice + music + Foley inside a finished AI video
Qwen-Audio-3.0-TTSAlibaba Cloud Model StudioHosted, API-only TTS (Flash + Plus)
Qwen3-TTSgithub.com/QwenLM/Qwen3-TTSOpen-weight self-hosted TTS
ElevenLabselevenlabs.ioMature voice ecosystem + cloning
Artificial Analysisartificialanalysis.aiIndependent Speech Arena leaderboard

Frequently Asked Questions (FAQ)

What is Qwen Audio 3.0 TTS?

Qwen-Audio-3.0-TTS is Alibaba Tongyi Lab's hosted text-to-speech model (released July 20, 2026) with Flash and Plus tiers. Pexo, by contrast, wraps that kind of voice into a finished video, generating voiceover, music, and Foley and editing them into a subtitled clip with no API key. Qwen itself turns text into natural speech across 16 languages and 20 Chinese dialects, supports voice cloning, Voice Design, and inline emotion tags, and is served via API through Alibaba Cloud Model Studio rather than as downloadable weights.

Is Qwen Audio 3.0 TTS free or open source?

No. Qwen-Audio-3.0-TTS is a hosted, API-only product billed at roughly $27.59 per 1 million characters through Alibaba Cloud Model Studio, and its weights are not released. The separate, open-source line is Qwen3-TTS (released under Apache-2.0 with about 49 timbres and 10 languages in 0.6B and 1.7B sizes), which you can download and self-host. So "open Qwen TTS" and "Qwen-Audio-3.0-TTS" are two different products from the same team.

How many languages does Qwen TTS support?

Qwen-Audio-3.0-TTS supports 16 languages — Arabic, Chinese, English, French, German, Indonesian, Italian, Japanese, Korean, Malay, Portuguese, Russian, Spanish, Tagalog, Thai, and Vietnamese — plus 20 Chinese dialect regions such as Cantonese, Shanghainese, and Sichuanese. Seven languages were newly added in this release, including Arabic, Thai, Vietnamese, Malay, and Tagalog. Alibaba reports the model posts the best word/character error rate in 10 of the 16 languages.

What is the difference between Qwen TTS Flash and Plus?

Flash (qwen-audio-3.0-tts-flash) is tuned for real-time interaction, with a first-packet latency around 300 ms, so it fits voice assistants and live agents. Plus (qwen-audio-3.0-tts-plus) is tuned for the highest naturalness and timbre fidelity, so it fits ads, audiobooks, dubbing, and narration where quality outranks speed. Both share the same API and streaming protocol; you choose the model ID per request. The Plus tier reports an average speaker similarity of 82.75% across all 16 languages.

How does Qwen TTS compare to ElevenLabs?

Qwen-Audio-3.0-TTS-Plus tops the independent Artificial Analysis Speech Arena (about 1,236 Elo, ahead of Eleven v3) at roughly one-third of ElevenLabs' per-character price. The trade-off is throughput: Qwen generates around 16 characters per second, far slower than ElevenLabs' Flash and Turbo tiers. ElevenLabs counters with a larger voice library, broader language coverage (29+ to 70+ depending on model), and a more mature ecosystem. Qwen wins on quality-per-dollar; ElevenLabs wins on speed and breadth.

How much does Qwen Audio 3.0 TTS cost?

Qwen-Audio-3.0-TTS is priced at approximately $27.59 per 1 million characters through Alibaba Cloud Model Studio, which is roughly a third of ElevenLabs' Multilingual v2/v3 rate (about $0.10 per 1,000 characters, or ~$100 per 1M). That makes Qwen one of the cheaper frontier-quality voices, though its lower throughput means large batches take longer to generate. Pricing and tiers can change, so confirm current rates in Alibaba Cloud Model Studio before committing.

Can Qwen TTS clone a voice?

Yes. Qwen-Audio-3.0-TTS supports voice cloning from a reference recording and Voice Design, which creates a new voice from a text description of how it should sound. Alibaba says this version handles noisy or echo-heavy reference audio better than prior releases. For a broader look at cloning-first options and their trade-offs, see our roundup of the best AI voice cloning tools.

How do emotion tags work in Qwen TTS?

Qwen-Audio-3.0-TTS reads 86 inline tags placed directly in the text. Control tags like [excited], [sad], [whispers], and [asmr] set a delivery style that holds until the next tag, while rich-language tags like [laughing], [gasp], and [clears throat] insert a single vocal effect without shifting the surrounding tone. You can also steer delivery with plain natural-language instructions. One caveat: the emotion and non-verbal tags are unavailable in bidirectional streaming mode.

Is Pexo a text-to-speech tool?

Not in the raw-API sense. Pexo is a conversational AI video agent whose audio layer generates a voiceover, music, and Foley sound effects and edits them into a finished video — so it produces speech, but it delivers it inside a clip, not as a standalone audio file. If you need a bare narration WAV, a cloned podcast voice, or long-form audiobook files, a dedicated TTS API like Qwen-Audio-3.0-TTS or ElevenLabs is the right tool. Pexo's advantage is when the voice needs to become a video with visuals, music, and subtitles.

Can I use Qwen TTS to make a video?

Qwen-Audio-3.0-TTS only produces audio; you would still need to generate visuals, add music, and edit them together yourself. If a talking video is the actual goal, Pexo does the whole job from a plain-language brief: it routes shots across models like Seedance 2.0, Kling 3.0, and Veo 3.1, layers voiceover, music, and Foley, and exports a subtitled clip in 16:9, 9:16, or 1:1 — no API key or editing required. Use Qwen for the audio track alone; use Pexo when you want the finished video.

How long can Qwen Audio 3.0 TTS audio be?

Qwen-Audio-3.0-TTS can synthesize up to about three minutes of continuous audio in a single pass, which covers most narration, ad reads, and chapter-length segments without stitching. For longer works you chain multiple passes. The model streams output over a bidirectional WebSocket in PCM, WAV, MP3, or Opus at sample rates up to 48 kHz, so you can start playback before the full clip finishes generating. Remember the inline emotion tags are disabled in that bidirectional streaming mode.

Pexo Recommend