Qwen3-TTS 升级：发布音色设计模型 VD-Flash 与 3 秒音色克隆模型 VC-Flash

Qwen3-TTS 升级：声音克隆与声音设计！

Qwen3-TTS 系列推出两款新模型：声音设计模型 Qwen3-TTS-VD-Flash（可通过 Qwen API 访问）和声音克隆模型 Qwen3-TTS-VC-Flash（可通过 Qwen API 访问）。

关键特性：

• 声音设计：Qwen3-TTS-VD-Flash 支持复杂的自然语言指令，可对音色、韵律、情感、人设等进行细粒度控制，实现从“说什么”到“怎么说”的全面掌控。它允许用户自由定义想要的声音，彻底摆脱只能克隆已有声音或从有限预设声音中选择的限制。在 InstructTTS-Eval 上，其整体表现显著优于 GPT-4o-mini-tts 和 Mimo-audio-7b-instruct，并在角色扮演测试中超越 Gemini-2.5-pro-preview-tts。
• 声音克隆：Qwen3-TTS-VC-Flash 支持 3 秒声音克隆，并可基于克隆声音生成中文、英文、德文、意大利文、葡萄牙文、西班牙文、日文、韩文、法文和俄文 10 种主要语言的语音。在 MiniMax TTS 多语言测试集上，其平均词错误率（WER）始终优于 MiniMax、ElevenLabs 和 GPT-4o-Audio-Preview。
• 高表现力：Qwen3-TTS-VD-Flash 和 Qwen3-TTS-VC-Flash 提供极具表现力、类人的声音，能够稳定可靠地生成与输入文本高度一致的语音，并根据语义内容自动调整语调和节奏，实现自然生动的表达。
• 稳健的文本处理：Qwen3-TTS-VD-Flash 和 Qwen3-TTS-VC-Flash 具备强大的文本解析能力，可自动处理复杂的文本结构并准确提取关键信息，在处理多样化和非标准文本格式时展现出很强的稳健性。

Qwen3-TTS-VD-Flash

Qwen3-TTS 支持直接根据自然语言描述创建定制声音档案。用户可以自由描述声学属性、人设设定、背景信息等，轻松创建自己想要的那种声音。

指标

可控生成：在 InstructTTS-Eval 基准上，Qwen3-TTS 整体显著优于 GPT-4o-mini-tts 和 Mimo-audio-7b-instruct，并在角色扮演测试中超越 Gemini-2.5-pro-preview-tts。

示例

用户还可以持久存储并反复调用由Qwen3-TTS创建的声音，从而生成生动自然的多轮、多角色长篇对话。

如何使用

通过 Qwen API 使用 Qwen3-TTS-VD-Flash 非常简单。下面是一段简短的代码片段，供你试用：

python

import requestsimport base64import os
def create_voice_and_play():    # API keys differ between Singapore and Beijing regions. Get your API key: https://www.alibabacloud.com/help/zh/model-studio/get-api-key    # If you haven't set an environment variable, replace the line below with: api_key = "sk-xxx"    api_key = os.getenv("DASHSCOPE_API_KEY")    if not api_key:        print("Error: DASHSCOPE_API_KEY environment variable not found. Please set your API key.")        return None, None, None    # Prepare request data    headers = {        "Authorization": f"Bearer {api_key}",        "Content-Type": "application/json"    }    data = {        "model": "qwen-voice-design",        "input": {            "action": "create",            "target_model": "qwen3-tts-vd-realtime-2025-12-16",            "voice_prompt": "A composed middle-aged male announcer with a deep, rich and magnetic voice, a steady speaking speed and clear articulation, is suitable for news broadcasting or documentary commentary.",            "preview_text": "Dear listeners, hello everyone. Welcome to the evening news.",            "preferred_name": "announcer",            "language": "en"        },        "parameters": {            "sample_rate": 24000,            "response_format": "wav"        }    }    # URL for Singapore region. For Beijing region, use: https://dashscope.aliyuncs.com/api/v1/services/audio/tts/customization    url = "https://dashscope-intl.aliyuncs.com/api/v1/services/audio/tts/customization"    try:        # Send request        response = requests.post(            url,            headers=headers,            json=data,            timeout=60  # Add timeout setting        )        if response.status_code == 200:            result = response.json()            # Get voice name            voice_name = result["output"]["voice"]            print(f"Voice name: {voice_name}")            # Get preview audio data            base64_audio = result["output"]["preview_audio"]["data"]            # Decode Base64 audio data            audio_bytes = base64.b64decode(base64_audio)            # Save audio file locally            filename = f"{voice_name}_preview.wav"            # Write audio data to local file            with open(filename, 'wb') as f:                f.write(audio_bytes)            print(f"Audio saved to local file: {filename}")            print(f"File path: {os.path.abspath(filename)}")            return voice_name, audio_bytes, filename        else:            print(f"Request failed. Status code: {response.status_code}")            print(f"Response: {response.text}")            return None, None, None    except requests.exceptions.RequestException as e:        print(f"Network request error: {e}")        return None, None, None    except KeyError as e:        print(f"Response format error: missing required field: {e}")        print(f"Response: {response.text if 'response' in locals() else 'No response'}")        return None, None, None    except Exception as e:        print(f"Unexpected error: {e}")        return None, None, None
if __name__ == "__main__":    print("Creating voice...")    voice_name, audio_data, saved_filename = create_voice_and_play()    if voice_name:        print(f"\nSuccessfully created voice '{voice_name}'")        print(f"Audio file saved: '{saved_filename}'")        print(f"File size: {os.path.getsize(saved_filename)} bytes")    else:        print("\nVoice creation failed")

Qwen3-TTS-VC-Flash

Qwen3-TTS 支持自然、3 秒级别的音色克隆，并能基于克隆音色生成多语言音频。它在处理复杂文本和真实场景音频时也具有很高的鲁棒性。

指标

多语言音色克隆：在 MiniMax TTS 多语言测试集上，Qwen3‑TTS 在中文、英文、法文、意大利文等语言上相比 MiniMax、ElevenLabs 和 GPT‑4o‑Audio‑Preview 展现出更稳定的内容，取得了最佳的平均词错误率（WER）。

样例

想听听动物如果会说话会是什么声音吗？Qwen3-TTS 可以向你展示跨物种克隆：

如何使用

通过 Qwen API 使用 Qwen3-TTS-VC-Flash 非常简单。下面是一段简短的代码片段，供你试用：

python

# The DashScope SDK version must be 1.23.9 or later, and the Python version must be 3.10 or later.# coding=utf-8# Installation instructions for pyaudio:# APPLE Mac OS X#   brew install portaudio#   pip install pyaudio# Debian/Ubuntu#   sudo apt-get install python-pyaudio python3-pyaudio#   or#   pip install pyaudio# CentOS#   sudo yum install -y portaudio portaudio-devel && pip install pyaudio# Microsoft Windows#   python -m pip install pyaudio
import pyaudioimport osimport requestsimport base64import pathlibimport threadingimport timeimport dashscope  # The DashScope Python SDK version must be 1.23.9 or later.from dashscope.audio.qwen_tts_realtime import QwenTtsRealtime, QwenTtsRealtimeCallback, AudioFormat
# ======= Constant configuration =======DEFAULT_TARGET_MODEL = "qwen3-tts-vc-realtime-2025-11-27"  # The same model must be used for voice cloning and speech synthesis.DEFAULT_PREFERRED_NAME = "guanyu"DEFAULT_AUDIO_MIME_TYPE = "audio/mpeg"VOICE_FILE_PATH = "voice.mp3"  # The relative path of the local audio file for voice cloning.
TEXT_TO_SYNTHESIZE = [    'Right? I really like this kind of supermarket,',    'especially during the New Year.',    'Going to the supermarket',    'just makes me feel',    'super, super happy!',    'I want to buy so many things!']
def create_voice(file_path: str,                 target_model: str = DEFAULT_TARGET_MODEL,                 preferred_name: str = DEFAULT_PREFERRED_NAME,                 audio_mime_type: str = DEFAULT_AUDIO_MIME_TYPE) -> str:    """
    Create a voice and return the voice parameter.
    """    # The API keys for the Singapore and Beijing regions are different. To get an API key, see https://www.alibabacloud.com/help/en/model-studio/get-api-key.    # If you have not configured the environment variable, replace the following line with your Model Studio API key: api_key = "sk-xxx"    api_key = os.getenv("DASHSCOPE_API_KEY")
    file_path_obj = pathlib.Path(file_path)    if not file_path_obj.exists():        raise FileNotFoundError(f"The audio file does not exist: {file_path}")
    base64_str = base64.b64encode(file_path_obj.read_bytes()).decode()    data_uri = f"data:{audio_mime_type};base64,{base64_str}"
    # The following is the URL for the Singapore region. If you use a model in the Beijing region, replace the URL with: https://dashscope.aliyuncs.com/api/v1/services/audio/tts/customization    url = "https://dashscope-intl.aliyuncs.com/api/v1/services/audio/tts/customization"    payload = {        "model": "qwen-voice-enrollment", # Do not modify this value.        "input": {            "action": "create",            "target_model": target_model,            "preferred_name": preferred_name,            "audio": {"data": data_uri}        }    }    headers = {        "Authorization": f"Bearer {api_key}",        "Content-Type": "application/json"    }
    resp = requests.post(url, json=payload, headers=headers)    if resp.status_code != 200:        raise RuntimeError(f"Failed to create the voice: {resp.status_code}, {resp.text}")
    try:        return resp.json()["output"]["voice"]    except (KeyError, ValueError) as e:        raise RuntimeError(f"Failed to parse the voice response: {e}")
def init_dashscope_api_key():    """
    Initialize the API key for the DashScope SDK.
    """    # The API keys for the Singapore and Beijing regions are different. To get an API key, see https://www.alibabacloud.com/help/en/model-studio/get-api-key.    # If you have not configured the environment variable, replace the following line with your Model Studio API key: dashscope.api_key = "sk-xxx"    dashscope.api_key = os.getenv("DASHSCOPE_API_KEY")
# ======= Callback class =======class MyCallback(QwenTtsRealtimeCallback):    """
    Custom TTS streaming callback.
    """    def __init__(self):        self.complete_event = threading.Event()        self._player = pyaudio.PyAudio()        self._stream = self._player.open(            format=pyaudio.paInt16, channels=1, rate=24000, output=True        )
    def on_open(self) -> None:        print('[TTS] Connection established')
    def on_close(self, close_status_code, close_msg) -> None:        self._stream.stop_stream()        self._stream.close()        self._player.terminate()        print(f'[TTS] Connection closed code={close_status_code}, msg={close_msg}')
    def on_event(self, response: dict) -> None:        try:            event_type = response.get('type', '')            if event_type == 'session.created':                print(f'[TTS] Session started: {response["session"]["id"]}')            elif event_type == 'response.audio.delta':                audio_data = base64.b64decode(response['delta'])                self._stream.write(audio_data)            elif event_type == 'response.done':                print(f'[TTS] Response complete, Response ID: {qwen_tts_realtime.get_last_response_id()}')            elif event_type == 'session.finished':                print('[TTS] Session finished')                self.complete_event.set()        except Exception as e:            print(f'[Error] Exception occurred while processing callback event: {e}')
    def wait_for_finished(self):        self.complete_event.wait()
# ======= Main execution logic =======if __name__ == '__main__':    init_dashscope_api_key()    print('[System] Initializing Qwen TTS Realtime ...')
    callback = MyCallback()    qwen_tts_realtime = QwenTtsRealtime(        model=DEFAULT_TARGET_MODEL,        callback=callback,        # The following is the URL for the Singapore region. If you use a model in the Beijing region, replace the URL with: wss://dashscope.aliyuncs.com/api-ws/v1/realtime        url='wss://dashscope-intl.aliyuncs.com/api-ws/v1/realtime'    )    qwen_tts_realtime.connect()    qwen_tts_realtime.update_session(        voice=create_voice(VOICE_FILE_PATH), # Replace the voice parameter with the custom voice generated by cloning.        response_format=AudioFormat.PCM_24000HZ_MONO_16BIT,        mode='server_commit'    )
    for text_chunk in TEXT_TO_SYNTHESIZE:        print(f'[Send text]: {text_chunk}')        qwen_tts_realtime.append_text(text_chunk)        time.sleep(0.1)
    qwen_tts_realtime.finish()    callback.wait_for_finished()
    print(f'[Metric] session_id={qwen_tts_realtime.get_session_id()}, '          f'first_audio_delay={qwen_tts_realtime.get_first_audio_delay()}s')

引用

如果你觉得我们的模型对你的研究有帮助，请考虑引用我们 📝 :)

BibTeX

@misc{qwen3_tts_202512,  author       = {Qwen Team, Alibaba},  title        = {Qwen3-TTS Steps Up: Voice Cloning and Voice Design!},  year         = {2025},  url          = {https://qwen.ai/blog?id=qwen3-tts-vc-voicedesign},  urldate      = {2025-12-23}}