DEV Community

AI-KSK
AI-KSK

Posted on Edited on Originally published at huggingface.co

Qwen3-TTS in ComfyUI: Multi-Speaker Dialogue, 3-Second Voice Cloning, and One Sampler You Have Not Seen

Voice generation finishing inside ComfyUI changes the shape of a video pipeline: audio and picture become one graph instead of two tools and an export. This release puts Qwen3-TTS in the graph, with cloning, multi-speaker dialogue, and a lip-sync stage downstream.

The four graphs

Workflow Nodes
Qwen3 TTS preset voices + custom voice design 11
Qwen3 TTS voice cloning 40
Qwen3 TTS multi-speaker dialogue 21
LTX-2 lip-sync 83

Voice cloning from three seconds

Three seconds is short. What it can capture:

  • Timbre — the fundamental quality of the voice
  • Rough pitch range — whether it sits high or low
  • Speaking rate tendency

What three seconds cannot capture:

  • Prosody across a long read — how the speaker handles paragraph-level emphasis
  • Emotional range — three seconds is one mood
  • Pronunciation of unusual words

So a cloned voice at three seconds is recognisably the same person on a similar sentence, and drifts on a different kind of sentence. That is the honest boundary.

The 11-node voice design graph

The smallest graph and arguably the most useful: preset voices plus custom voice design in eleven nodes.

Voice design means specifying a voice by description rather than cloning from a sample. For content where you need a voice that does not exist in your recordings, that is the path.

The 21-node multi-speaker graph

Multi-speaker dialogue is the interesting capability: two or more voices in one audio track, in a single generation.

That solves a real problem. Generating each speaker separately and concatenating produces clean audio with no conversational rhythm — each line starts and ends in isolation. A single generation with speaker assignment can produce overlap, backchannel, and natural timing.

The gradient_estimation sampler

The LTX-2 lip-sync graph uses KSamplerSelect → gradient_estimation.

That is not a sampler that appears in any other workflow covered in this series. It is a different solver family — gradient estimation rather than an Euler or ancestral variant.

Why it might be here: lip-sync is a constrained problem. The audio specifies the mouth timing exactly, so the sampler is solving for a video that matches a fixed temporal constraint. A gradient-estimation approach handles constrained optimisation differently from a stochastic sampler.

If you port settings from other LTX workflows into this one, the sampler will not behave the same way. Treat it as its own configuration.

The LTX-2 stack

Node Value
CheckpointLoaderSimple ltx-2-19b-dev-fp8.safetensors
LTXVAudioVAELoader ltx-2-19b-dev-fp8.safetensors
LoraLoaderModelOnly ltx-2-19b-distilled-lora-384 at 1.0
EmptyLTXVLatentVideo 768×512, 97 frames
EmptyImage 1280×720, colour 0

Note the checkpoint and audio VAE match — both ltx-2-19b-dev-fp8. That is the correct configuration, and it is worth noting given how often the mismatch appears elsewhere in this family.

EmptyImage at colour 0 is black — a placeholder, meaning the first frame is not being supplied from an image.

Where this breaks

  1. Three seconds is a narrow clone. Long reads will drift.
  2. The gradient_estimation sampler means settings from other LTX graphs do not transfer.
  3. Qwen3-TTS and IndexTTS2 compatibility — the release compares them, but a comparison across two TTS engines needs matched text and matched speaker, which is easy to get wrong.
  4. LTX-2 (19B), not 2.3. Older generation.
  5. 97 frames is about four seconds of lip-sync per segment.

Practical approach

Start with the 11-node preset voice graph to confirm the TTS works and to hear what the presets sound like. Then clone one speaker and read a paragraph — that tells you how far cloning holds. Multi-speaker dialogue last, because it is the most complex to evaluate.

Workflows

Four graphs, published on RunningHub with invite code rh-v1111:

  • Qwen3 TTS preset voices + custom voice design
  • Qwen3 TTS voice cloning
  • Qwen3 TTS multi-speaker dialogue
  • LTX-2 lip-sync

Files

https://huggingface.co/AI-KSK/ksk-video-166-comfyui-workflows

Notes

  • Workflow files only. Model weights are not included; each keeps its own licence.
  • Tutorial exports, not a product.
  • The "3-second" cloning figure is the tool's stated minimum sample length.
  • Independent AI-KSK release. Not affiliated with Alibaba, Lightricks or RunningHub.

Optional API platform - 88API (affiliate link)

Explore 88API for access to multiple AI model APIs. Available models, routes and prices are listed on the platform; Alipay top-ups are supported.

https://88api.ai/sign-up?aff=usx3

Disclosure: I may earn a commission from eligible purchases after you register through this referral link.

Top comments (0)