Text-to-Speech AI (TTS)

ElevenLabs TTS API — generate speech from text in Python

from elevenlabs import ElevenLabs, Voice, VoiceSettings

client = ElevenLabs(api_key="YOUR_API_KEY")

# Generate speech using a preset voice
audio = client.generate(
    text="Welcome to LumiChats — premium AI at coffee prices.",
    voice=Voice(
        voice_id="21m00Tcm4TlvDq8ikWAM",  # Rachel — natural, conversational
        settings=VoiceSettings(
            stability=0.5,       # 0 = expressive, 1 = consistent
            similarity_boost=0.75,  # how closely to match reference voice
            style=0.2,           # speaking style exaggeration
        )
    ),
    model="eleven_multilingual_v3",
    output_format="mp3_44100_128",
)

# Save to file
with open("output.mp3", "wb") as f:
    for chunk in audio:
        f.write(chunk)

• Content creation: YouTube creators, podcast producers, and audiobook publishers use TTS to generate narration in minutes rather than booking studio time. ElevenLabs is the market leader for creator-focused voice generation.
• AI customer service: Voice AI agents using TTS for real-time speech synthesis are replacing IVR (Interactive Voice Response) systems. Latency below 300ms is now achievable, enabling natural conversation flow.
• Accessibility: TTS enables screen readers, reading assistance for dyslexia, and audio description for visually impaired users across all languages — Google Cloud TTS covers 220+ languages.
• Language learning: Natural TTS pronunciation models are integrated into Duolingo, Babbel, and dedicated pronunciation training apps.
• Indian language support: Google Cloud TTS Chirp HD and Microsoft Azure Neural TTS cover all major Indian languages including Hindi, Tamil, Telugu, Kannada, Malayalam, Bengali, Marathi, and Gujarati with natural prosody.

1. What is the difference between concatenative TTS, parametric TTS, and neural TTS? (Answer: Concatenative TTS: splice together recorded speech segments from a large audio database — high naturalness for covered phrases, robotic for novel combinations. Parametric TTS: model acoustic features (mel spectrograms) with HMMs or early neural networks — smoother but robotic. Neural TTS (WaveNet, Tacotron, VITS): end-to-end neural generation from text to waveform or via intermediate mel spectrogram. Near-human naturalness. Current state-of-the-art is neural: ElevenLabs, Azure Neural TTS, Google WaveNet, Amazon Polly Neural.)
2. What is voice cloning and what are the ethical concerns? (Answer: Voice cloning: train a TTS model on as little as 3–60 seconds of a target speaker's voice, enabling generation of arbitrary speech in that voice. Applications: accessibility (restore lost voices), personalisation, entertainment. Ethical concerns: deepfake audio for fraud (fake CEO calls authorising wire transfers), non-consensual content (generating fake statements), political disinformation (fake politician speeches). Many jurisdictions are legislating consent requirements for voice cloning. ElevenLabs requires users to confirm ownership or consent for cloned voices.)
3. What is the role of the vocoder in neural TTS systems like Tacotron 2? (Answer: Tacotron 2 architecture has two parts: (1) Sequence-to-sequence model: converts text to mel spectrogram (acoustic features). (2) Vocoder (WaveNet/WaveGlow/HiFi-GAN): converts mel spectrogram to audio waveform. The vocoder's job is to synthesise the raw audio sample-by-sample from the abstract mel spectrogram representation. Early neural vocoders (WaveNet) were too slow for real-time (1 second audio took 2 minutes). HiFi-GAN achieves real-time synthesis at 100× speed.)
4. What is prosody in TTS and why is it hard to get right? (Answer: Prosody = the patterns of stress, intonation, rhythm, and emphasis in speech. 'I never said she stole the money' has 7 different meanings depending on which word is stressed. TTS systems trained on flat, neutral speech may correctly pronounce words but place stress incorrectly or use monotone intonation. Modern approaches: (1) Explicit prosody control via markup (SSML tags). (2) Emotion/style conditioning (train on diverse emotional speech). (3) In-context TTS (ElevenLabs): provide a short reference audio clip to match prosody style.)
5. What are the key differences between ElevenLabs, Azure TTS, and Coqui/open-source TTS for production deployment? (Answer: ElevenLabs: highest quality, most realistic voices, voice cloning in 1 minute of audio, multilingual. Cost: ~$0.24/1000 characters. Latency: 200–500ms. Azure Neural TTS: enterprise SLA, compliance certifications (HIPAA, GDPR), 400+ voices, custom neural voice. Cost: ~$0.016/1000 characters (much cheaper). Coqui TTS/XTTS (open source): free, self-hosted, privacy-preserving, high-quality voice cloning. Cost: infrastructure only. Latency depends on hardware. Best for: ElevenLabs=quality; Azure=enterprise; Coqui=privacy+cost.)