Open-source orchestration framework for LLM voice agents that make and take phone calls over Twilio or Plivo.
Replaces Voice agents (partly) Not: speech generation, voice cloning, speech recognition
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · MIT
- Paid services
- No: Required
- Hardware
- Unknown: Unknown
- Setup
- Confirmed: Medium
resemble-ai/chatterbox BEST FIT #3 TRENDING ★ 27k active 2mo ago
Resemble AI's family of open TTS models (Turbo, Nano, Multilingual) with zero-shot voice cloning from a reference clip.
Replaces Speech generation + Voice cloning (partly) Not: speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · MIT
- Paid services
- Partial: Optional only
- Hardware
- Partial: CPU works
- Setup
- Confirmed: Easy
Python TTS library with many models (XTTS-v2, VITS, YourTTS, Bark, Tortoise); original repo unmaintained, continued by idiap fork.
Replaces Speech generation + Voice cloning (partly) Not: speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Partial: Conditions · MPL-2.0
- Paid services
- Confirmed: None required
- Hardware
- Unknown: Unknown
- Setup
- Confirmed: Easy
1.6B-parameter English text-to-dialogue model from Nari Labs with two-speaker tags, non-verbal sounds and audio-prompt voice cloning.
Replaces Speech generation + Voice cloning (partly) Not: speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · Apache-2.0
- Paid services
- Confirmed: None required
- Hardware
- Confirmed: GPU, ~4.4GB+
- Setup
- Confirmed: Easy
Flow-matching text-to-speech research model that clones a voice zero-shot from a reference audio clip.
Replaces Speech generation + Voice cloning (partly) Not: speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- No: No · MIT code, CC-BY-NC-4.0 weights
- Paid services
- Confirmed: None required
- Hardware
- Unknown: Unknown
- Setup
- Confirmed: Medium
SYSTRAN/faster-whisper BEST FIT ★ 26k active today
Reimplementation of OpenAI Whisper on CTranslate2, up to 4x faster with less memory, with int8 on CPU or GPU.
Replaces Speech recognition Not: speech generation, voice cloning, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · MIT
- Paid services
- Confirmed: None required
- Hardware
- Confirmed: CPU works
- Setup
- Confirmed: Easy
fishaudio/fish-speech BEST FIT #4 TRENDING ★ 33k active 2d ago
Fish Audio's multilingual TTS and voice cloning stack (Drama 3, S2-Pro) under a source-available community licence.
Replaces Speech generation + Voice cloning Not: speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Partial: Conditions · Custom licence
- Paid services
- Partial: Optional only
- Hardware
- Confirmed: GPU, ~24GB+
- Setup
- Confirmed: Medium
RVC-Boss/GPT-SoVITS BEST FIT ★ 63k active 8d ago
Few-shot voice cloning and TTS WebUI; 5-second zero-shot or 1-minute fine-tune, five languages, MIT code and weights.
Replaces Speech generation + Voice cloning (partly) Not: speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · MIT
- Paid services
- Confirmed: None required
- Hardware
- Partial: CPU works
- Setup
- Confirmed: Easy
hexgrad/kokoro BEST FIT #5 TRENDING ★ 9.4k active 14mo ago
Lightweight 82M-parameter open-weight text-to-speech model with a pip-installable Python inference library.
Replaces Speech generation (partly) Not: voice cloning, speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · Apache-2.0
- Paid services
- Confirmed: None required
- Hardware
- Unknown: Unknown
- Setup
- Confirmed: Easy
Python framework for real-time voice agents as server-side participants in LiveKit WebRTC rooms, with STT/LLM/TTS plugins.
Replaces Voice agents (partly) Not: speech generation, voice cloning, speech recognition
- Runs locally
- Confirmed: Yes
- Commercial use
- Partial: Conditions · Apache-2.0
- Paid services
- No: Required
- Hardware
- Partial: CPU works
- Setup
- Confirmed: Easy
myshell-ai/MeloTTS BEST FIT ★ 7.7k active 22mo ago
Multilingual text-to-speech library from MyShell.ai and MIT covering English accents, Spanish, French, Chinese, Japanese and Korean.
Replaces Speech generation (partly) Not: voice cloning, speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · MIT
- Paid services
- Confirmed: None required
- Hardware
- Partial: CPU works
- Setup
- Confirmed: Medium
myshell-ai/OpenVoice BEST FIT ★ 38k active 18mo ago
MyShell's instant voice cloning model with tone-colour transfer, style control and cross-lingual cloning; MIT code and weights.
Replaces Speech generation + Voice cloning (partly) Not: speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · MIT
- Paid services
- Confirmed: None required
- Hardware
- Unknown: Unknown
- Setup
- Confirmed: Medium
canopyai/Orpheus-TTS BEST FIT ★ 6.4k active 10mo ago
Llama-based 3B speech LLM from Canopy Labs for expressive, emotive, low-latency streaming text-to-speech.
Replaces Speech generation + Voice cloning (partly) Not: speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Partial: Conditions · Apache-2.0
- Paid services
- Partial: Optional only
- Hardware
- Partial: CPU works
- Setup
- Confirmed: Medium
pipecat-ai/pipecat BEST FIT ★ 17k active today
Open-source Python framework for real-time voice and multimodal agents that plugs together STT, LLM, TTS and transports.
Replaces Voice agents (partly) Not: speech generation, voice cloning, speech recognition
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · BSD-2-Clause
- Paid services
- Partial: Optional only
- Hardware
- Unknown: Unknown
- Setup
- Confirmed: Easy
OHF-Voice/piper1-gpl BEST FIT ★ 5.9k active 1d ago
Fast, local neural text-to-speech engine with downloadable voices in 40+ languages, used by Home Assistant and NVDA.
Replaces Speech generation (partly) Not: voice cloning, speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Partial: Conditions · GPL-3.0-or-later
- Paid services
- Confirmed: None required
- Hardware
- Partial: CPU works
- Setup
- Confirmed: Easy
rishikanthc/Scriberr BEST FIT ★ 3.1k active 3w ago
Self-hosted web app for offline transcription with Whisper, Parakeet or Canary, speaker diarization and LLM summaries.
Replaces Speech recognition Not: speech generation, voice cloning, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · MIT
- Paid services
- Partial: Optional only
- Hardware
- Partial: CPU works
- Setup
- Confirmed: Medium
SesameAILabs/csm BEST FIT ★ 15k active 16mo ago
Sesame's 1B Conversational Speech Model that generates speech from text plus optional conversational audio context.
Replaces Speech generation (partly) Not: voice cloning, speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Partial: Conditions · Apache-2.0
- Paid services
- Confirmed: None required
- Hardware
- Partial: See details
- Setup
- Confirmed: Medium
yl4579/StyleTTS2 BEST FIT ★ 6.4k active 2y ago
Research text-to-speech model using style diffusion and adversarial training, with pretrained LJSpeech and LibriTTS checkpoints.
Replaces Speech generation + Voice cloning (partly) Not: speech recognition, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Partial: Conditions · MIT
- Paid services
- Confirmed: None required
- Hardware
- Partial: CPU works
- Setup
- Confirmed: Medium
debpalash/VoiceStudio BEST FIT #1 TRENDING ★ 70k active today
Local desktop app for voice cloning, voice design, video dubbing, dictation, transcription and audiobooks, built on OmniVoice and other engines.
Replaces Speech generation + Voice cloning + Speech recognition (partly) Not: voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- No: No · AGPL-3.0-only code, CC-BY-NC-4.0 weights
- Paid services
- Partial: Optional only
- Hardware
- Confirmed: CPU works
- Setup
- Confirmed: Easy
ggml-org/whisper.cpp BEST FIT ★ 54k active 4d ago
Dependency-free C/C++ port of OpenAI's Whisper speech recognition, running on CPU or GPU across desktop, mobile and the browser.
Replaces Speech recognition Not: speech generation, voice cloning, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · MIT
- Paid services
- Confirmed: None required
- Hardware
- Confirmed: CPU works
- Setup
- Confirmed: Hard
openai/whisper BEST FIT #2 TRENDING ★ 111k active 6w ago
OpenAI's general-purpose speech recognition model for multilingual transcription, translation to English and language ID.
Replaces Speech recognition Not: speech generation, voice cloning, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Confirmed: Yes · MIT
- Paid services
- Confirmed: None required
- Hardware
- Confirmed: GPU, ~1GB+
- Setup
- Confirmed: Easy
Fast batched Whisper transcription with word-level timestamps via wav2vec2 alignment and pyannote speaker diarization.
Replaces Speech recognition Not: speech generation, voice cloning, voice agents
- Runs locally
- Confirmed: Yes
- Commercial use
- Partial: Conditions · BSD-2-Clause
- Paid services
- Confirmed: None required
- Hardware
- Confirmed: CPU works
- Setup
- Confirmed: Medium
No project meets all of your requirements. The list below shows what you'd need to relax.