Skip to content

Repository files navigation

VoiceStudio

PythonPyTorchLicense

Your Complete Voice Adaptation Research Workspace


🎯 Overview

VoiceStudio is a unified toolkit for text-style prompted speech synthesis, enabling instant voice adaptation and editing through natural language descriptions. Built on cutting-edge research in voice style prompting, LoRA adaptation, and language-audio models.

Key Features:

  • Text-Conditional Generation: Generate voice characteristics using natural language descriptions like "young female voice with warm tone"
  • Multimodal Input: Support both text descriptions and audio feature vectors
  • Voice Editing: Modify existing voices with simple instructions (Future Work)
  • Instant Adaptation: Generate LoRA weights in a single forward pass without fine-tuning
  • Architecture Agnostic: Works with multiple TTS architectures
  • Zero-shot Generalization: Adapt to unseen voice characteristics not present in training data
  • Parameter Efficiency: Minimal computational overhead compared to full model fine-tuning

🛠️ Installation

From PyPI (Recommended)

uv add voicestudio[all] # Install with all available base TTS models

From Source

git clone https://github.com/LatentForge/voicestudio.git
cd voicestudio
uv pip install -e ".[all]"

Development Installation

git clone https://github.com/LatentForge/voicestudio.git
cd voicestudio
uv pip install -e ".[all,web]"

Building and Publishing

# Build package
uv build
# Upload to PyPI
uv publish

📊 Supported Models

VoiceStudio works with various TTS architectures:

ModelStatusNotes
Parler-TTS✅ SupportedRequired further testing
Higgs-Audio✅ SupportedRequired further testing
Qwen3-TTS✅ SupportedRequired further testing
Chroma✅ SupportedRequired further testing
Spark🔄 ExperimentalComing soon
Dia✅ SupportedFully tested (by HF)
CozyVoice🔄 ExperimentalComing soon
F5-TTS🔄 ExperimentalComing soon

Add your own model: See our Integration Guide


🤝 Contributing

We welcome contributions! See CONTRIBUTING.md for guidelines.

Areas we need help with:

  • 🔧 Additional TTS model adapters
  • 📚 Documentation improvements
  • 🐛 Bug fixes and testing
  • 🌍 Multi-language support
  • 🎨 New voice editing techniques

📝 License

This project is licensed under the MIT License - see LICENSE file for details.

The base TTS models supported by this project are subject to their own respective licenses. Users are responsible for reviewing and complying with each model’s license before use.


🙏 Acknowledgments

  • Sakana AI for the original Text-to-LoRA concept
  • HyperTTS authors for hypernetwork applications in TTS
  • The open-source community for tools and datasets
  • CLAP: Microsoft & LAION-AI for CLAP model
  • LoRA: Microsoft for LoRA technique
  • HuggingFace: For transformers library and model hub

📚 Citation

If you use VoiceStudio in your research, please cite:

@software{voicestudio2026,
title={VoiceStudio: A Unified Toolkit for Voice Style Adaptation},
author={Your Name},
year={2026},
url={https://github.com/LatentForge/voicestudio}
}
@article{t2a-lora-2025,
title={T2A-LoRA: Text-to-Audio LoRA Generation via Hypernetworks for Real-time Voice Adaptation},
author={LatentForge},
journal={arXiv preprint arXiv:2501.XXXXX},
year={2025}
}

🔗 Links


📞 Contact


StarsForksWatchers

Made with ❤️ by LatentForge Team

About

VoiceStudio: A unified toolkit for text-style prompted speech synthesis, voice adaptation, and editing

Resources

Stars

3 stars

Watchers

0 watching

Forks

Releases

Packages

Used by

Contributors

Languages