Text-to-Speech
Transformers
ONNX
Safetensors
lingv3_tts
feature-extraction
audio
voice-cloning
multilingual
mixture-of-experts
speech-generation
custom_code
Instructions to use inclusionAI/Ming-3.0-tts-tiny with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use inclusionAI/Ming-3.0-tts-tiny with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-to-speech", model="inclusionAI/Ming-3.0-tts-tiny", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("inclusionAI/Ming-3.0-tts-tiny", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add SGLang-Omni serving instructions to README
#1
by JustinTong - opened
README.md
CHANGED
|
@@ -140,6 +140,30 @@ See the [Tiny examples](https://github.com/inclusionAI/Ming-3.0-tts#ming-30-tts-
|
|
| 140 |
python tools/preflight_tiny.py --model_path /path/to/Ming-3.0-tts-tiny
|
| 141 |
```
|
| 142 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 143 |
## Performance
|
| 144 |
|
| 145 |
Benchmark comparisons from the [project README](https://github.com/inclusionAI/Ming-3.0-tts#performance).
|
|
|
|
| 140 |
python tools/preflight_tiny.py --model_path /path/to/Ming-3.0-tts-tiny
|
| 141 |
```
|
| 142 |
|
| 143 |
+
## Serving with SGLang-Omni
|
| 144 |
+
|
| 145 |
+
[SGLang-Omni](https://sgl-project.github.io/sglang-omni/) serves this checkpoint on one GPU:
|
| 146 |
+
|
| 147 |
+
```bash
|
| 148 |
+
sgl-omni serve --model-path inclusionAI/Ming-3.0-tts-tiny
|
| 149 |
+
```
|
| 150 |
+
|
| 151 |
+
Synthesize speech through the OpenAI-compatible endpoint:
|
| 152 |
+
|
| 153 |
+
```bash
|
| 154 |
+
curl -X POST http://127.0.0.1:8000/v1/audio/speech \
|
| 155 |
+
-H "Content-Type: application/json" \
|
| 156 |
+
-d '{
|
| 157 |
+
"model": "inclusionAI/Ming-3.0-tts-tiny",
|
| 158 |
+
"input": "Get the trust fund to the bank early.",
|
| 159 |
+
"response_format": "wav",
|
| 160 |
+
"seed": 123
|
| 161 |
+
}' \
|
| 162 |
+
--output speech.wav
|
| 163 |
+
```
|
| 164 |
+
|
| 165 |
+
`response_format` accepts `wav`, `mp3`, `flac`, and `pcm`. For zero-shot voice cloning, pass `ref_audio` (a server-side path or a `data:` URL) together with `ref_text`, the transcript of the reference recording. See the [SGLang-Omni cookbook](https://sgl-project.github.io/sglang-omni/cookbook/ming3_tts.html) for details.
|
| 166 |
+
|
| 167 |
## Performance
|
| 168 |
|
| 169 |
Benchmark comparisons from the [project README](https://github.com/inclusionAI/Ming-3.0-tts#performance).
|