Add SGLang-Omni serving instructions to README

#1
by JustinTong - opened
Files changed (1) hide show
  1. README.md +24 -0
README.md CHANGED
@@ -140,6 +140,30 @@ See the [Tiny examples](https://github.com/inclusionAI/Ming-3.0-tts#ming-30-tts-
140
  python tools/preflight_tiny.py --model_path /path/to/Ming-3.0-tts-tiny
141
  ```
142
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
143
  ## Performance
144
 
145
  Benchmark comparisons from the [project README](https://github.com/inclusionAI/Ming-3.0-tts#performance).
 
140
  python tools/preflight_tiny.py --model_path /path/to/Ming-3.0-tts-tiny
141
  ```
142
 
143
+ ## Serving with SGLang-Omni
144
+
145
+ [SGLang-Omni](https://sgl-project.github.io/sglang-omni/) serves this checkpoint on one GPU:
146
+
147
+ ```bash
148
+ sgl-omni serve --model-path inclusionAI/Ming-3.0-tts-tiny
149
+ ```
150
+
151
+ Synthesize speech through the OpenAI-compatible endpoint:
152
+
153
+ ```bash
154
+ curl -X POST http://127.0.0.1:8000/v1/audio/speech \
155
+ -H "Content-Type: application/json" \
156
+ -d '{
157
+ "model": "inclusionAI/Ming-3.0-tts-tiny",
158
+ "input": "Get the trust fund to the bank early.",
159
+ "response_format": "wav",
160
+ "seed": 123
161
+ }' \
162
+ --output speech.wav
163
+ ```
164
+
165
+ `response_format` accepts `wav`, `mp3`, `flac`, and `pcm`. For zero-shot voice cloning, pass `ref_audio` (a server-side path or a `data:` URL) together with `ref_text`, the transcript of the reference recording. See the [SGLang-Omni cookbook](https://sgl-project.github.io/sglang-omni/cookbook/ming3_tts.html) for details.
166
+
167
  ## Performance
168
 
169
  Benchmark comparisons from the [project README](https://github.com/inclusionAI/Ming-3.0-tts#performance).