Instructions to use RuneXX/LTX-2.3-Workflows with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use RuneXX/LTX-2.3-Workflows with LTX-2:

# Install the LTX-2 pipelines
git clone https://github.com/Lightricks/LTX-2.git
cd LTX-2
uv sync --extra natten

# Download weights from this repo
# Substitute filenames from this repo's "Files and versions" if they differ
hf download RuneXX/LTX-2.3-Workflows \
    diffusion_models/<distilled-transformer>.safetensors \
    text_encoders/gemma4-12b-with-proj-ltx-2.5-bf16.safetensors \
    vae/<video-vae>.safetensors \
    vae/<audio-vae>.safetensors \
    latent_upscale_models/<spatial-upsampler>.safetensors \
    latent_upscale_models/<temporal-upsampler>.safetensors \
    --local-dir models/LTX-2.3-Workflows
# DFR requires the detailing IC-LoRA (separate repo; strength is fixed at 0.5)
hf download Lightricks/LTX-2.5-22b-IC-LoRA-Pixel-Spatial-Upscaler --local-dir models/LTX-2.5-22b-IC-LoRA-Pixel-Spatial-Upscaler

# Distilled LTX-2.5 pipeline (fast)
uv run python -m ltx_pipelines.distilled \
    --transformer-path models/LTX-2.3-Workflows/diffusion_models/<distilled-transformer>.safetensors \
    --text-encoder-path models/LTX-2.3-Workflows/text_encoders/gemma4-12b-with-proj-ltx-2.5-bf16.safetensors \
    --video-vae-path models/LTX-2.3-Workflows/vae/<video-vae>.safetensors \
    --audio-vae-path models/LTX-2.3-Workflows/vae/<audio-vae>.safetensors \
    --spatial-upsampler-path models/LTX-2.3-Workflows/latent_upscale_models/<spatial-upsampler>.safetensors \
    --num-frames 121 \
    --prompt "A beautiful sunset over the ocean" \
    --output-path output.mp4
# For image-to-video, add: --image path/to/image.jpg 0 0.8

# DFR pipeline (higher detail fidelity; optional temporal 2x/4x)
uv run python -m ltx_pipelines.dfr_pipeline \
    --transformer-path models/LTX-2.3-Workflows/diffusion_models/<distilled-transformer>.safetensors \
    --text-encoder-path models/LTX-2.3-Workflows/text_encoders/gemma4-12b-with-proj-ltx-2.5-bf16.safetensors \
    --video-vae-path models/LTX-2.3-Workflows/vae/<video-vae>.safetensors \
    --audio-vae-path models/LTX-2.3-Workflows/vae/<audio-vae>.safetensors \
    --spatial-upsampler-path models/LTX-2.3-Workflows/latent_upscale_models/<spatial-upsampler>.safetensors \
    --temporal-upsampler-path models/LTX-2.3-Workflows/latent_upscale_models/<temporal-upsampler>.safetensors \
    --detailing-lora models/LTX-2.5-22b-IC-LoRA-Pixel-Spatial-Upscaler/ltx-2.5-22b-ic-lora-pixel-spatial-upscaler-x2-1.0.safetensors \
    --spatial-upscalings 1 \
    --temporal-upscalings 1 \
    --height 1088 \
    --width 1920 \
    --num-frames 121 \
    --prompt "A beautiful sunset over the ocean" \
    --output-path output.mp4
# For 4K: --spatial-upscalings 2 --width 3840 --height 2176
# For image-to-video, add: --image path/to/image.jpg 0 0.8

Notebooks
Google Colab
Kaggle

Alternative to MMaudio with LTX 2.3

#55

by Jehex - opened Mar 23

Discussion

Jehex

Mar 23

Hi there, thanks for your workflows Rune. Im wondering if they're is a way to " quickly " add a generated audio to an input video ( let's said generated with Wan ) with the audio model of ltx 2.3 only, They're is already a v2v for add sound / foley but Im wondering if they're is a way more simple / fastest way to do it without upscale, 2nd pass etc... Thanks a lot

RuneXX

Owner Mar 23

You mean in same workflow? Aka click "run", and the video is generated by wan but audio from ltx ?
The audio part of LTX is not extracted as its own model (since you mentioned MMaudio), so it would need the full ltx model

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment