Skip to content

README.md

Latest commit

 

History

History
78 lines (56 loc) · 3.32 KB

README.md

File metadata and controls

78 lines (56 loc) · 3.32 KB
Raw

LTX Trainer

This package provides tools and scripts for training and fine-tuning Lightricks' LTX family of audio-video generation models. It supports LoRA training, full fine-tuning, and a flexible conditioning framework covering text-to-video, text-to-audio, image-to-video, video extension, audio extension, video inpainting, audio inpainting, video outpainting, IC-LoRA for video, audio, and joint audio-video references, audio-to-video, and video-to-audio.

📖 Documentation

All detailed guides and technical documentation are in the docs directory:

🤖 Agent-Assisted Training

Use the train-model repository skill for an end-to-end guided run: it probes your data and hardware, chooses the matching training mode, prepares/preprocesses the dataset, launches training, and monitors the job while using the docs above as the source of truth.

🔧 Requirements

  • LTX Model - Local files, in either published layout:
    • Unified (LTX-2, LTX-2.3, LTX-2.5) — one .safetensors holding the transformer, both VAEs and the vocoder, plus a directory containing the matching Gemma text encoder.
    • Split (LTX 2.5) — one file per component: transformer, packed text encoder, video VAE, audio VAE. Each is named separately in the config; see Configuration Reference.
  • Matching text encoder - LTX 2.5 requires the LTX-specific fine-tuned Gemma 4 text encoder; do not substitute Google's vanilla Gemma 4 model. LTX-2/LTX-2.3 use Gemma 3.
  • Linux with CUDA - CUDA 13+ recommended for optimal performance
  • Nvidia GPU with 80GB+ VRAM - Recommended for the standard config. For GPUs with 32GB VRAM (e.g., RTX 5090), use the low VRAM config which enables INT8 quantization and other memory optimizations

🤝 Contributing

We welcome contributions from the community! Here's how you can help:

  • Share Your Work: If you've trained interesting LoRAs or achieved cool results, please share them with the community.
  • Report Issues: Found a bug or have a suggestion? Open an issue on GitHub.
  • Submit PRs: Help improve the codebase with bug fixes or general improvements.
  • Feature Requests: Have ideas for new features? Let us know through GitHub issues.

💬 Join the Community

Have questions, want to share your results, or need real-time help?

Join our community Discord server to connect with other users and the development team!

  • Get troubleshooting help
  • Share your training results and workflows
  • Collaborate on new ideas and features
  • Stay up to date with announcements and updates

We look forward to seeing you there!

Happy training! 🎉