ACE-Step

ACE Studio and StepFun · 2025

General-purpose music AI engine designed for ultra-fast audio synthesis and creative control.

Application types: Text-to-songLyrics-to-songText-to-sample
Architecture:Hybrid LLMDiffusion

Essential categories

CategoryStatusNotes
Source code✔︎ OpenSource code incudes model achitecture, training pipeline, inference, and data processing.
Training data✘ ClosedTraining data is not available nor properly described. In the technical report (Section 3.1.1), authors indicate that the model was trained on about 100,000 hours of music (~1.8 million musical pieces). However, no information on specific data sources, acquisition methods, and data licensing is given.
Model weights✔︎ OpenModel weights are available in HuggingFace.
Code documentation✔︎ OpenCodebase is properly documented, including details on model's installation and usage. In addition, authors provide a specific page with training instructions (https://github.com/ace-step/ACE-Step/blob/main/TRAIN_INSTRUCTION.md).
Training procedure✔︎ OpenTraining procedure is describe with detail in the technical report. Appendix A provides additional details on training parameters and hardware requirements.
Evaluation procedure~ PartialEvaluation procedure is described in the technical report, including human-evaluation and objective metrics evaluation. Despite evaluation data not being openly available, Appendix B includes the detailed description of the 20 prompts (with lyrics) used to generate the samples for the model evaluation.
Research paper~ PartialA technical report is available.
Licensing✔︎ OpenApache 2.0 License

Desirable categories

CategoryStatusNotes
Model card⭐ IncludedModel card available in Hugging Face.
Datasheet∅ Not included
Package∅ Not included
User-oriented application⭐ IncludedA demo is available in HuggingFace, as well as a Gradio UI.
Supplementary material page⭐ IncludedA supplementary page is available, including a brief description of the model, links to relevant sites (e.g., demo, paper and code), some examples showcasing the model's abilities, limitations and future work.

Raw YAML file with complete evaluation.