Analysis of Classifier-Free Guidance Weight Schedulers - Département d'informatique
Article Dans Une Revue Transactions on Machine Learning Research Journal Année : 2024

Analysis of Classifier-Free Guidance Weight Schedulers

Résumé

Classifier-Free Guidance (CFG) enhances the quality and condition adherence of text-toimage diffusion models. It operates by combining the conditional and unconditional predictions using a fixed weight. However, recent works vary the weights throughout the diffusion process, reporting superior results but without providing any rationale or analysis. By conducting comprehensive experiments, this paper provides insights into CFG weight schedulers. Our findings suggest that simple, monotonically increasing weight schedulers consistently lead to improved performances, requiring merely a single line of code. In addition, more complex parametrized schedulers can be optimized for further improvement, but do not generalize across different models and tasks.
Fichier principal
Vignette du fichier
TMLR_Guidance_Analysis_HAL.pdf (45.05 Mo) Télécharger le fichier
thumbnail.png (2.46 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04823146 , version 1 (06-12-2024)

Identifiants

Citer

Xi Wang, Nicolas Dufour, Nefeli Andreou, Marie-Paule Cani, Victoria Fernández Abrevaya, et al.. Analysis of Classifier-Free Guidance Weight Schedulers. Transactions on Machine Learning Research Journal, 2024, ⟨10.48550/arXiv.2404.13040⟩. ⟨hal-04823146⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More