Continuous diffusion for categorical data
S. Dieleman, L. Sartran, A. Roshannai, N. Savinov, Y. Ganin, P. H. Richemond, … J. Adler, … et al. · arXiv preprint (2022)
Continuous Diffusion for Categorical Data (CDCD) adapts continuous diffusion models to discrete data such as language by diffusing in embedding space with a score-interpolation objective.