Abstract: Traditional diffusion models are typically trained to predict only the mean of the denoised distribution given a noisy sample. But what if we go beyond the mean? This talk explores how incorporating additional information—specifically predicting the covariance of the denoised distribution—can significantly accelerate sampling and improve density estimation. We'll dive into: • Different techniques for covariance prediction • Their theoretical connections • Practical benefits for more efficient and expressive generative modeling