Playgrounds › Noise Schedules › Sigmoid Schedule
Sigmoid Schedule
Originating Paper
Scalable Adaptive Computation for Iterative Generation🧑🎓 Allan Jabri, David Fleet, Ting Chen
📍 arXiv 2022
📄 157 citations
Why this schedule?
The sigmoid schedule offers a smooth S-shaped transition similar to cosine, but with greater flexibility through its temperature parameter . It begins with a gradual noise increase, accelerates in the middle, and smooths out again at the end. This characteristic enhances stability and mitigates abrupt transitions that could hurt sample quality. The sigmoid schedule is particularly effective for high-resolution images, where neighboring pixels exhibit greater redundancy. In practice, it demonstrates greater training stability than the cosine schedule on such images, though the difference becomes less significant at sampling time.
Formula
- •
- • = temperature coefficient that sharpens () or smooths () the transition
- • = current timestep
- • = cumulative signal retention