We formulate guidance in diffusion models as a variational control problem. Intuitively, at each diffusion sampling step, we infer controls (via an optimization routine) which guide the noisy state ...