We propose a multigrid method to solve the linear system of equations arising from a hybrid discontinuous Galerkin (in particular, a single face hybridizable, a hybrid Raviart--Thomas, or a hybrid Brezzi--Douglas--Marini) discretization of a Stokes problem. Our analysis is centered around the augmented Lagrangian approach and we prove uniform convergence in this setting. Numerical experiments underline our analytical findings.