We introduce a homogeneous multigrid method in the sense that it uses the same embedded discontinuous Galerkin (EDG) discretization scheme for Poisson's equation on all levels. In particular, we use the injection operator developed in [LuRK2020] for HDG and prove optimal convergence of the method under the assumption of elliptic regularity. Numerical experiments underline our analytical findings.