Finite-gyroradius stabilization of diffuse high beta stellarators