Invariant renormalization for theories with nonlinear symmetry