Symmetry-breaking and intrinsic polarization instability in degenerate four-wave mixing