Critical behavior at finite-temperature confinement transitions