Phonon diffusion with frequency down‐conversion