A macroscopic formulation of large deformations elastoplasticity with tensorial structure variables is presented. The novel features are the effect of constitutive relations for the plastic spin and, to a lesser degree of importance, of elastically embedding the structure variables. The plastic spin constitutive relations are obtained for different kinds of initial and induced anisotropies on the basis of the representation theorems for isotropic second-order antisymmetric tensor-valued functions, and their role is illustrated by the analysis of several examples at large homogeneous deformations. In particular the analysis of simple shear with nonlinear kinematic hardening of the evanescent memory type provides, on the basis of the second Liapunov method for stability, conditions on the material constants for the occurrence or not of stress oscillations with monotonically increasing shear strain.