An energy-independent nonlocal potential model. II. The asymmetry term