The direct, singular, boundary element analysis formulation is shown to provide a basis for a computationally efficient and accurate shape design sensitivity analysis approach for the structural response of three-dimensional solid objects. The theoretical formulation for surface displacement and traction component sensitivities, and all components of the stress tensor is presented along with a formulation for the recovery of displacement and stress components in the interior of the object under consideration. Discussion of computational issues related to the overall efficiency of these formulations is given, along with numerical results to demonstrate the accuracy and efficiency of this approach.