The origins of contemporary work on the temporal cortex and object recognition are traced from their roots in phrenology through the search for a cortical visual area to the discovery of the Kl¨ver-Bucy syndrome and its fractionation, finally ending with early single-neuron recording studies.