In the somatosensory nerves, the tactile perception of texture is driven by spatial and temporal patterns of activation distributed across three populations of afferents. These disparate streams of information must then be integrated centrally to achieve a unified percept of texture. To investigate the representation of texture in somatosensory cortex, we scanned a wide range of natural textures across the fingertips of rhesus macaques and recorded the responses evoked in Brodmann’s areas 3b, 1, and 2. We found that texture identity is reliably encoded in the idiosyncratic responses of populations of cortical neurons, giving rise to a high-dimensional representation of texture. Cortical neurons fall along a continuum in their sensitivity to fine vs. coarse texture, and neurons at the extrema of this continuum seem to receive their major input from different afferent populations. Finally, we show that cortical responses can account for several aspects of texture perception in humans.