The fusiform gyrus responds more strongly to faces than to other categories of objects. This response could reflect either categorical detection of faces or recognition of particular facial identities. Recent fMRI studies have attempted to address the question of what information is encoded in these regions, but have reported mixed results. We tested whether the creation of richer identity representations via training on visual and social information, and the use of an adaptation design, would reveal more robust representations of these identities in ventral temporal cortex. Examining the patterns of activation across voxels in bilateral fusiform gyri, we identified unique patterns for particular identities. Attaching distinctive biographical information to identities did not increase the strength of these representations, but did produce a grouping effect: faces associated with the same amount of biographical information were represented more similarly to each other. These results are consistent with the possibility that identity exemplars are represented in posterior visual areas best known for their role in representing categorical information, and suggest that these areas may be sensitive to some forms of non-visual information, including from the social domain.