Recent efforts to characterize visual object representations in the ventral object processing pathway in the human brain have led to contrasting proposals about the causes of neural specificity for different categories. Here we use multivariate techniques in a novel way to relate patterns of functional connectivity to patterns of stimulus preferences. Stimulus preferences were measured throughout the ventral stream to tools, animals, faces and places; separately, we measured the strength of functional connectivity of each voxel in the ventral stream to category-preferring regions outside the ventral stream. Multivariate analyses were then performed over ventral stream voxels, relating ‘category-preferences’ to ‘functional connectivity preferences’. We show that the relation of those two measures doubly dissociates ‘tools’ and ‘places’, within what is ostensibly ‘place’ selective cortex (parahippocampal gyrus). Specifically, in the parahippocampal gyrus, functional connectivity to the left inferior parietal lobule is selectively related to stimulus preferences for tools (and not places), while functional connectivity to retrosplenial cortex is selectively related to place preferences (and not tools preferences). These findings indicate that functional connectivity can be used to index representational content rather than just provide an understanding of ‘which regions are talking to which regions’. We suggest that the connectivity of the brain is what drives category-specificity in the ventral stream, and that if this is correct, then understanding the connectivity of the ventral stream will be key to understanding the causes and function of category-specific neural organization.