This cross-sectional study aimed to investigate the relationship between caregivers and care receivers, defined as home-dwelling family members with dementia. We used a self-rating questionnaire, the Felt Expressed Emotion Rating Scale (FEERS; 6 simple questions), to measure caregiver perceptions of the care receiver’s criticisms (CCs) and emotional overinvolvement (EOI) toward the caregiver. We performed factor analyses to rank single items on the FEERS pertaining to CC and EOI. We included 208 caregiver/care receiver pairs. Logistic regression analyses tested associations between FEERS items and caregiver and care receiver variables. The main contributors to caregiver perceptions of CC were the caregiver’s own distress and the amount of time spent with the care receiver. Socially distressed caregivers perceived the care receiver as emotionally overinvolved. When offering a psychosocial intervention, a tailored program should target the caregiver’s perceived relationship with the family member and the caregiver’s distress. The program should also endeavor to give the caretaker more opportunities for leisure time.