Handover communication improvement initiatives typically employ a “one size fits all” approach. A human factors perspective has the potential to guide how to tailor interventions to roles, levels of experience, settings, and types of patients. We conducted ethnographic observations of sign-outs by attending and resident physicians in 2 medical intensive care units at one institution. Digitally audiotaped data were manually analyzed for content using codes and time spent using box plots for emergent categories. A total of 34 attending and 58 resident physician handovers were observed. Resident physicians spent more time for “soon to be discharged” and “higher concern” patients than attending physicians. Resident physicians spent less time discussing patients which they had provided care for within the last 3 days (“handbacks”). The study suggested differences for how handovers were conducted for attending and resident physicians for 3 categories of patients; handovers differ on the basis of role or level of expertise, patient type, and amount of prior knowledge of the patient. The findings have implications for new directions for subsequent research and for how to tailor quality improvement interventions based upon the role, level of experience, level of prior knowledge, and patient categories.