Acad Med. 2020 Aug 4. doi: 10.1097/ACM.0000000000003640. Online ahead of print.
PURPOSE: This study gathers validity evidence of an expanded History and Physical (H&P 360) examination to address chronic diseases through incorporation of biopsychosocial elements that are lacking in traditional H&P assessments via a multi-site randomized controlled trial among medical students.
METHOD: Third- and fourth-year medical students (n = 159) at 4 schools participated in an Objective Structured Clinical Examination designed with two cases for chronic disease. Students were randomized into the treatment group, which involved brief written instructions on how to use the H&P 360 followed by a standardized patient (SP) interaction, or the control group, which utilized the traditional H&P in an SP interaction without additional instructions. Validity evidence was gathered for content (alignment with an empirically-derived expanded history list), response process (feedback from raters and learners on the process), internal structure (reliability and item-level psychometrics), relations to other variables (comparison between treatment and control groups), and consequences (survey results from learners on experience).
RESULTS: H&P 360 items were blueprinted by faculty experts. SP observation checklist grading was consistent, and post-assessment debrief confirmed favorable educational experience among learners. The reliability of the H&P 360 was .76. Overall mean scores on the H&P 360 content (mean = 15.96, standard deviation [SD] = 3.66) were significantly higher compared to the traditional H&P (mean = 10.99, SD = 2.69), Cohen’s d = 1.17, P < .001.
CONCLUSIONS: Medical students using the H&P 360 collected significantly more biopsychosocial information compared to students using the traditional H&P, providing empirical support for teaching and assessing biopsychosocial information. The assessment demonstrated strong validity evidence supporting the use of the H&P 360 assessment in medical schools.