The Validity of MCAT Scores in Predicting Students' Performance and Progress in Medical School: Results From a Multisite Study

Purpose: This is the first multisite investigation of the validity of scores from the current version of the Medical College Admission Test (MCAT) in clerkship and licensure contexts. It examined the predictive validity of MCAT scores and undergraduate grade point averages (UGPAs) for performance in preclerkship and clerkship courses and on the United States Medical Licensing Examination Step 1 and Step 2 Clinical Knowledge examinations. It also studied students' progress in medical school.

Method: Researchers examined data from 17 U.S. and Canadian MD-granting medical schools for 2016 and 2017 entrants who volunteered for the research and applied with scores from the current MCAT exam. They also examined data for all U.S. medical schools for 2016 and 2017 entrants to regular-MD programs who applied with scores from the current exam. Researchers conducted linear and logistic regression analyses to determine whether MCAT total scores added value beyond UGPAs in predicting medical students' performance and progress. Importantly, they examined the comparability of prediction by sex, race and ethnicity, and socioeconomic status.

Results: Researchers reported medium to large correlations between MCAT total scores and medical student outcomes. Correlations between total UGPAs and medical student outcomes were similar but slightly lower. When MCAT scores and UGPAs were used together, they predicted student performance and progress better than either alone. Despite differences in average MCAT scores and UGPAs between students who self-identified as White or Asian and those from underrepresented racial and ethnic groups, predictive validity results were comparable. The same was true for students from different socioeconomic backgrounds, and for males and females.

Conclusions: These data demonstrate that MCAT scores add value to the prediction of medical student performance and progress and that applicants from different backgrounds who enter medical school with similar ranges of MCAT scores and UGPAs perform similarly in the curriculum.

Copyright © 2022 by the Association of American Medical Colleges.

Similar articles

Busche K, Elks ML, Hanson JT, Jackson-Williams L, Manuel RS, Parsons WL, Wofsy D, Yuan K. Busche K, et al. Acad Med. 2020 Mar;95(3):387-395. doi: 10.1097/ACM.0000000000002942. Acad Med. 2020. PMID: 31425189

Dunleavy DM, Kroopnick MH, Dowd KW, Searcy CA, Zhao X. Dunleavy DM, et al. Acad Med. 2013 May;88(5):666-71. doi: 10.1097/ACM.0b013e3182864299. Acad Med. 2013. PMID: 23478635

Julian ER. Julian ER. Acad Med. 2005 Oct;80(10):910-7. doi: 10.1097/00001888-200510000-00010. Acad Med. 2005. PMID: 16186610

O'Sullivan L, Kagabo W, Prasad N, Laporte D, Aiyer A. O'Sullivan L, et al. J Surg Educ. 2023 Jun;80(6):806-816. doi: 10.1016/j.jsurg.2023.03.004. Epub 2023 Apr 3. J Surg Educ. 2023. PMID: 37019709 Review.

Flores-Cohaila JA. Flores-Cohaila JA. J Educ Eval Health Prof. 2022;19:38. doi: 10.3352/jeehp.2022.19.38. Epub 2022 Dec 29. J Educ Eval Health Prof. 2022. PMID: 36579450 Free PMC article. Review.

Cited by

Cowan E, Altschafl B, Barnes D, Lasarev M, Ranheim EA, Pelley E. Cowan E, et al. Med Sci Educ. 2024 May 7;34(4):857-864. doi: 10.1007/s40670-024-02046-4. eCollection 2024 Aug. Med Sci Educ. 2024. PMID: 39099876

You Y, Wang W, Cleland J. You Y, et al. BMJ Open. 2023 Aug 11;13(8):e070239. doi: 10.1136/bmjopen-2022-070239. BMJ Open. 2023. PMID: 37567746 Free PMC article.

Alexander SM, Shenvi CL, Nichols KR, Dent G, Smith KL. Alexander SM, et al. Cureus. 2023 Jun 22;15(6):e40809. doi: 10.7759/cureus.40809. eCollection 2023 Jun. Cureus. 2023. PMID: 37485212 Free PMC article.

Mathew RE, Riehs M, Blenda AV, Chosed RJ, Wright WS. Mathew RE, et al. Adv Med Educ Pract. 2023 Jan 28;14:61-69. doi: 10.2147/AMEP.S389785. eCollection 2023. Adv Med Educ Pract. 2023. PMID: 36741938 Free PMC article.

References

    1. Hoover E. The COVID effect: Most colleges will keep test-optional policies for good. Chronicle of Higher Education. https://www.chronicle.com/article/the-covid-effect-most-colleges-will-ke. . Published February 25 2021. Accessed April 6, 2022.
    1. Rabin RC. Want to be a doctor? Take your chances in a closed room with strangers. New York Times. https://www.nytimes.com/2020/08/07/health/coronavirus-exams-mcat.html . Published August 7, 2020. Accessed April 6, 2022.
    1. Strauss V. Testing giants ACT and College Board struggle amid COVID-19 pandemic. Washington Post. https://www.washingtonpost.com/education/2020/05/30/testing-giants-act-c. . Published May 30, 2020. Accessed April 6, 2022.
    1. College Board. College Board asks colleges to show flexibility in admissions this year to reduce stress for students, citing challenges in providing universal access to the SAT during the Coronavirus pandemic. https://newsroom.collegeboard.org/college-board-asks-colleges-show-flexi. . Published June 6, 2020. Accessed April 6, 2022.
    1. Hubler S. Why is the SAT falling out of favor? New York Times. https://www.nytimes.com/2020/05/23/us/SAT-ACT-abolish-debate-california. . Published May 23, 2020. Accessed April 6, 2022.