Measuring knowledge and clinical work
"Will I pass?" and "What is this exam actually measuring?" are different questions. Calling the exam "good" or "bad" settles neither one. A construct validity study can examine how scores relate to other measures.
What the Research Found
In 2024, Saldaña, Callahan, and Cox published a construct validity study in Training and Education in Professional Psychology that examined the relationship between EPPP scores and several other measures among early-career psychologists from an APA-accredited program.
They compared EPPP performance against:
- Practicum competency evaluations: supervisor ratings of clinical skills during training
- Internship competency evaluations: supervisor ratings during the capstone clinical year
- Neurocognitive ability tests: measures of abstract reasoning, processing speed, and working memory
- EPPP scores showed no significant correlation with clinical competency ratings, neither practicum nor internship evaluations
- EPPP scores showed moderate to large correlations with neurocognitive ability: abstract reasoning (r = .52), processing speed (r = .37), and working memory (r = .33)
In this sample, reasoning measures had a clearer association with EPPP scores than supervisor ratings did.
Limits of the comparison
A knowledge exam can ask someone to apply an ethical standard to a case. A supervisor can observe how that trainee handles a difficult conversation with a client. Each measure captures a different part of training.
Practicing the format
If timed multiple choice feels different from the work you do with clients, practice the specific part that is unfamiliar.
- Try explaining two plausible choices before looking at the key.
- Work through a timed set to see which kinds of questions slow you down.
- When a qualifier changes the answer, go back to the stem and read it with the second choice in mind.
- Use supervisor feedback when you want to understand how you are doing in clinical work.
A question for future research
A study that tracked later client outcomes, ethical practice, or diagnostic accuracy would ask a different question from comparing exam scores with training evaluations.
References
Saldaña, S., Callahan, J. L., & Cox, R. J. (2024). The Examination for the Professional Practice of Psychology: An examination of construct validity. Training and Education in Professional Psychology, 18(1), 42–48.
Sharpless, B. A., & Barber, J. P. (2013). Predictors of program performance on the Examination for Professional Practice in Psychology (EPPP). Professional Psychology: Research and Practice, 44(4), 208–217.