What the researchers measured
Callahan, Ruggero, and Parent (2013) studied clinical psychology training programs. Their model used entering students’ GRE scores and GPA to explain about 81% of the variation in a combined program measure of internship match and licensure exam performance.
Sharpless and Barber (2013) also used program-level data to examine relationships between EPPP performance and admissions characteristics.
What Are "Pre-Training Factors"?
These program comparisons draw on several different measures:
- GRE scores: the single most consistent predictor, with correlations of r = .56 to .64 for general GRE scores
- Undergraduate GPA: a proxy for academic ability and study habits established before graduate school
- Program admission selectivity: more selective programs (lower admission rates, higher GRE cutoffs) produce higher EPPP averages
- Internship match rates measure an outcome that happens during training. Callahan and colleagues included match and licensure exam performance in the outcome they modeled.
These measures describe groups of students. People within the same program enter with different backgrounds and have different experiences during training.
How to read the 81% figure
The reported R² of .81 describes how closely the model fits differences between programs on the combined outcome. It cannot tell you how much of one student’s EPPP score was determined before graduate school.
The remaining variance has no simple interpretation. The model does not assign that share to study time, effort, or any other particular cause.
Choosing your next study session
Your own first attempts give you a starting point. Choose a set and see what happens when you answer without notes.
- Question-based practice: build the rapid processing and pattern recognition skills that the exam rewards
- Targeted content review: identify your weakest domains early and invest disproportionate time there
- Test-taking strategy: learn to eliminate distractors, manage time, and handle uncertainty efficiently
- Realistic practice exams: simulate exam conditions to build endurance and calibrate your pacing
Research-focused and practice-focused programs
Research-focused programs tend to have higher EPPP averages. Admissions selectivity and differences in coursework are two possible explanations.
Compare your coursework with the exam blueprint. If your training gave you little contact with research methods or biological bases, those may be useful places to start.
References
Callahan, J. L., Ruggero, C. J., & Parent, M. C. (2013). Hidden gems among clinical psychology training programs. Training and Education in Professional Psychology. DOI: 10.1037/a0034233.
Sharpless, B. A., & Barber, J. P. (2013). Predictors of program performance on the Examination for Professional Practice in Psychology (EPPP). Professional Psychology: Research and Practice, 44(4), 208–217.
Callahan, J. L., Bell, D. J., Davila, J., Johnson, S. L., Strauman, T. J., & Yee, C. M. (2020). Bigger is not always better: On the value of the EPPP pass rate as a program-level quality indicator. Training and Education in Professional Psychology, 14(4), 315–325.