Skip to content

What admissions data can tell us about program outcomes

A study of clinical psychology programs examined how entering students’ GPA and GRE scores related to internship match and licensure exam outcomes.

What the researchers measured

Callahan, Ruggero, and Parent (2013) studied clinical psychology training programs. Their model used entering students’ GRE scores and GPA to explain about 81% of the variation in a combined program measure of internship match and licensure exam performance.

Sharpless and Barber (2013) also used program-level data to examine relationships between EPPP performance and admissions characteristics.

What Are "Pre-Training Factors"?

These program comparisons draw on several different measures:

  • GRE scores: the single most consistent predictor, with correlations of r = .56 to .64 for general GRE scores
  • Undergraduate GPA: a proxy for academic ability and study habits established before graduate school
  • Program admission selectivity: more selective programs (lower admission rates, higher GRE cutoffs) produce higher EPPP averages
  • Internship match rates measure an outcome that happens during training. Callahan and colleagues included match and licensure exam performance in the outcome they modeled.

These measures describe groups of students. People within the same program enter with different backgrounds and have different experiences during training.

How to read the 81% figure

The reported R² of .81 describes how closely the model fits differences between programs on the combined outcome. It cannot tell you how much of one student’s EPPP score was determined before graduate school.

The remaining variance has no simple interpretation. The model does not assign that share to study time, effort, or any other particular cause.

Choosing your next study session

Your own first attempts give you a starting point. Choose a set and see what happens when you answer without notes.

  • Question-based practice: build the rapid processing and pattern recognition skills that the exam rewards
  • Targeted content review: identify your weakest domains early and invest disproportionate time there
  • Test-taking strategy: learn to eliminate distractors, manage time, and handle uncertainty efficiently
  • Realistic practice exams: simulate exam conditions to build endurance and calibrate your pacing

Research-focused and practice-focused programs

Research-focused programs tend to have higher EPPP averages. Admissions selectivity and differences in coursework are two possible explanations.

Compare your coursework with the exam blueprint. If your training gave you little contact with research methods or biological bases, those may be useful places to start.

References

Callahan, J. L., Ruggero, C. J., & Parent, M. C. (2013). Hidden gems among clinical psychology training programs. Training and Education in Professional Psychology. DOI: 10.1037/a0034233.

Sharpless, B. A., & Barber, J. P. (2013). Predictors of program performance on the Examination for Professional Practice in Psychology (EPPP). Professional Psychology: Research and Practice, 44(4), 208–217.

Callahan, J. L., Bell, D. J., Davila, J., Johnson, S. L., Strauman, T. J., & Yee, C. M. (2020). Bigger is not always better: On the value of the EPPP pass rate as a program-level quality indicator. Training and Education in Professional Psychology, 14(4), 315–325.

Try the five-level confidence scale in the demo. Pick an answer, rate how sure you are, then read the explanation.