Working with Ex Post Facto Research, Explained

UPI Study › Courses › Research Methods in Psychology › Free lessons › Lesson 7.2 Free with a free account

Working with Ex Post Facto Research

Research Methods in Psychology · Chapter 7: Quasi-Experimental and Time-Based DesignsSection 7.2 · lesson 41 of 949 min · free with a free account

← Defining and Understanding Quasi-Experimental DesignsNext lesson: Tracking Change: Longitudinal and Cross-Sectional Methods →

Earn 3 college credits for Research Methods in PsychologyRecommended for credit by NCCRS · Psychology 111 · self-paced · one payment, lifetime access
Enroll in Research Methods in Psychology · $250 →Download the syllabus (PDF)

In this lesson

Studying the effects of variables that have already occurred.

  • Define ex post facto research and place it within quasi-experimental inquiry
  • Distinguish causal-comparative from correlational designs
  • Recognize the validity threats specific to after-the-fact inquiry
  • Apply strategies that strengthen causal interpretation

Free study notes

Get this lesson's notes by email

The key points and 4 practice questions with answers, in your inbox. One email, free.

One email. Unsubscribe in one click.

Transcript

Everything said in the video, section by section (1,225 words). Read along, or search it.

Quasi-Experimental and Time-Based Designs

Working with Ex Post Facto Research

Some of the most important variables in psychology cannot be assigned to anyone. Childhood neglect. A war. A famine. The school you happened to attend. By the time a researcher gets interested, the variable has already done its work. Ex post facto research is how we study those variables anyway. In this section you will learn what the design is, and where it sits. You will distinguish its two variants, causal-comparative and correlational. You will meet the validity threats that hit after-the-fact work hardest. And you will learn the strategies that make its causal claims defensible. Along with the exact language you are entitled to use when you report it.

After the Fact

Looking Backward from Outcomes

The Latin phrase ex post facto means after the fact. That is a literal description of when the research happens. The study is conducted after the events of interest have already occurred. So the researcher cannot manipulate the independent variable. It has already happened, sometimes years or even decades earlier. Here is what the researcher does instead, and it is worth stating carefully. You identify groups that already differ on the independent variable. You compare their outcomes today. Then you ask whether the past difference is associated with the present one. Notice the verb. You select groups. You do not create them.

The Shape of It

A Difference That Was Never Assigned

Picture the design as a timeline. At the left sits a past difference. Something that already occurred, and was never assigned. In the middle, the researcher identifies groups that carry that difference. They were selected, not created, and that word choice matters. At the right sit the outcomes, measured now and compared across those groups. So the arrow of the design runs forward in time. Cause first, effect later, exactly as in an experiment. But the researcher enters the story late. Nothing at the first stage was under anyone's control. That gap between the design's logic and the researcher's authority is where every problem comes from.

Why It Is Everywhere

Most Interesting Variables Have Already Happened

Ex post facto research is not a niche method. It is everywhere. The reason is simple, and slightly humbling. Most of the variables social scientists care about have already occurred. Childhood experiences. Exposure to natural disasters. Attendance at different kinds of schools. Participation in major historical events. Every one of those is a pre-existing characteristic. No researcher could assign any of them, ethically or practically. So we face a choice. Study them after the fact, or do not study them at all. Ex post facto designs are the principal way of building evidence about their effects.

Two Variants

Categorical Groups or Continuous Predictors

Ex post facto research comes in two main forms. They are distinguished by the structure of the variables involved. Causal-comparative designs compare groups that differ categorically. Public versus private secondary schools, and their students' academic performance. Or the health outcomes of smokers versus non-smokers. The analytical task is to see whether the outcome differs systematically between groups. And then whether alternative explanations can be ruled out. Correlational ex post facto designs use continuous predictors instead. Do years of childhood adversity predict adult depression scores? The statistical methods overlap heavily with correlational research. But the framing, examining events that have already occurred, places it in this tradition.

When It Is the Only Option

Five Situations That Call for It

Five situations commonly call for an ex post facto approach. First, the variable cannot ethically be manipulated. Nobody assigns a child to neglect in order to study adult mental health. Second, the variable is a fixed personal characteristic. Gender, native language, or country of origin cannot be handed out. Third, the event of interest has already occurred. Studying the long-term effects of a famine or a war leaves no other option. Fourth, the intervention was applied long ago. Examining the career outcomes of a training program run thirty years back. Fifth, random assignment was simply infeasible at the time. Comparing schools that adopted a curriculum reform with schools that did not.

A Fair Question

Why Not Just Call It Correlational?

A reasonable objection surfaces around here. If this is just measuring two variables and relating them, why not call it correlational? The objection has real force. The two overlap substantially, and many studies could be classified either way. The labels matter because they signal different intentions. Correlational research is content to describe an association. It reports that two things go together, and stops there. Ex post facto research is explicitly asking something more. Can this past variable be treated as a causal factor? The methodological challenges are similar. The interpretive ambitions differ. And a bigger ambition means a heavier burden of proof.

Acute Threats

Five Ways an After-the-Fact Study Goes Wrong

Every quasi-experiment faces threats to validity. Ex post facto designs face several of them in especially acute form. Selection is the central one. Group membership was determined by uncontrolled real-world processes. Whatever sorted people into those groups may also affect the outcome. Confounding is the next. Variables tied to both the predictor and the outcome can produce spurious effects. Reverse causation is a real hazard when both were measured retrospectively. It can genuinely be unclear which one came first. Recall bias is subtler. Current outcomes distort memory of past events. A depressed adult may simply remember a harsher childhood than a cheerful one does. And survivorship bias is the quietest of all. Only those who survived to the time of study are included. The people most affected by the variable may be exactly the ones missing.

Building the Case

Six Strategies That Strengthen Inference

None of that makes the design useless. It makes the design demanding. Six strategies do most of the strengthening. Matching pairs participants across groups on potential confounders. That reduces the pre-existing differences you started with. Statistical control uses regression, propensity scoring, or related methods. It adjusts for the confounds you actually measured. A propensity score estimates the probability that an individual would receive a given treatment. Multiple comparison groups test whether the predicted outcome is specific. Replication across settings shows the pattern holds across populations and contexts. Theoretical plausibility checks ask whether the proposed mechanism makes sense at all. Biologically, psychologically, in whatever terms the claim requires. And triangulation combines the finding with experimental or longitudinal evidence.

Writing It Up

The Language You Are Entitled To

How you write it up is part of the method, not an afterthought. Ex post facto findings must be reported with appropriate epistemic humility. Three obligations follow, and they are concrete. State the design. Say clearly that the groups were not randomly assigned. Name what you controlled. Identify which confounds were measured and adjusted for. Name what you could not. Acknowledge the confounds you were unable to address. That third one is the honest part, and it is the one most often skipped. Then choose your verbs deliberately. Saying X causes Y should be reserved for cases where multiple lines of evidence converge. Saying X is associated with Y is the right phrasing for a single ex post facto study. Causal language is earned. It is not a default.

Powerful but Modest

Confident Humility

So where does that leave the design overall? Ex post facto research is one of the most useful tools in the social sciences. And it is useful precisely because it addresses questions experiments cannot. But its conclusions are always provisional. They are supported by patterns of association. By careful control of measurable confounds. And by consistency with the broader body of evidence. What they are never is proved, in the way a randomized experiment can prove a conclusion. The right tone is confident humility. Confident in what the evidence shows. Humble about what it cannot. Saying that out loud is a strength of the report, not a weakness in it.

About Research Methods in Psychology at UPI Study

Research Methods in Psychology (Psychology 111) is a self-paced online course of 94 video lessons in 16 chapters, from the scientific method and research ethics to designs, data collection, sampling, measurement, validity, experiments, descriptive statistics and hypothesis testing. It carries a NCCRS credit recommendation for 3 semester credits.

Every lesson transcript is free on pages like this one, and the videos are free with a free UPI Study account. Enrolling adds a practice quiz after each lesson, the graded work and final exam that earn the credit, lifetime access, and an official transcript on completion. UPI Study has helped over 130,000 students with college credits. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Enroll now → Course details Download the syllabus All Psychology and social science courses Every course with PRO →

Compare: Research Methods vs Statistics

Why take it here

Why students take Research Methods in Psychology with UPI Study

How psychologists know what they knowResearch Methods in Psychology teaches how psychological studies are designed, run and judged: research ethics, surveys and observation, correlational and experimental designs, sampling, reliability and validity, and the statistics used to test hypotheses. It is a core course in psychology and many social-science degrees.
Credit at a fraction of the priceThe same 3 credits can cost $750 or more at a US college. Here it is one payment, self-paced, with lifetime access.
Finish your degree soonerTransfer credits reduce the courses you still owe, so you can graduate earlier or lighten a heavy semester.
Strengthen an applicationA completed college-level course on an official transcript shows admissions and scholarship committees you can do the work.
Study on your own scheduleNo start dates, no deadlines. Watch the lessons, practice, and take the final when you are ready.
130,000+students helped with college creditsACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Where the credit goes

Universities that work with NCCRS

Research Methods in Psychology carries a NCCRS credit recommendation. These universities work with NCCRS; some are UPI Study's signed partners. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Thomas Edison State UniversityThomas Edison State UniversitySigned partnerUniversity of the PeopleUniversity of the PeopleSigned partnerCharter Oak State CollegeCharter Oak State CollegeSigned partnerStrayer UniversityStrayer UniversitySigned partnerColumbia Southern UniversityColumbia Southern UniversitySigned partnerIndiana TechIndiana TechSigned partnerPenn StatePenn StateWorks with NCCRSSouthern New Hampshire UniversitySouthern New Hampshire UniversityWorks with NCCRSSUNYSUNYWorks with NCCRS +many more cooperating universitiesFind my college →

Find my college → Not listed? Ask Athena in the corner of this page, or book a 15-minute call.

FAQ

Questions students ask us

About Working with Ex Post Facto Research

What is ex post facto research?
Ex post facto, Latin for after the fact, is research conducted after the variable of interest has already occurred, so the researcher cannot manipulate it. Instead, the researcher selects groups that already differ, such as people who did or did not live through a famine, and compares their present outcomes. It is the main way to study variables like childhood experiences, disasters, or school type that no one could assign.
What is the difference between causal-comparative and correlational ex post facto research?
Causal-comparative designs compare groups that differ categorically, such as students from public versus private schools or smokers versus non-smokers. Correlational ex post facto designs use continuous predictors, such as asking whether years of childhood adversity predict adult depression scores. Both study events that have already occurred, and both ask whether a past variable can be treated as a causal factor once alternative explanations are ruled out.
What are the main threats to validity in ex post facto research?
Selection is the central threat, because whatever sorted people into groups may also affect the outcome. Confounding variables can create spurious effects, and reverse causation is possible when both variables are measured retrospectively. Recall bias occurs when current states distort memories of the past. Survivorship bias arises because only people who survived to the time of study are included, possibly missing those most affected.
How should ex post facto findings be reported?
Ex post facto findings should be reported with cautious, non-causal language. State that groups were not randomly assigned, name the confounds that were measured and adjusted for, and acknowledge those that could not be addressed. For a single study, say X is associated with Y rather than X causes Y. Causal wording should be reserved for cases where multiple lines of evidence, such as replication and longitudinal data, converge.

About the Research Methods in Psychology course

How many college credits is Research Methods in Psychology?
Research Methods in Psychology (Psychology 111) carries a NCCRS credit recommendation for 3 semester credits. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.
How much does Research Methods in Psychology cost and what is included?
$250, paid once, with lifetime access: all 94 video lessons, a practice quiz after each, the graded work and final exam, and an official transcript when you finish. Students who want several courses choose UPI Study PRO instead.
Which universities accept UPI Study credits?
UPI Study has signed partner agreements with universities such as Thomas Edison State University, University of the People and Charter Oak State College, and works with universities such as Penn State, SNHU and SUNY. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities. Use "Find my college" on this page to check yours.
How long does Research Methods in Psychology take?
It is self-paced with no deadlines. The 94 lessons total about 16 hours of video; most students add reading and practice time and finish in a few weeks to a few months, on their own schedule.
How are the exams done?
Quizzes and assignments are online in the course. The final exam is taken online with proctoring; a person on the UPI Study team checks assignments, usually within two days.
How do my credits reach my college?
When the course shows 100% complete, request the official transcript from your dashboard. It is sent to the college you name, and you can send it to more than one. Check your college first with "Find my college" on this page, or ask Athena.

Ready for the full course? Earn 3 credits in Research Methods in Psychology.

94 video lessons, a quiz after each one, and the graded work that earns the credit. Recommended for credit by NCCRS.

Enroll in Research Methods in Psychology →Download the syllabusEvery course with PRO →
Research Methods in Psychology
3 credits · NCCRSEnroll →