The Role of Small-n Designs in Research, Explained

UPI Study › Courses › Research Methods in Psychology › Free lessons › Lesson 13.7 Free with a free account

The Role of Small-n Designs in Research

Research Methods in Psychology · Chapter 13: Factorial, Within-Subject, and Small-n DesignsSection 13.7 · lesson 83 of 949 min · free with a free account

← Strategies for Managing Carryover EffectsNext lesson: Descriptive Statistics and Frequency Distributions →

Earn 3 college credits for Research Methods in PsychologyRecommended for credit by NCCRS · Psychology 111 · self-paced · one payment, lifetime access
Enroll in Research Methods in Psychology · $250 →Download the syllabus (PDF)

In this lesson

Studying one person carefully, and the questions it can answer.

  • Define small-n designs against group-based experiments
  • Describe ABA reversal and multiple-baseline structures
  • Judge when a small-n design is the right choice
  • Apply visual-analysis principles to small-n data

Free study notes

Get this lesson's notes by email

The key points and 4 practice questions with answers, in your inbox. One email, free.

One email. Unsubscribe in one click.

Transcript

Everything said in the video, section by section (1,208 words). Read along, or search it.

Factorial, Within-Subject, and Small-n Designs

The Role of Small-n Designs in Research

Most of this course has assumed you have plenty of participants. Some of the best research in psychology has had exactly one. By the end of this section you will define small-n designs. And distinguish them from the group-based experiments you have been studying. You will describe the structure of common single-case designs. Including the ABA reversal design and the multiple-baseline design. You will identify the questions for which small-n research is most appropriate. You will recognize its strengths and limits, particularly around generalization. And you will apply visual analysis principles to interpret small-n data.

The Inversion

Many People Briefly, or Few People Deeply

Mainstream experimental psychology recruits dozens or hundreds of participants. It then averages across them, to detect effects against the noise of individual variation. Small-n research takes the opposite approach entirely. Rather than studying many people briefly, it studies one or a few people extensively. Gathering many observations from each, across multiple conditions. The strategy has deep roots in several traditions. Clinical research. Behavior analysis. The experimental study of unique cases. Patients with rare conditions, where you could not assemble a group if you tried. Athletes at the limits of human performance. Individuals undergoing intensive interventions, where group averages are unhelpful.

The Trade

Breadth for Depth

Small-n designs make one clear trade. Breadth for depth. They cannot speak directly to population averages. That limit is real, and no amount of care removes it. But they can characterize individual change with a precision group designs cannot match. Fifty observations from one person tell you things fifty people never could. For some questions, that trade is exactly right. For others, it is a poor substitute for proper sampling. Recognizing which is which is one of the skills experienced researchers develop. And it is a judgment, not a rule you can look up.

Design One

The ABA Reversal Design

The classic small-n design is the ABA reversal. It alternates phases of baseline and treatment within a single participant. During the first A phase, the baseline, the dependent variable is measured repeatedly. Under ordinary conditions, with no manipulation at all. Then comes the B phase, the treatment. The manipulation is introduced, and measurements continue as before. Finally, the second baseline phase. The manipulation is withdrawn, and behavior is observed once more. Now watch what pattern would count as evidence. The variable shifts when treatment is introduced, and returns when it is withdrawn. If that happens, the manipulation is the most plausible cause of the change.

Why It Works

The Reversal Is the Evidence

The reversal is not decoration. It is where the evidence comes from. Think about what a single shift would prove. Something changed at roughly the time you introduced the treatment. That could easily be coincidence. Plenty of things change over a week. But a shift that reverses when the manipulation is removed is much harder to explain. You would need a coincidence that arrived and departed on your schedule. So ABA designs work best for behaviors that respond quickly. And that can return to baseline once the manipulation stops. Two situations rule the design out. When the manipulation produces lasting change, because learning a skill cannot be reversed. And when ethics prevent withdrawing a beneficial treatment just to demonstrate its effect.

Design Two

Multiple-Baseline Designs

When a treatment cannot be reversed, there is another option. The multiple-baseline design. The treatment is introduced at staggered times, rather than introduced and withdrawn. Staggered across multiple participants, or multiple behaviors within one participant, or multiple settings. Now here is the logic that replaces the reversal. Suppose the dependent variable changes only when the treatment is introduced. Not before, in any of the baselines. That staggered correspondence supports a causal claim. The strength of the evidence comes from the alignment between introduction and change. And from that alignment being replicated across the multiple baselines.

Three Variants

What Gets Staggered

There are three variants, differing in what gets staggered. Multiple baseline across participants introduces treatment at different times for different people. That suits interventions for similar problems in different individuals. Multiple baseline across behaviors works inside one person. The treatment is applied to different behaviors of that participant, in sequence. That suits interventions targeting several skills or symptoms in the same person. And multiple baseline across settings staggers by context. The treatment is introduced in different contexts at different times. That suits generalization studies, and context-specific interventions.

Analysis

Four Features of Visual Analysis

Small-n research has its own analytic tradition, and it looks unusual at first. It is called visual analysis of phase-by-phase data. Rather than computing inferential statistics across many participants, the researcher inspects graphs. And there are four specific things being looked for. Level, which is the average value within a phase. Trend, which is the slope of change over time within that phase. Variability, which is how consistent the values are. And immediacy, which is how quickly change appears after a phase transition. Each of those is a separate question about the same graph.

The Standard

Multiple Features Must Align

Strong evidence for a treatment effect requires those features to converge. Not one of them. Several, pointing the same way. You want a clear level shift at the phase boundary. You want a trend that reverses when the phase changes. You want low variability within phases, so the shift stands out from the scatter. And you want rapid response to the manipulation. A change that arrives three weeks late is hard to attribute. There is one more criterion, about how the phases relate. The overlap of data across phases. The less the phases overlap, the stronger the case for an effect.

A Correction

Visual Analysis Is Disciplined, Not Impressionistic

The phrase visual analysis sometimes suggests informal eyeballing. That impression is wrong, and worth correcting. The tradition is in fact rigorous. Multiple criteria must converge before an effect is claimed. Level, trend, variability, immediacy, and overlap. Practitioners are trained to apply those criteria consistently. And agreement between independent analysts is checked, as a form of reliability. The result is genuinely counter-intuitive. When applied carefully, visual analysis can be more conservative than inferential statistics. It rejects weak effects that significance testing would happily accept.

The Balance Sheet

Strengths and Limitations

Set the strengths and limitations side by side, because they pair up neatly. Small-n designs give a detailed characterization of individual change. Against that, generalization to populations is limited. They are practical for rare conditions and unique cases. But they are vulnerable to participant-specific quirks and history. They support strong causal inference within the studied individual. They cannot estimate population-level effect sizes. They are sensitive to patterns that group averages obscure entirely. Which is why replication across participants is essential for broader claims. And they are useful when group designs are impractical or unethical. Their cost there is an extended commitment from each individual participant.

Complementary

Two Traditions, Two Questions

So when is a small-n design the right choice? When the research question concerns individual change. When participants are scarce or unique. When interventions are tailored to the specific person. Or when ethical considerations prevent random assignment to groups. They work less well when the question concerns average effects in a population. Or when individuals are interchangeable, and you want to know how widely findings generalize. But notice that the two traditions complement rather than compete. Many research programs use small-n studies to establish that an effect exists in any individual. Then group studies to estimate its prevalence and magnitude in populations. Group studies reveal what is true on average. Small-n reveals what is true for individuals. Either approach alone is incomplete, and a mature literature uses both.

About Research Methods in Psychology at UPI Study

Research Methods in Psychology (Psychology 111) is a self-paced online course of 94 video lessons in 16 chapters, from the scientific method and research ethics to designs, data collection, sampling, measurement, validity, experiments, descriptive statistics and hypothesis testing. It carries a NCCRS credit recommendation for 3 semester credits.

Every lesson transcript is free on pages like this one, and the videos are free with a free UPI Study account. Enrolling adds a practice quiz after each lesson, the graded work and final exam that earn the credit, lifetime access, and an official transcript on completion. UPI Study has helped over 130,000 students with college credits. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Enroll now → Course details Download the syllabus All Psychology and social science courses Every course with PRO →

Compare: Research Methods vs Statistics

Why take it here

Why students take Research Methods in Psychology with UPI Study

How psychologists know what they knowResearch Methods in Psychology teaches how psychological studies are designed, run and judged: research ethics, surveys and observation, correlational and experimental designs, sampling, reliability and validity, and the statistics used to test hypotheses. It is a core course in psychology and many social-science degrees.
Credit at a fraction of the priceThe same 3 credits can cost $750 or more at a US college. Here it is one payment, self-paced, with lifetime access.
Finish your degree soonerTransfer credits reduce the courses you still owe, so you can graduate earlier or lighten a heavy semester.
Strengthen an applicationA completed college-level course on an official transcript shows admissions and scholarship committees you can do the work.
Study on your own scheduleNo start dates, no deadlines. Watch the lessons, practice, and take the final when you are ready.
130,000+students helped with college creditsACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Where the credit goes

Universities that work with NCCRS

Research Methods in Psychology carries a NCCRS credit recommendation. These universities work with NCCRS; some are UPI Study's signed partners. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Thomas Edison State UniversityThomas Edison State UniversitySigned partnerUniversity of the PeopleUniversity of the PeopleSigned partnerCharter Oak State CollegeCharter Oak State CollegeSigned partnerStrayer UniversityStrayer UniversitySigned partnerColumbia Southern UniversityColumbia Southern UniversitySigned partnerIndiana TechIndiana TechSigned partnerPenn StatePenn StateWorks with NCCRSSouthern New Hampshire UniversitySouthern New Hampshire UniversityWorks with NCCRSSUNYSUNYWorks with NCCRS +many more cooperating universitiesFind my college →

Find my college → Not listed? Ask Athena in the corner of this page, or book a 15-minute call.

FAQ

Questions students ask us

About The Role of Small-n Designs in Research

What is a small-n design in psychology?
A small-n design studies one or a few participants intensively, collecting many observations from each across multiple conditions, instead of averaging across many people. It is common in clinical research and behavior analysis and suits rare conditions, unique cases, and individually tailored interventions. It trades breadth for depth: it can show individual change precisely but cannot directly estimate population averages, so replication across participants is needed for broader claims.
How does an ABA reversal design work?
An ABA reversal design measures a behavior repeatedly during a baseline phase (A), introduces the treatment (B), then withdraws it and returns to baseline (A). Evidence for an effect comes when the behavior shifts after the treatment starts and returns when it stops, a pattern hard to explain as coincidence. It works best for behaviors that respond quickly and can revert, and it does not suit lasting changes or treatments that would be unethical to withdraw.
What is a multiple-baseline design?
A multiple-baseline design introduces a treatment at staggered times instead of withdrawing it, which makes it useful when effects cannot be reversed. The staggering can be across participants, across several behaviors of one participant, or across settings. A causal claim is supported when the dependent variable changes only once the treatment is introduced in each baseline, and that alignment is replicated across the multiple baselines.
How is data from single-case designs analyzed?
Single-case data are usually analyzed by visual analysis of graphed phase-by-phase data. Analysts check level (the average within a phase), trend (the slope over time), variability (how consistent the values are), immediacy (how quickly change follows a phase change), and overlap of data between phases. A treatment effect is claimed only when several criteria converge, and agreement between independent analysts is checked as a form of reliability.

About the Research Methods in Psychology course

How many college credits is Research Methods in Psychology?
Research Methods in Psychology (Psychology 111) carries a NCCRS credit recommendation for 3 semester credits. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.
How much does Research Methods in Psychology cost and what is included?
$250, paid once, with lifetime access: all 94 video lessons, a practice quiz after each, the graded work and final exam, and an official transcript when you finish. Students who want several courses choose UPI Study PRO instead.
Which universities accept UPI Study credits?
UPI Study has signed partner agreements with universities such as Thomas Edison State University, University of the People and Charter Oak State College, and works with universities such as Penn State, SNHU and SUNY. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities. Use "Find my college" on this page to check yours.
How long does Research Methods in Psychology take?
It is self-paced with no deadlines. The 94 lessons total about 16 hours of video; most students add reading and practice time and finish in a few weeks to a few months, on their own schedule.
How are the exams done?
Quizzes and assignments are online in the course. The final exam is taken online with proctoring; a person on the UPI Study team checks assignments, usually within two days.
How do my credits reach my college?
When the course shows 100% complete, request the official transcript from your dashboard. It is sent to the college you name, and you can send it to more than one. Check your college first with "Find my college" on this page, or ask Athena.

Ready for the full course? Earn 3 credits in Research Methods in Psychology.

94 video lessons, a quiz after each one, and the graded work that earns the credit. Recommended for credit by NCCRS.

Enroll in Research Methods in Psychology →Download the syllabusEvery course with PRO →
Research Methods in Psychology
3 credits · NCCRSEnroll →