UPI Study › Courses › Educational Psychology › Free lessons › Lesson 10.1 Free with a free account
How Do Researchers Study Education? Research Designs and Experiments
Educational Psychology · Chapter 10: Research Methods and Evidence in EducationSection 10.1 · lesson 92 of 1009 min · free with a free account
Free preview
Create a free account to keep watching
It takes a minute and costs nothing. Your free account unlocks all of Chapter 1 and 3 more lessons of Educational Psychology.
Lesson complete
Earn the 3 college credits for Educational Psychology
Enrolling adds a quiz after each lesson, the graded work and the official transcript. Recommended for credit by NCCRS.
Next lesson: Can We Trust the Results? Validity, Reliability, and Correlation →← The Magic of Silence: Using Wait Time EffectivelyNext lesson: Can We Trust the Results? Validity, Reliability, and Correlation →
In this lesson
Experiments, quasi-experiments, and what random assignment actually buys you.
- Describe the major educational research designs
- Explain what random assignment guarantees
- Identify independent, dependent and control variables
- Recognize confounding in naturalistic school settings
Transcript
Everything said in the video, section by section (1,111 words). Read along, or search it.
Research Methods and Evidence in Education
How Do Researchers Study Education?
Every teaching method you will ever be sold comes with a claim attached. This program raises reading scores. This approach improves engagement. Whether you should believe any of it depends on how it was studied. This section is about how educational research is designed. We start with why design determines what you can conclude. Then the true experiment, and random assignment. Then quasi-experiments, which is what schools usually permit. Then single-subject designs, common in special education. Then variables, and the confounds that ruin studies. One idea does most of the work in this section. Random assignment handles the variables you never thought of.
Why It Matters
The Backbone of Evidence-Based Practice
Educational research is the backbone of evidence-based teaching. The alternative is relying on tradition, or on intuition. Researchers systematically investigate what influences learning. And what influences motivation, and academic achievement. By applying rigorous scientific methods, they can answer three questions. Which instructional strategies are actually effective. Under what conditions those strategies work best. And for which student populations they produce the greatest benefit. Notice that the second and third questions are often skipped. And this matters beyond the people conducting research. Practitioners must evaluate findings and apply them. In their own classrooms, and in their own schools.
Three Questions
The Design Follows the Question
Educational research answers three broad kinds of question. Questions about cause and effect, and about patterns of association. And questions about descriptive characteristics of what exists. The design follows from which kind of question you are asking. But two other things constrain the choice as well. The resources available to the researcher. And the ethical constraints of studying human participants. Particularly when those participants are children and adolescents. That is why the field has so many different methods. From laboratory-style experiments to large-scale survey studies. The diversity reflects the complexity of the educational environment.
True Experiment
The Gold Standard for Causality
The true experiment is the gold standard for establishing causality. Its structure is simple to describe. Participants are randomly assigned to one of two groups. A control group, or an experimental group. The experimental group receives the treatment, such as a new program. The control group receives the standard condition. It serves as the comparison baseline. Now here is what the random assignment actually guarantees. It ensures the two groups are equivalent at baseline. Which means any difference in outcomes belongs to the treatment. Rather than to pre-existing differences between the groups.
Key Idea
Known and Unknown Characteristics Alike
Random assignment is the defining feature of a true experiment. And it is worth stating exactly what it does. It distributes participant characteristics equally across groups. Both known characteristics and unknown ones. That second half is where the power lives. You do not have to think of every relevant variable in advance. Chance handles the ones you never anticipated. Which eliminates systematic bias from the comparison. And allows researchers to draw causal conclusions from the data. Consider a study of collaborative learning in mathematics. The researcher randomly assigns classrooms to two conditions. Collaborative instruction, or traditional lecture-based teaching. Then compares post-test scores between them.
When You Cannot
Quasi-Experiments and Single-Subject Designs
In real schools, random assignment is often impossible. So quasi-experimental designs are used instead. A researcher might compare two existing classrooms. One using a new literacy intervention, and one not. These lack the control of a true experiment. But they can still provide valuable evidence. Provided researchers account for pre-existing differences. One common approach is using pre-test scores as covariates. That statistically adjusts for where each group started. There is a third approach worth knowing about too. Single-subject designs observe one student or a small group. Observed across multiple conditions over time. Which makes them particularly useful in special education research.
The Spectrum
Ordered by How Much Causal Control You Have
It helps to lay these designs out along a single spectrum. Ordered by how much causal control the researcher has. At one end sits descriptive research. No manipulation, no random assignment. It describes what exists. Next comes correlational research. Still no manipulation, but it measures association between variables. It cannot show cause, and that limitation is structural. Then quasi-experiments, which do involve manipulation. But without random assignment, so they support probable cause. And at the far end, the true experiment. Random assignment plus manipulation, supporting causal claims. Read left to right and one thing becomes clear. What you may conclude is fixed by what you were able to control.
Variables
What You Change, and What You Measure
Every experiment involves at least two variables. The independent variable is what the researcher manipulates. For instance, the type of instructional strategy being used. The dependent variable is the outcome being measured. Student test scores, perhaps, or reading fluency rates. A well-designed experiment holds all other variables constant. So that changes in the dependent variable can be attributed confidently. Attributed to the independent variable, and nothing else. Sometimes researchers study more than one factor at once. They then use what are called factorial designs. Those examine main effects for each variable. And interaction effects between the variables as well.
Confounds
The Hardest Part of School-Based Research
Then there are the variables nobody wanted in the study. Control variables are those held constant, or statistically adjusted for. The purpose is to prevent confounding. In educational research, four control variables come up constantly. Student age, socioeconomic status, prior achievement, and teacher experience. Identifying and managing potential confounds is genuinely hard. It is one of the most challenging aspects of rigorous research. And it is hardest in naturalistic school settings. Because researchers have limited control over the environment there. A school is not a laboratory, and it should not be. Which is exactly why the design work matters so much.
Six Designs
What Each One Can and Cannot Claim
Six designs, compared on what each one can legitimately claim. A true experiment has random assignment and manipulation. It supports causal claims, in lab or controlled settings. A quasi-experiment has manipulation but no random assignment. It supports probable cause, in existing classrooms. Correlational research has neither, and reports association from surveys and records. Descriptive research also has neither, describing observations and surveys. Single-subject designs have manipulation without random assignment. They report individual patterns, mostly in special education. And mixed methods vary on both, aiming to be comprehensive. That last one is chosen for genuinely complex questions.
Classroom Example
Forty Classrooms and One Reading Program
Here is a true experiment running in a real district. The district wants to evaluate a new phonics-based reading program. Specifically, whether it improves literacy outcomes for first graders. A researcher randomly assigns twenty classrooms to the new program. And twenty to continue with the existing curriculum. Pre-test and post-test reading scores are collected from both. Now notice what the random assignment licenses at the end. Any significant difference in post-test scores belongs to the program. Not to differences in teacher quality, or in student demographics. And this is why design is not a technicality. A poorly designed study may say a method works when it does not. Wasting school resources, and potentially harming students.
About Educational Psychology at UPI Study
Educational Psychology (Psychology 120) is a self-paced online course of 100 video lessons in 11 chapters, from memory, conditioning and child development to motivation, individual differences, assessment, instruction and educational technology. It carries a NCCRS credit recommendation for 3 semester credits.
Every lesson transcript is free on pages like this one, and the videos are free with a free UPI Study account. Enrolling adds a practice quiz after each lesson, the graded work and final exam that earn the credit, lifetime access, and an official transcript on completion. UPI Study has helped over 130,000 students with college credits. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.
Enroll now → Course details Download the syllabus All Psychology and social science courses Every course with PRO →
Why take it here
Why students take Educational Psychology with UPI Study
Where the credit goes
Universities that work with NCCRS
Educational Psychology carries a NCCRS credit recommendation. These universities work with NCCRS; some are UPI Study's signed partners. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.
Thomas Edison State UniversitySigned partner
University of the PeopleSigned partner
Charter Oak State CollegeSigned partner
Strayer UniversitySigned partner
Columbia Southern UniversitySigned partner
Indiana TechSigned partner
Penn StateWorks with NCCRS
Southern New Hampshire UniversityWorks with NCCRS
SUNYWorks with NCCRS
+many more cooperating universitiesFind my college →Find my college → Not listed? Ask Athena in the corner of this page, or book a 15-minute call.
FAQ
Questions students ask us
About How Do Researchers Study Education? Research Designs and Experiments
What is random assignment and why does it matter in experiments?
What is the difference between a true experiment and a quasi-experiment?
What are independent, dependent and control variables?
What is a single-subject research design?
About the Educational Psychology course
How many college credits is Educational Psychology?
How much does Educational Psychology cost and what is included?
Which universities accept UPI Study credits?
How long does Educational Psychology take?
How are the exams done?
How do my credits reach my college?
Ready for the full course? Earn 3 credits in Educational Psychology.
100 video lessons, a quiz after each one, and the graded work that earns the credit. Recommended for credit by NCCRS.
3 credits · NCCRSEnroll →