Survey Approaches and Respondent Behavior, Explained

UPI Study › Courses › Research Methods in Psychology › Free lessons › Lesson 5.2 Free with a free account

Survey Approaches and Respondent Behavior

Research Methods in Psychology · Chapter 5: Non-Experimental and Correlational ResearchSection 5.2 · lesson 30 of 9411 min · free with a free account

← Foundations of Non-Experimental ResearchNext lesson: The Nature and Purpose of Correlational Research →

Earn 3 college credits for Research Methods in PsychologyRecommended for credit by NCCRS · Psychology 111 · self-paced · one payment, lifetime access
Enroll in Research Methods in Psychology · $250 →Download the syllabus (PDF)

In this lesson

What happens in the respondent's mind - and why it matters.

  • Identify the major survey approaches
  • Outline the five-stage survey response process
  • Recognize the common response biases
  • Distinguish unit from item non-response

Free study notes

Get this lesson's notes by email

The key points and 4 practice questions with answers, in your inbox. One email, free.

One email. Unsubscribe in one click.

Transcript

Everything said in the video, section by section (1,411 words). Read along, or search it.

Non-Experimental and Correlational Research

Surveys and Respondent Behavior

A survey looks like the simplest method in psychology. Ask people, and write down what they say. It is not simple at all. Between your question and the respondent's answer sits a whole cognitive process. Five stages, each of which can go wrong. This section is about that process, and about what it does to your data. You will identify the major survey approaches used in non-experimental research. You will outline the five-stage response process that respondents move through. You will recognize the common response biases, and how each one is managed. And you will separate unit non-response from item non-response. Those two failures look alike, and they need completely different fixes.

A Peculiar Conversation

Why Respondent Behavior Matters

Think of a survey as a particular kind of conversation. The researcher asks standardized questions. The respondent is expected to answer honestly, accurately, and within the options provided. None of those expectations is automatic. Look at what the respondent actually has to do. Understand the question. Recall the relevant information. Form a judgment, select an answer, and decide whether to report that answer truthfully. Every one of those steps is a potential source of error. And notice that only the last one is about honesty. The rest are about comprehension and memory, which people fail at without meaning to. Understanding respondent behavior is what separates a survey designer from a question-writer.

Five Approaches

What a Survey Is For

Surveys come in several forms, distinguished by purpose and by the inference they support. Descriptive surveys estimate prevalence. How common is an attitude, a behavior, or a characteristic in a population? Analytic surveys examine relationships between variables across respondents. Comparative surveys compare attitudes or behaviors across groups, regions, or time periods. Evaluative surveys assess satisfaction, program effectiveness, or service quality. Exploratory surveys identify themes, generate hypotheses, or scope out unfamiliar topics. The distinction is not cosmetic. The purpose decides what kind of inference the resulting data can support. So choose the approach before you write a single question. An exploratory survey and an evaluative survey answer entirely different questions.

The Response Process

Five Stages, Every Question

Cognitive psychologists studying survey methodology found something useful. Respondents move through a recognizable sequence of mental steps for every question. There are five, and they run in the same order every time. Comprehension. The respondent works out what the question is asking. Retrieval. They pull the relevant information out of memory. Judgment. They integrate what they retrieved into an estimate or an opinion. Response mapping. They translate that judgment into one of your answer options. Editing. They decide what they are actually willing to report. Recognizing the steps helps you locate where an error came from. A vague question fails at comprehension. A sensitive question fails at editing. The fix differs in each case, which is why the sequence is worth memorizing.

Stages One And Two

Comprehension and Retrieval

Take the first two stages closely. Comprehension sounds trivial, and it is not. Vague terms are the usual culprit. Words like often, or recently. So are unfamiliar vocabulary and complex sentence structures. Here is the failure mode that makes comprehension errors so dangerous. A question meaning different things to different respondents still produces tidy-looking data. The numbers look uniform. They are answers to different questions. Retrieval is the second stage, and its difficulty varies enormously. How old are you is an easily available fact. How many doctor visits in the last twelve months, that is effortful recall. Memory is reconstructive and selective, so vivid events are more accessible than routine ones.

Stages Three And Four

Judgment and Response Mapping

Stage three is judgment. Respondents often have to integrate retrieved information into a single estimate or opinion. How satisfied are you with your job? Answering that means weighing many considerations into one rating. And the order in which they happen to occur to you shapes the judgment you form. So do the questions that came earlier in the survey. Stage four is response mapping. The judgment now has to be matched to the options you provided. If the options are coarse, agree or disagree, information is lost. If they are too fine, a hundred point scale, respondents cannot use them consistently. Poorly designed scales distort answers even when the underlying judgment was accurate. That is worth repeating. The respondent was right, and your instrument made them wrong.

The Last Stage

Editing, and the Cost of Length

The fifth stage is editing, and it is where honesty enters. Respondents may modify their answer before reporting it. This is where social-desirability bias and other self-presentation effects do their work. People shade their reports to seem more attractive, agreeable, or socially acceptable. Now scale the whole process up. Even a five question survey puts a respondent through those five stages, five separate times. Researchers underestimate that cognitive effort at their peril. Long surveys are especially vulnerable to satisficing. Satisficing means settling for a good enough answer, rather than working through the full process. The respondent is still answering. They are just not working through the full process. So brevity, clarity, and a logical question order are not stylistic choices. They are methodological necessities.

Named Distortions

Six Common Response Biases

Some distortions in respondent behavior are common enough to have earned their own names. Six of them matter most. Social desirability. Answers that present the respondent favorably rather than accurately. Acquiescence, also called yea-saying. Agreeing with statements regardless of content. Extreme-response bias. Disproportionately choosing the strongest options on a scale. Central-tendency bias. Disproportionately choosing the middle, to avoid commitment. Order effects. Earlier questions influencing answers to later ones, or the reverse. Recall bias. Distortions in memory of past events biasing retrospective reports. Notice what those six have in common. Each is a pattern that repeats across respondents, which is what makes it a bias. Recognizing them is the first step toward designing surveys that minimize their impact.

Countermeasures

How Each Bias Is Managed

Each bias has a matching countermeasure, and the pairings are worth learning together. For social desirability, guarantee anonymity and use indirect questioning. For acquiescence, mix positively and negatively worded items. And reverse-score the negatively worded ones. For extreme-response bias, use moderate-length scales. For central-tendency bias, include a clearly distinct don't-know option. That stops the middle of your scale absorbing people who simply have no view. For order effects, randomize question order where possible, and pilot for them. For recall bias, use shorter recall periods and provide reference cues. None of these eliminates the bias. They reduce it, and a good report says which distortions may remain.

Nobody Answered

Unit and Item Non-Response

Now a problem that no amount of question-writing can solve. Even a perfect questionnaire produces poor data if the wrong people answer it. Or if too few people answer at all. Unit non-response is when sampled individuals decline to participate entirely. Response rates have fallen sharply across many populations. Rates of ten percent or lower are not uncommon in some online and telephone surveys. But here is the counter-intuitive part. The danger is not the low response rate itself. It is non-response bias. That is the possibility that those who respond differ systematically from those who do not. Item non-response is different. Respondents finish the survey but skip particular questions. Usually the questions that are sensitive, complex, or unclear. Same word, non-response, and two quite different problems underneath it.

Design Strategies

Seven Ways to Reduce Bias

Draw all of that together into practical design rules. Pilot every new instrument, because a pilot reveals problems before full deployment. Comprehension failures and unintended interpretations show up there, cheaply. Use validated scales when they exist. They build on prior psychometric work, and they let you compare across studies. Keep the survey as short as the question allows. That reduces fatigue and satisficing, and it raises completion rates. Place sensitive questions late, after rapport is established, which reduces refusal. Guarantee confidentiality and explain it, because that reduces social-desirability bias. Provide balanced response scales, so respondents are not nudged toward particular answers. Then test for response biases and report them, so readers know what may remain. Non-response needs its own tools. Follow-up contacts, modest incentives, and statistical weighting. For skipped items, better wording, a prefer-not-to-answer option, and imputation during analysis.

One Last Idea

Good Surveys Respect Respondents

One last idea, and it is not a technical one. Reducing bias is also a form of respect. A clear, well-designed, appropriately confidential survey treats respondents as collaborators. Collaborators in producing knowledge, rather than data points to be extracted. And there is a useful coincidence buried in that. The same instrument that produces better data usually produces a better experience. Better for the people who are providing it. So here is the summary worth keeping. Survey quality depends not only on the questions asked, but on what happens when people answer. Design for that process, not just for the question you wanted to ask.

About Research Methods in Psychology at UPI Study

Research Methods in Psychology (Psychology 111) is a self-paced online course of 94 video lessons in 16 chapters, from the scientific method and research ethics to designs, data collection, sampling, measurement, validity, experiments, descriptive statistics and hypothesis testing. It carries a NCCRS credit recommendation for 3 semester credits.

Every lesson transcript is free on pages like this one, and the videos are free with a free UPI Study account. Enrolling adds a practice quiz after each lesson, the graded work and final exam that earn the credit, lifetime access, and an official transcript on completion. UPI Study has helped over 130,000 students with college credits. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Enroll now → Course details Download the syllabus All Psychology and social science courses Every course with PRO →

Compare: Research Methods vs Statistics

Why take it here

Why students take Research Methods in Psychology with UPI Study

How psychologists know what they knowResearch Methods in Psychology teaches how psychological studies are designed, run and judged: research ethics, surveys and observation, correlational and experimental designs, sampling, reliability and validity, and the statistics used to test hypotheses. It is a core course in psychology and many social-science degrees.
Credit at a fraction of the priceThe same 3 credits can cost $750 or more at a US college. Here it is one payment, self-paced, with lifetime access.
Finish your degree soonerTransfer credits reduce the courses you still owe, so you can graduate earlier or lighten a heavy semester.
Strengthen an applicationA completed college-level course on an official transcript shows admissions and scholarship committees you can do the work.
Study on your own scheduleNo start dates, no deadlines. Watch the lessons, practice, and take the final when you are ready.
130,000+students helped with college creditsACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Where the credit goes

Universities that work with NCCRS

Research Methods in Psychology carries a NCCRS credit recommendation. These universities work with NCCRS; some are UPI Study's signed partners. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Thomas Edison State UniversityThomas Edison State UniversitySigned partnerUniversity of the PeopleUniversity of the PeopleSigned partnerCharter Oak State CollegeCharter Oak State CollegeSigned partnerStrayer UniversityStrayer UniversitySigned partnerColumbia Southern UniversityColumbia Southern UniversitySigned partnerIndiana TechIndiana TechSigned partnerPenn StatePenn StateWorks with NCCRSSouthern New Hampshire UniversitySouthern New Hampshire UniversityWorks with NCCRSSUNYSUNYWorks with NCCRS +many more cooperating universitiesFind my college →

Find my college → Not listed? Ask Athena in the corner of this page, or book a 15-minute call.

FAQ

Questions students ask us

About Survey Approaches and Respondent Behavior

What are the stages of the survey response process?
A common model breaks answering a survey question into five stages: comprehension, retrieval, judgment, response mapping, and editing. Respondents work out what is asked, recall relevant information, combine it into an estimate or opinion, fit that judgment to the answer options, and decide what they are willing to report. Knowing the stages helps locate errors, since vague wording fails at comprehension while sensitive questions fail at editing.
What are common response biases in surveys?
Common response biases include social desirability, acquiescence, extreme responding, central tendency, order effects, and recall bias. Social desirability means answering to look good, and anonymity helps reduce it. Acquiescence, or yea-saying, means agreeing regardless of content and is reduced by mixing positively and negatively worded items. Extreme and central-tendency biases overuse the ends or middle of a scale, and order effects arise when earlier questions shape later answers.
What is satisficing in survey research?
Satisficing is when respondents settle for a good-enough answer instead of working through the full mental process for each question. It is especially common in long surveys, because every question demands comprehension, recall, judgment, and mapping to the answer options. Keeping a survey as short as the research question allows, writing clear items, and using a logical question order help reduce satisficing and raise completion rates.
What is the difference between unit non-response and item non-response?
Unit non-response happens when a sampled person declines to take part in the survey at all, while item non-response happens when someone completes the survey but skips particular questions. Skipped items are usually sensitive, complex, or unclear. Unit non-response is addressed with follow-up contacts, modest incentives, and statistical weighting, while item non-response is addressed with better wording, a prefer-not-to-answer option, and imputation during analysis.

About the Research Methods in Psychology course

How many college credits is Research Methods in Psychology?
Research Methods in Psychology (Psychology 111) carries a NCCRS credit recommendation for 3 semester credits. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.
How much does Research Methods in Psychology cost and what is included?
$250, paid once, with lifetime access: all 94 video lessons, a practice quiz after each, the graded work and final exam, and an official transcript when you finish. Students who want several courses choose UPI Study PRO instead.
Which universities accept UPI Study credits?
UPI Study has signed partner agreements with universities such as Thomas Edison State University, University of the People and Charter Oak State College, and works with universities such as Penn State, SNHU and SUNY. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities. Use "Find my college" on this page to check yours.
How long does Research Methods in Psychology take?
It is self-paced with no deadlines. The 94 lessons total about 16 hours of video; most students add reading and practice time and finish in a few weeks to a few months, on their own schedule.
How are the exams done?
Quizzes and assignments are online in the course. The final exam is taken online with proctoring; a person on the UPI Study team checks assignments, usually within two days.
How do my credits reach my college?
When the course shows 100% complete, request the official transcript from your dashboard. It is sent to the college you name, and you can send it to more than one. Check your college first with "Find my college" on this page, or ask Athena.

Ready for the full course? Earn 3 credits in Research Methods in Psychology.

94 video lessons, a quiz after each one, and the graded work that earns the credit. Recommended for credit by NCCRS.

Enroll in Research Methods in Psychology →Download the syllabusEvery course with PRO →
Research Methods in Psychology
3 credits · NCCRSEnroll →