Crime Measurement Programs and Victim and Self-Report Survey Methods

UPI Study › Courses › Criminology › Free lessons › Lesson 3.3 Free with a free account

Crime Measurement Programs and Victim and Self-Report Survey Methods

Criminology · Chapter 3: Measuring Crime: Research Organizations and Data SourcesSection 3.3 · lesson 7 of 9112 min · free with a free account

← FBI Uniform Crime Report: Purpose, Benefits, and LimitationsNext lesson: Historical and Contemporary Crime Trends and Demographic Influences →

Earn 3 college credits for CriminologyRecommended for credit by NCCRS · Criminology 150 · self-paced · one payment, lifetime access
Enroll in Criminology · $250 →Download the syllabus (PDF)

In this lesson

Incident-based reporting, victimization surveys, and self-report studies.

  • Describe incident-based reporting and the transition problem.
  • Explain the design and limits of victimization surveys.
  • Explain the design and limits of self-report studies.
  • Match a measurement source to a research question.

Transcript

Everything said in the video, section by section (1,449 words). Read along, or search it.

Opening Question

Dana's Stolen Bike and Missing Records

Picture Dana, a student whose bike was stolen last spring. She never reported it; it didn't seem worth the trouble. So in police records, it never happened. Police records show only the crimes that reach police. So how do we measure everything else?

Lesson Roadmap

Three Sources Beyond Aggregate Police Counts

This lesson covers the main ways criminologists look beyond aggregate police counts. First, the National Incident-Based Reporting System, which records each incident in detail. Then victimization surveys, which ask the public about crimes they experienced. And self-report studies, which ask people about offenses they committed themselves. We'll see why these three sources are expected to disagree, and how triangulating across them gives a more honest picture. Finally, we'll practice matching the right measure to the right research question.

Definition

NIBRS Records Every Offense Per Incident

The National Incident-Based Reporting System, or NIBRS, succeeds the Summary Reporting System from the last lesson. The summary system aggregated one monthly count per offense category; NIBRS instead records detail about each individual incident. It captures every offense that occurred within the incident. It records characteristics of the victims and offenders involved, and the relationship between them, where that's known. And it describes the circumstances of the incident. Most importantly, NIBRS removes the hierarchy rule: every offense in a multi-offense incident is now recorded separately, so less serious offenses no longer disappear from the count.

Side Effect

Why Switching to NIBRS Raises Counts

That improvement creates a problem of its own. Before, a multi-offense incident added one offense to the count. After the switch, it adds every offense it contained. So a jurisdiction that begins reporting through NIBRS will typically show a rise in its total offense count, purely from the counting change, with no real change in offending. Anyone comparing figures across the transition must account for this first; only then can they draw conclusions about actual trends.

New Approach

Asking the Public About Victimization

A victimization survey takes a completely different approach. It asks a sample of the public directly about offenses they personally experienced, without relying on what was reported to police. The best-known American example is the National Crime Victimization Survey, administered by the Bureau of Justice Statistics. If Dana's household were sampled, and the theft fell within the survey's window, it could be counted after all.

Survey Design

Household Samples and the Reference Period

Its design uses a household sample: a set of households selected to represent the wider population. Members of those households are asked about their experiences over a defined reference period, typically the preceding six months. Because it asks respondents directly, the survey can capture offenses never reported to police. That offers a view of the dark figure of crime that police data structurally can't provide.

Blind Spots

What Household Surveys Can Never See

A household survey has structural blind spots of its own. It can't capture offenses against people outside its sampling frame: for example, people without a stable household address. It can't capture offenses without an individual victim to interview, like many offenses against organizations, or against the public at large. And there's one serious offense it can never capture at all. Which one? Pause, and think. Homicide. The one person who could report the offense is no longer available to be surveyed. So homicide must be measured another way: through police records, and vital-statistics records. Notice the pattern: each instrument's design determines exactly what it can, and can't, see.

Survey Limitations

Recall, Telescoping, Definitions, and Non-Response

Beyond those blind spots, victimization surveys carry the limitations of any survey. Recall error occurs when a respondent misremembers whether, or when, an event occurred. Telescoping is a specific form: the respondent reports an event as more recent than it really was, pulling it into the reference period, so it inflates the count. Definitions cause trouble too: a respondent's understanding of a word like assault may not match the survey's technical definition, causing over-reporting or under-reporting. Finally, non-response: selected people can't be reached, or decline; if they differ systematically from those who respond, the results will be biased.

Definition

Self-Report Studies Ask About Offending

A self-report study flips the question around: instead of asking what offenses people experienced, it asks what offenses they themselves committed. These studies are most often conducted with specific, accessible populations, such as students. They're especially useful for offenses that rarely come to police attention at all, including many forms of substance use, and minor property offenses.

Honesty Problem

Validity Checks on Self-Reported Conduct

The obvious challenge is honesty, because respondents must disclose their own conduct. So researchers build in validity checks. One check asks about a fictitious offense: anyone admitting to it may be over-reporting. Another compares a subsample of answers against official records, where those are available, to assess how honestly respondents are answering.

Big Idea

Three Instruments, Three Reasons to Diverge

So police data, victimization surveys, and self-report studies aren't three attempts at the same measurement. They're three different instruments, built to answer different questions, and each has a systematic reason to diverge. Police data reflect what victims chose to report, and what agencies chose to record. Victimization surveys reflect what a sampled household will disclose to an interviewer about the reference period. Self-report studies reflect what respondents are willing to admit about their own conduct.

Figure

Overlapping Circles of Agreement and Gaps

Figure 3.3.1 shows the three sources as overlapping circles, for a single offense type. The center is the region of agreement: offenses all three sources would capture. Outside the overlap, police data miss unreported offenses, and household surveys miss offenses outside their sampling frame. So disagreement among them is expected, not a sign that one source is simply wrong.

Key Concept

Triangulation Across Imperfect Sources

The practical response to imperfect sources is triangulation: drawing on more than one imperfect source, and treating agreement as stronger evidence. When all three sources point the same way, a researcher can be more confident in the finding. When they disagree, the disagreement itself is informative: it usually points to the specific stage where the sources diverge. That might be reporting, recording, sampling, or disclosure; it rarely settles which single source is correct.

Extensions

Specialized Collections Add Narrower Detail

Several specialized collections extend measurement into narrower areas. Supplementary Homicide Reporting gathers extra incident detail specific to homicide cases. Victimization supplements attach additional questions to an existing survey, to study a narrower population or offense. These are extensions of the three main approaches, not a fourth independent method.

Comparison Table

Comparing Sources on Four Dimensions

Table 3.3.1 compares the three sources on four dimensions. What's counted: police data count offenses reported and recorded; surveys, offenses people recall experiencing; self-reports, offenses people recall committing. Who's missed: unreported and unrecorded offenses; people outside the frame, and offenses with no interviewable victim; and respondents unwilling to disclose. The errors: reporting and recording decisions; recall error, telescoping, and non-response; and under- or over-disclosure. And what each best answers: what reaches police and how agencies respond; how much goes unreported, and who is victimized; and how common an offense is in a population.

Choosing a Source

Let the Research Question Decide

The choice of source should follow from the question. To study police workload across precincts, use police data, because the question is about what reaches police. To count people who experienced an offense they never reported, use a victimization survey. To study substance-related conduct in a specific population, use a self-report study; police and victimization data would miss much of it. And to study national trend direction across decades, use whichever source was measured most consistently: consistency of method matters more than which source you choose.

Worked Example

Priya's Choice for a Rarely Reported Offense

Now consider Priya, a researcher studying a rarely reported offense within a defined population. Police data would capture only a small fraction, understating the true frequency. So which should she choose: a victimization survey, or a self-report study? Pause, and decide what it depends on. It depends on the offense. She chooses a victimization survey if the offenses typically have an identifiable victim, willing to be interviewed. If asking respondents about their own conduct captures the offense better, she chooses a self-report study.

Practice

Matching Published Claims to Their Sources

Let's apply these ideas to some published claims. A claim that most offenses of a type go unreported most likely rests on a national victimization survey; its limits include the sampling frame, recall error, and non-response. A claim that a jurisdiction's clearance rate rose comes from official police data: remember, a clearance isn't a conviction, and recording practices can shift. A finding of high self-admitted minor offending in one group comes from a self-report study: it describes a specific population, and depends on honest disclosure. A claim about the offenses within multi-offense incidents comes from incident-based data, which isn't directly comparable with older summary counts. And for homicide, expect police and vital-statistics records to show the highest count, since surveys can't capture it.

Key Takeaways

Recap of Measures, Limits, and Triangulation

Let's recap. NIBRS records every offense in each incident, so a switch to it can raise counts with no change in crime. Victimization surveys see unreported crime, but miss people outside the frame, victimless offenses, and homicide, and carry recall and response errors. Self-report studies capture offenses that rarely reach police, with validity checks on honesty. The three sources are expected to disagree, so triangulate, and let the question choose the source.

About Criminology at UPI Study

Criminology (Criminology 150) is a self-paced online course of 91 video lessons in 21 chapters, from classical criminology and crime data to theories of crime, victims, policing, courts and corrections. It carries a NCCRS credit recommendation for 3 semester credits.

Every lesson transcript is free on pages like this one, and the videos are free with a free UPI Study account. Enrolling adds a practice quiz after each lesson, the graded work and final exam that earn the credit, lifetime access, and an official transcript on completion. UPI Study has helped over 130,000 students with college credits. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Enroll now → Course details Download the syllabus Every course with PRO →

Why take it here

Why students take Criminology with UPI Study

Understand crime and justiceCriminology explains why crime happens, how it is measured and how the justice system responds. It is a core course for criminal justice, sociology, psychology, law and policing degrees.
Credit at a fraction of the priceThe same 3 credits can cost $750 or more at a US college. Here it is one payment, self-paced, with lifetime access.
Finish your degree soonerTransfer credits reduce the courses you still owe, so you can graduate earlier or lighten a heavy semester.
Strengthen an applicationA completed college-level course on an official transcript shows admissions and scholarship committees you can do the work.
Study on your own scheduleNo start dates, no deadlines. Watch the lessons, practice, and take the final when you are ready.
130,000+students helped with college creditsACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Where the credit goes

Universities that work with NCCRS

Criminology carries a NCCRS credit recommendation. These universities work with NCCRS; some are UPI Study's signed partners. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Thomas Edison State UniversityThomas Edison State UniversitySigned partnerUniversity of the PeopleUniversity of the PeopleSigned partnerCharter Oak State CollegeCharter Oak State CollegeSigned partnerStrayer UniversityStrayer UniversitySigned partnerColumbia Southern UniversityColumbia Southern UniversitySigned partnerIndiana TechIndiana TechSigned partnerPenn StatePenn StateWorks with NCCRSSouthern New Hampshire UniversitySouthern New Hampshire UniversityWorks with NCCRSSUNYSUNYWorks with NCCRS +many more cooperating universitiesFind my college →

Find my college → Not listed? Ask Athena in the corner of this page, or book a 15-minute call.

FAQ

Questions students ask us

About Crime Measurement Programs and Victim and Self-Report Survey Methods

Why does switching to NIBRS make a jurisdiction's crime count go up?
Switching to NIBRS raises counts because it records every offense in a multi-offense incident, while the older Summary Reporting System's hierarchy rule counted only one. A jurisdiction can show a rise purely from the counting change, with no real increase in offending. Anyone comparing figures across the transition must account for this first.
What can the National Crime Victimization Survey measure that police data can't?
The National Crime Victimization Survey, run by the Bureau of Justice Statistics, can capture crimes never reported to police, offering a view of the dark figure of crime. It asks a household sample about experiences during a reference period, typically the preceding six months. Its limits include recall error, telescoping, non-response, and missing homicide.
Why can't a victimization survey measure homicide?
A victimization survey can't measure homicide because the one person who could report the offense, the victim, is no longer available to be interviewed. Homicide must be measured through other sources, such as police records and vital-statistics records. This shows how each instrument's design determines what it can and can't see.
How do self-report studies check whether respondents are being honest?
Self-report studies use validity checks to assess honesty. One check asks about a fictitious offense, so anyone admitting to it may be over-reporting. Another compares a subsample of answers with official records, where those exist. These checks matter because respondents must disclose their own conduct, such as substance use or minor property offenses that rarely reach police.

About the Criminology course

How many college credits is Criminology?
Criminology (Criminology 150) carries a NCCRS credit recommendation for 3 semester credits. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.
How much does Criminology cost and what is included?
$250, paid once, with lifetime access: all 91 video lessons, a practice quiz after each, the graded work and final exam, and an official transcript when you finish. Students who want several courses choose UPI Study PRO instead.
Which universities accept UPI Study credits?
UPI Study has signed partner agreements with universities such as Thomas Edison State University, University of the People and Charter Oak State College, and works with universities such as Penn State, SNHU and SUNY. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities. Use "Find my college" on this page to check yours.
How long does Criminology take?
It is self-paced with no deadlines. The 91 lessons total about 4 hours of video; most students add reading and practice time and finish in a few weeks to a few months, on their own schedule.
How are the exams done?
Quizzes and assignments are online in the course. The final exam is taken online with proctoring; a person on the UPI Study team checks assignments, usually within two days.
How do my credits reach my college?
When the course shows 100% complete, request the official transcript from your dashboard. It is sent to the college you name, and you can send it to more than one. Check your college first with "Find my college" on this page, or ask Athena.

Ready for the full course? Earn 3 credits in Criminology.

91 video lessons, a quiz after each one, and the graded work that earns the credit. Recommended for credit by NCCRS.

Enroll in Criminology →Download the syllabusEvery course with PRO →
Criminology
3 credits · NCCRSEnroll →