Goal Setting, Evaluation, and Performance Monitoring

UPI Study › Courses › Healthcare Organization and Management › Free lessons › Lesson 9.4 Free with a free account

Goal Setting, Evaluation, and Performance Monitoring

Healthcare Organization and Management · Chapter 9: Goal Setting, Analysis Tools, and Strategic Alignment in HealthcareSection 9.4 · lesson 57 of 10510 min · free with a free account

← PESTLE Analysis and Root Cause AnalysisNext lesson: Integrating Analytical Frameworks into Strategic Planning →

Earn 3 college credits for Healthcare Organization and ManagementRecommended for credit by NCCRS · Health 302 · self-paced · one payment, lifetime access
Enroll in Healthcare Organization and Management · $250 →Download the syllabus (PDF)

In this lesson

Judging whether goals were truly met, why, and at what cost.

  • Apply three evaluation questions to a completed goal
  • Compare absolute, relative, improvement-rate, and threshold targets
  • Use balancing measures and data checks before judging performance
  • Choose among continuing, adjusting, scaling, and stopping after an evaluation

Free study notes

Get this lesson's notes by email

The key points and 4 practice questions with answers, in your inbox. One email, free.

One email. Unsubscribe in one click.

Transcript

Everything said in the video, section by section (1,365 words). Read along, or search it.

Opening Case

A Twenty-Four Percent Drop in Waits

Hugo Lindgren runs rehabilitation services at Larkfield. His goal for the year: cut the median wait from referral to a first outpatient therapy visit by twenty percent. The year is over. The median fell by twenty-four percent. His report to the chief financial officer is due next week, and it looks like an easy win. But Hugo has noticed something. Patients now seem to wait longer for their second visit. So did he actually achieve his goal?

Three Questions

Achieved, Caused, and Worth It

Hugo's goal was well written. It passes the SMART test George Doran proposed in 1981: specific, measurable, assignable, realistic, and time-related. Today the letters often read achievable and relevant. Farah Siddiqui, the quality director, adds: a SMART goal says what to hit. It doesn't say whether you hit it. An evaluation has to answer three questions, in order. Was it achieved? Did the measure reach the target, through real change rather than a measurement quirk or ordinary variation? Was it achieved because of what we did? And was it worth achieving: did it deliver the benefit it stood for, and what did it cost elsewhere? Answer only the first, and you can report, but you can't learn.

Baselines

Recording a Baseline Before Work Starts

Everything rests on the baseline. A target without one can't be assessed. A retrospective baseline, built after the goal is set from whatever data exists, has a specific flaw. The period chosen shapes the result, and whoever chooses it usually knows which period would be convenient. Start from an unusually bad month, and any later movement looks like improvement. A usable baseline covers enough periods to show ordinary variation. It uses the same definition as the target measure. And it's recorded before the work begins. Hugo's team recorded twelve months before the year started. That part is solid.

Target Types

Absolute, Relative, Rate, and Threshold

Tom Brennan, the finance chief, says a target's form changes behavior. An absolute target states a level: every clinic at a median of twenty-one days. It's clear, and unfair to clinics starting far apart. A relative target ranks against others: be in the region's top half. It adjusts for shared conditions, but a clinic can improve and still fail, and half must fail by design. An improvement-rate target cuts your own baseline by a set share, like Hugo's twenty percent. It's fairest across starting points, but penalizes a unit already doing well, and rewards one that slipped first. A threshold target sets a limit: nobody waits over sixty days. It suits safety measures, but gives no reason to beat the line. So pair it: a rate, with a threshold underneath.

Ceilings and Floors

How Much Room a Measure Has

Two more traps hide in the measure itself. A ceiling is a measure with little room left. A unit at ninety-eight percent compliance can't show progress, however hard it works. Setting it another target just aims effort where the return is lowest. A floor is the reverse: a measure so poor that early gains come fast. The organization concludes the method works brilliantly, when it mostly picked up the easy part. Both distort comparisons between units. Before setting a target, ask how much room the measure really has.

Quick Check

Fifteen Percent for Every Clinic

Quick check. Each of Larkfield's eight clinics must cut its own no-show rate by fifteen percent from last year. Which clinic does this target treat most unfairly? Pause, and decide. The clinic with the lowest no-show rate. It's an improvement-rate target, and the best clinic has the least room left, so its fifteen percent is the hardest to find. The highest rate is tempting, because it has the most to fix. But that clinic has plenty of room. A threshold underneath would cover the gap.

Attribution

Naming Confounders Before Concluding

Now the second question: was it because of us? In a hospital, the usual confounders are staffing, demand, another project running at once, a definition or system change, or new management. Hugo's list has two. A new therapist started in month five. And a new scheduling system arrived in month seven. Three practices help. Name the confounders before concluding, not in a closing caveat. Check that the timing fits: an effect that appears before the change was made argues against it. And test the middle step. If a change was meant to work through a mechanism, that mechanism should look different. If it doesn't, the result moved for another reason.

Balancing Measures

Watching the Second-Visit Gap

The third question, was it worth it, needs a balancing measure: something that would move the wrong way, if the goal were met by exporting a problem rather than solving it. Hugo's is the gap between a patient's first and second visit. Through month five, it held steady. From month six, as first visits sped up, the gap began to grow. Other pairs follow the same logic. Length of stay pairs with readmissions. Cost per case pairs with an outcome. Throughput pairs with staff absence and turnover, because overwork shows there first. The balancing measure doesn't need to be perfect. It needs to sit in the same report, so nobody discusses the gain without seeing the cost.

Data Checks

Drift, Completeness, and System Change

Before interpreting any movement, three data checks take minutes. Definition drift: did what the measure counts change during the period? Completeness: did the share of activity being recorded change? An apparent improvement is often a drop in recording. And system change: did a new system, a coding update, or a new data source put a step in the series? Farah finds one. The new scheduling system starts the clock when a referral is triaged, not when it arrives. From month seven, the measure counts a shorter interval. The standing rule: a step change in a series is a data question before it's a performance question.

Mixed Results

Four Patterns Beyond Pass or Fail

Most evaluations aren't a clean pass or fail. Four patterns recur. Partial achievement: a big move that missed the target. Ask whether the target was reachable at all. Achievement with harm elsewhere: the target was met, and a balancing measure got worse. That's a failure. Reporting it as success is the dishonesty that wrecks a measurement system's credibility. Achievement without sustainment: met during the period, then slid back, which usually means it rested on effort, not on a changed process. And achievement by measurement artifact: the number moved and reality didn't, through a definition, completeness, or recording change.

Quick Check

A Hand-Hygiene Gain That Slipped

Quick check. Hand-hygiene audits on 4 South hit the ninety-five percent target during a spring campaign. By the fall, they're back near seventy-eight percent. Which pattern is this? Pause, and decide. Achievement without sustainment. The target was truly met, then lost once the campaign's extra effort ended. The process itself never changed. Partial achievement is tempting, because the final number misses. But the target was reached. The problem is what happened after.

Evaluation Decisions

Continue, Adjust, Scale, or Stop

An evaluation should end in one of four named decisions: continue unchanged, adjust the approach, scale to other units, or stop. Stopping is the least used and the most valuable. It's rare because a stop looks like failure, and someone sponsored the work. Three things make it possible: setting the stop rule in advance, treating a stop as a good use of an evaluation, and having someone other than the sponsor make the call. Scaling needs caution too. A result from one unit is a result from one unit, so record the conditions it depended on before copying it anywhere.

Case Resolved

Adjusting Instead of Celebrating

Back to Hugo's report to Tom. He puts the balancing measure beside the wait, at the same size. He names the new therapist and the new clock as confounders, up front. He separates measured from inferred: the early months look like real process change, but part of the later drop is the clock, and part is patients waiting for second visits instead. He states what would change his conclusion: re-running the series on the old definition. And he recommends adjusting, not celebrating. Next year's target becomes a pair: cut the first-visit wait again, with a limit underneath, no second visit more than fourteen days after the first.

Key Takeaways

Evaluate Honestly and Pair Measures

To recap. Ask three questions: was it achieved, was it because of us, and was it worth it? Record a baseline before the work begins, on the same definition. Pair an improvement-rate target with a threshold underneath. Check the data for drift, gaps, and system changes before judging performance. And report the balancing measure at the same prominence as the win.

About Healthcare Organization and Management at UPI Study

Healthcare Organization and Management (Health 302) is a self-paced online course of 105 video lessons in 18 chapters, from health systems and the law to ethics, leadership, teams, strategy, informatics, finance, quality, human resources, marketing and evidence-based practice. It carries a NCCRS credit recommendation for 3 semester credits.

Every lesson transcript is free on pages like this one, and the videos are free with a free UPI Study account. Enrolling adds a practice quiz after each lesson, the graded work and final exam that earn the credit, lifetime access, and an official transcript on completion. UPI Study has helped over 130,000 students with college credits. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Enroll now → Course details Download the syllabus All Health courses Every course with PRO →

Why take it here

Why students take Healthcare Organization and Management with UPI Study

How hospitals and clinics are runHealthcare Organization and Management covers how care organizations are led and run: health law and ethics, leadership and teams, strategic planning, health informatics, budgets, quality improvement, staffing and marketing. It is a core course in healthcare administration and health management degrees.
Credit at a fraction of the priceThe same 3 credits can cost $750 or more at a US college. Here it is one payment, self-paced, with lifetime access.
Finish your degree soonerTransfer credits reduce the courses you still owe, so you can graduate earlier or lighten a heavy semester.
Strengthen an applicationA completed college-level course on an official transcript shows admissions and scholarship committees you can do the work.
Study on your own scheduleNo start dates, no deadlines. Watch the lessons, practice, and take the final when you are ready.
130,000+students helped with college creditsACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Where the credit goes

Universities that work with NCCRS

Healthcare Organization and Management carries a NCCRS credit recommendation. These universities work with NCCRS; some are UPI Study's signed partners. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.

Thomas Edison State UniversityThomas Edison State UniversitySigned partnerUniversity of the PeopleUniversity of the PeopleSigned partnerCharter Oak State CollegeCharter Oak State CollegeSigned partnerStrayer UniversityStrayer UniversitySigned partnerColumbia Southern UniversityColumbia Southern UniversitySigned partnerIndiana TechIndiana TechSigned partnerPenn StatePenn StateWorks with NCCRSSouthern New Hampshire UniversitySouthern New Hampshire UniversityWorks with NCCRSSUNYSUNYWorks with NCCRS +many more cooperating universitiesFind my college →

Find my college → Not listed? Ask Athena in the corner of this page, or book a 15-minute call.

FAQ

Questions students ask us

About Goal Setting, Evaluation, and Performance Monitoring

What does SMART stand for in goal setting?
In George Doran's 1981 version, SMART stands for specific, measurable, assignable, realistic, and time-related. Many people now read the letters as achievable and relevant. A SMART goal says what to hit, but not whether it was hit. Evaluation asks whether it was achieved, whether it was achieved because of the work done, and whether it was worth achieving.
What makes a good baseline for measuring a performance goal?
A good baseline covers enough periods to show ordinary variation, uses the same definition as the target measure, and is recorded before the work begins. Without a baseline, a target cannot be assessed. A retrospective baseline, built after the goal is set from whatever data exists, is risky because the chosen period shapes the result. Starting from an unusually bad month makes any later movement look like improvement.
What are the pros and cons of an improvement-rate target?
An improvement-rate target asks each unit to cut its own baseline by a set share, such as 20 percent. It is fairer than a single absolute level when units start far apart, but it penalizes units already doing well, which have little room left, and can reward a unit that slipped first. Pairing it with a threshold underneath, such as a maximum wait, covers that gap.
Why check the data before judging a change in performance?
An apparent improvement can come from the data rather than from reality. Three quick checks help: definition drift, where what the measure counts changed; completeness, where less activity was recorded; and system change, where a new system or coding update created a step in the series. A scheduling system that starts the clock at triage instead of arrival shortens the measured wait.

About the Healthcare Organization and Management course

How many college credits is Healthcare Organization and Management?
Healthcare Organization and Management (Health 302) carries a NCCRS credit recommendation for 3 semester credits. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities.
How much does Healthcare Organization and Management cost and what is included?
$250, paid once, with lifetime access: all 105 video lessons, a practice quiz after each, the graded work and final exam, and an official transcript when you finish. Students who want several courses choose UPI Study PRO instead.
Which universities accept UPI Study credits?
UPI Study has signed partner agreements with universities such as Thomas Edison State University, University of the People and Charter Oak State College, and works with universities such as Penn State, SNHU and SUNY. ACE and NCCRS have over 2,100 cooperating colleges that will consider accepting credits; the final decision is with the universities. Use "Find my college" on this page to check yours.
How long does Healthcare Organization and Management take?
It is self-paced with no deadlines. The 105 lessons total about 17 hours of video; most students add reading and practice time and finish in a few weeks to a few months, on their own schedule.
How are the exams done?
Quizzes and assignments are online in the course. The final exam is taken online with proctoring; a person on the UPI Study team checks assignments, usually within two days.
How do my credits reach my college?
When the course shows 100% complete, request the official transcript from your dashboard. It is sent to the college you name, and you can send it to more than one. Check your college first with "Find my college" on this page, or ask Athena.

Ready for the full course? Earn 3 credits in Healthcare Organization and Management.

105 video lessons, a quiz after each one, and the graded work that earns the credit. Recommended for credit by NCCRS.

Enroll in Healthcare Organization and Management →Download the syllabusEvery course with PRO →
Healthcare Organization and Management
3 credits · NCCRSEnroll →