Monitoring & Evaluasi Program
Published on October 9, 2026
Feature | Detail |
|---|---|
Definition | The systematic collection and analysis of information about a health program's activities, characteristics, and outcomes to make judgments, improve effectiveness, and inform decision-making |
Core Purpose | To determine whether a program is doing what it is supposed to do, and whether the results justify the resources spent |
Foundational Framework | The Logic Model (Input, Process, Output, Outcome, Impact) |
Key Distinction | Program evaluation is not the same as research; evaluation aims to improve a program or inform a decision, while research aims to generate generalizable knowledge |
Who Uses It | Public health agencies, hospital administrators, government bodies, NGOs, accreditation organizations |
Common Exam Angle | Identifying the correct type of evaluation for a given scenario, distinguishing outputs from outcomes, and recognizing which part of the logic model a question is asking about |
Keywords in Vignettes | "Assess the effectiveness of the program," "determine whether the intervention achieved its goals," "monitor implementation," "quality improvement," "stakeholder," "process indicators," "outcome indicators" |
01Definition and Core Principles
Program evaluation is a systematic process of collecting and analyzing data to determine the merit, worth, or significance of a health program. It answers practical questions: Is this program reaching the right people? Is it being implemented as planned? Is it producing the intended results? Should it continue, be modified, or be discontinued?
The word "systematic" is critical. Program evaluation is not casual observation or anecdotal feedback. It follows a structured methodology, uses defined indicators, and produces evidence that stakeholders can act on.
A foundational principle tested on exams is the distinction between program evaluation and research. Although both use similar methods (surveys, data analysis, study designs), their purposes differ:
Purpose
Program Evaluation
Improve or judge a program
Research
Generate new generalizable knowledge
Audience
Program Evaluation
Program managers, funders, policymakers
Research
Scientific community
Generalizability
Program Evaluation
Findings apply to this program in this context
Research
Findings intended to apply broadly
Ethical oversight
Program Evaluation
May or may not require IRB review (depends on intent)
Research
Requires IRB review
Flexibility
Program Evaluation
Methods can be adapted mid-course as the program evolves
Research
Protocol is fixed to maintain internal validity
Feature | Program Evaluation | Research |
|---|---|---|
Purpose | Improve or judge a program | Generate new generalizable knowledge |
Audience | Program managers, funders, policymakers | Scientific community |
Generalizability | Findings apply to this program in this context | Findings intended to apply broadly |
Ethical oversight | May or may not require IRB review (depends on intent) | Requires IRB review |
Flexibility | Methods can be adapted mid-course as the program evolves | Protocol is fixed to maintain internal validity |
When a vignette describes a hospital measuring whether its new diabetes education program reduced HbA1c among its own patients, that is program evaluation. When a vignette describes a multicenter trial testing whether a new diabetes education curriculum reduces HbA1c in a generalizable population, that is research.
02The Logic Model
The logic model is the backbone of program evaluation. It maps the causal pathway from resources to long-term change. Every evaluation question can be traced to a component of this model.
Input
Definition
Resources, staff, funding, materials, infrastructure
Question It Answers
What do we invest?
Example (Tuberculosis Screening Program)
Trained community health workers, rapid diagnostic kits, funding from the ministry of health
Process (Activities)
Definition
What the program does with the inputs
Question It Answers
What do we do?
Example (Tuberculosis Screening Program)
Conducting door-to-door screening in high-prevalence districts, referring positive cases to treatment centers
Output
Definition
The direct, countable products of the activities
Question It Answers
What do we produce?
Example (Tuberculosis Screening Program)
5,000 households screened, 320 sputum samples collected, 280 referrals made
Outcome
Definition
The short-to-medium-term changes resulting from the outputs
Question It Answers
What changed?
Example (Tuberculosis Screening Program)
250 new TB cases detected and started on treatment, treatment initiation rate increased from 60% to 88%
Impact
Definition
The long-term, population-level effect
Question It Answers
What is the ultimate benefit?
Example (Tuberculosis Screening Program)
Decreased TB incidence and mortality in the district over 5 years
Component | Definition | Question It Answers | Example (Tuberculosis Screening Program) |
|---|---|---|---|
Input | Resources, staff, funding, materials, infrastructure | What do we invest? | Trained community health workers, rapid diagnostic kits, funding from the ministry of health |
Process (Activities) | What the program does with the inputs | What do we do? | Conducting door-to-door screening in high-prevalence districts, referring positive cases to treatment centers |
Output | The direct, countable products of the activities | What do we produce? | 5,000 households screened, 320 sputum samples collected, 280 referrals made |
Outcome | The short-to-medium-term changes resulting from the outputs | What changed? | 250 new TB cases detected and started on treatment, treatment initiation rate increased from 60% to 88% |
Impact | The long-term, population-level effect | What is the ultimate benefit? | Decreased TB incidence and mortality in the district over 5 years |
The Output vs. Outcome
This is the single most tested concept in program evaluation questions. Outputs measure effort and activity. Outcomes measure effect and change.
A program can have excellent outputs and poor outcomes. For example, a vaccination campaign may vaccinate 10,000 children (output), but if the cold chain was broken and the vaccines were ineffective, disease incidence does not change (outcome). Conversely, a program may have modest outputs but strong outcomes if it targets a highly effective intervention to the right population.
The exam tests whether you can tell the difference:
"Number of condoms distributed" = Output
"Reduction in new HIV infections" = Outcome
"Number of health education sessions conducted" = Output
"Increase in proportion of mothers practicing exclusive breastfeeding" = Outcome
"Decline in under-5 mortality rate over a decade" = Impact
03Types of Program Evaluation
This classification is heavily tested. You must know when each type applies.
Formative evaluation
When It Occurs
During program development or early implementation
What It Asks
Is the program designed well? Can it be improved before full rollout?
Logic Model Component
Input, early Process
Process evaluation (monitoring)
When It Occurs
During ongoing implementation
What It Asks
Is the program being delivered as planned? Are activities reaching the target population?
Logic Model Component
Process, Output
Outcome evaluation
When It Occurs
After sufficient implementation time
What It Asks
Did the program achieve its intended short- and medium-term effects?
Logic Model Component
Outcome
Impact evaluation
When It Occurs
Long-term, often years after implementation
What It Asks
Did the program produce lasting, population-level change? Can the change be attributed to the program?
Logic Model Component
Impact
Summative evaluation
When It Occurs
At the end of a program cycle or funding period
What It Asks
Should the program continue, expand, or be discontinued?
Logic Model Component
All components
Economic evaluation
When It Occurs
At any point
What It Asks
Is the program worth the cost?
Logic Model Component
Input vs. Outcome/Impact
Type of Evaluation | When It Occurs | What It Asks | Logic Model Component |
|---|---|---|---|
Formative evaluation | During program development or early implementation | Is the program designed well? Can it be improved before full rollout? | Input, early Process |
Process evaluation (monitoring) | During ongoing implementation | Is the program being delivered as planned? Are activities reaching the target population? | Process, Output |
Outcome evaluation | After sufficient implementation time | Did the program achieve its intended short- and medium-term effects? | Outcome |
Impact evaluation | Long-term, often years after implementation | Did the program produce lasting, population-level change? Can the change be attributed to the program? | Impact |
Summative evaluation | At the end of a program cycle or funding period | Should the program continue, expand, or be discontinued? | All components |
Economic evaluation | At any point | Is the program worth the cost? | Input vs. Outcome/Impact |
Formative vs. Summative
This is a classic exam pair. Formative evaluation happens during development to shape and improve the program. Summative evaluation happens at the end to judge whether the program worked. A useful mnemonic: formative evaluation helps you form the program; summative evaluation helps you sum up the program.
Process Evaluation
Process evaluation is the most practical and commonly conducted type. It does not ask whether the program works; it asks whether the program is being implemented correctly. Key process evaluation questions include:
Is the program reaching the intended population? (Coverage)
Are activities being carried out as designed? (Fidelity)
How many units of service were delivered? (Dose delivered)
How much of the intended intervention did participants actually receive? (Dose received)
How is the program perceived by participants and staff? (Satisfaction)
Process evaluation is essential because a program that appears to fail in an outcome evaluation may have failed not because the intervention was ineffective, but because it was never properly implemented. This concept is called a Type III error: concluding that a program does not work when in reality it was never delivered as intended.
Outcome vs. Impact Evaluation
Outcome evaluation measures proximal, program-level changes (e.g., increased knowledge, behavior change, clinical improvement). Impact evaluation measures distal, population-level changes (e.g., reduced disease burden, reduced mortality). Impact evaluation also attempts to establish causation: not just "did the indicator improve?" but "did it improve because of this program?" This is where quasi-experimental and experimental designs become relevant.
04Frameworks for Program Evaluation
Several structured frameworks guide how evaluation is planned and conducted. The exam may reference these by name.
CDC Framework for Program Evaluation
The most commonly cited framework in public health evaluation. It consists of six steps arranged in a cycle:
Step | Description |
|---|---|
1. Engage stakeholders | Identify who has a stake in the evaluation (funders, staff, community, policymakers) |
2. Describe the program | Define the program's mission, objectives, activities, and logic model |
3. Focus the evaluation design | Decide which questions the evaluation will answer and what methods to use |
4. Gather credible evidence | Collect data using appropriate indicators and methods |
5. Justify conclusions | Analyze data and interpret findings against agreed-upon standards |
6. Ensure use and share lessons learned | Disseminate findings to stakeholders and apply them to improve the program |
The concept tested most often from this framework is Step 1: stakeholder engagement. The exam may ask what the first step in planning a program evaluation is, and the answer is identifying and engaging stakeholders, not designing the data collection instrument.
Donabedian Model
Originally developed for healthcare quality assessment, this model is frequently tested:
Structure
Definition
The setting, resources, and organizational characteristics in which care is delivered
Example
Number of ICU beds, staff-to-patient ratio, availability of equipment
Process
Definition
What is actually done in giving and receiving care
Example
Adherence to clinical guidelines, time to antibiotic administration, hand hygiene compliance
Outcome
Definition
The effects of care on the health status of patients and populations
Example
Mortality rate, readmission rate, patient satisfaction, complication rate
Component | Definition | Example |
|---|---|---|
Structure | The setting, resources, and organizational characteristics in which care is delivered | Number of ICU beds, staff-to-patient ratio, availability of equipment |
Process | What is actually done in giving and receiving care | Adherence to clinical guidelines, time to antibiotic administration, hand hygiene compliance |
Outcome | The effects of care on the health status of patients and populations | Mortality rate, readmission rate, patient satisfaction, complication rate |
Donabedian's key insight: good structure facilitates good process, and good process leads to good outcomes. However, the relationship is not guaranteed. A well-equipped hospital (structure) may still have poor guideline adherence (process), leading to poor outcomes.
Exam questions on Donabedian typically present a quality indicator and ask you to classify it as structure, process, or outcome:
"Percentage of patients with acute MI who received aspirin within 24 hours" = Process
"30-day mortality after acute MI" = Outcome
"Availability of a cardiac catheterization lab" = Structure
RE-AIM Framework
Used to evaluate the public health impact of interventions. Each letter represents a dimension:
Dimension | Question |
|---|---|
Reach | What proportion of the target population participated? |
Efficacy/Effectiveness | Did the intervention produce the intended outcome? |
Adoption | What proportion of settings or institutions adopted the intervention? |
Implementation | Was the intervention delivered as intended (fidelity)? |
Maintenance | Were the effects sustained over time? Was the program institutionalized? |
05Indicators and Measurement
An indicator is a measurable variable used to track whether a program is achieving its objectives. Choosing the right indicator is a frequently tested skill.
Input indicator
What It Measures
Resources allocated
Example
Budget spent, number of health workers deployed
Process indicator
What It Measures
Activities performed
Example
Number of prenatal visits conducted per month
Output indicator
What It Measures
Products delivered
Example
Number of insecticide-treated nets distributed
Outcome indicator
What It Measures
Changes in behavior, knowledge, or health status
Example
Proportion of children sleeping under treated nets
Impact indicator
What It Measures
Long-term population-level change
Example
Malaria incidence per 1,000 population
Indicator Type | What It Measures | Example |
|---|---|---|
Input indicator | Resources allocated | Budget spent, number of health workers deployed |
Process indicator | Activities performed | Number of prenatal visits conducted per month |
Output indicator | Products delivered | Number of insecticide-treated nets distributed |
Outcome indicator | Changes in behavior, knowledge, or health status | Proportion of children sleeping under treated nets |
Impact indicator | Long-term population-level change | Malaria incidence per 1,000 population |
Good indicators are SMART: Specific, Measurable, Achievable, Relevant, and Time-bound. An exam question may present a vague program objective (e.g., "improve maternal health") and ask you to select the indicator that best measures whether the objective was met. The correct answer will be the one that is quantifiable and directly linked to the objective (e.g., "proportion of deliveries attended by a skilled birth attendant" rather than "number of health education pamphlets printed").
06Economic Evaluation in Program Evaluation
Economic evaluation compares the costs and consequences of programs to determine value. This often appears as a sub-question within a program evaluation vignette.
Cost-minimization analysis
What It Compares
Costs only (outcomes assumed equal)
Unit of Outcome
None (outcomes equivalent)
When to Use
When two programs have been shown to produce the same outcome
Cost-effectiveness analysis (CEA)
What It Compares
Cost per unit of health outcome
Unit of Outcome
Natural units (e.g., cost per life saved, cost per case prevented)
When to Use
When comparing programs with the same type of outcome
Cost-utility analysis (CUA)
What It Compares
Cost per quality-adjusted outcome
Unit of Outcome
QALYs or DALYs
When to Use
When comparing programs with different types of outcomes across different diseases
Cost-benefit analysis (CBA)
What It Compares
Costs and outcomes both in monetary terms
Unit of Outcome
Monetary (dollars/rupiah)
When to Use
When comparing programs across entirely different sectors (health vs. education vs. infrastructure)
Type | What It Compares | Unit of Outcome | When to Use |
|---|---|---|---|
Cost-minimization analysis | Costs only (outcomes assumed equal) | None (outcomes equivalent) | When two programs have been shown to produce the same outcome |
Cost-effectiveness analysis (CEA) | Cost per unit of health outcome | Natural units (e.g., cost per life saved, cost per case prevented) | When comparing programs with the same type of outcome |
Cost-utility analysis (CUA) | Cost per quality-adjusted outcome | QALYs or DALYs | When comparing programs with different types of outcomes across different diseases |
Cost-benefit analysis (CBA) | Costs and outcomes both in monetary terms | Monetary (dollars/rupiah) | When comparing programs across entirely different sectors (health vs. education vs. infrastructure) |
The high-yield distinction: CEA uses natural health units and cannot compare across diseases. CUA uses QALYs/DALYs and can compare across diseases. CBA converts everything to money and can compare across sectors entirely.
07Differential Diagnosis: Evaluation vs. Similar Concepts
Clinical research / RCT
Why It Is Confused with Program Evaluation
Both assess whether an intervention works
Key Discriminator
Research seeks generalizable knowledge; evaluation seeks to judge or improve a program in context
Quality improvement (QI)
Why It Is Confused with Program Evaluation
Both aim to improve healthcare delivery
Key Discriminator
QI uses rapid, iterative cycles (Plan-Do-Study-Act) to make incremental changes within an institution; program evaluation is a broader, more formal assessment of an entire program
Surveillance
Why It Is Confused with Program Evaluation
Both involve ongoing data collection
Key Discriminator
Surveillance tracks disease occurrence in a population; it does not evaluate a program's performance
Audit
Why It Is Confused with Program Evaluation
Both measure performance against a standard
Key Discriminator
Audit checks compliance against a predefined standard (e.g., guideline adherence); evaluation assesses whether the program achieved its goals and why
Needs assessment
Why It Is Confused with Program Evaluation
Both involve systematic data collection before or during a program
Key Discriminator
Needs assessment occurs before a program is designed to identify the problem and target population; evaluation occurs during or after to assess the program's performance
Concept | Why It Is Confused with Program Evaluation | Key Discriminator |
|---|---|---|
Clinical research / RCT | Both assess whether an intervention works | Research seeks generalizable knowledge; evaluation seeks to judge or improve a program in context |
Quality improvement (QI) | Both aim to improve healthcare delivery | QI uses rapid, iterative cycles (Plan-Do-Study-Act) to make incremental changes within an institution; program evaluation is a broader, more formal assessment of an entire program |
Surveillance | Both involve ongoing data collection | Surveillance tracks disease occurrence in a population; it does not evaluate a program's performance |
Audit | Both measure performance against a standard | Audit checks compliance against a predefined standard (e.g., guideline adherence); evaluation assesses whether the program achieved its goals and why |
Needs assessment | Both involve systematic data collection before or during a program | Needs assessment occurs before a program is designed to identify the problem and target population; evaluation occurs during or after to assess the program's performance |
08Traps and High-Yield Pearls
The most common exam trap is confusing outputs with outcomes. A vignette will describe a program that trained 500 health workers and distributed 10,000 educational pamphlets, then ask whether the program was effective. Students who select "yes, the program achieved its goals" are choosing the wrong answer because those are outputs, not outcomes. Effectiveness is measured by whether the target population's health knowledge, behavior, or health status actually changed.
A second trap involves process evaluation vs. outcome evaluation. A vignette describing a program where the curriculum was delivered as planned and attendance was high is describing good process, not good outcomes. The program may have been perfectly implemented but still failed to change the outcome. When the question asks "what type of evaluation does this represent?" the answer is process evaluation, not outcome evaluation.
A third testing pattern involves the Donabedian model. Students often classify process indicators as outcome indicators. "Percentage of eligible patients who received prophylactic antibiotics before surgery" is a process indicator, not an outcome. "Surgical site infection rate" is the outcome. The rule is: if it describes what was done, it is process; if it describes what happened to the patient, it is outcome.
Finally, remember that stakeholder engagement is always the first step in planning a program evaluation. Before selecting indicators, designing surveys, or analyzing data, you must identify who needs the evaluation results and what decisions the evaluation will inform. This principle reflects the practical reality that an evaluation, no matter how rigorous, is useless if it does not answer the questions that the people with decision-making power are asking.