Outcome Measures and PROMs

Patient-Reported Outcome Measures (PROMs) capture the patient's perspective on pain, function, and quality of life without clinician interpretation. The MCID (Minimal Clinically Important Difference) defines the smallest change that patients perceive as meaningful—compare observed change to MCID, not just p-values. PROMs are classified as generic (SF-36, EQ-5D—compare across conditions), region-specific (DASH for upper limb, LEFS for lower limb), or joint/disease-specific (WOMAC for hip/knee, ODI for spine—most sensitive to pathology). Key measurement properties are validity (measures what it claims), reliability (consistent results), and responsiveness (detects change over time). Floor and ceiling effects greater than 15% indicate the measure cannot detect deterioration or improvement respectively.

What are PROMs?

Patient-Reported Outcome Measures (PROMs) are standardized, validated questionnaires that patients complete without clinician interpretation. They capture the patient perspective on health status, symptoms, function, and quality of life.

Why PROMs Matter:

• Patient-Centered Care: Surgeon assessment may not match patient experience
• Quantifies Subjective Outcomes: Pain, function, satisfaction cannot be objectively measured
• Value-Based Care: Payers increasingly link reimbursement to patient-reported outcomes
• Quality Improvement: Registries (AOANJRR) use PROMs to benchmark performance
• Research: Essential for clinical trials to demonstrate treatment efficacy

PROM vs Clinician-Reported Outcomes:

• PROMs capture what matters to patients (pain, daily activities, quality of life)
• Clinician measures (ROM, strength) important but may not correlate with patient satisfaction
• Best practice: Use both PROMs and objective measures

Outcome measurement rests on a hierarchy: what you measure, how you measure it, and how you interpret it. The WHO ICF framework (body structure/function, activity, participation) is a useful map - PROMs predominantly capture the activity and participation levels, while clinician measures (range of motion, strength, radiographs) capture body structure and function.

Types of outcome:

• Patient-Reported Outcome Measures (PROMs) - the patient's own rating of symptoms, function and quality of life, with no clinician interpretation.
• Clinician-Reported Outcomes (ClinROs) - examiner-derived (range of motion, Constant strength, neurological grade).
• Performance Outcomes (PerfOs) - observed task performance (Timed Up-and-Go, six-minute walk).
• Composite scores - blend domains (e.g. Constant-Murley combines patient pain with examiner-measured strength and range), which improves breadth but can obscure which domain drives a change.

Anchoring concepts for interpretation:

• MCID - smallest change a patient perceives as worthwhile (see dedicated section).
• PASS (Patient Acceptable Symptom State) - the post-treatment score above which a patient considers their state satisfactory; increasingly preferred to MCID because it reports an attainable end state rather than a change.
• SCB (Substantial Clinical Benefit) - a higher threshold than MCID denoting a large, clearly meaningful improvement.
• Floor and ceiling effects - distort responsiveness when too many patients cluster at the extremes.

A good study pre-specifies a single primary PROM, justifies it on measurement properties, and reports both mean change versus MCID and the proportion of patients reaching MCID or PASS.

Generic PROMs

Purpose: Assess overall health status across any condition. Allow comparison between different diseases and populations.

Joint-Specific PROMs

Choosing Between PROMs: A Comparison

The most common exam error is treating all PROMs as interchangeable. The table below contrasts the major instrument types so you can justify a choice under viva pressure.

PROM science is evolving and several issues remain genuinely unsettled - useful "areas of debate" answers in a viva.

Validity

Definition: Does the measure assess what it claims to assess?

Reliability

Definition: Does the measure give consistent results when condition is stable?

Responsiveness

Definition: Can the measure detect clinically meaningful change over time?

Floor Effect: High proportion (over 15%) score at minimum (worst possible).

• Problem: Cannot detect worsening in these patients.

Ceiling Effect: High proportion score at maximum (best possible).

• Problem: Cannot detect improvement in these patients.

Responsiveness Index: Standardized Response Mean (SRM) or Effect Size.

• SRM greater than 0.8: Large responsiveness (good)
• SRM 0.5 to 0.8: Moderate responsiveness
• SRM less than 0.5: Small responsiveness (may miss change)

Understanding responsiveness prevents choosing measures that cannot detect improvement.

What is MCID?

Definition: The smallest change in PROM score that patients perceive as beneficial and would mandate a change in management.

Purpose: Distinguish statistically significant from clinically meaningful change.

How MCID is Determined

Methods:

1. Anchor-Based: Compare PROM change to external anchor (patient global assessment)

   • "Compared to before surgery, how would you rate your improvement: Much better, Better, Same, Worse?"
   • Calculate MCID as mean change for "Better" group.

2. Distribution-Based: Use statistical thresholds (0.5 SD, Standard Error of Measurement)

   • MCID = 0.5 × standard deviation
   • Less clinically intuitive than anchor-based.

Clinical Application:

• If mean improvement = 8 points and MCID = 10 points → Improvement is statistically significant but NOT clinically meaningful.
• If 95% CI = 12 to 18 points and MCID = 10 → Entire CI exceeds MCID → Clinically meaningful improvement.

Always compare treatment effects to MCID, not just p-values.

PROM collection has shifted from research tool to routine quality infrastructure worldwide, but the chosen instruments, mandate and uptake vary by region.

Global epidemiology and uptake. Joint arthroplasty is among the most-studied PROM settings: large registry programmes consistently show that the majority of hip and knee replacement patients achieve improvements exceeding the MCID at one year, while a meaningful minority (commonly cited around one in five for knees) report being unsatisfied - a gap PROMs make visible that complication rates alone miss. Uptake is high in publicly funded, registry-linked systems and far patchier where collection is voluntary or unfunded.

Guidance and Registry Programmes Side by Side

Methodological standards. The COSMIN initiative (Mokkink and colleagues) provides the most widely cited international consensus framework for selecting and appraising PROMs, complementing earlier quality criteria. ICHOM standard sets push toward globally comparable outcome reporting.

High- versus limited-resource practice variation. In well-resourced, registry-linked systems, electronic PROM (ePROM) capture is increasingly embedded in routine care, enabling case-mix-adjusted benchmarking. In limited-resource settings, barriers include literacy and language (validated translations are not universal), lack of electronic infrastructure, staffing for follow-up, and the cost of licensed instruments - so brief, free, culturally validated tools (and pragmatic VAS/EQ-5D use) are favoured. The principle that statistical significance does not equal clinical significance, and that MCID/PASS should anchor interpretation, applies in every setting regardless of resource level.