Study Design Types

View larger

Randomized Controlled Trial (RCT)

Definition: Participants are randomly allocated to intervention or control groups, then followed prospectively to measure outcomes.

Key Features:

• Randomization: Eliminates selection bias and balances confounders
• Prospective: Follows participants forward in time
• Control Group: Provides comparison to measure treatment effect
• Blinding: Can be single-blind, double-blind, or triple-blind

Trial Hypothesis Frameworks: Superiority vs Non-Inferiority vs Equivalence

Beyond the structural variations above, RCTs differ by the question they are framed to answer:

• Superiority trial — tests whether the new treatment is better than the comparator (the default framework). Failing to show superiority does not prove equivalence.
• Non-inferiority trial — tests whether a new treatment is not worse than the standard by more than a pre-specified margin (Δ). Used when the new option has other advantages (cheaper, safer, less invasive, oral vs IV). The margin Δ must be defined and clinically justified in advance.
• Equivalence trial — tests whether two treatments are within a margin of each other in both directions (e.g. a biosimilar).

Strengths of RCTs:

• Highest level of evidence for therapeutic questions
• Minimizes bias and confounding
• Establishes causality

Limitations of RCTs:

• Expensive and time-consuming
• May not reflect real-world practice (narrow inclusion criteria)
• Not ethical for harmful exposures
• Not feasible for rare outcomes

Understanding these experimental designs is essential for critically appraising treatment studies.

Evidence Hierarchy Principles

The evidence hierarchy is fundamental to understanding study quality:

View larger

Level I Evidence: Systematic reviews/meta-analyses of RCTs, or individual high-quality RCTs

• Provides strongest evidence for causation
• Randomization controls for known and unknown confounders
• Gold standard for therapeutic questions

Level II Evidence: Prospective cohort studies, lesser-quality RCTs

• Cannot prove causation (association only)
• Prone to confounding and selection bias
• Appropriate when RCTs are not ethical/feasible

Level III Evidence: Case-control studies, retrospective cohort studies

• High risk of recall bias and selection bias
• Best for rare diseases or outcomes
• Establishes temporal relationship for case-control

Level IV Evidence: Case series, cross-sectional studies

• No comparison group (case series)
• Cannot establish temporal relationship
• Useful for describing disease characteristics

Level V Evidence: Expert opinion, case reports

• Lowest level of evidence
• Subject to individual bias and experience
• May generate hypotheses for future research

Cohort Studies

Definition: Follows groups with and without exposure forward in time to compare incidence of outcomes.

Types:

Case-Control Studies

Definition: Starts with cases (disease present) and controls (disease absent), then looks backward to compare exposure history.

Process:

1. Identify cases with the disease/outcome
2. Select controls without the disease (matched or unmatched)
3. Measure past exposure in both groups
4. Calculate odds ratio (OR)

Example: Compare patients with AVN (cases) to those without AVN (controls) to assess whether steroid use (exposure) was more common in cases.

Strengths:

• Efficient for rare diseases
• Faster and cheaper than cohort studies
• Can study multiple exposures
• Small sample size needed

Limitations:

• Cannot calculate incidence or relative risk (only OR)
• Prone to recall bias and selection bias
• Temporal relationship unclear
• Confounding common

Key Point: Case-control studies are Level III evidence - useful for rare outcomes but inferior to cohort studies for establishing causality.

Cross-Sectional Studies

Definition: Measures exposure and outcome at a single point in time (snapshot).

Uses:

• Prevalence surveys
• Screening studies
• Hypothesis generation

Example: Survey orthopaedic surgeons to measure prevalence of burnout and correlate with work hours.

Strengths:

• Quick and inexpensive
• Good for prevalence data
• Generates hypotheses

Limitations:

• Cannot establish causality
• Cannot measure incidence
• Temporal relationship unclear (which came first?)
• Survival bias

Case Series and Case Reports

Definition: Descriptive study of patients with similar condition - no comparison group.

Uses:

• Describe new diseases or rare conditions
• Report novel surgical techniques
• Generate hypotheses

Strengths:

• Simple to conduct
• Useful for rare conditions
• Hypothesis-generating

Limitations:

• No comparison group (no control)
• Cannot establish causality
• Selection bias
• Level IV evidence only

Understanding descriptive studies helps identify when stronger evidence is needed.

Study-design methodology is governed by international reporting standards and evidence-grading frameworks rather than disease-specific clinical guidelines. The dominant frameworks are convergent worldwide: CONSORT for trials, STROBE for observational studies, PRISMA for systematic reviews, and GRADE for rating certainty of evidence. National bodies layer their own evidence hierarchies on top of these, and large national arthroplasty registries supply the real-world observational evidence that complements the trial literature.

Reporting Standards and Evidence Frameworks (Side-by-Side)

Position of the Major Guideline Bodies

National Arthroplasty Registries (Global Practice Variation)

Registries demonstrate practice variation in real time: the AOANJRR famously identified poorly performing metal-on-metal hip resurfacing and large-head designs years before they were withdrawn, illustrating how high-completeness observational data can detect rare device failures that no individual RCT is powered to find. Registry effectiveness data (real-world, all-comers) complements RCT efficacy data (selected populations, ideal conditions).

A frequent exam trap is mislabelling a study design. Use the table below to separate designs that are commonly confused, based on the direction of enquiry and the measures they permit.

Research study designs form an evidence hierarchy with randomized controlled trials (RCTs) at the apex (Level I) because randomization eliminates selection bias and balances both known and unknown confounders. Cohort studies (Level II) follow exposed vs unexposed groups forward in time—best for rare exposures. Case-control studies (Level III) compare cases with disease to controls without, looking backward for exposures—best for rare outcomes. Observational designs are prone to confounding and bias requiring statistical adjustment. The key distinction is experimental (investigator assigns intervention) vs observational (investigator only observes), and internal validity (are results valid within the study?) vs external validity (can results be generalized?).