Machine learning for fracture detection, measurement and planning - decision support, not decision replacement
Detection: Fracture identification, abnormality flagging
Measurement: Automated angles, alignment metrics
Planning: Arthroplasty templating, surgical simulation
Prioritisation: Worklist triage by urgency
Key: AI augments clinical capability but requires human oversight
- AI tools are decision support - clinician remains responsible
- High sensitivity for fracture detection reduces missed injuries
- Best validated for wrist, hip, and chest radiograph applications
- Cannot replace clinical correlation and physical examination
- Regulatory clearance (FDA 510(k), CE/UKCA, or national equivalent) required for clinical use
- “AI assists detection but does not replace clinical decision-making
- “Deep learning uses convolutional neural networks (CNNs)
- “Performance depends on training data quality and diversity
- “Particularly useful for reducing missed fractures in ED
AI in radiology is an emerging topic. For fellowship exams, understand the basic concepts (machine learning, deep learning), current validated applications (fracture detection), limitations (training bias, cannot replace clinical judgement), and the medicolegal position (clinician responsibility remains).
AIAppraising an Imaging AI Tool
Hook:If a tool is not VALID for your jurisdiction and population, a high published AUC is irrelevant - never deploy on the vendor's numbers alone.
Overview & Core Principles

- Definition
- Machines performing tasks requiring human intelligence
- Example
- Any automated image analysis
- Definition
- Algorithms that improve through experience
- Example
- Learning from labelled examples
- Definition
- Neural networks with multiple layers
- Example
- Convolutional neural networks
- Definition
- Neural network for image analysis
- Example
- Fracture detection models
- Definition
- Labelled examples used to teach the algorithm
- Example
- Radiographs with/without fractures
- Definition
- Applying trained model to new data
- Example
- Analysing a new patient radiograph
Performance Metrics



- Definition
- True positive rate (detects fractures)
- Clinical Interpretation
- High = few missed fractures
- Definition
- True negative rate (correct negatives)
- Clinical Interpretation
- High = few false alarms
- Definition
- Positive predictive value
- Clinical Interpretation
- Probability positive result is true
- Definition
- Negative predictive value
- Clinical Interpretation
- Probability negative result is true
- Definition
- Area under ROC curve
- Clinical Interpretation
- Overall discriminative ability (0.5-1.0)
- Definition
- Harmonic mean of precision/recall
- Clinical Interpretation
- Balanced performance measure
Limitations

- Explanation
- Model reflects training data characteristics
- Mitigation
- Diverse, representative datasets
- Explanation
- Poor performance on unusual cases
- Mitigation
- Clinical oversight, flag uncertainty
- Explanation
- Cannot explain reasoning
- Mitigation
- Explainability research, heatmaps
- Explanation
- Garbage in, garbage out
- Mitigation
- Quality training data curation
- Explanation
- Approval slower than development
- Mitigation
- Use only approved tools clinically
- Explanation
- Technical/workflow barriers
- Mitigation
- PACS integration, user training
Regulatory and Medicolegal

- Requirement
- Medical device (software)
- Notes
- SaMD - Software as Medical Device (IMDRF framework)
- Requirement
- Required for clinical use in USA
- Notes
- 510(k) pathway most common for fracture AI
- Requirement
- Required in EU (MDR) and UK (UKCA)
- Notes
- Most fracture tools are MDR Class IIa/IIb
- Requirement
- Required in each jurisdiction
- Notes
- TGA (Australia), Health Canada, PMDA (Japan), CDSCO (India)
- Requirement
- Performance data required
- Notes
- Prospective, locally representative studies preferred
- Requirement
- Ongoing monitoring + drift detection
- Notes
- Report adverse events; monitor performance over time
Systematic Approach: A Negative AI Result Is Not a Differential
The most dangerous error is treating an AI "no fracture" output as a clinical answer. AI flags a pattern; the clinician must still work through the differential of why a region hurts despite a reassuring algorithm. The table below contrasts the entities a fracture-detection model is and is not built to resolve.
- Why AI may miss or mislabel it
- Often invisible on initial radiograph (AI trained on radiographs cannot see what is not yet visible)
- Clinical action that overrides AI
- Snuffbox tenderness - immobilise, repeat imaging or MRI at 10-14 days
- Why AI may miss or mislabel it
- Subtle trabecular disruption, frequent false negatives in osteopenic bone
- Clinical action that overrides AI
- Inability to weight-bear - CT or MRI regardless of AI output
- Why AI may miss or mislabel it
- Radiographically silent for 2-3 weeks; outside most training distributions
- Clinical action that overrides AI
- History (load change, metabolic risk) - MRI or bone scan
- Why AI may miss or mislabel it
- Model trained on traumatic fractures may not flag underlying lesion
- Clinical action that overrides AI
- Atraumatic mechanism, lytic/blastic clues - cross-sectional imaging, oncology referral
- Why AI may miss or mislabel it
- AI detects the fracture, not the pattern or social context
- Clinical action that overrides AI
- Recognise inconsistent history, multiple ages of injury - safeguarding pathway
- Why AI may miss or mislabel it
- Fracture model has no class for ligament or tendon
- Clinical action that overrides AI
- Examination, stress views, MRI / ultrasound
- Why AI may miss or mislabel it
- Unusual projection, hardware, paediatric physis, rare anatomy degrades performance
- Clinical action that overrides AI
- Treat AI output as unreliable; rely on clinical reasoning
AIWhy a 'Negative' AI Result Never Excludes a Fracture
Hook:The classic trap: AI says 'no fracture', the patient has snuffbox tenderness - you still treat as a scaphoid fracture. Clinical suspicion always wins.
Guidelines, Registries & Global Practice
Missed fractures are the single most common diagnostic error in musculoskeletal imaging worldwide, and the burden falls hardest where specialist reporting is scarce - this is the global rationale for fracture-detection AI.
- Position on imaging AI
- Clears most fracture tools via 510(k); evolving framework for adaptive/locked algorithms
- Practical implication
- Cleared tools are decision support; predicate-based clearance does not prove outcome benefit
- Position on imaging AI
- Endorses AI as an adjunct; runs the ACR AI registry (Assess-AI) and Data Science Institute use cases
- Practical implication
- Encourages local performance monitoring rather than blind adoption
- Position on imaging AI
- RCR cautious endorsement; NICE early value assessment of fracture-detection AI (e.g. ED use)
- Practical implication
- Permits conditional use with evidence generation; human report still required
- Position on imaging AI
- Support AI as augmentation; emphasise CE/MDR compliance and explainability
- Practical implication
- MDR Class IIa/IIb obligations and post-market surveillance
- Position on imaging AI
- Promotes AI for classification, templating and surgical planning education
- Practical implication
- Focus on consistency of fracture classification and pre-operative planning
- Position on imaging AI
- Frameworks for SaMD and ethics of AI in health, relevant to limited-resource scale-up
- Practical implication
- Stresses equity, validation in local populations, and governance
- High-resource setting
- Second-read / worklist triage to support specialist radiologists
- Limited-resource setting
- Front-line decision support where no radiologist is available
- High-resource setting
- Integrated into PACS/RIS, on-premise or cloud inference
- Limited-resource setting
- May rely on smartphone capture or intermittent connectivity
- High-resource setting
- Efficiency, reduced miss rate, faster turnaround
- Limited-resource setting
- Access to expertise that would otherwise be absent (task-shifting)
- High-resource setting
- Automation bias, alert fatigue, over-investigation
- Limited-resource setting
- Deployment of unvalidated tools, distribution shift, no oversight
- High-resource setting
- Formal validation, audit and surveillance pathways
- Limited-resource setting
- Often absent - the key barrier to safe scale-up
Future Directions

- Application
- Automated report generation
- Potential Impact
- Efficiency, consistency
- Application
- Combined imaging and clinical data
- Potential Impact
- More holistic assessment
- Application
- Training without sharing data
- Potential Impact
- Privacy-preserving improvement
- Application
- Pre-trained, adaptable models
- Potential Impact
- Faster development of new tools
- Application
- Intraoperative AI assistance
- Potential Impact
- Surgical precision
- Application
- Predict treatment success
- Potential Impact
- Personalised medicine
Controversies & Areas of Uncertainty
Explainability: Opening the Black Box
The topic names the 'black box' problem, 'explainability research, heatmaps' and the 'gradient-based activation heatmaps' used in the Yoon scaphoid study (below), but never explains what these are or why they matter.
- The problem. A deep CNN outputs a prediction without a human-readable reason - the 'black box'.
- The commonest solution. A saliency or class-activation map (for example Grad-CAM, gradient-weighted class-activation mapping) overlays a heatmap on the radiograph showing the region that most drove the model's decision.
- Why it matters. It lets the clinician sanity-check the model - confirming it looked at the fracture and not at a spurious cue such as a laterality marker, text or a cast ('shortcut learning', the Clever-Hans effect) - which builds trust and helps catch out-of-distribution failures. A heatmap shows where, not the true reasoning, so it is a check, not a proof of correctness.
Q: What is a saliency / Grad-CAM heatmap, and why is it used in imaging AI?
A: It addresses the black-box problem - a class-activation map (e.g. Grad-CAM) overlays a heatmap on the image showing the region that most drove the model's prediction. It lets the clinician sanity-check that the model looked at the fracture, not a spurious cue (laterality marker, text, cast - 'shortcut learning' / Clever-Hans), building trust and catching out-of-distribution errors. Caveat: it shows where, not the true reasoning - a check, not a proof.
How a Model Is Trained and Why It Overfits
The topic says a model is 'trained on labelled examples' and 'validated on a separate test set' but never explains the data splits or why models overfit.
- Three data sets. A model is fit on a training set; hyperparameters and model choice are tuned on a separate validation set; final, unbiased performance is measured on a held-out test set (and ideally an external dataset from a different centre). A published fracture tool, for example, was trained on a 87 percent / 11 percent / 2 percent train-validation-test split.
- Overfitting. If a model memorises the training data (including its noise) rather than learning generalisable features, it performs excellently on training data but poorly on new data - recognised when training accuracy is high but validation/test accuracy is much lower.
- Mitigation. More and more-diverse data, data augmentation (rotations, flips, brightness changes that synthetically expand the dataset), regularisation and early stopping. Any tuning done on the test set leaks information and inflates the reported performance - which is why an untouched, ideally external, test set matters.
Q: What is overfitting, and why are separate training, validation and test sets needed?
A: Overfitting is when a model memorises the training data (including noise) rather than learning generalisable features - excellent on training data but poor on new data (high training accuracy, much lower validation/test accuracy). You fit on the training set, tune hyperparameters/model choice on the validation set, and measure final unbiased performance on a held-out test set (ideally external). Mitigate with more/diverse data, data augmentation, regularisation and early stopping. Tuning on the test set leaks information and inflates performance.

Clinical Imaging Applications
- Typical Sensitivity
- 90-95%
- Clinical Utility
- Reduces missed scaphoid, metacarpal fractures
- Typical Sensitivity
- 90-98%
- Clinical Utility
- Flags occult neck of femur fractures
- Typical Sensitivity
- 85-95%
- Clinical Utility
- Detects subtle rib fractures
- Typical Sensitivity
- 85-92%
- Clinical Utility
- Identifies vertebral compression fractures
- Typical Sensitivity
- 88-94%
- Clinical Utility
- Assists with subtle malleolar fractures
- Typical Sensitivity
- 85-92%
- Clinical Utility
- Helps with occult fractures


Clinical Decision Scenarios
Practise clinical reasoning and management decisions out loud

“Your hospital is considering implementing an AI tool for fracture detection on emergency department radiographs. What factors would you consider?”
“An ED registrar reviews a wrist X-ray and the AI tool reports 'no fracture detected'. The patient has snuffbox tenderness.”
“You are asked to give a presentation on AI in orthopaedic imaging to your department. What key messages would you convey?”
Core Concepts
- Deep learning uses CNNs for image analysis
- Trained on labelled examples
- Validated on separate test data
- Regulatory clearance required for clinical use
Current Applications
- Fracture detection (wrist, hip common)
- Automated measurements (Cobb angle)
- Arthroplasty templating
- Worklist prioritisation
Performance
- Sensitivity 90-95% for fracture detection
- High sensitivity prioritised (few missed)
- May have lower specificity (overcalling)
- AI + clinician better than either alone
Key Principles
- Decision support, not replacement
- Clinical correlation essential
- Clinician remains legally responsible
- Negative AI does not exclude pathology
Evidence Base
Deep Learning Assistance Closes the Accuracy Gap in Fracture Detection Across Clinician Types
- Multi-reader multi-case study: 24 clinicians (radiologists, orthopaedic surgeons, PAs, primary care and emergency physicians) read 175 cases across 12 anatomical regions, aided and unaided by an FDA-cleared deep learning tool
- Reader accuracy rose with AI aid: AUC 0.90 unaided to 0.94 aided (difference 0.04, 95% CI 0.01 to 0.07)
- Sensitivity improved from 82% to 90% and specificity from 89% to 92% with AI assistance
- Clinicians with limited MSK imaging training reduced their fracture miss rate from 20% to 9%, matching radiologist performance (10%)
Deep Learning Tool to Improve Fracture Detection by Radiologists and Emergency Physicians on Extremity Radiographs
- Standalone deep learning performance on 2626 extremity radiographs: accuracy 0.986, sensitivity 0.987, specificity 0.885, with accuracy over 0.95 across body part, age, sex, view and scanner
- Multi-reader study (24 readers): with AI aid, accuracy rose by 0.047 (95% CI 0.034 to 0.061) and sensitivity improved from 0.865 to 0.955
- Average interpretation time fell by 7.1 seconds (27%) per examination
- Diagnostic gain was largest for emergency physicians and non-MSK radiologists