Case Study: Response Preparation
With your understanding of the situation complete, you need to draft two critical communications: one to the leadership of the company, and one to hospital directors. The leadership brief should focus on strategic implications and risk management, while the hospital communication should focus on immediate corrective actions and protocol enforcement.
To save you some time, we have summarized the context of the case study below. You can use this in a new conversation with MyGPT:
SITUATION:
- UroScan: Sotelab Pharmaceuticals’s AI tool analyzing CT urography scans for bladder cancer diagnosis
- Project led by Marie (Medical Affairs), currently in emergency surgery
- Current validation data shows 95% accuracy for male patients
- Central Hospital reported 65% accuracy for female patients
- Women’s Health Network threatens media exposure tomorrow about gender bias
- You (Alex Jensen) are Medical Affairs manager covering for Marie
KEY STAKEHOLDERS:
- Medical Affairs: Responsible for UroScan implementation
- Central Hospital: First reported gender performance disparity
- Quality Control: Reported initial 95% accuracy rates
- Women’s Health Network: External advocacy group threatening media exposure
- Hospital Directors: Currently using tool outside validated scope
VALIDATION APPROACH:
- Currently in Phase 1: male-only validation
- Male focus chosen due to historically available datasets
- Phase 2 explicitly planned for female patient validation
- Phase 3 planned for full deployment after equal performance verified
- All phases require mandatory human verification of AI recommendations
IMPLEMENTATION ISSUES:
- Multiple hospitals using tool for female patients despite scope limitations
- Mandatory human verification protocols being bypassed
- Tool being used outside validated parameters to reduce backlogs
KEY POINTS:
- Performance disparity due to usage outside validated scope
- Phased validation approach is standard clinical practice
- Immediate action needed to enforce proper usage protocols
- Patient safety requires following validated procedures
A. Leadership Brief
Ask MyGPT to write an email to the leadership of the company starting with:
Following the Women’s Health Network’s concerns about UroScan, I want to clarify our position and planned actions…
B. Hospital Directors
Ask MyGPT to write an email to hospital directors starting with:
Effective immediately, we require urgent changes to UroScan usage protocols…
Key Learnings
This case highlights several critical aspects of implementing AI in healthcare:
-
Validation Process
- Importance of thorough, phased validation
- Need for diverse training data
- Critical role of real-world testing
-
Safety Controls
- Necessity of robust human oversight
- Importance of clear usage boundaries
- Value of regular performance audits
-
Change Management
- Need for comprehensive training
- Importance of clear communication
- Role of proper documentation
-
Risk Monitoring
- Value of early detection
- Importance of rapid response
- Need for continuous monitoring
These insights will help improve future AI implementations in healthcare settings.