Question answering computing systems starts to affect health care around 2020
Grader A: partial
Grader B: partial
agrees with A, without seeing its verdict
Audit: confirmed
in the fixed audit sample (D11)
Published: partial
Grader A: partial
Watson for Oncology was deployed at a limited number of hospitals, criticised for unsafe advice, and Watson Health was sold off in 2022. Real use below 5% by 2022; LLM-based clinical QA only spread in 2023-2025, which is also partial under D37.
Test: D37 health: share of relevant patients, providers or procedures using it by 2022 (hit >=5%; partial <5% real use by 2022 or 5% in 2023-2025; miss no real use by 2025); relevant: clinicians/hospitals
Grader B: partial
Watson for Oncology had niche hospital deployments and was wound down when IBM sold Watson Health in 2022, so by 2022 use was well under 5%. LLM-based clinical QA then crossed the line: OpenEvidence was used by about 40% of US physicians by mid-2025 (60% claimed by Sept 2025). 5% reached within 3-5 years after 2020 = partial.
Test: D37 health: >=5% of clinicians use such systems by 2022 = hit; real use below 5% by 2022, or 5% reached 2023-2025 = partial; no real use by 2025 = miss.