# IDC · Hindsight | Envisioning

Source: https://www.envisioning.com/hindsight/idc

---

---

1.  [Hindsight](/hindsight)
2.  ›IDC

---

# IDC

Every publication series from IDC in Hindsight, and how its predictions turned out.

---
[Publishers](/hindsight)[Forecast vs actual](/hindsight/forecasts)[Side by side](/hindsight/comparisons)
---

[FutureScape](/hindsight/idc/futurescape)Dated predictions

Validated: two blind graders, an adjudicator on every disagreement, and an agent audit of a fixed sample ([D20](https://github.com/envisioning/hindsight/blob/main/docs/DECISIONS.md#d20-agents-do-all-grading-adjudication-and-audit-amends-d7-d11)).

12 publications, 2014 to 2025 · 204 predictions

[D11](https://github.com/envisioning/hindsight/blob/main/docs/DECISIONS.md#d11-validation-thresholds): 8 graded claims, fewer than 20; counts only.

-   hit4
-   partial1
-   miss3
-   ungradable148
-   contested1

1.  157claims
    
    each graded by two agents who cannot see each other's verdict ([D7](https://github.com/envisioning/hindsight/blob/main/docs/DECISIONS.md#d7-agentic-verdicts-with-independent-agreement))
    
2.  →
    
    155agreed
    
    agreement beyond chance, kappa 0.82
    
3.  →
    
    2settled
    
    the graders disagreed; a third agent decided ([D20](https://github.com/envisioning/hindsight/blob/main/docs/DECISIONS.md#d20-agents-do-all-grading-adjudication-and-audit-amends-d7-d11))
    
4.  →
    
    7audited
    
    an agent re-checked a fixed sample of agreed verdicts: 0 corrected, 1 left unsettled ([D11](https://github.com/envisioning/hindsight/blob/main/docs/DECISIONS.md#d11-validation-thresholds))
    
5.  →
    
    156published
    
    1 contested: no verdict publishes
    

How testable the claims were

94% no public measure

148 of 157. ungradable: nothing measures what the claim states at its date.

---
Data, code and grading rules are public at [github.com/envisioning/hindsight](https://github.com/envisioning/hindsight). Data under CC BY 4.0 (the BCB Focus survey under ODbL), code under MIT. Every rule is in [the decision log](https://github.com/envisioning/hindsight/blob/main/docs/DECISIONS.md). Think a verdict is wrong? [Open a dispute](https://github.com/envisioning/hindsight/issues/new?template=dispute-verdict.yml).
---