Claim LD06-SL-C02 (v1.0)
The 2026 AI Index states that the benchmark scores in its technical-performance chapter come from leaderboards, public repositories and company disclosures, including papers, blog posts and product releases, and that it “assumes that company-reported results are accurate”, while its introduction says that “independent testing does not always confirm what developers report”.
Research opportunities this claim motivates
What this claim leaves open for research. Each is a hypothesis about a gap, not a finding.
- How faithfully do indices and policy documents relay AI evaluation results?The same index states that it assumes company-reported results are accurate.
Provenance and status
- Claim type
- FACT (as printed: “FACT”)
- Publication status
- ELIGIBLE (QUALIFIED) (as printed: “ELIGIBLE WITH QUALIFIER”)
- Verification state
- CONTENT_VERIFIED_PRIMARY (as printed: “CONTENT VERIFIED”; verified by: UNKNOWN)
- Does not license
- A claim that any particular company-reported score is wrong, or how many of the index’s figures are company-reported
- Source (field 6, as printed)
- Sajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026
- Source type (field 7)
- INDEPENDENT_RESEARCH_REPORT (as printed: “Annual index report”)
- Institutional position
- University-based index (Stanford HAI)
- Maturity (claim evidence / publication maturity)
- MATURE (as printed: “MATURE”)
- Recorded date
- 2026-10-15
- Currentness / correction
- This is the current version. No correction or concern relation is recorded on its Sources.
Version
Current version v1.0, resolved through the explicit current pointer CLAIM--LD06-SL-C02.
Pinned Sources (field 6, version-specific)
- “Sajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026” → SRC-SL-AI-INDEX-2026-ANNUAL-REPORT--v1.0 — Sajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026; class INDEPENDENT_RESEARCH_REPORT (explicit public provenance pin)
All 25 canonical Claim fields (raw values and normalized values)
| # | Canonical field | Canonical value (verbatim) | Normalized (Claim Value Vocabulary v1.0.2) |
|---|---|---|---|
| 1 | CLAIM ID | LD06-SL-C02 | — |
| 2 | PUBLIC-FACING CLAIM | The 2026 AI Index states that the benchmark scores in its technical-performance chapter come from leaderboards, public repositories and company disclosures, including papers, blog posts and product releases, and that it “assumes that company-reported results are accurate”, while its introduction says that “independent testing does not always confirm what developers report”. | — |
| 3 | CLAIM TYPE | FACT | base_types: FACT |
| 4 | RESEARCH STRAND | B — Leaderboards, judges and disclosure | — |
| 5 | MATURITY | MATURE | states: MATURE |
| 6 | SOURCE | Sajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026 | source_ids: SRC-SL-AI-INDEX-2026-ANNUAL-REPORT |
| 7 | SOURCE TYPE | Annual index report | classes: INDEPENDENT_RESEARCH_REPORT |
| 8 | INSTITUTIONAL POSITION | University-based index (Stanford HAI) | — |
| 9 | SCOPE | The technical-performance chapter of the 2026 report | — |
| 10 | DESIGN | Statement of method in the report | — |
| 11 | SAMPLE / DATASET | Benchmark scores reported as of early 2026 | — |
| 12 | MODEL / TOOL / VERSION | Not applicable | — |
| 13 | COMPARATOR | None | — |
| 14 | MAIN RESULT | “Scores are sourced from leaderboards, public repositories, and company disclosures, including papers, blog posts, and product releases. The AI Index assumes that company-reported results are accurate.” | — |
| 15 | INFERENTIAL TARGET | Whether a widely relayed index verifies developers’ own benchmark scores | — |
| 16 | DOES NOT LICENSE | A claim that any particular company-reported score is wrong, or how many of the index’s figures are company-reported | — |
| 17 | VERIFICATION STATE | CONTENT VERIFIED | state: CONTENT_VERIFIED_PRIMARY · verified_by: UNKNOWN |
| 18 | LIMITATIONS | Covers one chapter of one edition; the share of the chapter’s scores that are company-reported was not counted | — |
| 19 | CONTRADICTORY / SUPPORTING SOURCES | The same chapter notes cases where models did worse in independent testing than developers reported; on falling developer disclosure, LD06-SL-C17 | — |
| 20 | GEOGRAPHY / LANGUAGE | Global / English | — |
| 21 | DISTRIBUTIONAL LEDGER | Not analysed in this claim | — |
| 22 | R01 / FIELD-MAP LINKS | LD-06, D4b | — |
| 23 | WHAT WOULD CHANGE THIS CLAIM? | A later edition that verifies or marks company-reported scores | — |
| 24 | PUBLICATION STATUS | ELIGIBLE WITH QUALIFIER | state: ELIGIBLE · qualifiers: QUALIFIED |
| 25 | RECORDED DATE | 2026-10-15 | — |
Field 22 references resolved against Field Map v0.2: LD-06 (LIVING_DEBATE); D4b (SUB_AREA)
Cited by Living Debate versions
Research-of-record provenance
Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 71df6b9d2e0d21c7fee35bdee5658618c93d543cca072dbd8847035e832b0bfd.
Repository-authored inputs (not Drive exports)
- SocioLens claim — LD06-SL-C02 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-15; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts. Block “ENTRY 02 — LD06-SL-C02” SHA-256
95f35a5f492872212587a230dd97f5366f59551642b1624492acaea7ab2959da; fixturefixtures/authored/claims/LD06-SL-C02--v1.0.
Builder decisions (not Drive data)
- VERSION = v1.0 — basis: Claim version taken from the repository-authored claim fixture version (SocioLens claim — LD06-SL-C02 v1.0); the first version of a new Claim of the LD-06 debate
- CURRENT_POINTER = true — basis: repository-authored claim "SocioLens claim — LD06-SL-C02 v1.0" (Project Lead (Claude, AI), 2026-10-15); basis: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts
- FIELD_6_SOURCE_REFERENCE = SRC-SL-AI-INDEX-2026-ANNUAL-REPORT--v1.0 — basis: field 6 of ENTRY 02 — LD06-SL-C02 cites "Sajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026"; the only field-6 segment of this ClaimVersion's repository-authored ledger block.
- SOURCE_PROVENANCE_PIN = SRC-SL-AI-INDEX-2026-ANNUAL-REPORT--v1.0 — basis: explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Sajadieh, Fattorini, Perrault, Gil, Parli et al., “The AI Index 2026 Annual Report,” AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, April 2026".