Private preview. Not published and not indexed.

Source SRC-SL-SINGH-ET-AL-LEADERBOARD-ILLUSION-ARXIV-2504-20879

Singh, Nan, Wang, D’Souza, Kapoor, Üstün, Koyejo, Deng, Longpre, Smith, Ermis, Fadaee & Hooker, “The Leaderboard Illusion,” arXiv:2504.20879 (v2), May 2025

No checked link to the original yet. Use the reference above to find it.

Source class (bibliographic)
PREPRINT
Source-level roles
none
Institutional position
AI developer-led (Cohere, an Arena participant) with academic co-authors
Visibility
PUBLIC_REFERENCE
Registry section
—

Version

Pinned version v1.0 (entry SRC-SL-SINGH-ET-AL-LEADERBOARD-ILLUSION-ARXIV-2504-20879--v1.0) — this page never floats to newer evidence.

This pinned version is also the current version.

Versions:v1.0 · current

Linked Claims

Registry “Linked claim” (logical Claim identity; never a pinned version): LD06-SL-C15.

Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 b86014674b0d8a141e42c871755bfb1e3c43e831b0e3251f59e82b39c77fd146.

Repository-authored inputs (not Drive exports)

  • SocioLens claim — LD06-SL-C15 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-15; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 15 October 2026 to build the LD-06 debate; a new Claim, first version, written from the project's LD-06 source notes, checked against full texts or official abstracts. Block “ENTRY 15 — LD06-SL-C15” SHA-256 9eb78693321ac2ee3347b541e1139f40077e79112d77755951ff2e19def963e8; fixture fixtures/authored/claims/LD06-SL-C15--v1.0.

Builder decisions (not Drive data)

  • VERSION = v1.0 — basis: First SocioLens materialized record for this Source identity; no predecessor record exists (Publication System Amendment v1.2 §4). SocioLens Source-record version, not the external source's edition, revision or version of record.
  • CURRENT_POINTER = true — basis: Publication System Amendment v1.2 §4: the sole SocioLens record version for this Source identity; the materialization manifest explicitly designates SRC-SL-SINGH-ET-AL-LEADERBOARD-ILLUSION-ARXIV-2504-20879--v1.0 current.
  • VISIBILITY = PUBLIC_REFERENCE — basis: Explicit public provenance selection by LD06-SL-C15--v1.0 (explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Singh, Nan, Wang, D’Souza, Kapoor, Üstün, Koyejo, Deng, Longpre, Smith, Ermis, Fadaee & Hooker, “The Leaderboard Illusion,” arXiv:2504.20879 (v2), May 2025".) (Amendment v1.2 §4, §6).