Private preview. Not published and not indexed.

Source SRC-LD07-SHI-JUDGING-THE-JUDGES-2025

Shi et al., “Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judge,” IJCNLP-AACL 2025

Open the original (DOI; link checked 2026-10-12)

Source class (bibliographic)
PEER_REVIEWED_CONFERENCE_PAPER
Source-level roles
none
Institutional position
not stated by source authority
Visibility
PUBLIC_REFERENCE
Registry section
—

Version

Current version v1.0, resolved through the explicit current pointer SOURCE--SRC-LD07-SHI-JUDGING-THE-JUDGES-2025.

Versions:v1.0 · current

Linked Claims

Registry “Linked claim” (logical Claim identity; never a pinned version): LD07-HQ-C13.

Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 d65089f6eee5d4c0af5e0ba52e757e7ce96dfeb5f8aa0e0a95d78e10820a0a12.

Frozen Drive-derived inputs

  • R03 — LD-07 Canonical Claim Ledger v1.0 — LOCKED (v1.0) — Drive ID 1xVz_LrQAA8EA1tPhVWIrDgOUU3Zidlg9; revision: NOT_EXPOSED_BY_DRIVE_TEXT_EXPORT; Drive modified 2026-09-29T04:31:14.120Z; block “ENTRY 13 — LD07-HQ-C13” SHA-256 3ff0bb8b809271926087a1c2088fd36c90d851d10d1291d42390397c0f3a9d6a; SocioLens — Programme Status & Authority Register v0.6 status “CURRENT.”; frozen fixture fixtures/frozen/r03-ld07-claim-ledger-v1.0-canonical.

Builder decisions (not Drive data)

  • VERSION = v1.0 — basis: First SocioLens materialized record for this Source identity; no predecessor record exists (Publication System Amendment v1.2 §4; ruling-backed production identity materialized under Issue #39). SocioLens Source-record version, not the external source's edition, revision or version of record.
  • CURRENT_POINTER = true — basis: Publication System Amendment v1.2 §4: the sole SocioLens record version for this Source identity; the materialization manifest explicitly designates SRC-LD07-SHI-JUDGING-THE-JUDGES-2025--v1.0 current.
  • VISIBILITY = PUBLIC_REFERENCE — basis: Explicit public provenance selection by LD07-HQ-C13--v1.0 (Issue #5 proof rendering (Architecture Proof Protocol v0.1 AP-08 / Amendment v1.2 §6): explicit version-pinned public provenance of this ClaimVersion — the pinned field-6 Source record "Shi et al. IJCNLP-AACL 2025"; Drive-derived identity authority (Issue #39 Source inventory): Batch 04 §4; ledger C13; KEY EVIDENCE.) (Amendment v1.2 §4, §6).