Claim LD07-HQ-C12 (v1.0)
Model identity is time-indexed: proprietary services can change materially across deployed snapshots, so exact version and date are part of the measurement protocol.
Research opportunities this claim motivates
What this claim leaves open for research. Each is a hypothesis about a gap, not a finding.
- Do pinned model snapshots keep social-science conclusions stable over time?Model identity is time-indexed; exact version and date belong in the protocol.
- Does quantization or the serving engine change social-science findings?The instrument is defined by more than its name; deployment is part of its identity.
Provenance and status
- Claim type
- FACT (as printed: “FACT”)
- Publication status
- ELIGIBLE (HISTORICAL_SNAPSHOT) (as printed: “ELIGIBLE WITH HISTORICAL-SNAPSHOT QUALIFIER”)
- Verification state
- CONTENT_VERIFIED_PRIMARY (as printed: “CLEARED”; verified by: UNKNOWN)
- Does not license
- Extrapolation of same drift magnitude to all current pinned models; claim open weights solve everything
- Source (field 6, as printed)
- Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?”, Harvard Data Science Review 6(2), 2024
- Source type (field 7)
- PEER_REVIEWED_JOURNAL_ARTICLE (as printed: “Peer-reviewed journal article”)
- Institutional position
- Academic
- Maturity (claim evidence / publication maturity)
- EMERGING (FOUNDATIONAL) (as printed: “EMERGING / FOUNDATIONAL”)
- Recorded date
- 2026-09-25
- Currentness / correction
- This is the current version. No correction or concern relation is recorded on its Sources.
Version
Current version v1.0, resolved through the explicit current pointer CLAIM--LD07-HQ-C12.
Pinned Sources (field 6, version-specific)
- “Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?”, Harvard Data Science Review 6(2), 2024” → SRC-LD07-CHEN-ZAHARIA-ZOU-DRIFT-2024--v1.0 — Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?,” Harvard Data Science Review 6(2) (2024); class PEER_REVIEWED_JOURNAL_ARTICLE (explicit public provenance pin)
Read the originals
- SRC-LD07-CHEN-ZAHARIA-ZOU-DRIFT-2024: open the original
All 25 canonical Claim fields (raw values and normalized values)
| # | Canonical field | Canonical value (verbatim) | Normalized (Claim Value Vocabulary v1.0.2) |
|---|---|---|---|
| 1 | CLAIM ID | LD07-HQ-C12 | — |
| 2 | PUBLIC-FACING CLAIM | Model identity is time-indexed: proprietary services can change materially across deployed snapshots, so exact version and date are part of the measurement protocol. | — |
| 3 | CLAIM TYPE | FACT | base_types: FACT |
| 4 | RESEARCH STRAND | F | — |
| 5 | MATURITY | EMERGING / FOUNDATIONAL | states: EMERGING · qualifiers: FOUNDATIONAL |
| 6 | SOURCE | Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?”, Harvard Data Science Review 6(2), 2024 | source_ids: SRC-LD07-CHEN-ZAHARIA-ZOU-DRIFT-2024 |
| 7 | SOURCE TYPE | Peer-reviewed journal article | classes: PEER_REVIEWED_JOURNAL_ARTICLE |
| 8 | INSTITUTIONAL POSITION | Academic | — |
| 9 | SCOPE | March vs June 2023 GPT-3.5/GPT-4 snapshots | — |
| 10 | DESIGN | Longitudinal service audit across seven task families | — |
| 11 | SAMPLE / DATASET | Math, safety, opinion surveys, knowledge, code, USMLE, visual reasoning | — |
| 12 | MODEL / TOOL / VERSION | GPT-3.5 and GPT-4 March/June 2023 | — |
| 13 | COMPARATOR | Same named services at different dates | — |
| 14 | MAIN RESULT | Material behavior/performance shifts; final HDSR example GPT-4 prime/composite accuracy 84%→51%; willingness on opinion/sensitive questions changed | — |
| 15 | INFERENTIAL TARGET | Reproducibility/non-stationarity | — |
| 16 | DOES NOT LICENSE | Extrapolation of same drift magnitude to all current pinned models; claim open weights solve everything | — |
| 17 | VERIFICATION STATE | CLEARED | state: CONTENT_VERIFIED_PRIMARY · verified_by: UNKNOWN |
| 18 | LIMITATIONS | 2023 snapshots; provider-specific historical example | — |
| 19 | CONTRADICTORY / SUPPORTING SOURCES | Later reproducibility literature to update magnitude | — |
| 20 | GEOGRAPHY / LANGUAGE | English task set | — |
| 21 | DISTRIBUTIONAL LEDGER | Not assessed | — |
| 22 | R01 / FIELD-MAP LINKS | T1, T7, R-1, D9 | — |
| 23 | WHAT WOULD CHANGE THIS CLAIM? | Long-term proof that exact proprietary snapshots remain behaviorally stable and archivally accessible | — |
| 24 | PUBLICATION STATUS | ELIGIBLE WITH HISTORICAL-SNAPSHOT QUALIFIER | state: ELIGIBLE · qualifiers: HISTORICAL_SNAPSHOT |
| 25 | RECORDED DATE | 2026-09-25 | — |
Field 22 references resolved against Field Map v0.2: T1 (TENSION); T7 (TENSION); R-1 (LENS); D9 (DOMAIN)
Cited by Living Debate versions
Research-of-record provenance
Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 e9668a837581a16b55aa08d887345c7997aabbe48ece57d6e036cace0cd07d74.
Frozen Drive-derived inputs
- R03 — LD-07 Canonical Claim Ledger v1.0 — LOCKED (v1.0) — Drive ID
1xVz_LrQAA8EA1tPhVWIrDgOUU3Zidlg9; revision: NOT_EXPOSED_BY_DRIVE_TEXT_EXPORT; Drive modified 2026-09-29T04:31:14.120Z; block “ENTRY 12 — LD07-HQ-C12” SHA-2561fc84c068224a516cbd25ebe1523cf72a4a0e56c55866755181ee58e50e3fc1d; SocioLens — Programme Status & Authority Register v0.6 status “CURRENT.”; frozen fixturefixtures/frozen/r03-ld07-claim-ledger-v1.0-canonical.
Builder decisions (not Drive data)
- VERSION = v1.0 — basis: Claim version taken from the canonical ledger artifact version (R03 — LD-07 Canonical Claim Ledger v1.0); Implementation Architecture Selection §5
- CURRENT_POINTER = true — basis: SocioLens — Programme Status & Authority Register v0.6 status for "R03 — LD-07 Canonical Claim Ledger v1.0 — LOCKED": "CURRENT."
- FIELD_6_SOURCE_REFERENCE = SRC-LD07-CHEN-ZAHARIA-ZOU-DRIFT-2024--v1.0 — basis: field 6 of ENTRY 12 — LD07-HQ-C12 cites "Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?”, Harvard Data Science Review 6(2), 2024"; the frozen field-6 segment of this ClaimVersion's ledger block; Drive-derived identity authority (Issue #39 Source inventory): Batch 04 §2; ledger C12 fields 6/7/8; KEY EVIDENCE.
- SOURCE_PROVENANCE_PIN = SRC-LD07-CHEN-ZAHARIA-ZOU-DRIFT-2024--v1.0 — basis: Issue #5 proof rendering (Architecture Proof Protocol v0.1 AP-08 / Amendment v1.2 §6): explicit version-pinned public provenance of this ClaimVersion — the pinned field-6 Source record "Chen, Zaharia & Zou, “How is ChatGPT’s behavior changing over time?”, Harvard Data Science Review 6(2), 2024"; Drive-derived identity authority (Issue #39 Source inventory): Batch 04 §2; ledger C12 fields 6/7/8; KEY EVIDENCE.