Private preview. Not published and not indexed.

Claim LD01-SL-C05 (v1.0)

Mitchell and Krakauer report that in a 2022 survey of natural-language-processing researchers, 51% of 480 respondents agreed and 49% disagreed that a generative model trained only on text could, with enough data and compute, understand natural language “in some non-trivial sense”; they argue for an extended science of intelligence that recognizes distinct modes of understanding.

Provenance and status

Claim type
ESTIMATE + INTERPRETATION (as printed: “ESTIMATE / INTERPRETATION”)
Publication status
ELIGIBLE (PREPRINT) (as printed: “ELIGIBLE WITH PREPRINT QUALIFIER”)
Verification state
CONTENT_VERIFIED_PRIMARY (PREPRINT) (as printed: “CONTENT VERIFIED PREPRINT”; verified by: UNKNOWN)
Does not license
A view of the public, or a finding on whether models understand
Source (field 6, as printed)
Mitchell & Krakauer, “The Debate Over Understanding in AI’s Large Language Models,” arXiv:2210.13966, 2023
Source type (field 7)
PREPRINT (as printed: “Preprint (a journal version was published in PNAS)”)
Institutional position
Independent academic (Santa Fe Institute)
Maturity (claim evidence / publication maturity)
CONTESTED (as printed: “CONTESTED”)
Recorded date
2026-10-16
Currentness / correction
This is the current version. No correction or concern relation is recorded on its Sources.

Version

Current version v1.0, resolved through the explicit current pointer CLAIM--LD01-SL-C05.

Versions:v1.0 · current

Pinned Sources (field 6, version-specific)

All 25 canonical Claim fields (raw values and normalized values)
#Canonical fieldCanonical value (verbatim)Normalized (Claim Value Vocabulary v1.0.2)
1CLAIM IDLD01-SL-C05—
2PUBLIC-FACING CLAIMMitchell and Krakauer report that in a 2022 survey of natural-language-processing researchers, 51% of 480 respondents agreed and 49% disagreed that a generative model trained only on text could, with enough data and compute, understand natural language “in some non-trivial sense”; they argue for an extended science of intelligence that recognizes distinct modes of understanding.—
3CLAIM TYPEESTIMATE / INTERPRETATIONbase_types: ESTIMATE, INTERPRETATION
4RESEARCH STRANDA — What each account says generative AI is, and what it predicts—
5MATURITYCONTESTEDstates: CONTESTED
6SOURCEMitchell & Krakauer, “The Debate Over Understanding in AI’s Large Language Models,” arXiv:2210.13966, 2023source_ids: SRC-SL-MITCHELL-KRAKAUER-ARXIV-2210-13966
7SOURCE TYPEPreprint (a journal version was published in PNAS)classes: PREPRINT
8INSTITUTIONAL POSITIONIndependent academic (Santa Fe Institute)—
9SCOPEThe research community’s views as of 2022; the survey is cited by the authors, not run by them—
10DESIGNReview of the debate, citing a survey of researchers—
11SAMPLE / DATASET480 survey respondents—
12MODEL / TOOL / VERSIONLanguage models to early 2023—
13COMPARATORNot applicable—
14MAIN RESULT51% agreed and 49% disagreed; the authors call for new benchmarks and probing methods, since tests built for humans may not be valid for these systems—
15INFERENTIAL TARGETHow divided researchers are on whether language models understand—
16DOES NOT LICENSEA view of the public, or a finding on whether models understand—
17VERIFICATION STATECONTENT VERIFIED PREPRINTstate: CONTENT_VERIFIED_PRIMARY · qualifiers: PREPRINT · verified_by: UNKNOWN
18LIMITATIONSRead in arXiv version 3 (10 February 2023); the PNAS version was not compared; the 51/49 split comes from a survey by other researchers that the paper cites; views from 2022 may have moved—
19CONTRADICTORY / SUPPORTING SOURCESThe mimicry account treated as a null hypothesis: LD01-SL-C07—
20GEOGRAPHY / LANGUAGENot applicable / English—
21DISTRIBUTIONAL LEDGERNot analysed in this claim—
22R01 / FIELD-MAP LINKSLD-01, T4, D3—
23WHAT WOULD CHANGE THIS CLAIM?A later survey of the same population with a clear majority either way—
24PUBLICATION STATUSELIGIBLE WITH PREPRINT QUALIFIERstate: ELIGIBLE · qualifiers: PREPRINT
25RECORDED DATE2026-10-16—

Field 22 references resolved against Field Map v0.2: LD-01 (LIVING_DEBATE); T4 (TENSION); D3 (DOMAIN)

Cited by Living Debate versions

Research-of-record provenance

Materialized by sociolens-materializer 0.6.0 at 2026-09-28T20:00:00.000Z; normalization contract SocioLens — Claim Value Vocabulary v1.0.2 — Pre-Spike Materialization Contract (v1.0.2). Content seal SHA-256 feb8155238ceca1d47346b2e61fc9a648a70ff20552d274dabe69934b2b0696b.

Repository-authored inputs (not Drive exports)

  • SocioLens claim — LD01-SL-C05 v1.0 (v1.0) — written in the SocioLens repository by Project Lead (Claude, AI) on 2026-10-16; no Drive identity exists. Authority: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 16 October 2026 to build the LD-01 debate; a new Claim, first version, written from the project's LD-01 source notes, checked against full texts, official web pages or official abstracts. Block “ENTRY 05 — LD01-SL-C05” SHA-256 933b4552336957e5781d80c8c68f4f3c4da2dc8bedf3e64feba9b383c5bf5b6d; fixture fixtures/authored/claims/LD01-SL-C05--v1.0.

Builder decisions (not Drive data)

  • VERSION = v1.0 — basis: Claim version taken from the repository-authored claim fixture version (SocioLens claim — LD01-SL-C05 v1.0); the first version of a new Claim of the LD-01 debate
  • CURRENT_POINTER = true — basis: repository-authored claim "SocioLens claim — LD01-SL-C05 v1.0" (Project Lead (Claude, AI), 2026-10-16); basis: AGENTS.md "Authority" (the Project Lead decides research content within the research-integrity rules) and the Owner's choice in the SocioLens project chat on 16 October 2026 to build the LD-01 debate; a new Claim, first version, written from the project's LD-01 source notes, checked against full texts, official web pages or official abstracts
  • FIELD_6_SOURCE_REFERENCE = SRC-SL-MITCHELL-KRAKAUER-ARXIV-2210-13966--v1.0 — basis: field 6 of ENTRY 05 — LD01-SL-C05 cites "Mitchell & Krakauer, “The Debate Over Understanding in AI’s Large Language Models,” arXiv:2210.13966, 2023"; the only field-6 segment of this ClaimVersion's repository-authored ledger block.
  • SOURCE_PROVENANCE_PIN = SRC-SL-MITCHELL-KRAKAUER-ARXIV-2210-13966--v1.0 — basis: explicit version-pinned public provenance of this ClaimVersion (Amendment v1.2 §6): the pinned field-6 Source record "Mitchell & Krakauer, “The Debate Over Understanding in AI’s Large Language Models,” arXiv:2210.13966, 2023".