Private preview. Not published and not indexed.

Research opportunity · Concentration, Stack & Sovereignty

How large is open-weight model use beyond a single routing platform?

Question

How does the open-weight share of language-model use estimated from OpenRouter compare with shares estimated from other observable sources (other inference marketplaces and hosts, model downloads, self-hosting tool registries, and a survey of organisations' production deployments), and which population does each source actually represent?

Untested beyond the original settingOne PhD chapter or paperNeeds a budget (medium or higher)Partly addressed

Why it matters

The claim that open-weight models reduce dependence on proprietary vendors rests heavily on usage data from one routing platform whose users (developers, hobbyists, price-sensitive and roleplay traffic) may differ sharply from enterprises and public bodies. Without a second, independent measurement, nobody can say whether "about one-third" is a market fact or a platform fact.

The debate lists this among what we still do not know: global open-weight share beyond OpenRouter

Evidence that motivates it

A possible design

Build a multi-source panel for 2025–2027 with one row per model family per month: (1) token shares on OpenRouter from its public rankings; (2) usage or listing signals from other inference marketplaces and hosts that publish them; (3) Hugging Face download histories (using the released Longpre et al. dataset as a base); (4) pull counts or listings from self-hosting registries where public; and (5) a fielded survey of 500–1,000 organisations (stratified by size and sector, in two or three countries) asking which models run in production, how they are hosted, and roughly what share of their language-model workload each takes. Treat each as a separate estimand, report open-weight shares with intervals per source, and test how well platform-based shares predict survey-based shares. A short validation component asks a few hosting firms or a university IT department for aggregate logs to check the survey against records.

Data needed

Public OpenRouter rankings (archived snapshots exist); Hugging Face metadata and the Longpre et al. dataset; registry data where public; a commissioned organisational survey (or a module on an existing business survey); optional data-sharing agreements with hosts.

Feasibility

One PhD chapter or paper. Medium: public data is free; an organisational survey costs roughly US$5,000–20,000 depending on country and panel provider, less if added to an existing business survey. Hosts may not share logs; the study is still informative from public sources plus the survey. Downloads are not usage, and the write-up must not convert them into usage shares.

Has this been done?

Partly done already: related work covers some of this question (first-pass screen of 12 October 2026, checked again on 13 October 2026).

Demirer, Fradkin, Tadelis and Peng pair OpenRouter with Microsoft Azure AI Foundry data for pricing and demand rather than a population share. Nagle and Yue (2025) and the ATOM Report (2026) both rely on OpenRouter for usage share, and ATOM covers open models only. Longpre et al. map Hugging Face downloads (distribution, not use), and Dunivin (2026) measures open-weight use in scientific papers, a separate population. What remains open is a deliberately multi-source estimate that treats each source as a different population, includes self-hosted and enterprise production use measured by a replicable organisational survey, and tests whether the OpenRouter share generalises.

How strong this evidence is

Nearest work found

Literature check

Stands as first published. New 2025 to 2026 work adds further single-source estimates but no multi-source comparison: Nagle and Yue (SSRN 5767103) estimate open versus closed usage and revenue shares from OpenRouter only; the ATOM Report (Lambert and Brand, arXiv:2604.07190) uses OpenRouter for inference share and notes it correlates with Hugging Face downloads but does not estimate an open versus closed share; Dunivin (arXiv:2608.11090) measures open-weight use in 21 million scientific papers. None fields an organisational survey or treats sources as distinct populations, so the opportunity stands as written.

Searched: web (extended); arxiv.org; ssrn.com; osf.io; nber.org; dl.acm.org; sciencedirect.com; academic.oup.com; journals.sagepub.com; tandfonline.com; hbs.edu; aeaweb.org; linuxfoundation.org. Checked by Claude (SocioLens Project Lead) with AI research agents, by web search; not a person and not a domain expert.

The screen before this check

Partly done already: related work covers some of this question (first-pass screen of 12 October 2026).

Demirer, Fradkin, Tadelis & Peng already pair OpenRouter data with Microsoft Azure AI Foundry usage, so a second platform has been used, though Azure is a narrower, enterprise-oriented setting and the paper's aim is pricing and demand rather than a population share. Longpre et al. map open-weight downloads on Hugging Face, which measure distribution, not use. What remains open is a deliberately multi-source estimate that treats each source as a different population, includes self-hosted and enterprise production use measured by a replicable survey, and tests whether the OpenRouter share generalises.

Search queries used
  • open-weight model share of token usage across inference platforms measurement study beyond OpenRouter
  • "State of AI" OpenRouter a16z 100 trillion token study open-weight one third
  • Hugging Face downloads open model adoption economics paper open vs closed model usage share Nagle

Literature check, 13 October 2026:

  • survey enterprises production LLM deployment open-source vs proprietary models share of workloads 2026
  • open-weight models adoption measurement usage share inference providers (arxiv.org, ssrn.com, osf.io)
  • "OpenRouter" data representativeness LLM market shares bias developers sample
  • open source AI economic value usage closed vs open models demand estimation Nagle Yue 2025 working paper (nber.org, hbs.edu, ssrn.com, aeaweb.org, sciencedirect.com)
  • Ollama pulls self-hosted LLM usage measurement study local inference adoption
  • "Economies of Open Intelligence" Longpre extends OR builds on 2026 open model usage
  • Nagle Yue "The Latent Role of Open Models in the AI Economy" OpenRouter share open models

Provenance

RO-LD11-02 v2. Drafted by Claude (SocioLens Project Lead), AI-drafted from the LD-11 debate on 2026-10-12. Checked by an independent AI reviewer with fresh context (not a person), 12 October 2026: every nearest-work citation checked against its source page; corrections applied. Not yet reviewed by a domain expert. This is a research hypothesis, not a finding.

Changes

All research opportunities