Skip to content

walls: the free tier moved on 2026-10-28 - #12

Merged
github-actions[bot] merged 1 commit into
mainfrom
walls/observed
Oct 28, 2026
Merged

github-actions[bot] merged 1 commit into
mainfrom
walls/observed

Conversation

@github-actions

Copy link
Copy Markdown
Contributor

A scheduled survey measured the free tier on 2026-10-28 and found something
that is not what the last run recorded.

What is in this pull request is the snapshot, and the snapshot is read.
limits-observed.json is an input at run time and not only a report: for an id
limits.mjs does not name, or an axis whose catalogue value has moved since its
entry was written, this is the window a host is told, so merging is what
publishes those numbers. Where limits.mjs does name an id its entry keeps the
first word, because the samples behind it are there - a measurement here that
contradicts one of those entries is the reason to rewrite the entry.

https://opencode.ai/inference/v1
8 free ids offered, 6 measured before, 0 not
  answered from models.dev, so not measured: beam-free, nemotron-3.5-super-vl-free
  open-ended but under-declared, so measured again: flint-40b-free
flint-40b-free
    200000 chars: {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}} — asking again in 10s
    200000 chars: {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}} — asking again in 10s
       200000 chars: failed, {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}}
    1000000 chars: {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}} — asking again in 10s
    1000000 chars: {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}} — asking again in 10s
      1000000 chars: failed, {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}}
    1600000 chars: {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}} — asking again in 10s
    1600000 chars: {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}} — asking again in 10s
      1600000 chars: failed, {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}}
    2800000 chars: {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}} — asking again in 10s
    2800000 chars: {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}} — asking again in 10s
      2800000 chars: failed, {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}}
    4200000 chars: {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}} — asking again in 10s
      4200000 chars: failed, {"type":"error","error":{"type":"FreeUsageLimitError","message":"Free usage limit reached. Free models work in OpenCode (https://opencode.ai); subscribe to OpenCode Go to keep going: https://opencode.ai/go"}}
  learned nothing, so no measurement was written: flint-40b-free

  flint-40b-free — openEnded, 14 requests
    served   - tokens at - characters
    refused  - characters

wrote 6 ids to limits-observed.json

The rules the sweep applies — a failure that is not about a size is not a
refusal, a refusal is asked twice before it counts, a wall needs two refused
sizes behind a served one, fourteen requests per model — are in
limits-sweep.mjs. A bracket this run could not narrow is reported as
single-refusal rather than smoothed into a wall, and an upstream that is
failing shows up as openEnded rather than as a small window.

@github-actions
github-actions Bot merged commit 949c767 into main Oct 28, 2026
@github-actions
github-actions Bot deleted the walls/observed branch October 28, 2026 03:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants