Skip to content

remove sandbox-volumes bench — it's a private bench, lives in benchmarks-stealth - #532

Merged
HeyGarrison merged 1 commit into
masterfrom
devin/1792643000-drop-public-volumes
Oct 22, 2026
Merged

HeyGarrison merged 1 commit into
masterfrom
devin/1792643000-drop-public-volumes

Conversation

@HeyGarrison

Copy link
Copy Markdown
Collaborator

Summary

Removes the sandbox-volumes benchmark from the public repo — it's a private bench whose home is computesdk/benchmarks-stealth (which carries the current, review-fixed version). Deletes benchmarks/sandbox/volumes.bench.ts, volumes-adapters.ts, .github/workflows/sandbox-volumes-benchmarks.yml, and the bench:sandbox:volumes script. No other references (docs, results) existed. Typecheck clean.

Link to Devin session: https://app.devin.ai/sessions/030c6248cef045b68395136f77112603
Open in Devin Desktop: https://app.devin.ai/desktop/session/030c6248cef045b68395136f77112603?variant=devin
Requested by: @HeyGarrison

…rks-stealth

Deletes volumes.bench.ts, volumes-adapters.ts, the workflow, and the
bench:sandbox:volumes script. The bench + its SDK-ported adapters run
from computesdk/benchmarks-stealth; the public repo carried a stale
copy that predates all of its review fixes.
@devin-ai-integration

Copy link
Copy Markdown
Contributor

I'll fix CI failures and address comments from users with write access. I'll skip comments containing "(aside)".

  • Disable automatic comment, CI, and merge conflict monitoring

@HeyGarrison
HeyGarrison marked this pull request as ready for review October 22, 2026 00:02
@HeyGarrison
HeyGarrison merged commit 16de865 into master Oct 22, 2026
2 of 3 checks passed
@open-cla

open-cla Bot commented Oct 22, 2026

Copy link
Copy Markdown

Contributor License Agreement

All contributors are covered by a CLA.

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Devin Review

@github-actions

github-actions Bot commented Oct 22, 2026 •

Copy link
Copy Markdown
Contributor

Sandbox Benchmark Results

Burst

# Provider Score Median TTI P95 P99 Status
1 isorun 99.7 0.03s 0.03s 0.03s 10/10
2 miosa 99.4 0.05s 0.07s 0.07s 10/10
3 createos 99.3 0.07s 0.07s 0.07s 10/10
4 declaw 98.5 0.14s 0.16s 0.16s 10/10
5 givemeanode 98.4 0.15s 0.18s 0.18s 10/10
6 archil 98.3 0.11s 0.25s 0.25s 10/10
7 promigence 98.1 0.14s 0.28s 0.28s 10/10
8 arker 98.0 0.19s 0.20s 0.20s 10/10
9 buddy 97.7 0.23s 0.23s 0.23s 10/10
10 blaxel 97.7 0.22s 0.25s 0.25s 10/10
11 superserve 97.0 0.21s 0.43s 0.43s 10/10
12 upstash 96.8 0.32s 0.33s 0.33s 10/10
13 vercel 95.8 0.35s 0.52s 0.52s 10/10
14 beam 94.1 0.55s 0.65s 0.65s 10/10
15 mosaic 92.5 0.70s 0.81s 0.81s 10/10
16 daytona 90.7 0.75s 1.20s 1.20s 10/10
17 novita 90.5 0.87s 1.07s 1.07s 10/10
18 freestyle 90.0 0.95s 1.07s 1.07s 10/10
19 cloudflare 86.4 0.61s 2.48s 2.48s 10/10
20 modal 85.5 0.80s 2.44s 2.44s 10/10
21 microsandbox 83.0 1.63s 1.81s 1.81s 10/10
22 cloud-run 81.8 0.49s 3.81s 3.81s 10/10
23 tensorlake 76.2 2.32s 2.48s 2.48s 10/10
24 sail 74.9 2.38s 2.71s 2.71s 10/10
25 sandbox0 74.6 1.61s 3.94s 3.94s 10/10
26 tenki 65.9 0.59s 0.59s 0.59s 7/10
27 codesandbox 64.1 3.25s 4.09s 4.09s 10/10
28 e2b 59.0 3.97s 4.29s 4.29s 10/10
29 gravixlayer 0.0 0.00s 0.00s 0.00s 0/10
30 hopx 0.0 0.00s 0.00s 0.00s 0/10
31 northflank 0.0 0.00s 0.00s 0.00s 0/10
32 run-cloud 0.0 13.23s 19.51s 19.51s 10/10

View full run · SVGs available as build artifacts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant