Hyper: Pin new version 0.0.26516 and add Web variant - #1904
Open
caetanosauer wants to merge 1 commit into
Open
Conversation
This commit updates Hyper to a newer version and introduces a new "Web" variant. Inspired by the same variant in ClickHouse, this reads the Hyper database file on demand at query time directly from an S3 bucket. We tried to follow the blueprint of `ClickHouse (Web)` here, but please let us know if some step is incorrect. Furthermore, we rely on `curl` to fetch the object data size from S3 directly. For our standard `hyper` lane, we also switch the storage backend to `psync`, which gives a more representative and stable load time for the particular EBS volume used here. Unlike the previous backend, it does not rely on the kernel to flush pages at unpredictable times.
caetanosauer
requested a deployment
to
benchmark-approval
September 8, 2026 21:16 — with 
GitHub Actions
Waiting
GitHub Actions
Waiting
caetanosauer
marked this pull request as ready for review
September 8, 2026 21:19
Contributor
Author
|
@rschu1ze @alexey-milovidov sorry for the extra ping here, but I would be very thankful if we could merge this soon. We want to showcase this Web functionality internally very soon, and ClickBench performance is as always a big reference for us. Let me know if there's anything I can do to help. Much appreciated in advance! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This commit updates Hyper to a newer version and introduces a new "Web" variant. Inspired by the same variant in ClickHouse, this reads the Hyper database file on demand at query time directly from a public S3 bucket.
We tried to follow the blueprint of
ClickHouse (Web)here, but please let us know if some step is incorrect. Furthermore, we rely oncurlto fetch the object data size from S3 directly.For our standard
hyperlane, we also switch the storage backend topsync, which gives a more representative and stable load time for the particular EBS volume used here. Unlike the previous backend, it does not rely on the kernel to flush pages at unpredictable times.