Skip to content

duckdb: report single-column filters as not pushed - #9888

Draft
myrrc wants to merge 2 commits into
developfrom
myrrc/duckdb-remove-eq-hack
Draft

myrrc wants to merge 2 commits into
developfrom
myrrc/duckdb-remove-eq-hack

Conversation

@myrrc

@myrrc myrrc commented Sep 15, 2026

Copy link
Copy Markdown
Contributor

We currenly have a hack which reports Eq filters as not pushed. This is due to a
duckdb optimizer bug which rewrites delim joins to ordinary joins which leads to
massive regressions in tpch 17 et. al.

However, there are queries like tpch q15 which don't have Eq. If we learn to
cast Temporal types into each other (up the stack), all filters get pushed, and
we get the regression again.

This change replaces the hack with a slightly less hack - now all single-column
filters or constant filters are reported as not pushed. Duckdb then converts
them to table filters and hands them back to vortex in global state
initialization, so we don't do a double evaluation.

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc added changelog/feature A new feature ext/duckdb Relates to the DuckDB integration action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Sep 15, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 15, 2026
@codspeed

codspeed Bot commented Sep 15, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 18.37%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 4 improved benchmarks
❌ 2 regressed benchmarks
✅ 644 untouched benchmarks
⏩ 1766 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime words_gather_dispatch_avx512[1024] 9 ns 35 ns -74.29%
WallTime arrow_checked_add_u32_neon[16384] 13.5 µs 20.3 µs -33.4%
WallTime arrow_checked_add_u32_avx2[16384] 21.4 µs 17.7 µs +21.16%
WallTime scalar_subtract_neon 13.4 µs 11.8 µs +13.61%
Simulation allocate_drop_arrow[0] 456.9 ns 402.7 ns +13.45%
WallTime mul_u32_nonnull_avx512 6.3 µs 5.7 µs +10.62%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/duckdb-remove-eq-hack (515861a) with develop (3e2b65c)

Open in CodSpeed

Footnotes

  1. 1766 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions

github-actions Bot commented Sep 15, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 515861a statpopgen 1 Explore Profiling Data
🟢 Done 515861a clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 515861a tpch-nvme-10 1 Explore Profiling Data
🟢 Done 515861a fineweb-s3 1 Explore Profiling Data
🟢 Done 515861a clickbench-nvme 1 Explore Profiling Data
🟢 Done 515861a fineweb 1 Explore Profiling Data
🟢 Done 515861a tpcds-nvme 1 Explore Profiling Data
🟢 Done 515861a polarsignals 1 Explore Profiling Data
🟢 Done 515861a tpch-s3 1 Explore Profiling Data
🟢 Done 515861a tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 515861ae vs base 008e3b75
Vortex (geomean): hot 1.007x ➖ · cold 1.094x ➖


datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45388554 / 44894373 / +1.1% 92921042 / 89455639 / +3.9% 0.49 / 0.50 / -2.7%
polarsignals_q01/datafusion:vortex-file-compressed 51092356 / 51052788 / +0.1% 118853359 / 111296491 / +6.8% 0.43 / 0.46 / -6.3%
polarsignals_q02/datafusion:vortex-file-compressed 35369918 / 35341532 / +0.1% 80306878 / 76216899 / +5.4% 0.44 / 0.46 / -5.0%
polarsignals_q03/datafusion:vortex-file-compressed 54044166 / 53547787 / +0.9% 121803234 / 114689020 / +6.2% 0.44 / 0.47 / -5.0%
polarsignals_q04/datafusion:vortex-file-compressed 9734774 / 9419880 / +3.3% 52934231 / 44841461 / +18.0% 🔴 0.18 / 0.21 / -12.5%
polarsignals_q05/datafusion:vortex-file-compressed 11961384 / 11791484 / +1.4% 57635287 / 50754518 / +13.6% 🔴 0.21 / 0.23 / -10.7%
polarsignals_q06/datafusion:vortex-file-compressed 20929394 / 21231742 / -1.4% 65372482 / 59363817 / +10.1% 🔴 0.32 / 0.36 / -10.5%
polarsignals_q07/datafusion:vortex-file-compressed 11162901 / 11185213 / -0.2% 56945747 / 50310685 / +13.2% 🔴 0.20 / 0.22 / -11.8%
polarsignals_q08/datafusion:vortex-file-compressed 98346984 / 99108972 / -0.8% 168554773 / 164856169 / +2.2% 0.58 / 0.60 / -2.9%
polarsignals_q09/datafusion:vortex-file-compressed 10132300 / 9884853 / +2.5% 52865272 / 45687512 / +15.7% 🔴 0.19 / 0.22 / -11.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 515861ae vs base a65c6537
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.977x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.977x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 17041493 / 16981969 / +0.4% 48882637 / 49824725 / -1.9% 0.35 / 0.34 / +2.3%
tpch_q02/datafusion:vortex-file-compressed 17616190 / 17322146 / +1.7% 36304777 / 38777170 / -6.4% 0.49 / 0.45 / +8.6%
tpch_q03/datafusion:vortex-file-compressed 19060559 / 19459660 / -2.1% 50966450 / 54970163 / -7.3% 0.37 / 0.35 / +5.6%
tpch_q04/datafusion:vortex-file-compressed 10390064 / 9815295 / +5.9% 32856990 / 40942130 / -19.7% 🟢 0.32 / 0.24 / +31.9%
tpch_q05/datafusion:vortex-file-compressed 37471293 / 37488120 / -0.0% 68285167 / 71989617 / -5.1% 0.55 / 0.52 / +5.4%
tpch_q06/datafusion:vortex-file-compressed 6418049 / 6364133 / +0.8% 30911127 / 35554794 / -13.1% 🟢 0.21 / 0.18 / +16.0%
tpch_q07/datafusion:vortex-file-compressed 51828622 / 51762992 / +0.1% 82488299 / 86504578 / -4.6% 0.63 / 0.60 / +5.0%
tpch_q08/datafusion:vortex-file-compressed 53095372 / 51027955 / +4.1% 84572987 / 75830060 / +11.5% 🔴 0.63 / 0.67 / -6.7%
tpch_q09/datafusion:vortex-file-compressed 49131382 / 50019433 / -1.8% 77147164 / 78223871 / -1.4% 0.64 / 0.64 / -0.4%
tpch_q10/datafusion:vortex-file-compressed 16872829 / 16929225 / -0.3% 52657473 / 55375322 / -4.9% 0.32 / 0.31 / +4.8%
tpch_q11/datafusion:vortex-file-compressed 15111853 / 15230712 / -0.8% 33832121 / 36326992 / -6.9% 0.45 / 0.42 / +6.5%
tpch_q12/datafusion:vortex-file-compressed 22771319 / 22797187 / -0.1% 47842165 / 49373948 / -3.1% 0.48 / 0.46 / +3.1%
tpch_q13/datafusion:vortex-file-compressed 19966983 / 20011620 / -0.2% 42379112 / 43877423 / -3.4% 0.47 / 0.46 / +3.3%
tpch_q14/datafusion:vortex-file-compressed 15282579 / 15299622 / -0.1% 42839783 / 44804137 / -4.4% 0.36 / 0.34 / +4.5%
tpch_q15/datafusion:vortex-file-compressed 18791213 / 18731921 / +0.3% 46511374 / 50635694 / -8.1% 0.40 / 0.37 / +9.2%
tpch_q16/datafusion:vortex-file-compressed 18880586 / 18579194 / +1.6% 38361193 / 39840242 / -3.7% 0.49 / 0.47 / +5.5%
tpch_q17/datafusion:vortex-file-compressed 28554207 / 28854909 / -1.0% 59765212 / 58409097 / +2.3% 0.48 / 0.49 / -3.3%
tpch_q18/datafusion:vortex-file-compressed 36970540 / 36713605 / +0.7% 58531497 / 59320815 / -1.3% 0.63 / 0.62 / +2.1%
tpch_q19/datafusion:vortex-file-compressed 13927483 / 13625279 / +2.2% 40786119 / 40479292 / +0.8% 0.34 / 0.34 / +1.4%
tpch_q20/datafusion:vortex-file-compressed 20822818 / 21436208 / -2.9% 44644281 / 48179637 / -7.3% 0.47 / 0.44 / +4.8%
tpch_q21/datafusion:vortex-file-compressed 39842852 / 39329445 / +1.3% 70007803 / 69160619 / +1.2% 0.57 / 0.57 / +0.1%
tpch_q22/datafusion:vortex-file-compressed 11244861 / 11367215 / -1.1% 32568458 / 32639203 / -0.2% 0.35 / 0.35 / -0.9%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67480496 / 67574915 / -0.1% 85952152 / 90081876 / -4.6% 0.79 / 0.75 / +4.7%
tpch_q02/datafusion:parquet 53226492 / 52703966 / +1.0% 71453169 / 74432935 / -4.0% 0.74 / 0.71 / +5.2%
tpch_q03/datafusion:parquet 72541735 / 72749478 / -0.3% 100304502 / 102518298 / -2.2% 0.72 / 0.71 / +1.9%
tpch_q04/datafusion:parquet 39831429 / 39651502 / +0.5% 59465571 / 65155926 / -8.7% 0.67 / 0.61 / +10.1%
tpch_q05/datafusion:parquet 88503240 / 88784719 / -0.3% 120057394 / 126030193 / -4.7% 0.74 / 0.70 / +4.6%
tpch_q06/datafusion:parquet 28607015 / 28128298 / +1.7% 49428613 / 51737348 / -4.5% 0.58 / 0.54 / +6.5%
tpch_q07/datafusion:parquet 95492219 / 95738871 / -0.3% 125178729 / 128390548 / -2.5% 0.76 / 0.75 / +2.3%
tpch_q08/datafusion:parquet 97670914 / 98095988 / -0.4% 127933666 / 129236235 / -1.0% 0.76 / 0.76 / +0.6%
tpch_q09/datafusion:parquet 114255069 / 114777347 / -0.5% 147564943 / 149658327 / -1.4% 0.77 / 0.77 / +1.0%
tpch_q10/datafusion:parquet 80680996 / 80188022 / +0.6% 114210333 / 122204005 / -6.5% 0.71 / 0.66 / +7.7%
tpch_q11/datafusion:parquet 39618292 / 39574437 / +0.1% 61625355 / 63448187 / -2.9% 0.64 / 0.62 / +3.1%
tpch_q12/datafusion:parquet 62289939 / 62858612 / -0.9% 89687549 / 91089917 / -1.5% 0.69 / 0.69 / +0.6%
tpch_q13/datafusion:parquet 160456431 / 160838810 / -0.2% 183469898 / 189383897 / -3.1% 0.87 / 0.85 / +3.0%
tpch_q14/datafusion:parquet 40113070 / 40376056 / -0.7% 71098626 / 74962393 / -5.2% 0.56 / 0.54 / +4.7%
tpch_q15/datafusion:parquet 47027872 / 47197160 / -0.4% 71277737 / 72707545 / -2.0% 0.66 / 0.65 / +1.6%
tpch_q16/datafusion:parquet 39118708 / 38473766 / +1.7% 59387873 / 58815077 / +1.0% 0.66 / 0.65 / +0.7%
tpch_q17/datafusion:parquet 117925684 / 116375674 / +1.3% 144470403 / 146110937 / -1.1% 0.82 / 0.80 / +2.5%
tpch_q18/datafusion:parquet 115282882 / 116386376 / -0.9% 137927765 / 142096456 / -2.9% 0.84 / 0.82 / +2.0%
tpch_q19/datafusion:parquet 50345534 / 50781478 / -0.9% 80735518 / 83550660 / -3.4% 0.62 / 0.61 / +2.6%
tpch_q20/datafusion:parquet 59053792 / 58160827 / +1.5% 84936067 / 89540151 / -5.1% 0.70 / 0.65 / +7.0%
tpch_q21/datafusion:parquet 99212471 / 99459394 / -0.2% 125271057 / 127790331 / -2.0% 0.79 / 0.78 / +1.8%
tpch_q22/datafusion:parquet 42339661 / 41572634 / +1.8% 58524933 / 62653466 / -6.6% 0.72 / 0.66 / +9.0%
duckdb / vortex-file-compressed / ns (0.992x ➖, 3↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11583187 / 10962672 / +5.7% 20908477 / 19879719 / +5.2% 0.55 / 0.55 / +0.5%
tpch_q02/duckdb:vortex-file-compressed 17946618 / 17541079 / +2.3% 27317673 / 28442435 / -4.0% 0.66 / 0.62 / +6.5%
tpch_q03/duckdb:vortex-file-compressed 18353351 / 18271860 / +0.4% 37483796 / 35107134 / +6.8% 0.49 / 0.52 / -5.9%
tpch_q04/duckdb:vortex-file-compressed 19380875 / 17537932 / +10.5% 🔴 33308234 / 31681770 / +5.1% 0.58 / 0.55 / +5.1%
tpch_q05/duckdb:vortex-file-compressed 21651638 / 21783428 / -0.6% 37747068 / 35622363 / +6.0% 0.57 / 0.61 / -6.2%
tpch_q06/duckdb:vortex-file-compressed 5415878 / 6199448 / -12.6% 🟢 15089206 / 15872295 / -4.9% 0.36 / 0.39 / -8.1%
tpch_q07/duckdb:vortex-file-compressed 25176256 / 21095327 / +19.3% 🔴 49688203 / 37174700 / +33.7% 🔴 0.51 / 0.57 / -10.7%
tpch_q08/duckdb:vortex-file-compressed 24063679 / 23948562 / +0.5% 40625152 / 38150833 / +6.5% 0.59 / 0.63 / -5.6%
tpch_q09/duckdb:vortex-file-compressed 40731033 / 30531518 / +33.4% 🔴 59465193 / 48570149 / +22.4% 🔴 0.68 / 0.63 / +9.0%
tpch_q10/duckdb:vortex-file-compressed 26210581 / 28151437 / -6.9% 43563022 / 49913305 / -12.7% 🟢 0.60 / 0.56 / +6.7%
tpch_q11/duckdb:vortex-file-compressed 8093649 / 11312073 / -28.5% 🟢 16211801 / 16676559 / -2.8% 0.50 / 0.68 / -26.4%
tpch_q12/duckdb:vortex-file-compressed 16575857 / 17231483 / -3.8% 29978793 / 36276544 / -17.4% 🟢 0.55 / 0.48 / +16.4%
tpch_q13/duckdb:vortex-file-compressed 21125433 / 21897598 / -3.5% 42411600 / 40725283 / +4.1% 0.50 / 0.54 / -7.4%
tpch_q14/duckdb:vortex-file-compressed 13085838 / 13396786 / -2.3% 24411683 / 26132851 / -6.6% 0.54 / 0.51 / +4.6%
tpch_q15/duckdb:vortex-file-compressed 10163408 / 10168511 / -0.1% 19227946 / 18733728 / +2.6% 0.53 / 0.54 / -2.6%
tpch_q16/duckdb:vortex-file-compressed 19035453 / 18393572 / +3.5% 25904318 / 25688708 / +0.8% 0.73 / 0.72 / +2.6%
tpch_q17/duckdb:vortex-file-compressed 14837891 / 15096269 / -1.7% 35833253 / 32777851 / +9.3% 0.41 / 0.46 / -10.1%
tpch_q18/duckdb:vortex-file-compressed 24761219 / 25974874 / -4.7% 34371255 / 41447647 / -17.1% 🟢 0.72 / 0.63 / +15.0%
tpch_q19/duckdb:vortex-file-compressed 23684343 / 23881014 / -0.8% 36218270 / 40423957 / -10.4% 🟢 0.65 / 0.59 / +10.7%
tpch_q20/duckdb:vortex-file-compressed 17525349 / 17852300 / -1.8% 36905908 / 35352646 / +4.4% 0.47 / 0.50 / -6.0%
tpch_q21/duckdb:vortex-file-compressed 59226344 / 66111873 / -10.4% 🟢 72990887 / 85985109 / -15.1% 🟢 0.81 / 0.77 / +5.5%
tpch_q22/duckdb:vortex-file-compressed 12181151 / 12289286 / -0.9% 21241946 / 23347343 / -9.0% 0.57 / 0.53 / +8.9%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60200078 / 60592597 / -0.6% 66760313 / 67175038 / -0.6% 0.90 / 0.90 / -0.0%
tpch_q02/duckdb:parquet 34925767 / 35186694 / -0.7% 43125206 / 43432881 / -0.7% 0.81 / 0.81 / -0.0%
tpch_q03/duckdb:parquet 62300203 / 62867665 / -0.9% 74049934 / 75186001 / -1.5% 0.84 / 0.84 / +0.6%
tpch_q04/duckdb:parquet 43377963 / 43675974 / -0.7% 56807836 / 53588932 / +6.0% 0.76 / 0.82 / -6.3%
tpch_q05/duckdb:parquet 60776115 / 61300994 / -0.9% 73071942 / 73458218 / -0.5% 0.83 / 0.83 / -0.3%
tpch_q06/duckdb:parquet 20038834 / 20375539 / -1.7% 24209915 / 25273179 / -4.2% 0.83 / 0.81 / +2.7%
tpch_q07/duckdb:parquet 60865348 / 61341889 / -0.8% 71851145 / 72819091 / -1.3% 0.85 / 0.84 / +0.6%
tpch_q08/duckdb:parquet 73391288 / 74042811 / -0.9% 86413597 / 87709360 / -1.5% 0.85 / 0.84 / +0.6%
tpch_q09/duckdb:parquet 113255916 / 114234210 / -0.9% 127291359 / 127669556 / -0.3% 0.89 / 0.89 / -0.6%
tpch_q10/duckdb:parquet 108626923 / 111120086 / -2.2% 123114917 / 121538427 / +1.3% 0.88 / 0.91 / -3.5%
tpch_q11/duckdb:parquet 20108722 / 20151406 / -0.2% 23768809 / 23880537 / -0.5% 0.85 / 0.84 / +0.3%
tpch_q12/duckdb:parquet 41602102 / 41790928 / -0.5% 49160451 / 49684496 / -1.1% 0.85 / 0.84 / +0.6%
tpch_q13/duckdb:parquet 239490299 / 239417261 / +0.0% 248699201 / 248637303 / +0.0% 0.96 / 0.96 / +0.0%
tpch_q14/duckdb:parquet 43675840 / 43868294 / -0.4% 53118218 / 52580539 / +1.0% 0.82 / 0.83 / -1.4%
tpch_q15/duckdb:parquet 25063605 / 25008733 / +0.2% 31127446 / 36282340 / -14.2% 🟢 0.81 / 0.69 / +16.8%
tpch_q16/duckdb:parquet 49818384 / 51400586 / -3.1% 56400914 / 57787992 / -2.4% 0.88 / 0.89 / -0.7%
tpch_q17/duckdb:parquet 44457722 / 44928401 / -1.0% 54499184 / 54643660 / -0.3% 0.82 / 0.82 / -0.8%
tpch_q18/duckdb:parquet 90184899 / 91143933 / -1.1% 101192686 / 104348797 / -3.0% 0.89 / 0.87 / +2.0%
tpch_q19/duckdb:parquet 61421482 / 61355364 / +0.1% 71366003 / 71583404 / -0.3% 0.86 / 0.86 / +0.4%
tpch_q20/duckdb:parquet 58577050 / 59178846 / -1.0% 72088009 / 71695674 / +0.5% 0.81 / 0.83 / -1.6%
tpch_q21/duckdb:parquet 136828870 / 137928740 / -0.8% 148033337 / 150099546 / -1.4% 0.92 / 0.92 / +0.6%
tpch_q22/duckdb:parquet 50699917 / 50761929 / -0.1% 60014635 / 58500299 / +2.6% 0.84 / 0.87 / -2.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 515861ae vs base 008e3b75
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.0%
Engines: DataFusion No clear signal (+4.5%, low confidence) · DuckDB No clear signal (+9.6%, medium confidence)
Vortex (geomean): hot 1.072x ➖ · cold 0.942x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +0.2% · Median polish +1.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.046x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7137095 / 6896419 / +3.5% 20788491 / 20611347 / +0.9% 0.34 / 0.33 / +2.6%
fineweb_q01/datafusion:vortex-file-compressed 12326892 / 11437994 / +7.8% 43539467 / 45659512 / -4.6% 0.28 / 0.25 / +13.0%
fineweb_q02/datafusion:vortex-file-compressed 12391842 / 12676933 / -2.2% 51641785 / 49634510 / +4.0% 0.24 / 0.26 / -6.0%
fineweb_q03/datafusion:vortex-file-compressed 20154630 / 20689142 / -2.6% 98216713 / 108254151 / -9.3% 0.21 / 0.19 / +7.4%
fineweb_q04/datafusion:vortex-file-compressed 76753294 / 75772418 / +1.3% 154562909 / 160042386 / -3.4% 0.50 / 0.47 / +4.9%
fineweb_q05/datafusion:vortex-file-compressed 59848278 / 59698230 / +0.3% 139715139 / 141769293 / -1.4% 0.43 / 0.42 / +1.7%
fineweb_q06/datafusion:vortex-file-compressed 19686725 / 18366198 / +7.2% 104215267 / 104883350 / -0.6% 0.19 / 0.18 / +7.9%
fineweb_q07/datafusion:vortex-file-compressed 17978597 / 16977723 / +5.9% 102016990 / 102838129 / -0.8% 0.18 / 0.17 / +6.7%
fineweb_q08/datafusion:vortex-file-compressed 10973106 / 8999444 / +21.9% 🔴 44024928 / 58918260 / -25.3% 🟢 0.25 / 0.15 / +63.2%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9930752 / 9724420 / +2.1% 34067257 / 32188590 / +5.8% 0.29 / 0.30 / -3.5%
fineweb_q01/datafusion:parquet 74091982 / 76060234 / -2.6% 146104709 / 156389433 / -6.6% 0.51 / 0.49 / +4.3%
fineweb_q02/datafusion:parquet 74604308 / 75998700 / -1.8% 144066452 / 148456610 / -3.0% 0.52 / 0.51 / +1.2%
fineweb_q03/datafusion:parquet 74745572 / 74913388 / -0.2% 152702456 / 147146239 / +3.8% 0.49 / 0.51 / -3.9%
fineweb_q04/datafusion:parquet 82991256 / 80799738 / +2.7% 145404695 / 150271563 / -3.2% 0.57 / 0.54 / +6.2%
fineweb_q05/datafusion:parquet 80571790 / 80909270 / -0.4% 147041936 / 151355266 / -2.8% 0.55 / 0.53 / +2.5%
fineweb_q06/datafusion:parquet 75678332 / 75577366 / +0.1% 145803535 / 156972976 / -7.1% 0.52 / 0.48 / +7.8%
fineweb_q07/datafusion:parquet 74853743 / 75734164 / -1.2% 139178196 / 144812138 / -3.9% 0.54 / 0.52 / +2.8%
fineweb_q08/datafusion:parquet 74595396 / 72939774 / +2.3% 141769458 / 146078769 / -2.9% 0.53 / 0.50 / +5.4%
duckdb / vortex-file-compressed / ns (1.100x ❌, 1↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 1970465 / 1897998 / +3.8% 4887043 / 8532219 / -42.7% 🟢 0.40 / 0.22 / +81.3%
fineweb_q01/duckdb:vortex-file-compressed 23016217 / 19495537 / +18.1% 🔴 60797180 / 59031498 / +3.0% 0.38 / 0.33 / +14.6%
fineweb_q02/duckdb:vortex-file-compressed 20062292 / 17970137 / +11.6% 🔴 47578393 / 46282869 / +2.8% 0.42 / 0.39 / +8.6%
fineweb_q03/duckdb:vortex-file-compressed 46197396 / 27558980 / +67.6% 🔴 115738033 / 129396192 / -10.6% 🟢 0.40 / 0.21 / +87.4%
fineweb_q04/duckdb:vortex-file-compressed 75965052 / 83165715 / -8.7% 115173104 / 171460358 / -32.8% 🟢 0.66 / 0.49 / +36.0%
fineweb_q05/duckdb:vortex-file-compressed 66689925 / 59253310 / +12.6% 🔴 145821705 / 102966757 / +41.6% 🔴 0.46 / 0.58 / -20.5%
fineweb_q06/duckdb:vortex-file-compressed 31452558 / 45341046 / -30.6% 🟢 112092851 / 130706332 / -14.2% 🟢 0.28 / 0.35 / -19.1%
fineweb_q07/duckdb:vortex-file-compressed 33299618 / 28662318 / +16.2% 🔴 115843481 / 92909230 / +24.7% 🔴 0.29 / 0.31 / -6.8%
fineweb_q08/duckdb:vortex-file-compressed 7681782 / 6188112 / +24.1% 🔴 14622319 / 15063895 / -2.9% 0.53 / 0.41 / +27.9%
duckdb / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 22745408 / 21573340 / +5.4% 27337479 / 24402580 / +12.0% 🔴 0.83 / 0.88 / -5.9%
fineweb_q01/duckdb:parquet 44355116 / 44695695 / -0.8% 54337642 / 56874948 / -4.5% 0.82 / 0.79 / +3.9%
fineweb_q02/duckdb:parquet 43624130 / 43831986 / -0.5% 60186964 / 55978984 / +7.5% 0.72 / 0.78 / -7.4%
fineweb_q03/duckdb:parquet 94907644 / 94478112 / +0.5% 183574780 / 190214146 / -3.5% 0.52 / 0.50 / +4.1%
fineweb_q04/duckdb:parquet 155739694 / 153372760 / +1.5% 198804744 / 204540363 / -2.8% 0.78 / 0.75 / +4.5%
fineweb_q05/duckdb:parquet 142503580 / 143263945 / -0.5% 191742720 / 197187282 / -2.8% 0.74 / 0.73 / +2.3%
fineweb_q06/duckdb:parquet 71000520 / 71837570 / -1.2% 115474439 / 125810123 / -8.2% 0.61 / 0.57 / +7.7%
fineweb_q07/duckdb:parquet 72960266 / 72097117 / +1.2% 156010256 / 155331553 / +0.4% 0.47 / 0.46 / +0.8%
fineweb_q08/duckdb:parquet 22477272 / 23014253 / -2.3% 24849859 / 23942857 / +3.8% 0.90 / 0.96 / -5.9%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 515861ae vs base 008e3b75
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.9%
Engines: DataFusion No clear signal (-3.6%, low confidence) · DuckDB No clear signal (-4.2%, environment too noisy confidence)
Vortex (geomean): hot 0.993x ➖ · cold 0.954x ➖
Parquet (geomean): hot 1.033x ➖ · cold 0.985x ➖
Shifts: Parquet (control) +3.3% · Median polish +0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.978x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 172352586 / 202177374 / -14.8% 🟢 559601211 / 514382282 / +8.8% 0.31 / 0.39 / -21.6%
clickbench-sorted_q24/datafusion:vortex-file-compressed 11081731 / 11188267 / -1.0% 46679516 / 47369367 / -1.5% 0.24 / 0.24 / +0.5%
clickbench-sorted_q26/datafusion:vortex-file-compressed 10858748 / 11489987 / -5.5% 48082243 / 49218289 / -2.3% 0.23 / 0.23 / -3.3%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23183044 / 22898283 / +1.2% 67826640 / 68871776 / -1.5% 0.34 / 0.33 / +2.8%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18613573 / 18889736 / -1.5% 57853952 / 58833630 / -1.7% 0.32 / 0.32 / +0.2%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17545758 / 17578764 / -0.2% 58169610 / 59804386 / -2.7% 0.30 / 0.29 / +2.6%
clickbench-sorted_q39/datafusion:vortex-file-compressed 41057146 / 40431381 / +1.5% 91780878 / 95471574 / -3.9% 0.45 / 0.42 / +5.6%
clickbench-sorted_q40/datafusion:vortex-file-compressed 11898413 / 12364642 / -3.8% 42431771 / 44671616 / -5.0% 0.28 / 0.28 / +1.3%
clickbench-sorted_q41/datafusion:vortex-file-compressed 12470958 / 11884640 / +4.9% 41414612 / 45478391 / -8.9% 0.30 / 0.26 / +15.2%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9838360 / 9988859 / -1.5% 35950113 / 36544882 / -1.6% 0.27 / 0.27 / +0.1%
datafusion / parquet / ns (1.015x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 768619331 / 767853862 / +0.1% 937833420 / 943196114 / -0.6% 0.82 / 0.81 / +0.7%
clickbench-sorted_q24/datafusion:parquet 9459146 / 9003622 / +5.1% 70843012 / 70855534 / -0.0% 0.13 / 0.13 / +5.1%
clickbench-sorted_q26/datafusion:parquet 9493936 / 9067958 / +4.7% 73042014 / 72229531 / +1.1% 0.13 / 0.13 / +3.5%
clickbench-sorted_q36/datafusion:parquet 94016184 / 94080832 / -0.1% 167268079 / 169358261 / -1.2% 0.56 / 0.56 / +1.2%
clickbench-sorted_q37/datafusion:parquet 64673424 / 63717246 / +1.5% 132931780 / 131159285 / +1.4% 0.49 / 0.49 / +0.1%
clickbench-sorted_q38/datafusion:parquet 87655247 / 87086638 / +0.7% 162396340 / 158508063 / +2.5% 0.54 / 0.55 / -1.8%
clickbench-sorted_q39/datafusion:parquet 159831864 / 158904340 / +0.6% 232466867 / 234675436 / -0.9% 0.69 / 0.68 / +1.5%
clickbench-sorted_q40/datafusion:parquet 44648086 / 43905790 / +1.7% 115382811 / 117978126 / -2.2% 0.39 / 0.37 / +4.0%
clickbench-sorted_q41/datafusion:parquet 42542712 / 41931482 / +1.5% 112006951 / 111807446 / +0.2% 0.38 / 0.38 / +1.3%
clickbench-sorted_q42/datafusion:parquet 26319798 / 26422306 / -0.4% 91224815 / 86764613 / +5.1% 0.29 / 0.30 / -5.3%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 60571469 / 59286430 / +2.2% 80055488 / 92127280 / -13.1% 🟢 0.76 / 0.64 / +17.6%
clickbench-sorted_q24/duckdb:vortex-file-compressed 21470970 / 20654503 / +4.0% 26234903 / 35462210 / -26.0% 🟢 0.82 / 0.58 / +40.5%
clickbench-sorted_q26/duckdb:vortex-file-compressed 16039586 / 16515937 / -2.9% 24933601 / 25973337 / -4.0% 0.64 / 0.64 / +1.2%
clickbench-sorted_q36/duckdb:vortex-file-compressed 30886766 / 31307574 / -1.3% 62010549 / 64493644 / -3.9% 0.50 / 0.49 / +2.6%
clickbench-sorted_q37/duckdb:vortex-file-compressed 23709432 / 24043136 / -1.4% 49008738 / 55978920 / -12.5% 🟢 0.48 / 0.43 / +12.6%
clickbench-sorted_q38/duckdb:vortex-file-compressed 26287519 / 25527104 / +3.0% 61729307 / 61724452 / +0.0% 0.43 / 0.41 / +3.0%
clickbench-sorted_q39/duckdb:vortex-file-compressed 49648209 / 48081881 / +3.3% 94728456 / 101092105 / -6.3% 0.52 / 0.48 / +10.2%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15683741 / 16823503 / -6.8% 38620194 / 39351749 / -1.9% 0.41 / 0.43 / -5.0%
clickbench-sorted_q41/duckdb:vortex-file-compressed 16462400 / 16549024 / -0.5% 37753613 / 37289683 / +1.2% 0.44 / 0.44 / -1.7%
clickbench-sorted_q42/duckdb:vortex-file-compressed 14501790 / 13369444 / +8.5% 30736696 / 30577855 / +0.5% 0.47 / 0.44 / +7.9%
duckdb / parquet / ns (1.052x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 125803337 / 124464182 / +1.1% 149846923 / 147540119 / +1.6% 0.84 / 0.84 / -0.5%
clickbench-sorted_q24/duckdb:parquet 18941487 / 17447936 / +8.6% 26902565 / 26190006 / +2.7% 0.70 / 0.67 / +5.7%
clickbench-sorted_q26/duckdb:parquet 13260230 / 12741704 / +4.1% 20892825 / 21135517 / -1.1% 0.63 / 0.60 / +5.3%
clickbench-sorted_q36/duckdb:parquet 47056155 / 42519431 / +10.7% 🔴 60022810 / 59289377 / +1.2% 0.78 / 0.72 / +9.3%
clickbench-sorted_q37/duckdb:parquet 30752313 / 30165187 / +1.9% 43833847 / 51901121 / -15.5% 🟢 0.70 / 0.58 / +20.7%
clickbench-sorted_q38/duckdb:parquet 40417793 / 38482698 / +5.0% 55661296 / 55862349 / -0.4% 0.73 / 0.69 / +5.4%
clickbench-sorted_q39/duckdb:parquet 70167198 / 68910540 / +1.8% 90656729 / 87047134 / +4.1% 0.77 / 0.79 / -2.2%
clickbench-sorted_q40/duckdb:parquet 16800285 / 17856076 / -5.9% 35997901 / 38640953 / -6.8% 0.47 / 0.46 / +1.0%
clickbench-sorted_q41/duckdb:parquet 19227900 / 15967082 / +20.4% 🔴 35276448 / 42506583 / -17.0% 🟢 0.55 / 0.38 / +45.1%
clickbench-sorted_q42/duckdb:parquet 11209292 / 10567508 / +6.1% 23474039 / 23731911 / -1.1% 0.48 / 0.45 / +7.2%

File Size Changes (100 files changed, -0.0% overall, 45↑ 55↓)
File Scale Format Base HEAD Change %
hits_075.vortex 1.0 vortex-file-compressed 189.02 MB 191.35 MB +2.32 MB +1.2%
hits_007.vortex 1.0 vortex-file-compressed 199.62 MB 201.23 MB +1.61 MB +0.8%
hits_071.vortex 1.0 vortex-file-compressed 139.26 MB 140.15 MB +905.98 KB +0.6%
hits_059.vortex 1.0 vortex-file-compressed 198.94 MB 200.14 MB +1.20 MB +0.6%
hits_010.vortex 1.0 vortex-file-compressed 168.12 MB 169.09 MB +993.98 KB +0.6%
hits_056.vortex 1.0 vortex-file-compressed 135.13 MB 135.75 MB +637.01 KB +0.5%
hits_018.vortex 1.0 vortex-file-compressed 199.96 MB 200.82 MB +885.09 KB +0.4%
hits_062.vortex 1.0 vortex-file-compressed 171.42 MB 172.10 MB +696.45 KB +0.4%
hits_050.vortex 1.0 vortex-file-compressed 161.58 MB 161.98 MB +413.79 KB +0.3%
hits_041.vortex 1.0 vortex-file-compressed 130.23 MB 130.54 MB +308.81 KB +0.2%
hits_029.vortex 1.0 vortex-file-compressed 200.89 MB 201.28 MB +396.23 KB +0.2%
hits_060.vortex 1.0 vortex-file-compressed 192.70 MB 193.07 MB +377.81 KB +0.2%
hits_099.vortex 1.0 vortex-file-compressed 171.78 MB 172.10 MB +321.65 KB +0.2%
hits_013.vortex 1.0 vortex-file-compressed 161.81 MB 162.09 MB +287.20 KB +0.2%
hits_004.vortex 1.0 vortex-file-compressed 130.57 MB 130.79 MB +217.48 KB +0.2%
hits_003.vortex 1.0 vortex-file-compressed 136.58 MB 136.80 MB +223.60 KB +0.2%
hits_070.vortex 1.0 vortex-file-compressed 200.94 MB 201.20 MB +267.91 KB +0.1%
hits_039.vortex 1.0 vortex-file-compressed 161.63 MB 161.78 MB +157.23 KB +0.1%
hits_083.vortex 1.0 vortex-file-compressed 156.24 MB 156.38 MB +149.65 KB +0.1%
hits_035.vortex 1.0 vortex-file-compressed 102.18 MB 102.26 MB +87.12 KB +0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.68 MB 100.76 MB +79.91 KB +0.1%
hits_022.vortex 1.0 vortex-file-compressed 200.02 MB 200.17 MB +144.82 KB +0.1%
hits_094.vortex 1.0 vortex-file-compressed 158.41 MB 158.52 MB +113.62 KB +0.1%
hits_037.vortex 1.0 vortex-file-compressed 177.96 MB 178.07 MB +108.42 KB +0.1%
hits_065.vortex 1.0 vortex-file-compressed 161.90 MB 161.98 MB +86.53 KB +0.1%
hits_081.vortex 1.0 vortex-file-compressed 200.97 MB 201.07 MB +98.77 KB +0.0%
hits_058.vortex 1.0 vortex-file-compressed 154.36 MB 154.43 MB +75.28 KB +0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.57 MB 130.63 MB +55.45 KB +0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.59 MB 161.66 MB +65.63 KB +0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.73 MB 126.78 MB +51.25 KB +0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.75 MB 153.81 MB +61.58 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.32 MB 147.38 MB +57.39 KB +0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.65 MB 192.71 MB +70.05 KB +0.0%
hits_024.vortex 1.0 vortex-file-compressed 161.06 MB 161.11 MB +52.15 KB +0.0%
hits_053.vortex 1.0 vortex-file-compressed 189.51 MB 189.56 MB +57.02 KB +0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.72 MB 153.75 MB +39.56 KB +0.0%
hits_011.vortex 1.0 vortex-file-compressed 200.17 MB 200.21 MB +40.30 KB +0.0%
hits_092.vortex 1.0 vortex-file-compressed 200.76 MB 200.79 MB +37.60 KB +0.0%
hits_001.vortex 1.0 vortex-file-compressed 190.74 MB 190.77 MB +31.90 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.21 MB 131.22 MB +19.04 KB +0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.07 MB 101.08 MB +13.80 KB +0.0%
hits_042.vortex 1.0 vortex-file-compressed 202.20 MB 202.22 MB +25.02 KB +0.0%
hits_028.vortex 1.0 vortex-file-compressed 152.07 MB 152.07 MB +8.48 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 127.05 MB 127.05 MB +6.29 KB +0.0%
hits_084.vortex 1.0 vortex-file-compressed 153.91 MB 153.92 MB +5.89 KB +0.0%
hits_036.vortex 1.0 vortex-file-compressed 171.97 MB 171.97 MB 1.73 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.22 MB 130.22 MB 1.40 KB -0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.35 MB 130.35 MB 4.27 KB -0.0%
hits_093.vortex 1.0 vortex-file-compressed 130.92 MB 130.92 MB 5.24 KB -0.0%
hits_005.vortex 1.0 vortex-file-compressed 167.18 MB 167.17 MB 19.33 KB -0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.77 MB 159.76 MB 19.29 KB -0.0%
hits_073.vortex 1.0 vortex-file-compressed 173.08 MB 173.06 MB 22.59 KB -0.0%
hits_069.vortex 1.0 vortex-file-compressed 143.13 MB 143.11 MB 19.14 KB -0.0%
hits_096.vortex 1.0 vortex-file-compressed 200.43 MB 200.39 MB 35.51 KB -0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.22 MB 147.19 MB 27.12 KB -0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.75 MB 191.72 MB 35.41 KB -0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.08 MB 130.05 MB 25.20 KB -0.0%
hits_038.vortex 1.0 vortex-file-compressed 189.56 MB 189.52 MB 37.07 KB -0.0%
hits_048.vortex 1.0 vortex-file-compressed 200.73 MB 200.70 MB 40.41 KB -0.0%
hits_020.vortex 1.0 vortex-file-compressed 159.85 MB 159.82 MB 32.98 KB -0.0%
hits_076.vortex 1.0 vortex-file-compressed 161.60 MB 161.56 MB 40.48 KB -0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.50 MB 190.45 MB 48.44 KB -0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.76 MB 181.71 MB 46.25 KB -0.0%
hits_090.vortex 1.0 vortex-file-compressed 192.37 MB 192.32 MB 52.29 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 179.99 MB 179.94 MB 52.85 KB -0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.82 MB 130.78 MB 40.84 KB -0.0%
hits_074.vortex 1.0 vortex-file-compressed 200.15 MB 200.08 MB 77.73 KB -0.0%
hits_089.vortex 1.0 vortex-file-compressed 130.70 MB 130.65 MB 53.23 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 161.39 MB 161.32 MB 66.45 KB -0.0%
hits_068.vortex 1.0 vortex-file-compressed 160.45 MB 160.39 MB 66.40 KB -0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.39 MB 172.32 MB 71.86 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.20 MB 159.13 MB 69.49 KB -0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.94 MB 194.83 MB 113.02 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 172.96 MB 172.85 MB 115.44 KB -0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.07 MB 139.97 MB 98.05 KB -0.1%
hits_008.vortex 1.0 vortex-file-compressed 139.40 MB 139.29 MB 110.67 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.81 MB 137.70 MB 112.04 KB -0.1%
hits_002.vortex 1.0 vortex-file-compressed 161.76 MB 161.59 MB 178.94 KB -0.1%
hits_014.vortex 1.0 vortex-file-compressed 172.84 MB 172.64 MB 197.52 KB -0.1%
hits_088.vortex 1.0 vortex-file-compressed 172.78 MB 172.57 MB 213.10 KB -0.1%
hits_049.vortex 1.0 vortex-file-compressed 191.40 MB 191.16 MB 251.88 KB -0.1%
hits_040.vortex 1.0 vortex-file-compressed 144.38 MB 144.19 MB 196.33 KB -0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.98 MB 180.74 MB 248.73 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.05 MB 130.87 MB 181.04 KB -0.1%
hits_072.vortex 1.0 vortex-file-compressed 102.06 MB 101.91 MB 155.30 KB -0.1%
hits_064.vortex 1.0 vortex-file-compressed 190.74 MB 190.42 MB 329.46 KB -0.2%
hits_051.vortex 1.0 vortex-file-compressed 173.40 MB 173.10 MB 306.66 KB -0.2%
hits_066.vortex 1.0 vortex-file-compressed 163.25 MB 162.96 MB 290.60 KB -0.2%
hits_026.vortex 1.0 vortex-file-compressed 130.80 MB 130.51 MB 292.77 KB -0.2%
hits_032.vortex 1.0 vortex-file-compressed 154.34 MB 153.99 MB 359.77 KB -0.2%
hits_095.vortex 1.0 vortex-file-compressed 154.00 MB 153.62 MB 393.36 KB -0.2%
hits_006.vortex 1.0 vortex-file-compressed 126.90 MB 126.58 MB 329.74 KB -0.3%
hits_045.vortex 1.0 vortex-file-compressed 140.22 MB 139.78 MB 453.39 KB -0.3%
hits_033.vortex 1.0 vortex-file-compressed 201.19 MB 200.44 MB 769.76 KB -0.4%
hits_082.vortex 1.0 vortex-file-compressed 139.70 MB 139.17 MB 537.26 KB -0.4%
hits_054.vortex 1.0 vortex-file-compressed 147.83 MB 147.22 MB 619.54 KB -0.4%
hits_085.vortex 1.0 vortex-file-compressed 200.78 MB 199.88 MB 920.35 KB -0.4%
hits_044.vortex 1.0 vortex-file-compressed 201.07 MB 199.81 MB 1.27 MB -0.6%
hits_055.vortex 1.0 vortex-file-compressed 200.96 MB 199.51 MB 1.46 MB -0.7%
hits_027.vortex 1.0 vortex-file-compressed 192.29 MB 189.51 MB 2.78 MB -1.4%

Totals:

  • vortex-file-compressed: 15.96 GB → 15.96 GB (-0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 515861ae vs base a65c6537
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.3%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-4.7%, low confidence)
Vortex (geomean): hot 0.970x ➖ · cold 0.961x ➖
Parquet (geomean): hot 0.993x ➖ · cold 0.982x ➖
Shifts: Parquet (control) -0.7% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92038386 / 97702289 / -5.8% 163558583 / 169208339 / -3.3% 0.56 / 0.58 / -2.5%
tpch_q02/datafusion:vortex-file-compressed 65555211 / 65087727 / +0.7% 93370684 / 95746788 / -2.5% 0.70 / 0.68 / +3.3%
tpch_q03/datafusion:vortex-file-compressed 66441155 / 65212355 / +1.9% 115690439 / 118734306 / -2.6% 0.57 / 0.55 / +4.6%
tpch_q04/datafusion:vortex-file-compressed 35243216 / 35583170 / -1.0% 75702351 / 82084192 / -7.8% 0.47 / 0.43 / +7.4%
tpch_q05/datafusion:vortex-file-compressed 119142684 / 117124300 / +1.7% 171338656 / 178738147 / -4.1% 0.70 / 0.66 / +6.1%
tpch_q06/datafusion:vortex-file-compressed 14631007 / 15790361 / -7.3% 72601750 / 69484514 / +4.5% 0.20 / 0.23 / -11.3%
tpch_q07/datafusion:vortex-file-compressed 141848473 / 139164767 / +1.9% 195336269 / 196149323 / -0.4% 0.73 / 0.71 / +2.4%
tpch_q08/datafusion:vortex-file-compressed 145109488 / 144868557 / +0.2% 204764431 / 200625360 / +2.1% 0.71 / 0.72 / -1.9%
tpch_q09/datafusion:vortex-file-compressed 184163507 / 183589236 / +0.3% 251316604 / 254958755 / -1.4% 0.73 / 0.72 / +1.8%
tpch_q10/datafusion:vortex-file-compressed 74172849 / 74214031 / -0.1% 133559983 / 148408040 / -10.0% 🟢 0.56 / 0.50 / +11.1%
tpch_q11/datafusion:vortex-file-compressed 43322556 / 43200542 / +0.3% 65601753 / 70456954 / -6.9% 0.66 / 0.61 / +7.7%
tpch_q12/datafusion:vortex-file-compressed 44727949 / 45514909 / -1.7% 96036933 / 97986735 / -2.0% 0.47 / 0.46 / +0.3%
tpch_q13/datafusion:vortex-file-compressed 46358054 / 47668165 / -2.7% 79923546 / 78262244 / +2.1% 0.58 / 0.61 / -4.8%
tpch_q14/datafusion:vortex-file-compressed 24889820 / 25086394 / -0.8% 93457920 / 95837113 / -2.5% 0.27 / 0.26 / +1.7%
tpch_q15/datafusion:vortex-file-compressed 37092823 / 37823500 / -1.9% 99546264 / 101444634 / -1.9% 0.37 / 0.37 / -0.1%
tpch_q16/datafusion:vortex-file-compressed 37410927 / 37598782 / -0.5% 65738455 / 66272899 / -0.8% 0.57 / 0.57 / +0.3%
tpch_q17/datafusion:vortex-file-compressed 175557721 / 177462041 / -1.1% 214304206 / 231818726 / -7.6% 0.82 / 0.77 / +7.0%
tpch_q18/datafusion:vortex-file-compressed 206317938 / 206540077 / -0.1% 265314464 / 268220462 / -1.1% 0.78 / 0.77 / +1.0%
tpch_q19/datafusion:vortex-file-compressed 33620915 / 35187644 / -4.5% 103593712 / 98133659 / +5.6% 0.32 / 0.36 / -9.5%
tpch_q20/datafusion:vortex-file-compressed 63743462 / 63462325 / +0.4% 117728519 / 125685046 / -6.3% 0.54 / 0.50 / +7.2%
tpch_q21/datafusion:vortex-file-compressed 181929556 / 181802421 / +0.1% 232538320 / 243187874 / -4.4% 0.78 / 0.75 / +4.7%
tpch_q22/datafusion:vortex-file-compressed 25603106 / 25863192 / -1.0% 51391179 / 56197168 / -8.6% 0.50 / 0.46 / +8.3%
datafusion / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83598209 / 83357413 / +0.3% 136845097 / 135456533 / +1.0% 0.61 / 0.62 / -0.7%
tpch_q02/datafusion:parquet 135827612 / 135752661 / +0.1% 162402801 / 169856464 / -4.4% 0.84 / 0.80 / +4.6%
tpch_q03/datafusion:parquet 125229031 / 126177302 / -0.8% 196968169 / 194830287 / +1.1% 0.64 / 0.65 / -1.8%
tpch_q04/datafusion:parquet 53974912 / 54168292 / -0.4% 100079235 / 112383052 / -10.9% 🟢 0.54 / 0.48 / +11.9%
tpch_q05/datafusion:parquet 165193826 / 165205949 / -0.0% 234841335 / 245860713 / -4.5% 0.70 / 0.67 / +4.7%
tpch_q06/datafusion:parquet 31731813 / 32507765 / -2.4% 81287621 / 88149134 / -7.8% 0.39 / 0.37 / +5.9%
tpch_q07/datafusion:parquet 213882818 / 216765148 / -1.3% 289261514 / 280741652 / +3.0% 0.74 / 0.77 / -4.2%
tpch_q08/datafusion:parquet 209415290 / 210257672 / -0.4% 297877431 / 291002158 / +2.4% 0.70 / 0.72 / -2.7%
tpch_q09/datafusion:parquet 285281382 / 280872446 / +1.6% 367473997 / 361555183 / +1.6% 0.78 / 0.78 / -0.1%
tpch_q10/datafusion:parquet 302992527 / 305984554 / -1.0% 368787147 / 369109483 / -0.1% 0.82 / 0.83 / -0.9%
tpch_q11/datafusion:parquet 97106843 / 97615567 / -0.5% 116659591 / 121290628 / -3.8% 0.83 / 0.80 / +3.4%
tpch_q12/datafusion:parquet 77661810 / 79827107 / -2.7% 129195682 / 130171906 / -0.7% 0.60 / 0.61 / -2.0%
tpch_q13/datafusion:parquet 195002063 / 195548910 / -0.3% 225343872 / 230845582 / -2.4% 0.87 / 0.85 / +2.2%
tpch_q14/datafusion:parquet 74413012 / 75808752 / -1.8% 173461959 / 196024822 / -11.5% 🟢 0.43 / 0.39 / +10.9%
tpch_q15/datafusion:parquet 77295136 / 79515866 / -2.8% 138374130 / 141207851 / -2.0% 0.56 / 0.56 / -0.8%
tpch_q16/datafusion:parquet 84376202 / 86079562 / -2.0% 110548307 / 110105439 / +0.4% 0.76 / 0.78 / -2.4%
tpch_q17/datafusion:parquet 204020954 / 208704860 / -2.2% 262143605 / 266679505 / -1.7% 0.78 / 0.78 / -0.6%
tpch_q18/datafusion:parquet 263103565 / 269929519 / -2.5% 309129492 / 325844039 / -5.1% 0.85 / 0.83 / +2.7%
tpch_q19/datafusion:parquet 97447867 / 98573606 / -1.1% 169202063 / 173155743 / -2.3% 0.58 / 0.57 / +1.2%
tpch_q20/datafusion:parquet 151829746 / 154312913 / -1.6% 208790352 / 221655164 / -5.8% 0.73 / 0.70 / +4.5%
tpch_q21/datafusion:parquet 228883676 / 234447166 / -2.4% 304485723 / 315377700 / -3.5% 0.75 / 0.74 / +1.1%
tpch_q22/datafusion:parquet 161149062 / 162366486 / -0.7% 182451634 / 187950654 / -2.9% 0.88 / 0.86 / +2.2%
duckdb / vortex-file-compressed / ns (0.950x ➖, 5↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 55986765 / 53874807 / +3.9% 95547856 / 95691008 / -0.1% 0.59 / 0.56 / +4.1%
tpch_q02/duckdb:vortex-file-compressed 32784218 / 32380196 / +1.2% 45403736 / 45610549 / -0.5% 0.72 / 0.71 / +1.7%
tpch_q03/duckdb:vortex-file-compressed 57522809 / 57777056 / -0.4% 104754252 / 110149045 / -4.9% 0.55 / 0.52 / +4.7%
tpch_q04/duckdb:vortex-file-compressed 57942554 / 80469603 / -28.0% 🟢 88496952 / 116005281 / -23.7% 🟢 0.65 / 0.69 / -5.6%
tpch_q05/duckdb:vortex-file-compressed 69900917 / 65967743 / +6.0% 121005365 / 114150813 / +6.0% 0.58 / 0.58 / -0.0%
tpch_q06/duckdb:vortex-file-compressed 21254953 / 21499472 / -1.1% 56722957 / 58602150 / -3.2% 0.37 / 0.37 / +2.1%
tpch_q07/duckdb:vortex-file-compressed 57910424 / 58724703 / -1.4% 116370785 / 113157062 / +2.8% 0.50 / 0.52 / -4.1%
tpch_q08/duckdb:vortex-file-compressed 95815838 / 88348069 / +8.5% 151740546 / 150249776 / +1.0% 0.63 / 0.59 / +7.4%
tpch_q09/duckdb:vortex-file-compressed 153664023 / 167087078 / -8.0% 208230534 / 227484651 / -8.5% 0.74 / 0.73 / +0.5%
tpch_q10/duckdb:vortex-file-compressed 71443637 / 113797254 / -37.2% 🟢 118884851 / 199859131 / -40.5% 🟢 0.60 / 0.57 / +5.5%
tpch_q11/duckdb:vortex-file-compressed 17246534 / 20186140 / -14.6% 🟢 31134284 / 32879396 / -5.3% 0.55 / 0.61 / -9.8%
tpch_q12/duckdb:vortex-file-compressed 58510800 / 57810204 / +1.2% 99753610 / 98472082 / +1.3% 0.59 / 0.59 / -0.1%
tpch_q13/duckdb:vortex-file-compressed 91670693 / 90814933 / +0.9% 134023302 / 136373692 / -1.7% 0.68 / 0.67 / +2.7%
tpch_q14/duckdb:vortex-file-compressed 30211605 / 31448577 / -3.9% 70551569 / 74998838 / -5.9% 0.43 / 0.42 / +2.1%
tpch_q15/duckdb:vortex-file-compressed 39958029 / 39451099 / +1.3% 87831495 / 87400339 / +0.5% 0.45 / 0.45 / +0.8%
tpch_q16/duckdb:vortex-file-compressed 43873178 / 42394651 / +3.5% 56870405 / 55175058 / +3.1% 0.77 / 0.77 / +0.4%
tpch_q17/duckdb:vortex-file-compressed 63645312 / 76482224 / -16.8% 🟢 131470348 / 159151483 / -17.4% 🟢 0.48 / 0.48 / +0.7%
tpch_q18/duckdb:vortex-file-compressed 131109238 / 135182491 / -3.0% 173064070 / 165216507 / +4.7% 0.76 / 0.82 / -7.4%
tpch_q19/duckdb:vortex-file-compressed 51456655 / 48005097 / +7.2% 101034053 / 106677564 / -5.3% 0.51 / 0.45 / +13.2%
tpch_q20/duckdb:vortex-file-compressed 59351623 / 60384074 / -1.7% 114384101 / 115703780 / -1.1% 0.52 / 0.52 / -0.6%
tpch_q21/duckdb:vortex-file-compressed 216065724 / 244934361 / -11.8% 🟢 260165487 / 283950363 / -8.4% 0.83 / 0.86 / -3.7%
tpch_q22/duckdb:vortex-file-compressed 41659188 / 41065997 / +1.4% 63350834 / 56683644 / +11.8% 🔴 0.66 / 0.72 / -9.2%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70731408 / 69942011 / +1.1% 94588570 / 87384645 / +8.2% 0.75 / 0.80 / -6.6%
tpch_q02/duckdb:parquet 70254596 / 71165721 / -1.3% 80481224 / 82356591 / -2.3% 0.87 / 0.86 / +1.0%
tpch_q03/duckdb:parquet 117595077 / 116565922 / +0.9% 155614789 / 154750066 / +0.6% 0.76 / 0.75 / +0.3%
tpch_q04/duckdb:parquet 74363010 / 74506296 / -0.2% 102653820 / 111792067 / -8.2% 0.72 / 0.67 / +8.7%
tpch_q05/duckdb:parquet 126451328 / 125609495 / +0.7% 172168387 / 179837123 / -4.3% 0.73 / 0.70 / +5.2%
tpch_q06/duckdb:parquet 34118288 / 34673035 / -1.6% 52076114 / 49603772 / +5.0% 0.66 / 0.70 / -6.3%
tpch_q07/duckdb:parquet 89362457 / 89130403 / +0.3% 132564326 / 153874627 / -13.8% 🟢 0.67 / 0.58 / +16.4%
tpch_q08/duckdb:parquet 142722141 / 142986115 / -0.2% 185597989 / 186975435 / -0.7% 0.77 / 0.76 / +0.6%
tpch_q09/duckdb:parquet 222912923 / 223730113 / -0.4% 266683434 / 263051019 / +1.4% 0.84 / 0.85 / -1.7%
tpch_q10/duckdb:parquet 471122420 / 471836983 / -0.2% 514269943 / 521327821 / -1.4% 0.92 / 0.91 / +1.2%
tpch_q11/duckdb:parquet 30666541 / 30571664 / +0.3% 37860004 / 37750436 / +0.3% 0.81 / 0.81 / +0.0%
tpch_q12/duckdb:parquet 75151961 / 74668469 / +0.6% 95324210 / 93022468 / +2.5% 0.79 / 0.80 / -1.8%
tpch_q13/duckdb:parquet 319757130 / 318310180 / +0.5% 335257343 / 329868773 / +1.6% 0.95 / 0.96 / -1.2%
tpch_q14/duckdb:parquet 105951403 / 103649894 / +2.2% 133712506 / 133443184 / +0.2% 0.79 / 0.78 / +2.0%
tpch_q15/duckdb:parquet 43329020 / 43037907 / +0.7% 77548389 / 77677149 / -0.2% 0.56 / 0.55 / +0.8%
tpch_q16/duckdb:parquet 113780741 / 114590765 / -0.7% 125617936 / 124544666 / +0.9% 0.91 / 0.92 / -1.6%
tpch_q17/duckdb:parquet 76363908 / 77015493 / -0.8% 103657298 / 103887848 / -0.2% 0.74 / 0.74 / -0.6%
tpch_q18/duckdb:parquet 202799459 / 207583709 / -2.3% 167409228 / 166911713 / +0.3% 1.21 / 1.24 / -2.6%
tpch_q19/duckdb:parquet 161502468 / 174812775 / -7.6% 191317319 / 195353661 / -2.1% 0.84 / 0.89 / -5.7%
tpch_q20/duckdb:parquet 127552443 / 129390359 / -1.4% 161049006 / 169206647 / -4.8% 0.79 / 0.76 / +3.6%
tpch_q21/duckdb:parquet 271899795 / 261346254 / +4.0% 296606552 / 289444049 / +2.5% 0.92 / 0.90 / +1.5%
tpch_q22/duckdb:parquet 260316744 / 261905889 / -0.6% 270728305 / 271440052 / -0.3% 0.96 / 0.96 / -0.3%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 515861ae vs base 008e3b75
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.2%
Engines: DataFusion No clear signal (-4.4%, environment too noisy confidence) · DuckDB No clear signal (-11.8%, environment too noisy confidence)
Vortex (geomean): hot 1.032x ➖ · cold 0.954x ➖
Parquet (geomean): hot 1.123x ➖ · cold 1.054x ➖
Shifts: Parquet (control) +12.3% · Median polish +5.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.148x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 62743681 / 52616896 / +19.2% 152649357 / 134143913 / +13.8% 0.41 / 0.39 / +4.8%
fineweb_q01/datafusion:vortex-file-compressed 606087618 / 367835794 / +64.8% 🔴 770868217 / 536405426 / +43.7% 🔴 0.79 / 0.69 / +14.7%
fineweb_q02/datafusion:vortex-file-compressed 672935400 / 401791115 / +67.5% 🔴 698564418 / 544713676 / +28.2% 0.96 / 0.74 / +30.6%
fineweb_q03/datafusion:vortex-file-compressed 630048600 / 473567678 / +33.0% 🔴 777904642 / 756426577 / +2.8% 0.81 / 0.63 / +29.4%
fineweb_q04/datafusion:vortex-file-compressed 497370902 / 445803446 / +11.6% 627746301 / 604995590 / +3.8% 0.79 / 0.74 / +7.5%
fineweb_q05/datafusion:vortex-file-compressed 410143399 / 482936586 / -15.1% 430157200 / 451868935 / -4.8% 0.95 / 1.07 / -10.8%
fineweb_q06/datafusion:vortex-file-compressed 762793002 / 741278351 / +2.9% 684248264 / 726474893 / -5.8% 1.11 / 1.02 / +9.3%
fineweb_q07/datafusion:vortex-file-compressed 494174954 / 487451974 / +1.4% 467166687 / 417737716 / +11.8% 1.06 / 1.17 / -9.3%
fineweb_q08/datafusion:vortex-file-compressed 213281528 / 265983630 / -19.8% 210659639 / 336484963 / -37.4% 🟢 1.01 / 0.79 / +28.1%
datafusion / parquet / ns (1.201x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 505326314 / 481901846 / +4.9% 872991279 / 770915103 / +13.2% 0.58 / 0.63 / -7.4%
fineweb_q01/datafusion:parquet 923294102 / 705605238 / +30.9% 🔴 784753586 / 702681222 / +11.7% 1.18 / 1.00 / +17.2%
fineweb_q02/datafusion:parquet 947823390 / 914923273 / +3.6% 1141433883 / 926365455 / +23.2% 0.83 / 0.99 / -15.9%
fineweb_q03/datafusion:parquet 1031167242 / 705202388 / +46.2% 🔴 724782837 / 767486802 / -5.6% 1.42 / 0.92 / +54.8%
fineweb_q04/datafusion:parquet 903152912 / 861944518 / +4.8% 821150387 / 686764069 / +19.6% 1.10 / 1.26 / -12.4%
fineweb_q05/datafusion:parquet 973674784 / 765186630 / +27.2% 915322353 / 785666545 / +16.5% 1.06 / 0.97 / +9.2%
fineweb_q06/datafusion:parquet 864772808 / 787044744 / +9.9% 798587163 / 833654331 / -4.2% 1.08 / 0.94 / +14.7%
fineweb_q07/datafusion:parquet 1014265020 / 768135330 / +32.0% 🔴 737765879 / 719690454 / +2.5% 1.37 / 1.07 / +28.8%
fineweb_q08/datafusion:parquet 936030320 / 723775068 / +29.3% 913080226 / 740419421 / +23.3% 1.03 / 0.98 / +4.9%
duckdb / vortex-file-compressed / ns (0.927x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 58888470 / 90292795 / -34.8% 🟢 70960594 / 135586882 / -47.7% 🟢 0.83 / 0.67 / +24.6%
fineweb_q01/duckdb:vortex-file-compressed 461646762 / 406756810 / +13.5% 442086390 / 463704094 / -4.7% 1.04 / 0.88 / +19.0%
fineweb_q02/duckdb:vortex-file-compressed 570976266 / 832792294 / -31.4% 🟢 585006940 / 637062935 / -8.2% 0.98 / 1.31 / -25.3%
fineweb_q03/duckdb:vortex-file-compressed 943905396 / 1001689544 / -5.8% 948021351 / 1068717272 / -11.3% 1.00 / 0.94 / +6.2%
fineweb_q04/duckdb:vortex-file-compressed 1070248148 / 1007352292 / +6.2% 1012646562 / 1061680081 / -4.6% 1.06 / 0.95 / +11.4%
fineweb_q05/duckdb:vortex-file-compressed 865693169 / 893976232 / -3.2% 941764788 / 963409289 / -2.2% 0.92 / 0.93 / -0.9%
fineweb_q06/duckdb:vortex-file-compressed 1272876524 / 1247023694 / +2.1% 1188502214 / 1284024835 / -7.4% 1.07 / 0.97 / +10.3%
fineweb_q07/duckdb:vortex-file-compressed 1002266791 / 963984322 / +4.0% 1026719833 / 1027164124 / -0.0% 0.98 / 0.94 / +4.0%
fineweb_q08/duckdb:vortex-file-compressed 395277090 / 409550554 / -3.5% 470012018 / 535902496 / -12.3% 0.84 / 0.76 / +10.0%
duckdb / parquet / ns (1.051x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 499044387 / 473860562 / +5.3% 522546437 / 565171140 / -7.5% 0.96 / 0.84 / +13.9%
fineweb_q01/duckdb:parquet 618504010 / 575996844 / +7.4% 556410348 / 544558797 / +2.2% 1.11 / 1.06 / +5.1%
fineweb_q02/duckdb:parquet 655128928 / 592984912 / +10.5% 685061573 / 585410698 / +17.0% 0.96 / 1.01 / -5.6%
fineweb_q03/duckdb:parquet 1404849001 / 1413648306 / -0.6% 1472756026 / 1457898844 / +1.0% 0.95 / 0.97 / -1.6%
fineweb_q04/duckdb:parquet 865653627 / 722713456 / +19.8% 802977329 / 742711943 / +8.1% 1.08 / 0.97 / +10.8%
fineweb_q05/duckdb:parquet 839415758 / 921567416 / -8.9% 935394985 / 994301462 / -5.9% 0.90 / 0.93 / -3.2%
fineweb_q06/duckdb:parquet 1831245705 / 1698732416 / +7.8% 1727795413 / 1792355218 / -3.6% 1.06 / 0.95 / +11.8%
fineweb_q07/duckdb:parquet 1107797496 / 1047703771 / +5.7% 1133053510 / 1117234140 / +1.4% 0.98 / 0.94 / +4.3%
fineweb_q08/duckdb:parquet 492480956 / 486262394 / +1.3% 473476392 / 508535161 / -6.9% 1.04 / 0.96 / +8.8%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 515861ae vs base a65c6537
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.013x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.015x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1286010 / 1253244 / +2.6% 20514656 / 19854098 / +3.3% 0.06 / 0.06 / -0.7%
clickbench_q01/datafusion:vortex-file-compressed 5766744 / 6104594 / -5.5% 34583022 / 33605895 / +2.9% 0.17 / 0.18 / -8.2%
clickbench_q02/datafusion:vortex-file-compressed 10342079 / 11000370 / -6.0% 42235204 / 40098671 / +5.3% 0.24 / 0.27 / -10.7%
clickbench_q03/datafusion:vortex-file-compressed 12089614 / 11638826 / +3.9% 54989723 / 53279480 / +3.2% 0.22 / 0.22 / +0.6%
clickbench_q04/datafusion:vortex-file-compressed 57655946 / 56252674 / +2.5% 92844038 / 89852525 / +3.3% 0.62 / 0.63 / -0.8%
clickbench_q05/datafusion:vortex-file-compressed 75491204 / 75949040 / -0.6% 120853468 / 117429927 / +2.9% 0.62 / 0.65 / -3.4%
clickbench_q06/datafusion:vortex-file-compressed 1275784 / 1243698 / +2.6% 20472845 / 19613620 / +4.4% 0.06 / 0.06 / -1.7%
clickbench_q07/datafusion:vortex-file-compressed 9530465 / 9823806 / -3.0% 34184096 / 32411858 / +5.5% 0.28 / 0.30 / -8.0%
clickbench_q08/datafusion:vortex-file-compressed 75100210 / 75978734 / -1.2% 116830830 / 111825358 / +4.5% 0.64 / 0.68 / -5.4%
clickbench_q09/datafusion:vortex-file-compressed 171795362 / 172073283 / -0.2% 207704100 / 211015438 / -1.6% 0.83 / 0.82 / +1.4%
clickbench_q10/datafusion:vortex-file-compressed 23845980 / 25251033 / -5.6% 67758916 / 66610296 / +1.7% 0.35 / 0.38 / -7.2%
clickbench_q11/datafusion:vortex-file-compressed 26244290 / 26159926 / +0.3% 70406057 / 67888500 / +3.7% 0.37 / 0.39 / -3.3%
clickbench_q12/datafusion:vortex-file-compressed 73128848 / 72320355 / +1.1% 113122624 / 114350587 / -1.1% 0.65 / 0.63 / +2.2%
clickbench_q13/datafusion:vortex-file-compressed 121237721 / 117110659 / +3.5% 182068067 / 178120347 / +2.2% 0.67 / 0.66 / +1.3%
clickbench_q14/datafusion:vortex-file-compressed 76976584 / 75736343 / +1.6% 118896634 / 122845388 / -3.2% 0.65 / 0.62 / +5.0%
clickbench_q15/datafusion:vortex-file-compressed 62789099 / 62005172 / +1.3% 98087261 / 94734057 / +3.5% 0.64 / 0.65 / -2.2%
clickbench_q16/datafusion:vortex-file-compressed 151493140 / 153125711 / -1.1% 208373901 / 202772257 / +2.8% 0.73 / 0.76 / -3.7%
clickbench_q17/datafusion:vortex-file-compressed 150768968 / 148557969 / +1.5% 212811598 / 210646886 / +1.0% 0.71 / 0.71 / +0.5%
clickbench_q18/datafusion:vortex-file-compressed 296713146 / 298679324 / -0.7% 357807667 / 374987317 / -4.6% 0.83 / 0.80 / +4.1%
clickbench_q19/datafusion:vortex-file-compressed 7519540 / 7755610 / -3.0% 48230867 / 44456432 / +8.5% 0.16 / 0.17 / -10.6%
clickbench_q20/datafusion:vortex-file-compressed 61357594 / 61032503 / +0.5% 234114185 / 232720532 / +0.6% 0.26 / 0.26 / -0.1%
clickbench_q21/datafusion:vortex-file-compressed 88373512 / 89106200 / -0.8% 273631797 / 272577151 / +0.4% 0.32 / 0.33 / -1.2%
clickbench_q22/datafusion:vortex-file-compressed 103869385 / 101948026 / +1.9% 348338808 / 349312070 / -0.3% 0.30 / 0.29 / +2.2%
clickbench_q23/datafusion:vortex-file-compressed 203625987 / 195018304 / +4.4% 539397233 / 535795513 / +0.7% 0.38 / 0.36 / +3.7%
clickbench_q24/datafusion:vortex-file-compressed 15762901 / 16316292 / -3.4% 63687734 / 61580477 / +3.4% 0.25 / 0.26 / -6.6%
clickbench_q25/datafusion:vortex-file-compressed 17936866 / 17947388 / -0.1% 55874939 / 56912482 / -1.8% 0.32 / 0.32 / +1.8%
clickbench_q26/datafusion:vortex-file-compressed 17023458 / 16841492 / +1.1% 66856724 / 64762455 / +3.2% 0.25 / 0.26 / -2.1%
clickbench_q27/datafusion:vortex-file-compressed 99202888 / 98671758 / +0.5% 243472048 / 242463722 / +0.4% 0.41 / 0.41 / +0.1%
clickbench_q28/datafusion:vortex-file-compressed 564003717 / 564856294 / -0.2% 612026490 / 620320106 / -1.3% 0.92 / 0.91 / +1.2%
clickbench_q29/datafusion:vortex-file-compressed 23643260 / 22846181 / +3.5% 50189179 / 51559110 / -2.7% 0.47 / 0.44 / +6.3%
clickbench_q30/datafusion:vortex-file-compressed 61015932 / 60970045 / +0.1% 109672726 / 108411674 / +1.2% 0.56 / 0.56 / -1.1%
clickbench_q31/datafusion:vortex-file-compressed 71075354 / 73643918 / -3.5% 152540144 / 150215995 / +1.5% 0.47 / 0.49 / -5.0%
clickbench_q32/datafusion:vortex-file-compressed 300333522 / 297636006 / +0.9% 388080939 / 388720166 / -0.2% 0.77 / 0.77 / +1.1%
clickbench_q33/datafusion:vortex-file-compressed 328620042 / 329989645 / -0.4% 419237375 / 429064267 / -2.3% 0.78 / 0.77 / +1.9%
clickbench_q34/datafusion:vortex-file-compressed 327178404 / 334097428 / -2.1% 428657481 / 423924305 / +1.1% 0.76 / 0.79 / -3.2%
clickbench_q35/datafusion:vortex-file-compressed 54971570 / 55704550 / -1.3% 87914922 / 87169267 / +0.9% 0.63 / 0.64 / -2.2%
clickbench_q36/datafusion:vortex-file-compressed 37727480 / 37338169 / +1.0% 65138916 / 64906949 / +0.4% 0.58 / 0.58 / +0.7%
clickbench_q37/datafusion:vortex-file-compressed 22023043 / 21719736 / +1.4% 47089296 / 46605572 / +1.0% 0.47 / 0.47 / +0.4%
clickbench_q38/datafusion:vortex-file-compressed 11750875 / 11531990 / +1.9% 39186052 / 37230035 / +5.3% 0.30 / 0.31 / -3.2%
clickbench_q39/datafusion:vortex-file-compressed 78488168 / 78384854 / +0.1% 110695278 / 109109723 / +1.5% 0.71 / 0.72 / -1.3%
clickbench_q40/datafusion:vortex-file-compressed 11141814 / 11518415 / -3.3% 35936464 / 36585828 / -1.8% 0.31 / 0.31 / -1.5%
clickbench_q41/datafusion:vortex-file-compressed 10702876 / 10970846 / -2.4% 35010209 / 34750595 / +0.7% 0.31 / 0.32 / -3.2%
clickbench_q42/datafusion:vortex-file-compressed 10909167 / 11053092 / -1.3% 35827471 / 34782775 / +3.0% 0.30 / 0.32 / -4.2%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1270580 / 1276854 / -0.5% 49450701 / 48415487 / +2.1% 0.03 / 0.03 / -2.6%
clickbench_q01/datafusion:parquet 15743396 / 16338007 / -3.6% 68763509 / 74428912 / -7.6% 0.23 / 0.22 / +4.3%
clickbench_q02/datafusion:parquet 19074030 / 18968022 / +0.6% 84434213 / 84885710 / -0.5% 0.23 / 0.22 / +1.1%
clickbench_q03/datafusion:parquet 17240856 / 17780842 / -3.0% 80771712 / 81434447 / -0.8% 0.21 / 0.22 / -2.2%
clickbench_q04/datafusion:parquet 63845270 / 63188308 / +1.0% 127442089 / 126299319 / +0.9% 0.50 / 0.50 / +0.1%
clickbench_q05/datafusion:parquet 88433450 / 88841347 / -0.5% 158495296 / 159462630 / -0.6% 0.56 / 0.56 / +0.1%
clickbench_q06/datafusion:parquet 1293367 / 1278119 / +1.2% 49024060 / 48269767 / +1.6% 0.03 / 0.03 / -0.4%
clickbench_q07/datafusion:parquet 16854791 / 16824260 / +0.2% 69434971 / 68485198 / +1.4% 0.24 / 0.25 / -1.2%
clickbench_q08/datafusion:parquet 86428670 / 87554366 / -1.3% 160689155 / 162073117 / -0.9% 0.54 / 0.54 / -0.4%
clickbench_q09/datafusion:parquet 190131928 / 189838528 / +0.2% 260548362 / 269849566 / -3.4% 0.73 / 0.70 / +3.7%
clickbench_q10/datafusion:parquet 36809447 / 36571271 / +0.7% 100175707 / 101100882 / -0.9% 0.37 / 0.36 / +1.6%
clickbench_q11/datafusion:parquet 42481884 / 43115244 / -1.5% 108752988 / 109261671 / -0.5% 0.39 / 0.39 / -1.0%
clickbench_q12/datafusion:parquet 96852490 / 95974058 / +0.9% 163367852 / 163862631 / -0.3% 0.59 / 0.59 / +1.2%
clickbench_q13/datafusion:parquet 148715592 / 147314624 / +1.0% 226557927 / 228875433 / -1.0% 0.66 / 0.64 / +2.0%
clickbench_q14/datafusion:parquet 102371325 / 102174375 / +0.2% 171273560 / 172143343 / -0.5% 0.60 / 0.59 / +0.7%
clickbench_q15/datafusion:parquet 74715013 / 70996126 / +5.2% 132640034 / 131762045 / +0.7% 0.56 / 0.54 / +4.5%
clickbench_q16/datafusion:parquet 158816170 / 157432430 / +0.9% 238522697 / 239427269 / -0.4% 0.67 / 0.66 / +1.3%
clickbench_q17/datafusion:parquet 157789812 / 156966294 / +0.5% 238627687 / 239841469 / -0.5% 0.66 / 0.65 / +1.0%
clickbench_q18/datafusion:parquet 312938277 / 316939801 / -1.3% 419910063 / 419888897 / +0.0% 0.75 / 0.75 / -1.3%
clickbench_q19/datafusion:parquet 19141258 / 19038334 / +0.5% 76604225 / 75256190 / +1.8% 0.25 / 0.25 / -1.2%
clickbench_q20/datafusion:parquet 178452042 / 179586806 / -0.6% 278907786 / 277739853 / +0.4% 0.64 / 0.65 / -1.0%
clickbench_q21/datafusion:parquet 173029594 / 173953949 / -0.5% 292816547 / 290798371 / +0.7% 0.59 / 0.60 / -1.2%
clickbench_q22/datafusion:parquet 261331176 / 261457367 / -0.0% 413381756 / 412132013 / +0.3% 0.63 / 0.63 / -0.4%
clickbench_q23/datafusion:parquet 1148730932 / 1195108448 / -3.9% 1221929421 / 1230504753 / -0.7% 0.94 / 0.97 / -3.2%
clickbench_q24/datafusion:parquet 30129432 / 30015034 / +0.4% 87997261 / 86218417 / +2.1% 0.34 / 0.35 / -1.6%
clickbench_q25/datafusion:parquet 36616916 / 37091626 / -1.3% 99042582 / 99964263 / -0.9% 0.37 / 0.37 / -0.4%
clickbench_q26/datafusion:parquet 30996705 / 30645528 / +1.1% 88696424 / 88020565 / +0.8% 0.35 / 0.35 / +0.4%
clickbench_q27/datafusion:parquet 193867558 / 194454424 / -0.3% 285314543 / 286448954 / -0.4% 0.68 / 0.68 / +0.1%
clickbench_q28/datafusion:parquet 625891577 / 623834138 / +0.3% 701741386 / 695662344 / +0.9% 0.89 / 0.90 / -0.5%
clickbench_q29/datafusion:parquet 29006464 / 29159228 / -0.5% 92583204 / 91642504 / +1.0% 0.31 / 0.32 / -1.5%
clickbench_q30/datafusion:parquet 91218584 / 91641498 / -0.5% 169561977 / 168872438 / +0.4% 0.54 / 0.54 / -0.9%
clickbench_q31/datafusion:parquet 102870625 / 104883696 / -1.9% 191946074 / 191942580 / +0.0% 0.54 / 0.55 / -1.9%
clickbench_q32/datafusion:parquet 326324922 / 328067324 / -0.5% 430717479 / 425204107 / +1.3% 0.76 / 0.77 / -1.8%
clickbench_q33/datafusion:parquet 383026889 / 387004562 / -1.0% 475500157 / 472597643 / +0.6% 0.81 / 0.82 / -1.6%
clickbench_q34/datafusion:parquet 385353020 / 384671310 / +0.2% 474297305 / 474232083 / +0.0% 0.81 / 0.81 / +0.2%
clickbench_q35/datafusion:parquet 66175364 / 62973294 / +5.1% 125899017 / 124121475 / +1.4% 0.53 / 0.51 / +3.6%
clickbench_q36/datafusion:parquet 73663762 / 73592270 / +0.1% 133873964 / 133779768 / +0.1% 0.55 / 0.55 / +0.0%
clickbench_q37/datafusion:parquet 35556651 / 35440082 / +0.3% 92240396 / 91656973 / +0.6% 0.39 / 0.39 / -0.3%
clickbench_q38/datafusion:parquet 47770634 / 47864858 / -0.2% 105980271 / 106618852 / -0.6% 0.45 / 0.45 / +0.4%
clickbench_q39/datafusion:parquet 143644082 / 143991143 / -0.2% 209110143 / 207257560 / +0.9% 0.69 / 0.69 / -1.1%
clickbench_q40/datafusion:parquet 20279674 / 20271676 / +0.0% 76914059 / 77151214 / -0.3% 0.26 / 0.26 / +0.3%
clickbench_q41/datafusion:parquet 18927226 / 18911974 / +0.1% 78106424 / 75628855 / +3.3% 0.24 / 0.25 / -3.1%
clickbench_q42/datafusion:parquet 19313078 / 19292986 / +0.1% 76006398 / 75051081 / +1.3% 0.25 / 0.26 / -1.2%
duckdb / vortex-file-compressed / ns (1.002x ➖, 4↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1783195 / 1538754 / +15.9% 🔴 27723882 / 24469684 / +13.3% 🔴 0.06 / 0.06 / +2.3%
clickbench_q01/duckdb:vortex-file-compressed 14070345 / 12004464 / +17.2% 🔴 28978778 / 29130745 / -0.5% 0.49 / 0.41 / +17.8%
clickbench_q02/duckdb:vortex-file-compressed 13498850 / 13626508 / -0.9% 36738412 / 33617235 / +9.3% 0.37 / 0.41 / -9.4%
clickbench_q03/duckdb:vortex-file-compressed 17199198 / 18390720 / -6.5% 43510485 / 47362053 / -8.1% 0.40 / 0.39 / +1.8%
clickbench_q04/duckdb:vortex-file-compressed 72582733 / 70108202 / +3.5% 96975444 / 103469983 / -6.3% 0.75 / 0.68 / +10.5%
clickbench_q05/duckdb:vortex-file-compressed 67782236 / 70125336 / -3.3% 95734436 / 97456258 / -1.8% 0.71 / 0.72 / -1.6%
clickbench_q06/duckdb:vortex-file-compressed 2013881 / 1881139 / +7.1% 29006947 / 31328103 / -7.4% 0.07 / 0.06 / +15.6%
clickbench_q07/duckdb:vortex-file-compressed 13846731 / 16714627 / -17.2% 🟢 32957750 / 32011144 / +3.0% 0.42 / 0.52 / -19.5%
clickbench_q08/duckdb:vortex-file-compressed 84023944 / 82775262 / +1.5% 120608528 / 127631232 / -5.5% 0.70 / 0.65 / +7.4%
clickbench_q09/duckdb:vortex-file-compressed 108688928 / 108016663 / +0.6% 149038659 / 143401961 / +3.9% 0.73 / 0.75 / -3.2%
clickbench_q10/duckdb:vortex-file-compressed 33039168 / 33971144 / -2.7% 66990979 / 63278305 / +5.9% 0.49 / 0.54 / -8.1%
clickbench_q11/duckdb:vortex-file-compressed 35658698 / 36368098 / -2.0% 70796159 / 69232494 / +2.3% 0.50 / 0.53 / -4.1%
clickbench_q12/duckdb:vortex-file-compressed 76532732 / 73096681 / +4.7% 110145488 / 103452173 / +6.5% 0.69 / 0.71 / -1.7%
clickbench_q13/duckdb:vortex-file-compressed 145434940 / 142425184 / +2.1% 170221578 / 185862126 / -8.4% 0.85 / 0.77 / +11.5%
clickbench_q14/duckdb:vortex-file-compressed 78460973 / 78075288 / +0.5% 110053190 / 111666844 / -1.4% 0.71 / 0.70 / +2.0%
clickbench_q15/duckdb:vortex-file-compressed 92453225 / 92890405 / -0.5% 131005235 / 128381747 / +2.0% 0.71 / 0.72 / -2.5%
clickbench_q16/duckdb:vortex-file-compressed 162685150 / 163983984 / -0.8% 205470533 / 203933056 / +0.8% 0.79 / 0.80 / -1.5%
clickbench_q17/duckdb:vortex-file-compressed 160694330 / 163682544 / -1.8% 211483529 / 204054897 / +3.6% 0.76 / 0.80 / -5.3%
clickbench_q18/duckdb:vortex-file-compressed 314161456 / 318607559 / -1.4% 372591792 / 406172561 / -8.3% 0.84 / 0.78 / +7.5%
clickbench_q19/duckdb:vortex-file-compressed 16397342 / 15965413 / +2.7% 42780926 / 41062916 / +4.2% 0.38 / 0.39 / -1.4%
clickbench_q20/duckdb:vortex-file-compressed 154769014 / 111109108 / +39.3% 🔴 244363207 / 186849958 / +30.8% 🔴 0.63 / 0.59 / +6.5%
clickbench_q21/duckdb:vortex-file-compressed 161811164 / 162899957 / -0.7% 287395161 / 288566107 / -0.4% 0.56 / 0.56 / -0.3%
clickbench_q22/duckdb:vortex-file-compressed 240358592 / 247953338 / -3.1% 425938453 / 431659519 / -1.3% 0.56 / 0.57 / -1.8%
clickbench_q23/duckdb:vortex-file-compressed 55941723 / 58254160 / -4.0% 96055536 / 92704956 / +3.6% 0.58 / 0.63 / -7.3%
clickbench_q24/duckdb:vortex-file-compressed 30073504 / 25942898 / +15.9% 🔴 46577823 / 42490012 / +9.6% 0.65 / 0.61 / +5.7%
clickbench_q25/duckdb:vortex-file-compressed 32075500 / 33469596 / -4.2% 57521037 / 56847918 / +1.2% 0.56 / 0.59 / -5.3%
clickbench_q26/duckdb:vortex-file-compressed 19570173 / 19520754 / +0.3% 36160351 / 36810098 / -1.8% 0.54 / 0.53 / +2.1%
clickbench_q27/duckdb:vortex-file-compressed 148715190 / 144902705 / +2.6% 239642600 / 241342121 / -0.7% 0.62 / 0.60 / +3.4%
clickbench_q28/duckdb:vortex-file-compressed 591964144 / 658460388 / -10.1% 🟢 675715573 / 683357583 / -1.1% 0.88 / 0.96 / -9.1%
clickbench_q29/duckdb:vortex-file-compressed 17646420 / 20552210 / -14.1% 🟢 40001376 / 35115122 / +13.9% 🔴 0.44 / 0.59 / -24.6%
clickbench_q30/duckdb:vortex-file-compressed 68214396 / 65381580 / +4.3% 105002813 / 106004147 / -0.9% 0.65 / 0.62 / +5.3%
clickbench_q31/duckdb:vortex-file-compressed 130122436 / 127183786 / +2.3% 198633756 / 196239357 / +1.2% 0.66 / 0.65 / +1.1%
clickbench_q32/duckdb:vortex-file-compressed 439899162 / 447756828 / -1.8% 484279710 / 467631543 / +3.6% 0.91 / 0.96 / -5.1%
clickbench_q33/duckdb:vortex-file-compressed 400017734 / 393950270 / +1.5% 501463293 / 508399380 / -1.4% 0.80 / 0.77 / +2.9%
clickbench_q34/duckdb:vortex-file-compressed 414034684 / 411809358 / +0.5% 532633406 / 542749712 / -1.9% 0.78 / 0.76 / +2.4%
clickbench_q35/duckdb:vortex-file-compressed 101521390 / 102497618 / -1.0% 152011234 / 139193375 / +9.2% 0.67 / 0.74 / -9.3%
clickbench_q36/duckdb:vortex-file-compressed 16013829 / 15736192 / +1.8% 30704094 / 32978570 / -6.9% 0.52 / 0.48 / +9.3%
clickbench_q37/duckdb:vortex-file-compressed 12532760 / 11776118 / +6.4% 29448334 / 28661882 / +2.7% 0.43 / 0.41 / +3.6%
clickbench_q38/duckdb:vortex-file-compressed 12931065 / 13489172 / -4.1% 28136276 / 29562838 / -4.8% 0.46 / 0.46 / +0.7%
clickbench_q39/duckdb:vortex-file-compressed 23112648 / 24468380 / -5.5% 42635829 / 42700938 / -0.2% 0.54 / 0.57 / -5.4%
clickbench_q40/duckdb:vortex-file-compressed 11261816 / 10966366 / +2.7% 28651306 / 28287499 / +1.3% 0.39 / 0.39 / +1.4%
clickbench_q41/duckdb:vortex-file-compressed 12261529 / 12791422 / -4.1% 26373398 / 28485424 / -7.4% 0.46 / 0.45 / +3.5%
clickbench_q42/duckdb:vortex-file-compressed 11887654 / 14602521 / -18.6% 🟢 31209435 / 29331807 / +6.4% 0.38 / 0.50 / -23.5%
duckdb / parquet / ns (1.006x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8484268 / 9553553 / -11.2% 🟢 22634096 / 23978120 / -5.6% 0.37 / 0.40 / -5.9%
clickbench_q01/duckdb:parquet 9681120 / 9982025 / -3.0% 21231525 / 20645205 / +2.8% 0.46 / 0.48 / -5.7%
clickbench_q02/duckdb:parquet 15223918 / 15187374 / +0.2% 31094253 / 31259954 / -0.5% 0.49 / 0.49 / +0.8%
clickbench_q03/duckdb:parquet 17359538 / 15183330 / +14.3% 🔴 50373459 / 50166654 / +0.4% 0.34 / 0.30 / +13.9%
clickbench_q04/duckdb:parquet 69869471 / 76186014 / -8.3% 91209838 / 92683011 / -1.6% 0.77 / 0.82 / -6.8%
clickbench_q05/duckdb:parquet 80273888 / 83524124 / -3.9% 119170723 / 118134935 / +0.9% 0.67 / 0.71 / -4.7%
clickbench_q06/duckdb:parquet 15646955 / 14676582 / +6.6% 27668160 / 24830081 / +11.4% 🔴 0.57 / 0.59 / -4.3%
clickbench_q07/duckdb:parquet 12316389 / 10740843 / +14.7% 🔴 23083572 / 22790866 / +1.3% 0.53 / 0.47 / +13.2%
clickbench_q08/duckdb:parquet 87480784 / 82500768 / +6.0% 123255422 / 122208171 / +0.9% 0.71 / 0.68 / +5.1%
clickbench_q09/duckdb:parquet 116659861 / 114589722 / +1.8% 154101359 / 158751142 / -2.9% 0.76 / 0.72 / +4.9%
clickbench_q10/duckdb:parquet 32815964 / 34566686 / -5.1% 68109494 / 69266598 / -1.7% 0.48 / 0.50 / -3.5%
clickbench_q11/duckdb:parquet 38062872 / 35868648 / +6.1% 83007199 / 74834757 / +10.9% 🔴 0.46 / 0.48 / -4.3%
clickbench_q12/duckdb:parquet 89305196 / 90876442 / -1.7% 128267052 / 133406461 / -3.9% 0.70 / 0.68 / +2.2%
clickbench_q13/duckdb:parquet 147046214 / 147354846 / -0.2% 216362840 / 226604157 / -4.5% 0.68 / 0.65 / +4.5%
clickbench_q14/duckdb:parquet 96321438 / 95666290 / +0.7% 145476215 / 137686147 / +5.7% 0.66 / 0.69 / -4.7%
clickbench_q15/duckdb:parquet 97378194 / 94691103 / +2.8% 118691764 / 129139051 / -8.1% 0.82 / 0.73 / +11.9%
clickbench_q16/duckdb:parquet 169307048 / 173875103 / -2.6% 240670145 / 231855447 / +3.8% 0.70 / 0.75 / -6.2%
clickbench_q17/duckdb:parquet 176187032 / 175331266 / +0.5% 258583013 / 231889583 / +11.5% 🔴 0.68 / 0.76 / -9.9%
clickbench_q18/duckdb:parquet 320975820 / 325888230 / -1.5% 441973314 / 440247274 / +0.4% 0.73 / 0.74 / -1.9%
clickbench_q19/duckdb:parquet 13388536 / 13631120 / -1.8% 43424434 / 40366010 / +7.6% 0.31 / 0.34 / -8.7%
clickbench_q20/duckdb:parquet 134775752 / 134955091 / -0.1% 243560469 / 237211468 / +2.7% 0.55 / 0.57 / -2.7%
clickbench_q21/duckdb:parquet 180494736 / 184820181 / -2.3% 320943960 / 319062142 / +0.6% 0.56 / 0.58 / -2.9%
clickbench_q22/duckdb:parquet 244242227 / 240954136 / +1.4% 408622290 / 401248052 / +1.8% 0.60 / 0.60 / -0.5%
clickbench_q23/duckdb:parquet 148418282 / 147316516 / +0.7% 177135690 / 170299137 / +4.0% 0.84 / 0.87 / -3.1%
clickbench_q24/duckdb:parquet 44226460 / 44077850 / +0.3% 60952232 / 58229698 / +4.7% 0.73 / 0.76 / -4.1%
clickbench_q25/duckdb:parquet 40812634 / 40074848 / +1.8% 89765232 / 87755790 / +2.3% 0.45 / 0.46 / -0.4%
clickbench_q26/duckdb:parquet 30351120 / 30932933 / -1.9% 48962364 / 44387662 / +10.3% 🔴 0.62 / 0.70 / -11.0%
clickbench_q27/duckdb:parquet 145626902 / 142390626 / +2.3% 259838598 / 255041620 / +1.9% 0.56 / 0.56 / +0.4%
clickbench_q28/duckdb:parquet 906525224 / 907486782 / -0.1% 986710929 / 1024139972 / -3.7% 0.92 / 0.89 / +3.7%
clickbench_q29/duckdb:parquet 17921323 / 17063719 / +5.0% 30401142 / 28841886 / +5.4% 0.59 / 0.59 / -0.4%
clickbench_q30/duckdb:parquet 91886512 / 91277937 / +0.7% 178453152 / 168647384 / +5.8% 0.51 / 0.54 / -4.9%
clickbench_q31/duckdb:parquet 143043090 / 143994254 / -0.7% 294538639 / 289845469 / +1.6% 0.49 / 0.50 / -2.2%
clickbench_q32/duckdb:parquet 450530370 / 440518651 / +2.3% 532594451 / 485215467 / +9.8% 0.85 / 0.91 / -6.8%
clickbench_q33/duckdb:parquet 443744764 / 450879019 / -1.6% 491514693 / 470451429 / +4.5% 0.90 / 0.96 / -5.8%
clickbench_q34/duckdb:parquet 460302108 / 446685279 / +3.0% 478204642 / 498549632 / -4.1% 0.96 / 0.90 / +7.4%
clickbench_q35/duckdb:parquet 102132256 / 105426400 / -3.1% 129993653 / 127785344 / +1.7% 0.79 / 0.83 / -4.8%
clickbench_q36/duckdb:parquet 31104036 / 31251456 / -0.5% 41683470 / 41767934 / -0.2% 0.75 / 0.75 / -0.3%
clickbench_q37/duckdb:parquet 22795572 / 22761188 / +0.2% 32186706 / 31642067 / +1.7% 0.71 / 0.72 / -1.5%
clickbench_q38/duckdb:parquet 23913040 / 24641746 / -3.0% 34510859 / 35930791 / -4.0% 0.69 / 0.69 / +1.0%
clickbench_q39/duckdb:parquet 56999398 / 57166078 / -0.3% 84305925 / 66337216 / +27.1% 🔴 0.68 / 0.86 / -21.5%
clickbench_q40/duckdb:parquet 12920833 / 12668964 / +2.0% 23422989 / 22638598 / +3.5% 0.55 / 0.56 / -1.4%
clickbench_q41/duckdb:parquet 13479084 / 12439968 / +8.4% 23053201 / 22336625 / +3.2% 0.58 / 0.56 / +5.0%
clickbench_q42/duckdb:parquet 14703858 / 14443638 / +1.8% 30807704 / 24542509 / +25.5% 🔴 0.48 / 0.59 / -18.9%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 515861ae vs base 008e3b75
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.4%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+2.5%, low confidence)
Vortex (geomean): hot 1.017x ➖ · cold 0.983x ➖
Parquet (geomean): hot 1.004x ➖ · cold 0.986x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24552650 / 23944632 / +2.5% 43161555 / 44252415 / -2.5% 0.57 / 0.54 / +5.1%
tpcds_q02/datafusion:vortex-file-compressed 45192765 / 45626076 / -0.9% 62570943 / 63360023 / -1.2% 0.72 / 0.72 / +0.3%
tpcds_q03/datafusion:vortex-file-compressed 11780962 / 11565544 / +1.9% 27698497 / 28716767 / -3.5% 0.43 / 0.40 / +5.6%
tpcds_q04/datafusion:vortex-file-compressed 111839444 / 113488243 / -1.5% 143258748 / 139190873 / +2.9% 0.78 / 0.82 / -4.3%
tpcds_q05/datafusion:vortex-file-compressed 60657477 / 59873861 / +1.3% 87136260 / 82721809 / +5.3% 0.70 / 0.72 / -3.8%
tpcds_q06/datafusion:vortex-file-compressed 23698870 / 23969100 / -1.1% 43102090 / 46692293 / -7.7% 0.55 / 0.51 / +7.1%
tpcds_q07/datafusion:vortex-file-compressed 32976837 / 32185364 / +2.5% 56048444 / 56363804 / -0.6% 0.59 / 0.57 / +3.0%
tpcds_q08/datafusion:vortex-file-compressed 25707445 / 25480644 / +0.9% 42685737 / 46651251 / -8.5% 0.60 / 0.55 / +10.3%
tpcds_q09/datafusion:vortex-file-compressed 17318930 / 17486297 / -1.0% 34718488 / 35461343 / -2.1% 0.50 / 0.49 / +1.2%
tpcds_q10/datafusion:vortex-file-compressed 29152641 / 28917850 / +0.8% 49025868 / 52242832 / -6.2% 0.59 / 0.55 / +7.4%
tpcds_q11/datafusion:vortex-file-compressed 62811913 / 62893276 / -0.1% 90650736 / 88892061 / +2.0% 0.69 / 0.71 / -2.1%
tpcds_q12/datafusion:vortex-file-compressed 16371946 / 16407603 / -0.2% 31448755 / 32723333 / -3.9% 0.52 / 0.50 / +3.8%
tpcds_q13/datafusion:vortex-file-compressed 34667816 / 34256082 / +1.2% 53307664 / 56293963 / -5.3% 0.65 / 0.61 / +6.9%
tpcds_q14/datafusion:vortex-file-compressed 90929482 / 92233977 / -1.4% 118900365 / 121334683 / -2.0% 0.76 / 0.76 / +0.6%
tpcds_q15/datafusion:vortex-file-compressed 23734270 / 23934493 / -0.8% 42754669 / 45283920 / -5.6% 0.56 / 0.53 / +5.0%
tpcds_q16/datafusion:vortex-file-compressed 20912088 / 20711589 / +1.0% 40327076 / 41533396 / -2.9% 0.52 / 0.50 / +4.0%
tpcds_q17/datafusion:vortex-file-compressed 57685900 / 58800054 / -1.9% 76371275 / 77273772 / -1.2% 0.76 / 0.76 / -0.7%
tpcds_q18/datafusion:vortex-file-compressed 68542960 / 68519670 / +0.0% 91027022 / 96367612 / -5.5% 0.75 / 0.71 / +5.9%
tpcds_q19/datafusion:vortex-file-compressed 18919837 / 18247522 / +3.7% 39549782 / 40767748 / -3.0% 0.48 / 0.45 / +6.9%
tpcds_q20/datafusion:vortex-file-compressed 17596736 / 17920652 / -1.8% 33360088 / 34524131 / -3.4% 0.53 / 0.52 / +1.6%
tpcds_q21/datafusion:vortex-file-compressed 17019604 / 17376068 / -2.1% 35701886 / 42281249 / -15.6% 🟢 0.48 / 0.41 / +16.0%
tpcds_q22/datafusion:vortex-file-compressed 49319264 / 50138894 / -1.6% 72251489 / 72856866 / -0.8% 0.68 / 0.69 / -0.8%
tpcds_q23/datafusion:vortex-file-compressed 73520716 / 72414822 / +1.5% 101364555 / 103042124 / -1.6% 0.73 / 0.70 / +3.2%
tpcds_q24/datafusion:vortex-file-compressed 71150129 / 70402866 / +1.1% 95262145 / 94866680 / +0.4% 0.75 / 0.74 / +0.6%
tpcds_q25/datafusion:vortex-file-compressed 56489530 / 52387048 / +7.8% 74368337 / 83680683 / -11.1% 🟢 0.76 / 0.63 / +21.3%
tpcds_q26/datafusion:vortex-file-compressed 30119835 / 30270383 / -0.5% 51180901 / 52908832 / -3.3% 0.59 / 0.57 / +2.9%
tpcds_q27/datafusion:vortex-file-compressed 64285424 / 65032116 / -1.1% 93712309 / 91856804 / +2.0% 0.69 / 0.71 / -3.1%
tpcds_q28/datafusion:vortex-file-compressed 18277430 / 18346325 / -0.4% 35007414 / 35207379 / -0.6% 0.52 / 0.52 / +0.2%
tpcds_q29/datafusion:vortex-file-compressed 56841911 / 62861850 / -9.6% 76220616 / 85531534 / -10.9% 🟢 0.75 / 0.73 / +1.5%
tpcds_q30/datafusion:vortex-file-compressed 27051860 / 27576848 / -1.9% 44176296 / 45640060 / -3.2% 0.61 / 0.60 / +1.3%
tpcds_q31/datafusion:vortex-file-compressed 65361244 / 64814594 / +0.8% 89949549 / 92705531 / -3.0% 0.73 / 0.70 / +3.9%
tpcds_q32/datafusion:vortex-file-compressed 13326593 / 13999488 / -4.8% 30508451 / 32152752 / -5.1% 0.44 / 0.44 / +0.3%
tpcds_q33/datafusion:vortex-file-compressed 27004014 / 26766554 / +0.9% 46661501 / 49177034 / -5.1% 0.58 / 0.54 / +6.3%
tpcds_q34/datafusion:vortex-file-compressed 18553423 / 18238702 / +1.7% 37660143 / 39430315 / -4.5% 0.49 / 0.46 / +6.5%
tpcds_q35/datafusion:vortex-file-compressed 37033813 / 35424722 / +4.5% 57175346 / 59183523 / -3.4% 0.65 / 0.60 / +8.2%
tpcds_q36/datafusion:vortex-file-compressed 48304744 / 48132178 / +0.4% 71414314 / 73734801 / -3.1% 0.68 / 0.65 / +3.6%
tpcds_q37/datafusion:vortex-file-compressed 13842791 / 13758870 / +0.6% 33054747 / 36018988 / -8.2% 0.42 / 0.38 / +9.6%
tpcds_q38/datafusion:vortex-file-compressed 29641020 / 29925345 / -1.0% 51354952 / 53210686 / -3.5% 0.58 / 0.56 / +2.6%
tpcds_q39/datafusion:vortex-file-compressed 65288332 / 65940362 / -1.0% 88254872 / 92671857 / -4.8% 0.74 / 0.71 / +4.0%
tpcds_q40/datafusion:vortex-file-compressed 25882200 / 25009368 / +3.5% 43531318 / 46929423 / -7.2% 0.59 / 0.53 / +11.6%
tpcds_q41/datafusion:vortex-file-compressed 16534558 / 16586309 / -0.3% 30539303 / 31644447 / -3.5% 0.54 / 0.52 / +3.3%
tpcds_q42/datafusion:vortex-file-compressed 11484850 / 11529220 / -0.4% 26165244 / 28614074 / -8.6% 0.44 / 0.40 / +8.9%
tpcds_q43/datafusion:vortex-file-compressed 13473305 / 13911632 / -3.2% 31229944 / 33571025 / -7.0% 0.43 / 0.41 / +4.1%
tpcds_q44/datafusion:vortex-file-compressed 26576278 / 26251406 / +1.2% 49688550 / 52371513 / -5.1% 0.53 / 0.50 / +6.7%
tpcds_q45/datafusion:vortex-file-compressed 28079486 / 27263066 / +3.0% 47745891 / 49052242 / -2.7% 0.59 / 0.56 / +5.8%
tpcds_q46/datafusion:vortex-file-compressed 24481464 / 24437004 / +0.2% 47177170 / 48791195 / -3.3% 0.52 / 0.50 / +3.6%
tpcds_q47/datafusion:vortex-file-compressed 78313172 / 78135034 / +0.2% 107035422 / 106113519 / +0.9% 0.73 / 0.74 / -0.6%
tpcds_q48/datafusion:vortex-file-compressed 31710565 / 31258688 / +1.4% 49566858 / 53333144 / -7.1% 0.64 / 0.59 / +9.2%
tpcds_q49/datafusion:vortex-file-compressed 60180508 / 59930230 / +0.4% 81822021 / 85451765 / -4.2% 0.74 / 0.70 / +4.9%
tpcds_q50/datafusion:vortex-file-compressed 34161184 / 34526961 / -1.1% 54885445 / 57449848 / -4.5% 0.62 / 0.60 / +3.6%
tpcds_q51/datafusion:vortex-file-compressed 61108482 / 61035381 / +0.1% 83119152 / 84618244 / -1.8% 0.74 / 0.72 / +1.9%
tpcds_q52/datafusion:vortex-file-compressed 11741144 / 11748707 / -0.1% 27236854 / 27930818 / -2.5% 0.43 / 0.42 / +2.5%
tpcds_q53/datafusion:vortex-file-compressed 18288396 / 18216327 / +0.4% 36939080 / 37997189 / -2.8% 0.50 / 0.48 / +3.3%
tpcds_q54/datafusion:vortex-file-compressed 34791416 / 33920417 / +2.6% 58632622 / 62750045 / -6.6% 0.59 / 0.54 / +9.8%
tpcds_q55/datafusion:vortex-file-compressed 11512132 / 11245705 / +2.4% 27167507 / 28188740 / -3.6% 0.42 / 0.40 / +6.2%
tpcds_q56/datafusion:vortex-file-compressed 26908970 / 26464688 / +1.7% 48027151 / 48840075 / -1.7% 0.56 / 0.54 / +3.4%
tpcds_q57/datafusion:vortex-file-compressed 74202630 / 74167211 / +0.0% 96173974 / 98465998 / -2.3% 0.77 / 0.75 / +2.4%
tpcds_q58/datafusion:vortex-file-compressed 40479375 / 41249084 / -1.9% 65045132 / 67319746 / -3.4% 0.62 / 0.61 / +1.6%
tpcds_q59/datafusion:vortex-file-compressed 32199106 / 31924354 / +0.9% 51848107 / 54144615 / -4.2% 0.62 / 0.59 / +5.3%
tpcds_q60/datafusion:vortex-file-compressed 26391326 / 27159804 / -2.8% 47433252 / 50901478 / -6.8% 0.56 / 0.53 / +4.3%
tpcds_q61/datafusion:vortex-file-compressed 24285407 / 24347702 / -0.3% 46835009 / 50017222 / -6.4% 0.52 / 0.49 / +6.5%
tpcds_q62/datafusion:vortex-file-compressed 17078720 / 17024742 / +0.3% 35432529 / 36321766 / -2.4% 0.48 / 0.47 / +2.8%
tpcds_q63/datafusion:vortex-file-compressed 18515936 / 18413362 / +0.6% 37348881 / 38499775 / -3.0% 0.50 / 0.48 / +3.7%
tpcds_q64/datafusion:vortex-file-compressed 325002712 / 321037089 / +1.2% 349583588 / 354688730 / -1.4% 0.93 / 0.91 / +2.7%
tpcds_q65/datafusion:vortex-file-compressed 75847310 / 75097098 / +1.0% 93365666 / 96770974 / -3.5% 0.81 / 0.78 / +4.7%
tpcds_q66/datafusion:vortex-file-compressed 53371833 / 52967277 / +0.8% 74890949 / 75171023 / -0.4% 0.71 / 0.70 / +1.1%
tpcds_q67/datafusion:vortex-file-compressed 55683194 / 55324120 / +0.6% 84376854 / 85587996 / -1.4% 0.66 / 0.65 / +2.1%
tpcds_q68/datafusion:vortex-file-compressed 23610682 / 23685562 / -0.3% 46490299 / 51381132 / -9.5% 0.51 / 0.46 / +10.2%
tpcds_q69/datafusion:vortex-file-compressed 28633368 / 28707298 / -0.3% 46142067 / 50470403 / -8.6% 0.62 / 0.57 / +9.1%
tpcds_q70/datafusion:vortex-file-compressed 71936470 / 72025520 / -0.1% 91137396 / 93776194 / -2.8% 0.79 / 0.77 / +2.8%
tpcds_q71/datafusion:vortex-file-compressed 19426960 / 18159404 / +7.0% 37691696 / 41887972 / -10.0% 🟢 0.52 / 0.43 / +18.9%
tpcds_q72/datafusion:vortex-file-compressed 475305592 / 465659867 / +2.1% 476906190 / 497308625 / -4.1% 1.00 / 0.94 / +6.4%
tpcds_q73/datafusion:vortex-file-compressed 17822817 / 17718763 / +0.6% 37035838 / 38990035 / -5.0% 0.48 / 0.45 / +5.9%
tpcds_q74/datafusion:vortex-file-compressed 45950376 / 45280226 / +1.5% 69102304 / 70242389 / -1.6% 0.66 / 0.64 / +3.2%
tpcds_q75/datafusion:vortex-file-compressed 132327432 / 130251274 / +1.6% 158032970 / 156682580 / +0.9% 0.84 / 0.83 / +0.7%
tpcds_q76/datafusion:vortex-file-compressed 42966580 / 40455272 / +6.2% 63745802 / 66442063 / -4.1% 0.67 / 0.61 / +10.7%
tpcds_q77/datafusion:vortex-file-compressed 36113666 / 34309500 / +5.3% 58377061 / 59051342 / -1.1% 0.62 / 0.58 / +6.5%
tpcds_q78/datafusion:vortex-file-compressed 80257164 / 80612112 / -0.4% 107353964 / 111623482 / -3.8% 0.75 / 0.72 / +3.5%
tpcds_q79/datafusion:vortex-file-compressed 21188322 / 20881810 / +1.5% 42596958 / 42525460 / +0.2% 0.50 / 0.49 / +1.3%
tpcds_q80/datafusion:vortex-file-compressed 76783780 / 76256435 / +0.7% 110611037 / 109234447 / +1.3% 0.69 / 0.70 / -0.6%
tpcds_q81/datafusion:vortex-file-compressed 27583986 / 28012670 / -1.5% 45788731 / 46862834 / -2.3% 0.60 / 0.60 / +0.8%
tpcds_q82/datafusion:vortex-file-compressed 13789793 / 13566985 / +1.6% 31652696 / 37121293 / -14.7% 🟢 0.44 / 0.37 / +19.2%
tpcds_q83/datafusion:vortex-file-compressed 36604500 / 36414138 / +0.5% 57947186 / 58130773 / -0.3% 0.63 / 0.63 / +0.8%
tpcds_q84/datafusion:vortex-file-compressed 12021222 / 11746696 / +2.3% 27422119 / 28388012 / -3.4% 0.44 / 0.41 / +5.9%
tpcds_q85/datafusion:vortex-file-compressed 59827940 / 59769642 / +0.1% 85806783 / 85392918 / +0.5% 0.70 / 0.70 / -0.4%
tpcds_q86/datafusion:vortex-file-compressed 16309412 / 16553338 / -1.5% 32150299 / 33224289 / -3.2% 0.51 / 0.50 / +1.8%
tpcds_q87/datafusion:vortex-file-compressed 29372348 / 29745330 / -1.3% 51736251 / 52673204 / -1.8% 0.57 / 0.56 / +0.5%
tpcds_q88/datafusion:vortex-file-compressed 34816816 / 34068132 / +2.2% 61656640 / 61879292 / -0.4% 0.56 / 0.55 / +2.6%
tpcds_q89/datafusion:vortex-file-compressed 21264660 / 21398384 / -0.6% 39009475 / 41363662 / -5.7% 0.55 / 0.52 / +5.4%
tpcds_q90/datafusion:vortex-file-compressed 10477945 / 10323099 / +1.5% 25491909 / 26229320 / -2.8% 0.41 / 0.39 / +4.4%
tpcds_q91/datafusion:vortex-file-compressed 16712135 / 17440682 / -4.2% 35400409 / 35137744 / +0.7% 0.47 / 0.50 / -4.9%
tpcds_q92/datafusion:vortex-file-compressed 13479164 / 13947698 / -3.4% 30689243 / 32326740 / -5.1% 0.44 / 0.43 / +1.8%
tpcds_q93/datafusion:vortex-file-compressed 23953064 / 23858753 / +0.4% 44578877 / 47096560 / -5.3% 0.54 / 0.51 / +6.1%
tpcds_q94/datafusion:vortex-file-compressed 19297852 / 19793544 / -2.5% 39151606 / 40705687 / -3.8% 0.49 / 0.49 / +1.4%
tpcds_q95/datafusion:vortex-file-compressed 46319556 / 46380054 / -0.1% 67557006 / 66874889 / +1.0% 0.69 / 0.69 / -1.1%
tpcds_q96/datafusion:vortex-file-compressed 9421658 / 9572342 / -1.6% 23332849 / 26725248 / -12.7% 🟢 0.40 / 0.36 / +12.7%
tpcds_q97/datafusion:vortex-file-compressed 20922845 / 21283462 / -1.7% 42338411 / 44723599 / -5.3% 0.49 / 0.48 / +3.8%
tpcds_q98/datafusion:vortex-file-compressed 16829998 / 17190722 / -2.1% 35298119 / 37750050 / -6.5% 0.48 / 0.46 / +4.7%
tpcds_q99/datafusion:vortex-file-compressed 19521166 / 19293053 / +1.2% 37443757 / 38501544 / -2.7% 0.52 / 0.50 / +4.0%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 28539254 / 31005024 / -8.0% 45487590 / 46454086 / -2.1% 0.63 / 0.67 / -6.0%
tpcds_q02/datafusion:parquet 45325861 / 45909644 / -1.3% 60099584 / 60676820 / -1.0% 0.75 / 0.76 / -0.3%
tpcds_q03/datafusion:parquet 19040042 / 18619656 / +2.3% 32077541 / 32500711 / -1.3% 0.59 / 0.57 / +3.6%
tpcds_q04/datafusion:parquet 195159850 / 193763444 / +0.7% 221051510 / 229540795 / -3.7% 0.88 / 0.84 / +4.6%
tpcds_q05/datafusion:parquet 72318848 / 71867003 / +0.6% 94272134 / 98129012 / -3.9% 0.77 / 0.73 / +4.7%
tpcds_q06/datafusion:parquet 34830626 / 34799214 / +0.1% 54043342 / 53791743 / +0.5% 0.64 / 0.65 / -0.4%
tpcds_q07/datafusion:parquet 46133956 / 46554747 / -0.9% 68901610 / 67846949 / +1.6% 0.67 / 0.69 / -2.4%
tpcds_q08/datafusion:parquet 40001836 / 39130737 / +2.2% 52157065 / 54280775 / -3.9% 0.77 / 0.72 / +6.4%
tpcds_q09/datafusion:parquet 30034502 / 29289976 / +2.5% 38074211 / 44293632 / -14.0% 🟢 0.79 / 0.66 / +19.3%
tpcds_q10/datafusion:parquet 51762060 / 49938382 / +3.7% 62060761 / 64471152 / -3.7% 0.83 / 0.77 / +7.7%
tpcds_q11/datafusion:parquet 94717430 / 92763504 / +2.1% 117278980 / 120440986 / -2.6% 0.81 / 0.77 / +4.9%
tpcds_q12/datafusion:parquet 24545256 / 24073314 / +2.0% 36271113 / 37453459 / -3.2% 0.68 / 0.64 / +5.3%
tpcds_q13/datafusion:parquet 44679121 / 45574878 / -2.0% 62774233 / 66183790 / -5.2% 0.71 / 0.69 / +3.4%
tpcds_q14/datafusion:parquet 137207512 / 136380319 / +0.6% 154105974 / 155073710 / -0.6% 0.89 / 0.88 / +1.2%
tpcds_q15/datafusion:parquet 30313449 / 31287927 / -3.1% 48885508 / 49952535 / -2.1% 0.62 / 0.63 / -1.0%
tpcds_q16/datafusion:parquet 36619323 / 36047113 / +1.6% 54553416 / 55347527 / -1.4% 0.67 / 0.65 / +3.1%
tpcds_q17/datafusion:parquet 73799429 / 73519334 / +0.4% 100457123 / 103492366 / -2.9% 0.73 / 0.71 / +3.4%
tpcds_q18/datafusion:parquet 57188827 / 59439410 / -3.8% 83400479 / 80409366 / +3.7% 0.69 / 0.74 / -7.2%
tpcds_q19/datafusion:parquet 32360578 / 32002288 / +1.1% 48598412 / 49286049 / -1.4% 0.67 / 0.65 / +2.6%
tpcds_q20/datafusion:parquet 25605140 / 25479374 / +0.5% 38074155 / 38489094 / -1.1% 0.67 / 0.66 / +1.6%
tpcds_q21/datafusion:parquet 20239555 / 20214415 / +0.1% 34053659 / 33160959 / +2.7% 0.59 / 0.61 / -2.5%
tpcds_q22/datafusion:parquet 77511019 / 77500992 / +0.0% 92622210 / 92801235 / -0.2% 0.84 / 0.84 / +0.2%
tpcds_q23/datafusion:parquet 115945590 / 116106581 / -0.1% 139489883 / 141503947 / -1.4% 0.83 / 0.82 / +1.3%
tpcds_q24/datafusion:parquet 89992498 / 89013950 / +1.1% 118434758 / 118961161 / -0.4% 0.76 / 0.75 / +1.5%
tpcds_q25/datafusion:parquet 75127416 / 74539123 / +0.8% 102288841 / 106596233 / -4.0% 0.73 / 0.70 / +5.0%
tpcds_q26/datafusion:parquet 42133140 / 43348022 / -2.8% 60331737 / 64382014 / -6.3% 0.70 / 0.67 / +3.7%
tpcds_q27/datafusion:parquet 78652044 / 78329337 / +0.4% 97213541 / 102692731 / -5.3% 0.81 / 0.76 / +6.1%
tpcds_q28/datafusion:parquet 27143195 / 26757328 / +1.4% 44571068 / 41952954 / +6.2% 0.61 / 0.64 / -4.5%
tpcds_q29/datafusion:parquet 75562923 / 75756120 / -0.3% 101571304 / 103631056 / -2.0% 0.74 / 0.73 / +1.8%
tpcds_q30/datafusion:parquet 45958698 / 44101217 / +4.2% 65445863 / 67253111 / -2.7% 0.70 / 0.66 / +7.1%
tpcds_q31/datafusion:parquet 91666898 / 89295999 / +2.7% 105330961 / 108805876 / -3.2% 0.87 / 0.82 / +6.0%
tpcds_q32/datafusion:parquet 25861538 / 25666290 / +0.8% 40856903 / 42281440 / -3.4% 0.63 / 0.61 / +4.3%
tpcds_q33/datafusion:parquet 41377416 / 39762458 / +4.1% 54782682 / 58297693 / -6.0% 0.76 / 0.68 / +10.7%
tpcds_q34/datafusion:parquet 23888438 / 24069558 / -0.8% 37410783 / 39540637 / -5.4% 0.64 / 0.61 / +4.9%
tpcds_q35/datafusion:parquet 55679612 / 55853634 / -0.3% 71697467 / 73446652 / -2.4% 0.78 / 0.76 / +2.1%
tpcds_q36/datafusion:parquet 51511325 / 51129418 / +0.7% 75598845 / 76591878 / -1.3% 0.68 / 0.67 / +2.1%
tpcds_q37/datafusion:parquet 26399120 / 26007518 / +1.5% 37219949 / 41080837 / -9.4% 0.71 / 0.63 / +12.0%
tpcds_q38/datafusion:parquet 44164748 / 44884920 / -1.6% 63473906 / 66785023 / -5.0% 0.70 / 0.67 / +3.5%
tpcds_q39/datafusion:parquet 72093803 / 70952100 / +1.6% 91125718 / 89378838 / +2.0% 0.79 / 0.79 / -0.3%
tpcds_q40/datafusion:parquet 28255790 / 29590158 / -4.5% 50620813 / 50244295 / +0.7% 0.56 / 0.59 / -5.2%
tpcds_q41/datafusion:parquet 19664485 / 20019784 / -1.8% 32829904 / 34850592 / -5.8% 0.60 / 0.57 / +4.3%
tpcds_q42/datafusion:parquet 18152967 / 18034923 / +0.7% 30782295 / 31134194 / -1.1% 0.59 / 0.58 / +1.8%
tpcds_q43/datafusion:parquet 19465588 / 19607252 / -0.7% 32818548 / 34137413 / -3.9% 0.59 / 0.57 / +3.3%
tpcds_q44/datafusion:parquet 32875360 / 33737514 / -2.6% 49667668 / 52192830 / -4.8% 0.66 / 0.65 / +2.4%
tpcds_q45/datafusion:parquet 37918128 / 38160508 / -0.6% 53316498 / 55006603 / -3.1% 0.71 / 0.69 / +2.5%
tpcds_q46/datafusion:parquet 30804336 / 29944062 / +2.9% 49989374 / 51613734 / -3.1% 0.62 / 0.58 / +6.2%
tpcds_q47/datafusion:parquet 98645888 / 98200062 / +0.5% 123879095 / 126410005 / -2.0% 0.80 / 0.78 / +2.5%
tpcds_q48/datafusion:parquet 41138210 / 41760328 / -1.5% 58222710 / 61288991 / -5.0% 0.71 / 0.68 / +3.7%
tpcds_q49/datafusion:parquet 76421889 / 73906077 / +3.4% 96971900 / 104591531 / -7.3% 0.79 / 0.71 / +11.5%
tpcds_q50/datafusion:parquet 47991413 / 47956312 / +0.1% 69447876 / 72081012 / -3.7% 0.69 / 0.67 / +3.9%
tpcds_q51/datafusion:parquet 71203554 / 71345630 / -0.2% 92899343 / 93540922 / -0.7% 0.77 / 0.76 / +0.5%
tpcds_q52/datafusion:parquet 18659274 / 18765806 / -0.6% 32599030 / 34233526 / -4.8% 0.57 / 0.55 / +4.4%
tpcds_q53/datafusion:parquet 22781886 / 22552532 / +1.0% 38972641 / 41858915 / -6.9% 0.58 / 0.54 / +8.5%
tpcds_q54/datafusion:parquet 54346366 / 54650718 / -0.6% 71455905 / 76592096 / -6.7% 0.76 / 0.71 / +6.6%
tpcds_q55/datafusion:parquet 18150684 / 18179276 / -0.2% 31007304 / 34174399 / -9.3% 0.59 / 0.53 / +10.0%
tpcds_q56/datafusion:parquet 46743579 / 47166456 / -0.9% 61194936 / 62812715 / -2.6% 0.76 / 0.75 / +1.7%
tpcds_q57/datafusion:parquet 101380198 / 100364208 / +1.0% 121230381 / 121264745 / -0.0% 0.84 / 0.83 / +1.0%
tpcds_q58/datafusion:parquet 63717892 / 64274738 / -0.9% 82215686 / 84278930 / -2.4% 0.78 / 0.76 / +1.6%
tpcds_q59/datafusion:parquet 46702272 / 47956144 / -2.6% 64560630 / 63961444 / +0.9% 0.72 / 0.75 / -3.5%
tpcds_q60/datafusion:parquet 46077788 / 44804952 / +2.8% 60473219 / 64213536 / -5.8% 0.76 / 0.70 / +9.2%
tpcds_q61/datafusion:parquet 36598006 / 36546796 / +0.1% 56397404 / 59218806 / -4.8% 0.65 / 0.62 / +5.1%
tpcds_q62/datafusion:parquet 25271730 / 25202335 / +0.3% 39095088 / 40026787 / -2.3% 0.65 / 0.63 / +2.7%
tpcds_q63/datafusion:parquet 22322314 / 22299165 / +0.1% 39214858 / 40487904 / -3.1% 0.57 / 0.55 / +3.4%
tpcds_q64/datafusion:parquet 210074900 / 208691002 / +0.7% 241439849 / 242277457 / -0.3% 0.87 / 0.86 / +1.0%
tpcds_q65/datafusion:parquet 38403316 / 37230172 / +3.2% 53213460 / 57832086 / -8.0% 0.72 / 0.64 / +12.1%
tpcds_q66/datafusion:parquet 62999706 / 62032864 / +1.6% 78923185 / 79492802 / -0.7% 0.80 / 0.78 / +2.3%
tpcds_q67/datafusion:parquet 69884348 / 69747791 / +0.2% 95601050 / 97272068 / -1.7% 0.73 / 0.72 / +1.9%
tpcds_q68/datafusion:parquet 29475128 / 29680026 / -0.7% 50115982 / 52287049 / -4.2% 0.59 / 0.57 / +3.6%
tpcds_q69/datafusion:parquet 51568374 / 51161896 / +0.8% 61780323 / 65579218 / -5.8% 0.83 / 0.78 / +7.0%
tpcds_q70/datafusion:parquet 37090028 / 37055058 / +0.1% 58440061 / 57839251 / +1.0% 0.63 / 0.64 / -0.9%
tpcds_q71/datafusion:parquet 27279566 / 28732981 / -5.1% 43406793 / 44337757 / -2.1% 0.63 / 0.65 / -3.0%
tpcds_q72/datafusion:parquet 566960146 / 551128308 / +2.9% 579247339 / 593379498 / -2.4% 0.98 / 0.93 / +5.4%
tpcds_q73/datafusion:parquet 22981311 / 23289042 / -1.3% 37920898 / 39624203 / -4.3% 0.61 / 0.59 / +3.1%
tpcds_q74/datafusion:parquet 68798844 / 69589604 / -1.1% 87255285 / 89194195 / -2.2% 0.79 / 0.78 / +1.1%
tpcds_q75/datafusion:parquet 149051260 / 147731910 / +0.9% 178877636 / 186237829 / -4.0% 0.83 / 0.79 / +5.0%
tpcds_q76/datafusion:parquet 53034809 / 54787944 / -3.2% 72657086 / 74041921 / -1.9% 0.73 / 0.74 / -1.4%
tpcds_q77/datafusion:parquet 56403265 / 55992443 / +0.7% 74179392 / 76856306 / -3.5% 0.76 / 0.73 / +4.4%
tpcds_q78/datafusion:parquet 91430754 / 93147375 / -1.8% 125777215 / 123665593 / +1.7% 0.73 / 0.75 / -3.5%
tpcds_q79/datafusion:parquet 26088696 / 25802948 / +1.1% 44719867 / 46696850 / -4.2% 0.58 / 0.55 / +5.6%
tpcds_q80/datafusion:parquet 81775040 / 82807218 / -1.2% 111707626 / 116586313 / -4.2% 0.73 / 0.71 / +3.1%
tpcds_q81/datafusion:parquet 40703467 / 41386223 / -1.6% 57857177 / 63749199 / -9.2% 0.70 / 0.65 / +8.4%
tpcds_q82/datafusion:parquet 26146300 / 26866182 / -2.7% 41101560 / 41276077 / -0.4% 0.64 / 0.65 / -2.3%
tpcds_q83/datafusion:parquet 56731224 / 57091744 / -0.6% 77253534 / 73345128 / +5.3% 0.73 / 0.78 / -5.7%
tpcds_q84/datafusion:parquet 30716049 / 30714283 / +0.0% 45294004 / 45749778 / -1.0% 0.68 / 0.67 / +1.0%
tpcds_q85/datafusion:parquet 82833407 / 83578886 / -0.9% 106840778 / 107695703 / -0.8% 0.78 / 0.78 / -0.1%
tpcds_q86/datafusion:parquet 20505966 / 20314138 / +0.9% 33937946 / 36086784 / -6.0% 0.60 / 0.56 / +7.3%
tpcds_q87/datafusion:parquet 45383038 / 46590276 / -2.6% 58684210 / 62012492 / -5.4% 0.77 / 0.75 / +2.9%
tpcds_q88/datafusion:parquet 50495410 / 47269750 / +6.8% 67843559 / 67399213 / +0.7% 0.74 / 0.70 / +6.1%
tpcds_q89/datafusion:parquet 25499185 / 25682230 / -0.7% 43161253 / 43915557 / -1.7% 0.59 / 0.58 / +1.0%
tpcds_q90/datafusion:parquet 19461456 / 19439516 / +0.1% 31146164 / 30597151 / +1.8% 0.62 / 0.64 / -1.7%
tpcds_q91/datafusion:parquet 35437341 / 36565612 / -3.1% 52640023 / 54869858 / -4.1% 0.67 / 0.67 / +1.0%
tpcds_q92/datafusion:parquet 26338158 / 25815938 / +2.0% 41330212 / 42154754 / -2.0% 0.64 / 0.61 / +4.1%
tpcds_q93/datafusion:parquet 26972980 / 26815832 / +0.6% 46034983 / 48690384 / -5.5% 0.59 / 0.55 / +6.4%
tpcds_q94/datafusion:parquet 34110710 / 34724510 / -1.8% 50941521 / 49783309 / +2.3% 0.67 / 0.70 / -4.0%
tpcds_q95/datafusion:parquet 63630848 / 64546842 / -1.4% 78112334 / 82243054 / -5.0% 0.81 / 0.78 / +3.8%
tpcds_q96/datafusion:parquet 16871261 / 16622684 / +1.5% 29675935 / 30840685 / -3.8% 0.57 / 0.54 / +5.5%
tpcds_q97/datafusion:parquet 35535581 / 35955326 / -1.2% 54910864 / 54417477 / +0.9% 0.65 / 0.66 / -2.1%
tpcds_q98/datafusion:parquet 25182130 / 25397899 / -0.8% 38707971 / 40983174 / -5.6% 0.65 / 0.62 / +5.0%
tpcds_q99/datafusion:parquet 29100663 / 29387549 / -1.0% 42876836 / 44513892 / -3.7% 0.68 / 0.66 / +2.8%
duckdb / vortex-file-compressed / ns (1.032x ➖, 6↑ 15↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15102818 / 15174725 / -0.5% 22254311 / 23438287 / -5.1% 0.68 / 0.65 / +4.8%
tpcds_q02/duckdb:vortex-file-compressed 15116118 / 14970261 / +1.0% 19201068 / 20746612 / -7.4% 0.79 / 0.72 / +9.1%
tpcds_q03/duckdb:vortex-file-compressed 11137568 / 11203152 / -0.6% 20477262 / 20855876 / -1.8% 0.54 / 0.54 / +1.3%
tpcds_q04/duckdb:vortex-file-compressed 63691216 / 49666481 / +28.2% 🔴 74579082 / 59278077 / +25.8% 🔴 0.85 / 0.84 / +1.9%
tpcds_q05/duckdb:vortex-file-compressed 18639734 / 18926130 / -1.5% 24404433 / 29310641 / -16.7% 🟢 0.76 / 0.65 / +18.3%
tpcds_q06/duckdb:vortex-file-compressed 28251990 / 26768356 / +5.5% 41723332 / 41544094 / +0.4% 0.68 / 0.64 / +5.1%
tpcds_q07/duckdb:vortex-file-compressed 16582037 / 15566488 / +6.5% 29911569 / 29841392 / +0.2% 0.55 / 0.52 / +6.3%
tpcds_q08/duckdb:vortex-file-compressed 19213398 / 19189037 / +0.1% 27519184 / 28466386 / -3.3% 0.70 / 0.67 / +3.6%
tpcds_q09/duckdb:vortex-file-compressed 15001174 / 10696604 / +40.2% 🔴 23002990 / 17947416 / +28.2% 🔴 0.65 / 0.60 / +9.4%
tpcds_q10/duckdb:vortex-file-compressed 27973129 / 29410066 / -4.9% 42466675 / 40923271 / +3.8% 0.66 / 0.72 / -8.3%
tpcds_q11/duckdb:vortex-file-compressed 40286061 / 40334083 / -0.1% 50281461 / 51086245 / -1.6% 0.80 / 0.79 / +1.5%
tpcds_q12/duckdb:vortex-file-compressed 11428392 / 10091874 / +13.2% 🔴 16570418 / 16767032 / -1.2% 0.69 / 0.60 / +14.6%
tpcds_q13/duckdb:vortex-file-compressed 23240530 / 21794531 / +6.6% 37749335 / 35757602 / +5.6% 0.62 / 0.61 / +1.0%
tpcds_q14/duckdb:vortex-file-compressed 60605183 / 58486914 / +3.6% 71771899 / 72128580 / -0.5% 0.84 / 0.81 / +4.1%
tpcds_q15/duckdb:vortex-file-compressed 21133746 / 20826081 / +1.5% 24921246 / 25462061 / -2.1% 0.85 / 0.82 / +3.7%
tpcds_q16/duckdb:vortex-file-compressed 17594892 / 17433432 / +0.9% 30712816 / 26776445 / +14.7% 🔴 0.57 / 0.65 / -12.0%
tpcds_q17/duckdb:vortex-file-compressed 26578514 / 30146062 / -11.8% 🟢 39755024 / 45355756 / -12.3% 🟢 0.67 / 0.66 / +0.6%
tpcds_q18/duckdb:vortex-file-compressed 33837857 / 28721650 / +17.8% 🔴 45955607 / 39865588 / +15.3% 🔴 0.74 / 0.72 / +2.2%
tpcds_q19/duckdb:vortex-file-compressed 23761733 / 23981464 / -0.9% 33768860 / 35190808 / -4.0% 0.70 / 0.68 / +3.3%
tpcds_q20/duckdb:vortex-file-compressed 10877536 / 10744504 / +1.2% 16223518 / 15442125 / +5.1% 0.67 / 0.70 / -3.6%
tpcds_q21/duckdb:vortex-file-compressed 9898412 / 10060532 / -1.6% 17827312 / 18036393 / -1.2% 0.56 / 0.56 / -0.5%
tpcds_q22/duckdb:vortex-file-compressed 29427407 / 29682344 / -0.9% 37570788 / 39393124 / -4.6% 0.78 / 0.75 / +3.9%
tpcds_q23/duckdb:vortex-file-compressed 38018475 / 36415945 / +4.4% 52753713 / 46180493 / +14.2% 🔴 0.72 / 0.79 / -8.6%
tpcds_q24/duckdb:vortex-file-compressed 27908524 / 27872624 / +0.1% 39674684 / 39232622 / +1.1% 0.70 / 0.71 / -1.0%
tpcds_q25/duckdb:vortex-file-compressed 26430008 / 25794259 / +2.5% 38675739 / 40880515 / -5.4% 0.68 / 0.63 / +8.3%
tpcds_q26/duckdb:vortex-file-compressed 13337594 / 13499856 / -1.2% 20061748 / 19877609 / +0.9% 0.66 / 0.68 / -2.1%
tpcds_q27/duckdb:vortex-file-compressed 32394620 / 17078193 / +89.7% 🔴 44952853 / 30752338 / +46.2% 🔴 0.72 / 0.56 / +29.8%
tpcds_q28/duckdb:vortex-file-compressed 12906898 / 8483308 / +52.1% 🔴 21874246 / 13167347 / +66.1% 🔴 0.59 / 0.64 / -8.4%
tpcds_q29/duckdb:vortex-file-compressed 26693680 / 28800928 / -7.3% 40271133 / 47380060 / -15.0% 🟢 0.66 / 0.61 / +9.0%
tpcds_q30/duckdb:vortex-file-compressed 18876596 / 19316939 / -2.3% 26554447 / 28014652 / -5.2% 0.71 / 0.69 / +3.1%
tpcds_q31/duckdb:vortex-file-compressed 19414581 / 19618848 / -1.0% 31403980 / 25930402 / +21.1% 🔴 0.62 / 0.76 / -18.3%
tpcds_q32/duckdb:vortex-file-compressed 9985486 / 10062642 / -0.8% 19850635 / 16549987 / +19.9% 🔴 0.50 / 0.61 / -17.3%
tpcds_q33/duckdb:vortex-file-compressed 17021118 / 17132708 / -0.7% 31021036 / 31814258 / -2.5% 0.55 / 0.54 / +1.9%
tpcds_q34/duckdb:vortex-file-compressed 14540155 / 15773759 / -7.8% 24566288 / 24768855 / -0.8% 0.59 / 0.64 / -7.1%
tpcds_q35/duckdb:vortex-file-compressed 46582314 / 45979626 / +1.3% 60782598 / 62716197 / -3.1% 0.77 / 0.73 / +4.5%
tpcds_q36/duckdb:vortex-file-compressed 15455205 / 15026000 / +2.9% 25491916 / 30352856 / -16.0% 🟢 0.61 / 0.50 / +22.5%
tpcds_q37/duckdb:vortex-file-compressed 15454948 / 13771497 / +12.2% 🔴 17920005 / 22807942 / -21.4% 🟢 0.86 / 0.60 / +42.8%
tpcds_q38/duckdb:vortex-file-compressed 23513960 / 22583096 / +4.1% 30524614 / 28997216 / +5.3% 0.77 / 0.78 / -1.1%
tpcds_q39/duckdb:vortex-file-compressed 17991058 / 18414698 / -2.3% 27259240 / 28847039 / -5.5% 0.66 / 0.64 / +3.4%
tpcds_q40/duckdb:vortex-file-compressed 13462376 / 13212012 / +1.9% 19202457 / 19656799 / -2.3% 0.70 / 0.67 / +4.3%
tpcds_q41/duckdb:vortex-file-compressed 12651954 / 6568104 / +92.6% 🔴 18103321 / 9224477 / +96.3% 🔴 0.70 / 0.71 / -1.8%
tpcds_q42/duckdb:vortex-file-compressed 8210226 / 8036792 / +2.2% 19316859 / 17929297 / +7.7% 0.43 / 0.45 / -5.2%
tpcds_q43/duckdb:vortex-file-compressed 11503754 / 9941688 / +15.7% 🔴 18188120 / 18277534 / -0.5% 0.63 / 0.54 / +16.3%
tpcds_q44/duckdb:vortex-file-compressed 14212349 / 13992585 / +1.6% 21748334 / 24805279 / -12.3% 🟢 0.65 / 0.56 / +15.8%
tpcds_q45/duckdb:vortex-file-compressed 22584260 / 22443652 / +0.6% 28162168 / 28455032 / -1.0% 0.80 / 0.79 / +1.7%
tpcds_q46/duckdb:vortex-file-compressed 35844711 / 18690948 / +91.8% 🔴 50108232 / 28843277 / +73.7% 🔴 0.72 / 0.65 / +10.4%
tpcds_q47/duckdb:vortex-file-compressed 31566209 / 31816685 / -0.8% 46015698 / 43324789 / +6.2% 0.69 / 0.73 / -6.6%
tpcds_q48/duckdb:vortex-file-compressed 19280721 / 19534848 / -1.3% 29347262 / 32572378 / -9.9% 0.66 / 0.60 / +9.5%
tpcds_q49/duckdb:vortex-file-compressed 17214371 / 17029163 / +1.1% 32173285 / 30989304 / +3.8% 0.54 / 0.55 / -2.6%
tpcds_q50/duckdb:vortex-file-compressed 16968706 / 16790533 / +1.1% 28299584 / 33321798 / -15.1% 🟢 0.60 / 0.50 / +19.0%
tpcds_q51/duckdb:vortex-file-compressed 77844820 / 76364468 / +1.9% 87422420 / 60493286 / +44.5% 🔴 0.89 / 1.26 / -29.5%
tpcds_q52/duckdb:vortex-file-compressed 8200846 / 8196388 / +0.1% 18919402 / 18256053 / +3.6% 0.43 / 0.45 / -3.5%
tpcds_q53/duckdb:vortex-file-compressed 13970501 / 14396797 / -3.0% 24686138 / 28292624 / -12.7% 🟢 0.57 / 0.51 / +11.2%
tpcds_q54/duckdb:vortex-file-compressed 21096080 / 20544224 / +2.7% 29792008 / 31704322 / -6.0% 0.71 / 0.65 / +9.3%
tpcds_q55/duckdb:vortex-file-compressed 8691056 / 8665776 / +0.3% 17067258 / 18220904 / -6.3% 0.51 / 0.48 / +7.1%
tpcds_q56/duckdb:vortex-file-compressed 17172034 / 16877996 / +1.7% 30439771 / 29302968 / +3.9% 0.56 / 0.58 / -2.1%
tpcds_q57/duckdb:vortex-file-compressed 24998289 / 24216650 / +3.2% 32562289 / 34064789 / -4.4% 0.77 / 0.71 / +8.0%
tpcds_q58/duckdb:vortex-file-compressed 18751326 / 18638217 / +0.6% 27291812 / 28387316 / -3.9% 0.69 / 0.66 / +4.6%
tpcds_q59/duckdb:vortex-file-compressed 18684284 / 19128011 / -2.3% 28838929 / 25923591 / +11.2% 🔴 0.65 / 0.74 / -12.2%
tpcds_q60/duckdb:vortex-file-compressed 17883710 / 17565302 / +1.8% 28814615 / 30324918 / -5.0% 0.62 / 0.58 / +7.1%
tpcds_q61/duckdb:vortex-file-compressed 20108759 / 19839376 / +1.4% 34863813 / 32656999 / +6.8% 0.58 / 0.61 / -5.1%
tpcds_q62/duckdb:vortex-file-compressed 10130312 / 10243416 / -1.1% 16128822 / 16978348 / -5.0% 0.63 / 0.60 / +4.1%
tpcds_q63/duckdb:vortex-file-compressed 15522770 / 13504986 / +14.9% 🔴 23599644 / 23609884 / -0.0% 0.66 / 0.57 / +15.0%
tpcds_q64/duckdb:vortex-file-compressed 52126433 / 63654686 / -18.1% 🟢 70284925 / 79431334 / -11.5% 🟢 0.74 / 0.80 / -7.5%
tpcds_q65/duckdb:vortex-file-compressed 13496150 / 13735000 / -1.7% 23764874 / 22720553 / +4.6% 0.57 / 0.60 / -6.1%
tpcds_q66/duckdb:vortex-file-compressed 21883642 / 21319756 / +2.6% 34668301 / 31893872 / +8.7% 0.63 / 0.67 / -5.6%
tpcds_q67/duckdb:vortex-file-compressed 64814788 / 65444164 / -1.0% 87217312 / 82975711 / +5.1% 0.74 / 0.79 / -5.8%
tpcds_q68/duckdb:vortex-file-compressed 17561932 / 18026888 / -2.6% 27915656 / 35366093 / -21.1% 🟢 0.63 / 0.51 / +23.4%
tpcds_q69/duckdb:vortex-file-compressed 29308845 / 29173732 / +0.5% 42991226 / 43287720 / -0.7% 0.68 / 0.67 / +1.2%
tpcds_q70/duckdb:vortex-file-compressed 17643911 / 18800690 / -6.2% 28015034 / 29716635 / -5.7% 0.63 / 0.63 / -0.5%
tpcds_q71/duckdb:vortex-file-compressed 12909882 / 12668826 / +1.9% 21495345 / 22892939 / -6.1% 0.60 / 0.55 / +8.5%
tpcds_q72/duckdb:vortex-file-compressed 59217010 / 62570943 / -5.4% 73615080 / 75567235 / -2.6% 0.80 / 0.83 / -2.9%
tpcds_q73/duckdb:vortex-file-compressed 13463943 / 14655652 / -8.1% 23699702 / 21205706 / +11.8% 🔴 0.57 / 0.69 / -17.8%
tpcds_q74/duckdb:vortex-file-compressed 52200656 / 27652030 / +88.8% 🔴 61354464 / 36806383 / +66.7% 🔴 0.85 / 0.75 / +13.2%
tpcds_q75/duckdb:vortex-file-compressed 38566356 / 28623820 / +34.7% 🔴 50130126 / 48745151 / +2.8% 0.77 / 0.59 / +31.0%
tpcds_q76/duckdb:vortex-file-compressed 12437690 / 12845277 / -3.2% 24236018 / 24485462 / -1.0% 0.51 / 0.52 / -2.2%
tpcds_q77/duckdb:vortex-file-compressed 16857404 / 16022393 / +5.2% 25061418 / 29295774 / -14.5% 🟢 0.67 / 0.55 / +23.0%
tpcds_q78/duckdb:vortex-file-compressed 37342874 / 36977899 / +1.0% 47653490 / 47653067 / +0.0% 0.78 / 0.78 / +1.0%
tpcds_q79/duckdb:vortex-file-compressed 19247200 / 14598966 / +31.8% 🔴 34559746 / 29278121 / +18.0% 🔴 0.56 / 0.50 / +11.7%
tpcds_q80/duckdb:vortex-file-compressed 29690024 / 27953193 / +6.2% 43972353 / 43556031 / +1.0% 0.68 / 0.64 / +5.2%
tpcds_q81/duckdb:vortex-file-compressed 22466898 / 22094680 / +1.7% 29744501 / 34779936 / -14.5% 🟢 0.76 / 0.64 / +18.9%
tpcds_q82/duckdb:vortex-file-compressed 11346527 / 32537864 / -65.1% 🟢 18150290 / 39066381 / -53.5% 🟢 0.63 / 0.83 / -24.9%
tpcds_q83/duckdb:vortex-file-compressed 17637880 / 20264490 / -13.0% 🟢 25380163 / 26525071 / -4.3% 0.69 / 0.76 / -9.0%
tpcds_q84/duckdb:vortex-file-compressed 12162284 / 15263993 / -20.3% 🟢 16070449 / 21723051 / -26.0% 🟢 0.76 / 0.70 / +7.7%
tpcds_q85/duckdb:vortex-file-compressed 31286108 / 31785320 / -1.6% 44258006 / 41788391 / +5.9% 0.71 / 0.76 / -7.1%
tpcds_q86/duckdb:vortex-file-compressed 10910888 / 10828548 / +0.8% 18966913 / 21075800 / -10.0% 🟢 0.58 / 0.51 / +12.0%
tpcds_q87/duckdb:vortex-file-compressed 24544076 / 24197138 / +1.4% 31739434 / 30889211 / +2.8% 0.77 / 0.78 / -1.3%
tpcds_q88/duckdb:vortex-file-compressed 26980486 / 33392563 / -19.2% 🟢 35105706 / 47242281 / -25.7% 🟢 0.77 / 0.71 / +8.7%
tpcds_q89/duckdb:vortex-file-compressed 13827920 / 13988674 / -1.1% 24488775 / 23340818 / +4.9% 0.56 / 0.60 / -5.8%
tpcds_q90/duckdb:vortex-file-compressed 8183665 / 7659062 / +6.8% 12656016 / 14569811 / -13.1% 🟢 0.65 / 0.53 / +23.0%
tpcds_q91/duckdb:vortex-file-compressed 17530814 / 15310598 / +14.5% 🔴 25588192 / 21938915 / +16.6% 🔴 0.69 / 0.70 / -1.8%
tpcds_q92/duckdb:vortex-file-compressed 13301999 / 13187678 / +0.9% 22516826 / 21101004 / +6.7% 0.59 / 0.62 / -5.5%
tpcds_q93/duckdb:vortex-file-compressed 16938572 / 17009504 / -0.4% 24998492 / 25852249 / -3.3% 0.68 / 0.66 / +3.0%
tpcds_q94/duckdb:vortex-file-compressed 16357306 / 16404956 / -0.3% 26215583 / 28292862 / -7.3% 0.62 / 0.58 / +7.6%
tpcds_q95/duckdb:vortex-file-compressed 68591924 / 71631534 / -4.2% 75714673 / 81763767 / -7.4% 0.91 / 0.88 / +3.4%
tpcds_q96/duckdb:vortex-file-compressed 7159962 / 7559997 / -5.3% 14703348 / 17512922 / -16.0% 🟢 0.49 / 0.43 / +12.8%
tpcds_q97/duckdb:vortex-file-compressed 22375446 / 22162848 / +1.0% 27939037 / 30254558 / -7.7% 0.80 / 0.73 / +9.3%
tpcds_q98/duckdb:vortex-file-compressed 14287422 / 13578982 / +5.2% 22577974 / 24052134 / -6.1% 0.63 / 0.56 / +12.1%
tpcds_q99/duckdb:vortex-file-compressed 13285494 / 13481806 / -1.5% 19970574 / 20387924 / -2.0% 0.67 / 0.66 / +0.6%
duckdb / parquet / ns (1.007x ➖, 1↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23645364 / 26681794 / -11.4% 🟢 31900322 / 34295419 / -7.0% 0.74 / 0.78 / -4.7%
tpcds_q02/duckdb:parquet 15702814 / 16746910 / -6.2% 22386962 / 19475553 / +14.9% 🔴 0.70 / 0.86 / -18.4%
tpcds_q03/duckdb:parquet 8949143 / 8696742 / +2.9% 15270322 / 14941242 / +2.2% 0.59 / 0.58 / +0.7%
tpcds_q04/duckdb:parquet 127739920 / 127405652 / +0.3% 131470772 / 132423859 / -0.7% 0.97 / 0.96 / +1.0%
tpcds_q05/duckdb:parquet 21767209 / 21693992 / +0.3% 26159402 / 27228190 / -3.9% 0.83 / 0.80 / +4.4%
tpcds_q06/duckdb:parquet 26817297 / 26320744 / +1.9% 37478035 / 37055386 / +1.1% 0.72 / 0.71 / +0.7%
tpcds_q07/duckdb:parquet 15275042 / 15095874 / +1.2% 23284615 / 23053838 / +1.0% 0.66 / 0.65 / +0.2%
tpcds_q08/duckdb:parquet 27431476 / 28526146 / -3.8% 34172837 / 36482369 / -6.3% 0.80 / 0.78 / +2.7%
tpcds_q09/duckdb:parquet 19146358 / 19457452 / -1.6% 23806777 / 22271198 / +6.9% 0.80 / 0.87 / -7.9%
tpcds_q10/duckdb:parquet 27908500 / 27493188 / +1.5% 39020033 / 40069669 / -2.6% 0.72 / 0.69 / +4.2%
tpcds_q11/duckdb:parquet 71426523 / 70880685 / +0.8% 78930803 / 76605245 / +3.0% 0.90 / 0.93 / -2.2%
tpcds_q12/duckdb:parquet 12795128 / 12540800 / +2.0% 17510685 / 17473983 / +0.2% 0.73 / 0.72 / +1.8%
tpcds_q13/duckdb:parquet 24021148 / 23583898 / +1.9% 31808932 / 31750852 / +0.2% 0.76 / 0.74 / +1.7%
tpcds_q14/duckdb:parquet 61476085 / 61066080 / +0.7% 69019539 / 70323122 / -1.9% 0.89 / 0.87 / +2.6%
tpcds_q15/duckdb:parquet 25213534 / 24597026 / +2.5% 31515460 / 30326673 / +3.9% 0.80 / 0.81 / -1.4%
tpcds_q16/duckdb:parquet 22949133 / 20511477 / +11.9% 🔴 32604446 / 27909373 / +16.8% 🔴 0.70 / 0.73 / -4.2%
tpcds_q17/duckdb:parquet 32493671 / 32484632 / +0.0% 41201781 / 40581398 / +1.5% 0.79 / 0.80 / -1.5%
tpcds_q18/duckdb:parquet 39713523 / 38887306 / +2.1% 51202422 / 49217364 / +4.0% 0.78 / 0.79 / -1.8%
tpcds_q19/duckdb:parquet 24684440 / 24299426 / +1.6% 32332463 / 31997063 / +1.0% 0.76 / 0.76 / +0.5%
tpcds_q20/duckdb:parquet 13518601 / 13539249 / -0.2% 18345411 / 17488879 / +4.9% 0.74 / 0.77 / -4.8%
tpcds_q21/duckdb:parquet 9451924 / 9370455 / +0.9% 15764904 / 15034028 / +4.9% 0.60 / 0.62 / -3.8%
tpcds_q22/duckdb:parquet 40930993 / 34918759 / +17.2% 🔴 39149214 / 39088953 / +0.2% 1.05 / 0.89 / +17.0%
tpcds_q23/duckdb:parquet 40533026 / 40336561 / +0.5% 51622316 / 47209149 / +9.3% 0.79 / 0.85 / -8.1%
tpcds_q24/duckdb:parquet 33515688 / 34958662 / -4.1% 44440517 / 43511084 / +2.1% 0.75 / 0.80 / -6.1%
tpcds_q25/duckdb:parquet 30191867 / 30154612 / +0.1% 40606948 / 42138963 / -3.6% 0.74 / 0.72 / +3.9%
tpcds_q26/duckdb:parquet 31260106 / 31209231 / +0.2% 39500859 / 37847419 / +4.4% 0.79 / 0.82 / -4.0%
tpcds_q27/duckdb:parquet 32127093 / 32423474 / -0.9% 40881623 / 46121572 / -11.4% 🟢 0.79 / 0.70 / +11.8%
tpcds_q28/duckdb:parquet 17287562 / 17089390 / +1.2% 19699494 / 19840317 / -0.7% 0.88 / 0.86 / +1.9%
tpcds_q29/duckdb:parquet 30755386 / 30649450 / +0.3% 38950958 / 39401770 / -1.1% 0.79 / 0.78 / +1.5%
tpcds_q30/duckdb:parquet 32844000 / 32327638 / +1.6% 41506588 / 41936933 / -1.0% 0.79 / 0.77 / +2.7%
tpcds_q31/duckdb:parquet 20149286 / 20319164 / -0.8% 25165311 / 25960348 / -3.1% 0.80 / 0.78 / +2.3%
tpcds_q32/duckdb:parquet 11093256 / 11239734 / -1.3% 17912333 / 16794307 / +6.7% 0.62 / 0.67 / -7.5%
tpcds_q33/duckdb:parquet 15985855 / 15884169 / +0.6% 23779514 / 23341870 / +1.9% 0.67 / 0.68 / -1.2%
tpcds_q34/duckdb:parquet 15983276 / 16007240 / -0.1% 22692806 / 22262791 / +1.9% 0.70 / 0.72 / -2.0%
tpcds_q35/duckdb:parquet 47194300 / 48159872 / -2.0% 57333262 / 59379379 / -3.4% 0.82 / 0.81 / +1.5%
tpcds_q36/duckdb:parquet 16554698 / 15063788 / +9.9% 23196043 / 23330451 / -0.6% 0.71 / 0.65 / +10.5%
tpcds_q37/duckdb:parquet 12133920 / 12792900 / -5.2% 19082517 / 16914866 / +12.8% 🔴 0.64 / 0.76 / -15.9%
tpcds_q38/duckdb:parquet 26414132 / 26089596 / +1.2% 30307473 / 31692749 / -4.4% 0.87 / 0.82 / +5.9%
tpcds_q39/duckdb:parquet 24746784 / 24594271 / +0.6% 29657704 / 29237578 / +1.4% 0.83 / 0.84 / -0.8%
tpcds_q40/duckdb:parquet 15956738 / 15895379 / +0.4% 21914738 / 20753403 / +5.6% 0.73 / 0.77 / -4.9%
tpcds_q41/duckdb:parquet 7890940 / 7677796 / +2.8% 13839132 / 13023641 / +6.3% 0.57 / 0.59 / -3.3%
tpcds_q42/duckdb:parquet 8376691 / 8311810 / +0.8% 14806860 / 14748042 / +0.4% 0.57 / 0.56 / +0.4%
tpcds_q43/duckdb:parquet 10560096 / 10540942 / +0.2% 15656655 / 15464635 / +1.2% 0.67 / 0.68 / -1.0%
tpcds_q44/duckdb:parquet 16531448 / 16227934 / +1.9% 25198091 / 22346859 / +12.8% 🔴 0.66 / 0.73 / -9.7%
tpcds_q45/duckdb:parquet 23384569 / 23173005 / +0.9% 29493190 / 29651260 / -0.5% 0.79 / 0.78 / +1.5%
tpcds_q46/duckdb:parquet 36198802 / 36272085 / -0.2% 45913197 / 46044265 / -0.3% 0.79 / 0.79 / +0.1%
tpcds_q47/duckdb:parquet 31518746 / 30805416 / +2.3% 38196641 / 37901927 / +0.8% 0.83 / 0.81 / +1.5%
tpcds_q48/duckdb:parquet 21219925 / 20956396 / +1.3% 28982934 / 30778703 / -5.8% 0.73 / 0.68 / +7.5%
tpcds_q49/duckdb:parquet 19022711 / 18769722 / +1.3% 30899015 / 28724180 / +7.6% 0.62 / 0.65 / -5.8%
tpcds_q50/duckdb:parquet 17704144 / 17471078 / +1.3% 24535921 / 25288865 / -3.0% 0.72 / 0.69 / +4.4%
tpcds_q51/duckdb:parquet 54140645 / 52689720 / +2.8% 59434248 / 65779851 / -9.6% 0.91 / 0.80 / +13.7%
tpcds_q52/duckdb:parquet 8706328 / 8565710 / +1.6% 15790750 / 14789428 / +6.8% 0.55 / 0.58 / -4.8%
tpcds_q53/duckdb:parquet 11651049 / 12708015 / -8.3% 16719417 / 20517235 / -18.5% 🟢 0.70 / 0.62 / +12.5%
tpcds_q54/duckdb:parquet 20503650 / 21386888 / -4.1% 29890036 / 29491045 / +1.4% 0.69 / 0.73 / -5.4%
tpcds_q55/duckdb:parquet 8701723 / 8523208 / +2.1% 16753185 / 15299486 / +9.5% 0.52 / 0.56 / -6.8%
tpcds_q56/duckdb:parquet 16313894 / 16288336 / +0.2% 23456959 / 26329080 / -10.9% 🟢 0.70 / 0.62 / +12.4%
tpcds_q57/duckdb:parquet 29148968 / 28905620 / +0.8% 35307885 / 37431848 / -5.7% 0.83 / 0.77 / +6.9%
tpcds_q58/duckdb:parquet 18393429 / 18021428 / +2.1% 24868504 / 25851611 / -3.8% 0.74 / 0.70 / +6.1%
tpcds_q59/duckdb:parquet 20741198 / 22794229 / -9.0% 24781331 / 25599328 / -3.2% 0.84 / 0.89 / -6.0%
tpcds_q60/duckdb:parquet 17061566 / 16857354 / +1.2% 24652460 / 24452471 / +0.8% 0.69 / 0.69 / +0.4%
tpcds_q61/duckdb:parquet 21747920 / 21687257 / +0.3% 28962331 / 29478087 / -1.7% 0.75 / 0.74 / +2.1%
tpcds_q62/duckdb:parquet 10877298 / 10788003 / +0.8% 14810685 / 14546031 / +1.8% 0.73 / 0.74 / -1.0%
tpcds_q63/duckdb:parquet 10868501 / 10764165 / +1.0% 16574751 / 16697322 / -0.7% 0.66 / 0.64 / +1.7%
tpcds_q64/duckdb:parquet 54718196 / 51719860 / +5.8% 65393783 / 67355631 / -2.9% 0.84 / 0.77 / +9.0%
tpcds_q65/duckdb:parquet 14597502 / 14504660 / +0.6% 21094443 / 21604157 / -2.4% 0.69 / 0.67 / +3.1%
tpcds_q66/duckdb:parquet 24675644 / 24639772 / +0.1% 31712092 / 31744931 / -0.1% 0.78 / 0.78 / +0.2%
tpcds_q67/duckdb:parquet 77267869 / 76657418 / +0.8% 98228188 / 83434897 / +17.7% 🔴 0.79 / 0.92 / -14.4%
tpcds_q68/duckdb:parquet 29476008 / 29357509 / +0.4% 40858940 / 41084379 / -0.5% 0.72 / 0.71 / +1.0%
tpcds_q69/duckdb:parquet 32113522 / 28803842 / +11.5% 🔴 38545623 / 39302154 / -1.9% 0.83 / 0.73 / +13.7%
tpcds_q70/duckdb:parquet 16313968 / 17322512 / -5.8% 25213898 / 25220924 / -0.0% 0.65 / 0.69 / -5.8%
tpcds_q71/duckdb:parquet 14772362 / 15203480 / -2.8% 20379656 / 21236248 / -4.0% 0.72 / 0.72 / +1.2%
tpcds_q72/duckdb:parquet 82015131 / 81441527 / +0.7% 87347120 / 87196936 / +0.2% 0.94 / 0.93 / +0.5%
tpcds_q73/duckdb:parquet 13578708 / 13374854 / +1.5% 19729524 / 19587745 / +0.7% 0.69 / 0.68 / +0.8%
tpcds_q74/duckdb:parquet 99253084 / 98420680 / +0.8% 105444577 / 106671524 / -1.2% 0.94 / 0.92 / +2.0%
tpcds_q75/duckdb:parquet 41155920 / 40278414 / +2.2% 50358310 / 57481411 / -12.4% 🟢 0.82 / 0.70 / +16.6%
tpcds_q76/duckdb:parquet 13644286 / 13356154 / +2.2% 20738911 / 23145724 / -10.4% 🟢 0.66 / 0.58 / +14.0%
tpcds_q77/duckdb:parquet 16835846 / 16796132 / +0.2% 28270047 / 25875528 / +9.3% 0.60 / 0.65 / -8.3%
tpcds_q78/duckdb:parquet 48360357 / 48144388 / +0.4% 53582512 / 53919711 / -0.6% 0.90 / 0.89 / +1.1%
tpcds_q79/duckdb:parquet 20512102 / 20298701 / +1.1% 29350162 / 28626127 / +2.5% 0.70 / 0.71 / -1.4%
tpcds_q80/duckdb:parquet 31465852 / 31002113 / +1.5% 39794783 / 40545120 / -1.9% 0.79 / 0.76 / +3.4%
tpcds_q81/duckdb:parquet 29245241 / 29838088 / -2.0% 39300444 / 41612002 / -5.6% 0.74 / 0.72 / +3.8%
tpcds_q82/duckdb:parquet 14001494 / 13834890 / +1.2% 18810807 / 22346491 / -15.8% 🟢 0.74 / 0.62 / +20.2%
tpcds_q83/duckdb:parquet 16130411 / 15665164 / +3.0% 21001841 / 21366354 / -1.7% 0.77 / 0.73 / +4.8%
tpcds_q84/duckdb:parquet 18431731 / 17242160 / +6.9% 24324465 / 23617134 / +3.0% 0.76 / 0.73 / +3.8%
tpcds_q85/duckdb:parquet 34845014 / 36160694 / -3.6% 45237170 / 48390961 / -6.5% 0.77 / 0.75 / +3.1%
tpcds_q86/duckdb:parquet 11032247 / 10930517 / +0.9% 15944139 / 18337341 / -13.1% 🟢 0.69 / 0.60 / +16.1%
tpcds_q87/duckdb:parquet 28485756 / 28096210 / +1.4% 33072853 / 35537348 / -6.9% 0.86 / 0.79 / +8.9%
tpcds_q88/duckdb:parquet 27848552 / 26995833 / +3.2% 37638237 / 32084981 / +17.3% 🔴 0.74 / 0.84 / -12.1%
tpcds_q89/duckdb:parquet 12748312 / 12624297 / +1.0% 18940116 / 18767920 / +0.9% 0.67 / 0.67 / +0.1%
tpcds_q90/duckdb:parquet 7862883 / 6761345 / +16.3% 🔴 11871505 / 10888907 / +9.0% 0.66 / 0.62 / +6.7%
tpcds_q91/duckdb:parquet 20965104 / 20866918 / +0.5% 30838572 / 28532609 / +8.1% 0.68 / 0.73 / -7.0%
tpcds_q92/duckdb:parquet 11373369 / 11607429 / -2.0% 18197419 / 18196095 / +0.0% 0.62 / 0.64 / -2.0%
tpcds_q93/duckdb:parquet 21214343 / 21321062 / -0.5% 29131784 / 29122586 / +0.0% 0.73 / 0.73 / -0.5%
tpcds_q94/duckdb:parquet 15973148 / 15891199 / +0.5% 25786792 / 25097173 / +2.7% 0.62 / 0.63 / -2.2%
tpcds_q95/duckdb:parquet 90106338 / 89555672 / +0.6% 96003701 / 95450341 / +0.6% 0.94 / 0.94 / +0.0%
tpcds_q96/duckdb:parquet 6918128 / 6921042 / -0.0% 11220706 / 11161851 / +0.5% 0.62 / 0.62 / -0.6%
tpcds_q97/duckdb:parquet 25900042 / 25802417 / +0.4% 32868117 / 32005822 / +2.7% 0.79 / 0.81 / -2.3%
tpcds_q98/duckdb:parquet 15139296 / 15226447 / -0.6% 21748044 / 25101539 / -13.4% 🟢 0.70 / 0.61 / +14.8%
tpcds_q99/duckdb:parquet 17110108 / 17206993 / -0.6% 21508460 / 21245792 / +1.2% 0.80 / 0.81 / -1.8%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 515861ae vs base a65c6537
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DuckDB No clear signal (+0.5%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.995x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.980x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9043153 / 9046222 / -0.0% 9423745 / 9512904 / -0.9% 0.96 / 0.95 / +0.9%
statpopgen_q01/duckdb:vortex-file-compressed 10368098 / 10354572 / +0.1% 13621736 / 13651165 / -0.2% 0.76 / 0.76 / +0.3%
statpopgen_q02/duckdb:vortex-file-compressed 305134450 / 307700384 / -0.8% 337809898 / 351487698 / -3.9% 0.90 / 0.88 / +3.2%
statpopgen_q03/duckdb:vortex-file-compressed 812716516 / 814617600 / -0.2% 817030584 / 833309952 / -2.0% 0.99 / 0.98 / +1.8%
statpopgen_q04/duckdb:vortex-file-compressed 810848962 / 823901187 / -1.6% 826090867 / 824403723 / +0.2% 0.98 / 1.00 / -1.8%
statpopgen_q05/duckdb:vortex-file-compressed 321191932 / 319049321 / +0.7% 355010701 / 340213115 / +4.3% 0.90 / 0.94 / -3.5%
statpopgen_q06/duckdb:vortex-file-compressed 1148267162 / 1133351164 / +1.3% 1145997042 / 1149322228 / -0.3% 1.00 / 0.99 / +1.6%
statpopgen_q07/duckdb:vortex-file-compressed 131380110 / 130978225 / +0.3% 188917375 / 188655020 / +0.1% 0.70 / 0.69 / +0.2%
statpopgen_q08/duckdb:vortex-file-compressed 144915932 / 142215630 / +1.9% 159660361 / 158164487 / +0.9% 0.91 / 0.90 / +0.9%
statpopgen_q09/duckdb:vortex-file-compressed 599480845 / 612151772 / -2.1% 608781003 / 630686109 / -3.5% 0.98 / 0.97 / +1.5%
statpopgen_q10/duckdb:vortex-file-compressed 1902538326 / 1907690160 / -0.3% 1879220226 / 1885391820 / -0.3% 1.01 / 1.01 / +0.1%
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 245587159 / 246909558 / -0.5% 244956979 / 245750857 / -0.3% 1.00 / 1.00 / -0.2%
statpopgen_q01/duckdb:parquet 300510117 / 301292498 / -0.3% 302731015 / 305962581 / -1.1% 0.99 / 0.98 / +0.8%
statpopgen_q02/duckdb:parquet 551970853 / 528643484 / +4.4% 562996282 / 583092274 / -3.4% 0.98 / 0.91 / +8.1%
statpopgen_q03/duckdb:parquet 868872168 / 868149166 / +0.1% 860235703 / 896890247 / -4.1% 1.01 / 0.97 / +4.3%
statpopgen_q04/duckdb:parquet 837669537 / 848197592 / -1.2% 829928507 / 875604653 / -5.2% 1.01 / 0.97 / +4.2%
statpopgen_q05/duckdb:parquet 594373833 / 582235004 / +2.1% 598428918 / 604209909 / -1.0% 0.99 / 0.96 / +3.1%
statpopgen_q06/duckdb:parquet 700171819 / 726052634 / -3.6% 700352097 / 695242267 / +0.7% 1.00 / 1.04 / -4.3%
statpopgen_q07/duckdb:parquet 606425908 / 607922870 / -0.2% 704158197 / 669901362 / +5.1% 0.86 / 0.91 / -5.1%
statpopgen_q08/duckdb:parquet 610339800 / 618351482 / -1.3% 683356885 / 721288804 / -5.3% 0.89 / 0.86 / +4.2%
statpopgen_q09/duckdb:parquet 795942227 / 799046228 / -0.4% 801447953 / 806906275 / -0.7% 0.99 / 0.99 / +0.3%
statpopgen_q10/duckdb:parquet 1438914196 / 1507021316 / -4.5% 1250878725 / 1334833705 / -6.3% 1.15 / 1.13 / +1.9%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 515861ae vs base a65c6537
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +19.9%
Engines: DataFusion No clear signal (+29.9%, environment too noisy confidence) · DuckDB No clear signal (+10.6%, environment too noisy confidence)
Vortex (geomean): hot 1.269x ➖ · cold 1.198x ➖
Parquet (geomean): hot 1.058x ➖ · cold 1.114x ➖
Shifts: Parquet (control) +5.8% · Median polish +10.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.367x ❌, 0↑ 13↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 221543106 / 212725205 / +4.1% 820437097 / 742272818 / +10.5% 0.27 / 0.29 / -5.8%
tpch_q02/datafusion:vortex-file-compressed 358111263 / 305555680 / +17.2% 853413514 / 601132950 / +42.0% 🔴 0.42 / 0.51 / -17.4%
tpch_q03/datafusion:vortex-file-compressed 576640619 / 364938203 / +58.0% 🔴 1216736378 / 910786440 / +33.6% 🔴 0.47 / 0.40 / +18.3%
tpch_q04/datafusion:vortex-file-compressed 293068054 / 171333856 / +71.1% 🔴 481577120 / 605488685 / -20.5% 0.61 / 0.28 / +115.1%
tpch_q05/datafusion:vortex-file-compressed 520385046 / 362718960 / +43.5% 🔴 754502867 / 508378563 / +48.4% 🔴 0.69 / 0.71 / -3.3%
tpch_q06/datafusion:vortex-file-compressed 270886519 / 241484945 / +12.2% 469022235 / 397659184 / +17.9% 0.58 / 0.61 / -4.9%
tpch_q07/datafusion:vortex-file-compressed 585370417 / 434089498 / +34.9% 🔴 720140821 / 451851178 / +59.4% 🔴 0.81 / 0.96 / -15.4%
tpch_q08/datafusion:vortex-file-compressed 736041136 / 529289879 / +39.1% 🔴 970823790 / 565674684 / +71.6% 🔴 0.76 / 0.94 / -19.0%
tpch_q09/datafusion:vortex-file-compressed 646929449 / 442683167 / +46.1% 🔴 833894110 / 549867428 / +51.7% 🔴 0.78 / 0.81 / -3.6%
tpch_q10/datafusion:vortex-file-compressed 486319109 / 376056650 / +29.3% 610016549 / 572640043 / +6.5% 0.80 / 0.66 / +21.4%
tpch_q11/datafusion:vortex-file-compressed 322476459 / 268932452 / +19.9% 513574233 / 380058424 / +35.1% 🔴 0.63 / 0.71 / -11.3%
tpch_q12/datafusion:vortex-file-compressed 489730913 / 294841063 / +66.1% 🔴 658895109 / 520380722 / +26.6% 0.74 / 0.57 / +31.2%
tpch_q13/datafusion:vortex-file-compressed 204163874 / 135641691 / +50.5% 🔴 338298249 / 388548851 / -12.9% 0.60 / 0.35 / +72.9%
tpch_q14/datafusion:vortex-file-compressed 212929212 / 251850406 / -15.5% 374281186 / 783644361 / -52.2% 🟢 0.57 / 0.32 / +77.0%
tpch_q15/datafusion:vortex-file-compressed 352922587 / 279017452 / +26.5% 724022516 / 484974886 / +49.3% 🔴 0.49 / 0.58 / -15.3%
tpch_q16/datafusion:vortex-file-compressed 196787867 / 152618919 / +28.9% 312304918 / 274045649 / +14.0% 0.63 / 0.56 / +13.1%
tpch_q17/datafusion:vortex-file-compressed 405091173 / 274160668 / +47.8% 🔴 482610201 / 428724871 / +12.6% 0.84 / 0.64 / +31.3%
tpch_q18/datafusion:vortex-file-compressed 359285809 / 208817203 / +72.1% 🔴 609695996 / 376315877 / +62.0% 🔴 0.59 / 0.55 / +6.2%
tpch_q19/datafusion:vortex-file-compressed 468157431 / 308245462 / +51.9% 🔴 663463362 / 457492497 / +45.0% 🔴 0.71 / 0.67 / +4.7%
tpch_q20/datafusion:vortex-file-compressed 327367861 / 257043625 / +27.4% 406658694 / 425751727 / -4.5% 0.81 / 0.60 / +33.3%
tpch_q21/datafusion:vortex-file-compressed 670040641 / 432719854 / +54.8% 🔴 898715917 / 566710463 / +58.6% 🔴 0.75 / 0.76 / -2.4%
tpch_q22/datafusion:vortex-file-compressed 257356724 / 157868873 / +63.0% 🔴 486072708 / 331209463 / +46.8% 🔴 0.53 / 0.48 / +11.1%
datafusion / parquet / ns (1.052x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 164367902 / 164987468 / -0.4% 509532396 / 405946140 / +25.5% 0.32 / 0.41 / -20.6%
tpch_q02/datafusion:parquet 309215640 / 280284840 / +10.3% 564717302 / 459266343 / +23.0% 0.55 / 0.61 / -10.3%
tpch_q03/datafusion:parquet 459310760 / 268265654 / +71.2% 🔴 915912001 / 675033428 / +35.7% 🔴 0.50 / 0.40 / +26.2%
tpch_q04/datafusion:parquet 173291278 / 131902666 / +31.4% 🔴 454623469 / 365647503 / +24.3% 0.38 / 0.36 / +5.7%
tpch_q05/datafusion:parquet 332566040 / 380236342 / -12.5% 548981551 / 470137041 / +16.8% 0.61 / 0.81 / -25.1%
tpch_q06/datafusion:parquet 125790182 / 154474436 / -18.6% 216049545 / 230913000 / -6.4% 0.58 / 0.67 / -13.0%
tpch_q07/datafusion:parquet 350866551 / 529011848 / -33.7% 🟢 446146243 / 650166941 / -31.4% 🟢 0.79 / 0.81 / -3.3%
tpch_q08/datafusion:parquet 407284219 / 421637347 / -3.4% 490205644 / 509426576 / -3.8% 0.83 / 0.83 / +0.4%
tpch_q09/datafusion:parquet 458374386 / 419247845 / +9.3% 664269547 / 597630612 / +11.2% 0.69 / 0.70 / -1.6%
tpch_q10/datafusion:parquet 398522450 / 388778496 / +2.5% 583061056 / 491410857 / +18.7% 0.68 / 0.79 / -13.6%
tpch_q11/datafusion:parquet 318130240 / 265239074 / +19.9% 487763219 / 449339448 / +8.6% 0.65 / 0.59 / +10.5%
tpch_q12/datafusion:parquet 190774327 / 205623570 / -7.2% 677539462 / 404482213 / +67.5% 🔴 0.28 / 0.51 / -44.6%
tpch_q13/datafusion:parquet 394009340 / 391592646 / +0.6% 576656411 / 553866356 / +4.1% 0.68 / 0.71 / -3.4%
tpch_q14/datafusion:parquet 176293722 / 163899079 / +7.6% 362153391 / 293497429 / +23.4% 0.49 / 0.56 / -12.8%
tpch_q15/datafusion:parquet 286422901 / 268358377 / +6.7% 515408815 / 435259702 / +18.4% 0.56 / 0.62 / -9.9%
tpch_q16/datafusion:parquet 108567824 / 111015330 / -2.2% 250985175 / 258759489 / -3.0% 0.43 / 0.43 / +0.8%
tpch_q17/datafusion:parquet 355086028 / 291605157 / +21.8% 494940111 / 399752423 / +23.8% 0.72 / 0.73 / -1.6%
tpch_q18/datafusion:parquet 416376157 / 379247252 / +9.8% 610850460 / 516612040 / +18.2% 0.68 / 0.73 / -7.1%
tpch_q19/datafusion:parquet 187463923 / 170541798 / +9.9% 310862476 / 285700864 / +8.8% 0.60 / 0.60 / +1.0%
tpch_q20/datafusion:parquet 289068519 / 286573888 / +0.9% 527533882 / 426211188 / +23.8% 0.55 / 0.67 / -18.5%
tpch_q21/datafusion:parquet 376624532 / 321014745 / +17.3% 450073256 / 408579336 / +10.2% 0.84 / 0.79 / +6.5%
tpch_q22/datafusion:parquet 171362172 / 154127759 / +11.2% 333997474 / 292548567 / +14.2% 0.51 / 0.53 / -2.6%
duckdb / vortex-file-compressed / ns (1.178x ➖, 1↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 209365982 / 208197666 / +0.6% 254263281 / 305864149 / -16.9% 0.82 / 0.68 / +21.0%
tpch_q02/duckdb:vortex-file-compressed 412183917 / 366898195 / +12.3% 465347353 / 357336155 / +30.2% 🔴 0.89 / 1.03 / -13.7%
tpch_q03/duckdb:vortex-file-compressed 536748815 / 421274504 / +27.4% 528488950 / 467416553 / +13.1% 1.02 / 0.90 / +12.7%
tpch_q04/duckdb:vortex-file-compressed 329467586 / 223819578 / +47.2% 🔴 405438404 / 484383649 / -16.3% 0.81 / 0.46 / +75.9%
tpch_q05/duckdb:vortex-file-compressed 647815002 / 410640295 / +57.8% 🔴 598322779 / 447681233 / +33.6% 🔴 1.08 / 0.92 / +18.0%
tpch_q06/duckdb:vortex-file-compressed 246850578 / 257935392 / -4.3% 275973350 / 303125534 / -9.0% 0.89 / 0.85 / +5.1%
tpch_q07/duckdb:vortex-file-compressed 506448649 / 607393832 / -16.6% 519937981 / 562419682 / -7.6% 0.97 / 1.08 / -9.8%
tpch_q08/duckdb:vortex-file-compressed 792205349 / 589902323 / +34.3% 🔴 999920432 / 585994804 / +70.6% 🔴 0.79 / 1.01 / -21.3%
tpch_q09/duckdb:vortex-file-compressed 495093443 / 435773164 / +13.6% 578186745 / 439969516 / +31.4% 🔴 0.86 / 0.99 / -13.5%
tpch_q10/duckdb:vortex-file-compressed 564996721 / 472173616 / +19.7% 958768337 / 461179317 / +107.9% 🔴 0.59 / 1.02 / -42.4%
tpch_q11/duckdb:vortex-file-compressed 177103748 / 146132043 / +21.2% 210462907 / 153621534 / +37.0% 🔴 0.84 / 0.95 / -11.5%
tpch_q12/duckdb:vortex-file-compressed 449254734 / 743386427 / -39.6% 🟢 514645280 / 823920270 / -37.5% 🟢 0.87 / 0.90 / -3.2%
tpch_q13/duckdb:vortex-file-compressed 402286616 / 300385423 / +33.9% 🔴 527509975 / 302033533 / +74.7% 🔴 0.76 / 0.99 / -23.3%
tpch_q14/duckdb:vortex-file-compressed 265787749 / 234023785 / +13.6% 340963977 / 274017438 / +24.4% 0.78 / 0.85 / -8.7%
tpch_q15/duckdb:vortex-file-compressed 138905449 / 141598299 / -1.9% 172882888 / 181271521 / -4.6% 0.80 / 0.78 / +2.9%
tpch_q16/duckdb:vortex-file-compressed 202061271 / 176489959 / +14.5% 224991032 / 237633479 / -5.3% 0.90 / 0.74 / +20.9%
tpch_q17/duckdb:vortex-file-compressed 457299222 / 357184468 / +28.0% 514955639 / 390526380 / +31.9% 🔴 0.89 / 0.91 / -2.9%
tpch_q18/duckdb:vortex-file-compressed 366847652 / 322332547 / +13.8% 539369211 / 378776181 / +42.4% 🔴 0.68 / 0.85 / -20.1%
tpch_q19/duckdb:vortex-file-compressed 305898599 / 307764521 / -0.6% 301765435 / 329326474 / -8.4% 1.01 / 0.93 / +8.5%
tpch_q20/duckdb:vortex-file-compressed 358048619 / 347862366 / +2.9% 364181099 / 432740367 / -15.8% 0.98 / 0.80 / +22.3%
tpch_q21/duckdb:vortex-file-compressed 772462420 / 520827029 / +48.3% 🔴 834434615 / 796020354 / +4.8% 0.93 / 0.65 / +41.5%
tpch_q22/duckdb:vortex-file-compressed 311797441 / 115228285 / +170.6% 🔴 311542305 / 137939819 / +125.9% 🔴 1.00 / 0.84 / +19.8%
duckdb / parquet / ns (1.064x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 288726185 / 289608541 / -0.3% 314435732 / 302960714 / +3.8% 0.92 / 0.96 / -3.9%
tpch_q02/duckdb:parquet 655183704 / 597531100 / +9.6% 653266567 / 619301251 / +5.5% 1.00 / 0.96 / +3.9%
tpch_q03/duckdb:parquet 721674655 / 720143441 / +0.2% 864402476 / 803286481 / +7.6% 0.83 / 0.90 / -6.9%
tpch_q04/duckdb:parquet 476283868 / 422435410 / +12.7% 517462272 / 477157309 / +8.4% 0.92 / 0.89 / +4.0%
tpch_q05/duckdb:parquet 937843345 / 898204663 / +4.4% 969380909 / 843028830 / +15.0% 0.97 / 1.07 / -9.2%
tpch_q06/duckdb:parquet 301614269 / 287013906 / +5.1% 346086391 / 282938691 / +22.3% 0.87 / 1.01 / -14.1%
tpch_q07/duckdb:parquet 834924111 / 798494570 / +4.6% 870936037 / 755324137 / +15.3% 0.96 / 1.06 / -9.3%
tpch_q08/duckdb:parquet 1011942626 / 955472332 / +5.9% 1008924344 / 990540873 / +1.9% 1.00 / 0.96 / +4.0%
tpch_q09/duckdb:parquet 1000309468 / 894095450 / +11.9% 981753990 / 919616236 / +6.8% 1.02 / 0.97 / +4.8%
tpch_q10/duckdb:parquet 930968360 / 950985468 / -2.1% 997836908 / 906571137 / +10.1% 0.93 / 1.05 / -11.1%
tpch_q11/duckdb:parquet 447952233 / 395840020 / +13.2% 390029065 / 375112411 / +4.0% 1.15 / 1.06 / +8.8%
tpch_q12/duckdb:parquet 544265099 / 496508327 / +9.6% 690185351 / 573216361 / +20.4% 0.79 / 0.87 / -9.0%
tpch_q13/duckdb:parquet 784160181 / 736891887 / +6.4% 898841660 / 814743137 / +10.3% 0.87 / 0.90 / -3.5%
tpch_q14/duckdb:parquet 506963272 / 472620542 / +7.3% 516359034 / 472020094 / +9.4% 0.98 / 1.00 / -1.9%
tpch_q15/duckdb:parquet 386288635 / 356412119 / +8.4% 411770167 / 372116226 / +10.7% 0.94 / 0.96 / -2.1%
tpch_q16/duckdb:parquet 453419614 / 477607420 / -5.1% 536601611 / 473725549 / +13.3% 0.84 / 1.01 / -16.2%
tpch_q17/duckdb:parquet 478439952 / 455419186 / +5.1% 444980515 / 500091507 / -11.0% 1.08 / 0.91 / +18.1%
tpch_q18/duckdb:parquet 632076518 / 583780882 / +8.3% 978725624 / 683365729 / +43.2% 🔴 0.65 / 0.85 / -24.4%
tpch_q19/duckdb:parquet 588453730 / 519150904 / +13.3% 581853699 / 606076508 / -4.0% 1.01 / 0.86 / +18.1%
tpch_q20/duckdb:parquet 799658055 / 728657295 / +9.7% 809248652 / 786136970 / +2.9% 0.99 / 0.93 / +6.6%
tpch_q21/duckdb:parquet 665363894 / 643894150 / +3.3% 702073638 / 681471079 / +3.0% 0.95 / 0.94 / +0.3%
tpch_q22/duckdb:parquet 426594509 / 377779931 / +12.9% 405196674 / 356352818 / +13.7% 1.05 / 1.06 / -0.7%

@myrrc
myrrc marked this pull request as draft September 15, 2026 14:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant