Skip to content

duckdb: return projection_ids handling - #9887

Open
myrrc wants to merge 2 commits into
developfrom
myrrc/duckdb-projection-ids
Open

myrrc wants to merge 2 commits into
developfrom
myrrc/duckdb-projection-ids

Conversation

@myrrc

@myrrc myrrc commented Sep 15, 2026

Copy link
Copy Markdown
Contributor

#9383 removed handling of
projection_ids, since MultiFileReader handles them internally.

However, if there's a table filter in get.table_filters which is passed to
Vortex and this filter contains a column that's not part of projection, this
column will stay in column_ids, and Vortex will load and canonicalize it which
is extra work.

Main reason for this change is the removal for the "Eq not pushed" hack
up the stack - if we save some filters in table filters, we don't want
to project these filter-only columns still in column_ids.

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc myrrc added changelog/feature A new feature ext/duckdb Relates to the DuckDB integration labels Sep 15, 2026
@myrrc
myrrc enabled auto-merge (squash) September 15, 2026 13:32
@codspeed

codspeed Bot commented Sep 15, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 0.15%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 2 improved benchmarks
❌ 1 regressed benchmark
✅ 2195 untouched benchmarks
⏩ 218 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime arrow_checked_add_u32_neon[16384] 13.5 µs 20.3 µs -33.49%
Simulation random_i16[0.8] 96.4 µs 78.1 µs +23.5%
WallTime arrow_checked_add_u32_avx2[16384] 21.4 µs 17.6 µs +21.22%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/duckdb-projection-ids (1ef5527) with develop (b5f43ba)

Open in CodSpeed

Footnotes

  1. 218 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@myrrc myrrc added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 15, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 15, 2026
@github-actions

github-actions Bot commented Sep 15, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 303cdae statpopgen 1 Explore Profiling Data
🟢 Done 303cdae clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 303cdae tpch-nvme-10 1 Explore Profiling Data
🟢 Done 303cdae fineweb-s3 1 Explore Profiling Data
🟢 Done 303cdae fineweb 1 Explore Profiling Data
🟢 Done 303cdae tpcds-nvme 1 Explore Profiling Data
🟢 Done 303cdae clickbench-nvme 1 Explore Profiling Data
🟢 Done 303cdae polarsignals 1 Explore Profiling Data
🟢 Done 303cdae tpch-s3 1 Explore Profiling Data
🟢 Done 303cdae tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 303cdaef vs base 008e3b75
Vortex (geomean): hot 1.002x ➖ · cold 1.047x ➖


datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45640104 / 44894373 / +1.7% 90528616 / 89455639 / +1.2% 0.50 / 0.50 / +0.5%
polarsignals_q01/datafusion:vortex-file-compressed 51116478 / 51052788 / +0.1% 114429597 / 111296491 / +2.8% 0.45 / 0.46 / -2.6%
polarsignals_q02/datafusion:vortex-file-compressed 35407158 / 35341532 / +0.2% 82767176 / 76216899 / +8.6% 0.43 / 0.46 / -7.7%
polarsignals_q03/datafusion:vortex-file-compressed 54060135 / 53547787 / +1.0% 117054818 / 114689020 / +2.1% 0.46 / 0.47 / -1.1%
polarsignals_q04/datafusion:vortex-file-compressed 9429083 / 9419880 / +0.1% 49272611 / 44841461 / +9.9% 0.19 / 0.21 / -8.9%
polarsignals_q05/datafusion:vortex-file-compressed 11572796 / 11791484 / -1.9% 53468525 / 50754518 / +5.3% 0.22 / 0.23 / -6.8%
polarsignals_q06/datafusion:vortex-file-compressed 21181090 / 21231742 / -0.2% 61747444 / 59363817 / +4.0% 0.34 / 0.36 / -4.1%
polarsignals_q07/datafusion:vortex-file-compressed 11305040 / 11185213 / +1.1% 52979382 / 50310685 / +5.3% 0.21 / 0.22 / -4.0%
polarsignals_q08/datafusion:vortex-file-compressed 98606514 / 99108972 / -0.5% 162467447 / 164856169 / -1.4% 0.61 / 0.60 / +1.0%
polarsignals_q09/datafusion:vortex-file-compressed 9929222 / 9884853 / +0.4% 50185348 / 45687512 / +9.8% 0.20 / 0.22 / -8.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 303cdaef vs base 008e3b75
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.8%
Engines: DataFusion No clear signal (+1.5%, low confidence) · DuckDB No clear signal (+6.1%, low confidence)
Vortex (geomean): hot 1.042x ➖ · cold 1.002x ➖
Parquet (geomean): hot 1.004x ➖ · cold 1.009x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.014x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6706763 / 6896419 / -2.8% 19542614 / 20611347 / -5.2% 0.34 / 0.33 / +2.6%
fineweb_q01/datafusion:vortex-file-compressed 11232250 / 11437994 / -1.8% 46614188 / 45659512 / +2.1% 0.24 / 0.25 / -3.8%
fineweb_q02/datafusion:vortex-file-compressed 12945704 / 12676933 / +2.1% 54482537 / 49634510 / +9.8% 0.24 / 0.26 / -7.0%
fineweb_q03/datafusion:vortex-file-compressed 20310981 / 20689142 / -1.8% 109520890 / 108254151 / +1.2% 0.19 / 0.19 / -3.0%
fineweb_q04/datafusion:vortex-file-compressed 77525082 / 75772418 / +2.3% 159210047 / 160042386 / -0.5% 0.49 / 0.47 / +2.8%
fineweb_q05/datafusion:vortex-file-compressed 60137788 / 59698230 / +0.7% 142273629 / 141769293 / +0.4% 0.42 / 0.42 / +0.4%
fineweb_q06/datafusion:vortex-file-compressed 19208520 / 18366198 / +4.6% 109808502 / 104883350 / +4.7% 0.17 / 0.18 / -0.1%
fineweb_q07/datafusion:vortex-file-compressed 18180014 / 16977723 / +7.1% 105741762 / 102838129 / +2.8% 0.17 / 0.17 / +4.1%
fineweb_q08/datafusion:vortex-file-compressed 9202281 / 8999444 / +2.3% 50621423 / 58918260 / -14.1% 🟢 0.18 / 0.15 / +19.0%
datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9626930 / 9724420 / -1.0% 35676753 / 32188590 / +10.8% 🔴 0.27 / 0.30 / -10.7%
fineweb_q01/datafusion:parquet 74740087 / 76060234 / -1.7% 154064562 / 156389433 / -1.5% 0.49 / 0.49 / -0.3%
fineweb_q02/datafusion:parquet 76174696 / 75998700 / +0.2% 149953999 / 148456610 / +1.0% 0.51 / 0.51 / -0.8%
fineweb_q03/datafusion:parquet 74256290 / 74913388 / -0.9% 152422719 / 147146239 / +3.6% 0.49 / 0.51 / -4.3%
fineweb_q04/datafusion:parquet 83109894 / 80799738 / +2.9% 152683042 / 150271563 / +1.6% 0.54 / 0.54 / +1.2%
fineweb_q05/datafusion:parquet 80673864 / 80909270 / -0.3% 150910921 / 151355266 / -0.3% 0.53 / 0.53 / +0.0%
fineweb_q06/datafusion:parquet 74947982 / 75577366 / -0.8% 159006761 / 156972976 / +1.3% 0.47 / 0.48 / -2.1%
fineweb_q07/datafusion:parquet 75023352 / 75734164 / -0.9% 151411143 / 144812138 / +4.6% 0.50 / 0.52 / -5.3%
fineweb_q08/datafusion:parquet 73764668 / 72939774 / +1.1% 146302288 / 146078769 / +0.2% 0.50 / 0.50 / +1.0%
duckdb / vortex-file-compressed / ns (1.071x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 1913568 / 1897998 / +0.8% 4746089 / 8532219 / -44.4% 🟢 0.40 / 0.22 / +81.2%
fineweb_q01/duckdb:vortex-file-compressed 21392546 / 19495537 / +9.7% 63107323 / 59031498 / +6.9% 0.34 / 0.33 / +2.6%
fineweb_q02/duckdb:vortex-file-compressed 24207960 / 17970137 / +34.7% 🔴 60204435 / 46282869 / +30.1% 🔴 0.40 / 0.39 / +3.6%
fineweb_q03/duckdb:vortex-file-compressed 28681843 / 27558980 / +4.1% 117695353 / 129396192 / -9.0% 0.24 / 0.21 / +14.4%
fineweb_q04/duckdb:vortex-file-compressed 74448400 / 83165715 / -10.5% 🟢 119588936 / 171460358 / -30.3% 🟢 0.62 / 0.49 / +28.3%
fineweb_q05/duckdb:vortex-file-compressed 64633244 / 59253310 / +9.1% 151961865 / 102966757 / +47.6% 🔴 0.43 / 0.58 / -26.1%
fineweb_q06/duckdb:vortex-file-compressed 37974453 / 45341046 / -16.2% 🟢 128402866 / 130706332 / -1.8% 0.30 / 0.35 / -14.7%
fineweb_q07/duckdb:vortex-file-compressed 32587162 / 28662318 / +13.7% 🔴 121617914 / 92909230 / +30.9% 🔴 0.27 / 0.31 / -13.1%
fineweb_q08/duckdb:vortex-file-compressed 7955680 / 6188112 / +28.6% 🔴 16847456 / 15063895 / +11.8% 🔴 0.47 / 0.41 / +15.0%
duckdb / parquet / ns (1.010x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24056214 / 21573340 / +11.5% 🔴 24889872 / 24402580 / +2.0% 0.97 / 0.88 / +9.3%
fineweb_q01/duckdb:parquet 45423670 / 44695695 / +1.6% 54303550 / 56874948 / -4.5% 0.84 / 0.79 / +6.4%
fineweb_q02/duckdb:parquet 43488765 / 43831986 / -0.8% 56970135 / 55978984 / +1.8% 0.76 / 0.78 / -2.5%
fineweb_q03/duckdb:parquet 94735472 / 94478112 / +0.3% 181156871 / 190214146 / -4.8% 0.52 / 0.50 / +5.3%
fineweb_q04/duckdb:parquet 151746668 / 153372760 / -1.1% 208045249 / 204540363 / +1.7% 0.73 / 0.75 / -2.7%
fineweb_q05/duckdb:parquet 142290380 / 143263945 / -0.7% 193299443 / 197187282 / -2.0% 0.74 / 0.73 / +1.3%
fineweb_q06/duckdb:parquet 71096250 / 71837570 / -1.0% 124591551 / 125810123 / -1.0% 0.57 / 0.57 / -0.1%
fineweb_q07/duckdb:parquet 71610043 / 72097117 / -0.7% 158441871 / 155331553 / +2.0% 0.45 / 0.46 / -2.6%
fineweb_q08/duckdb:parquet 23026680 / 23014253 / +0.1% 24197879 / 23942857 / +1.1% 0.95 / 0.96 / -1.0%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 303cdaef vs base a65c6537
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): hot 0.989x ➖ · cold 0.964x ➖
Parquet (geomean): hot 0.992x ➖ · cold 0.970x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16423393 / 16981969 / -3.3% 48708460 / 49824725 / -2.2% 0.34 / 0.34 / -1.1%
tpch_q02/datafusion:vortex-file-compressed 17245151 / 17322146 / -0.4% 36307248 / 38777170 / -6.4% 0.47 / 0.45 / +6.3%
tpch_q03/datafusion:vortex-file-compressed 19240360 / 19459660 / -1.1% 50192580 / 54970163 / -8.7% 0.38 / 0.35 / +8.3%
tpch_q04/datafusion:vortex-file-compressed 10158401 / 9815295 / +3.5% 33909005 / 40942130 / -17.2% 🟢 0.30 / 0.24 / +25.0%
tpch_q05/datafusion:vortex-file-compressed 37061224 / 37488120 / -1.1% 66364937 / 71989617 / -7.8% 0.56 / 0.52 / +7.2%
tpch_q06/datafusion:vortex-file-compressed 6415178 / 6364133 / +0.8% 31677919 / 35554794 / -10.9% 🟢 0.20 / 0.18 / +13.1%
tpch_q07/datafusion:vortex-file-compressed 51906115 / 51762992 / +0.3% 84095859 / 86504578 / -2.8% 0.62 / 0.60 / +3.1%
tpch_q08/datafusion:vortex-file-compressed 52289487 / 51027955 / +2.5% 81887251 / 75830060 / +8.0% 0.64 / 0.67 / -5.1%
tpch_q09/datafusion:vortex-file-compressed 49553424 / 50019433 / -0.9% 78146425 / 78223871 / -0.1% 0.63 / 0.64 / -0.8%
tpch_q10/datafusion:vortex-file-compressed 17162489 / 16929225 / +1.4% 49817917 / 55375322 / -10.0% 🟢 0.34 / 0.31 / +12.7%
tpch_q11/datafusion:vortex-file-compressed 15072591 / 15230712 / -1.0% 32924454 / 36326992 / -9.4% 0.46 / 0.42 / +9.2%
tpch_q12/datafusion:vortex-file-compressed 22465749 / 22797187 / -1.5% 50797816 / 49373948 / +2.9% 0.44 / 0.46 / -4.2%
tpch_q13/datafusion:vortex-file-compressed 20374125 / 20011620 / +1.8% 39271801 / 43877423 / -10.5% 🟢 0.52 / 0.46 / +13.8%
tpch_q14/datafusion:vortex-file-compressed 15160859 / 15299622 / -0.9% 39862193 / 44804137 / -11.0% 🟢 0.38 / 0.34 / +11.4%
tpch_q15/datafusion:vortex-file-compressed 18907795 / 18731921 / +0.9% 46960988 / 50635694 / -7.3% 0.40 / 0.37 / +8.8%
tpch_q16/datafusion:vortex-file-compressed 18694100 / 18579194 / +0.6% 36393034 / 39840242 / -8.7% 0.51 / 0.47 / +10.1%
tpch_q17/datafusion:vortex-file-compressed 27974846 / 28854909 / -3.0% 59092223 / 58409097 / +1.2% 0.47 / 0.49 / -4.2%
tpch_q18/datafusion:vortex-file-compressed 36914274 / 36713605 / +0.5% 57152521 / 59320815 / -3.7% 0.65 / 0.62 / +4.4%
tpch_q19/datafusion:vortex-file-compressed 13320797 / 13625279 / -2.2% 38232876 / 40479292 / -5.5% 0.35 / 0.34 / +3.5%
tpch_q20/datafusion:vortex-file-compressed 21021534 / 21436208 / -1.9% 44312617 / 48179637 / -8.0% 0.47 / 0.44 / +6.6%
tpch_q21/datafusion:vortex-file-compressed 38997351 / 39329445 / -0.8% 68244436 / 69160619 / -1.3% 0.57 / 0.57 / +0.5%
tpch_q22/datafusion:vortex-file-compressed 11214916 / 11367215 / -1.3% 32404743 / 32639203 / -0.7% 0.35 / 0.35 / -0.6%
datafusion / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67180770 / 67574915 / -0.6% 86629340 / 90081876 / -3.8% 0.78 / 0.75 / +3.4%
tpch_q02/datafusion:parquet 52945352 / 52703966 / +0.5% 70357209 / 74432935 / -5.5% 0.75 / 0.71 / +6.3%
tpch_q03/datafusion:parquet 72464334 / 72749478 / -0.4% 101157030 / 102518298 / -1.3% 0.72 / 0.71 / +0.9%
tpch_q04/datafusion:parquet 39496076 / 39651502 / -0.4% 59612633 / 65155926 / -8.5% 0.66 / 0.61 / +8.9%
tpch_q05/datafusion:parquet 88032059 / 88784719 / -0.8% 118318012 / 126030193 / -6.1% 0.74 / 0.70 / +5.6%
tpch_q06/datafusion:parquet 28110039 / 28128298 / -0.1% 49926634 / 51737348 / -3.5% 0.56 / 0.54 / +3.6%
tpch_q07/datafusion:parquet 95604525 / 95738871 / -0.1% 123639623 / 128390548 / -3.7% 0.77 / 0.75 / +3.7%
tpch_q08/datafusion:parquet 97178050 / 98095988 / -0.9% 125515991 / 129236235 / -2.9% 0.77 / 0.76 / +2.0%
tpch_q09/datafusion:parquet 113037345 / 114777347 / -1.5% 146942735 / 149658327 / -1.8% 0.77 / 0.77 / +0.3%
tpch_q10/datafusion:parquet 78986844 / 80188022 / -1.5% 113829969 / 122204005 / -6.9% 0.69 / 0.66 / +5.7%
tpch_q11/datafusion:parquet 38328068 / 39574437 / -3.1% 61071128 / 63448187 / -3.7% 0.63 / 0.62 / +0.6%
tpch_q12/datafusion:parquet 62134120 / 62858612 / -1.2% 87368487 / 91089917 / -4.1% 0.71 / 0.69 / +3.1%
tpch_q13/datafusion:parquet 159009715 / 160838810 / -1.1% 182036555 / 189383897 / -3.9% 0.87 / 0.85 / +2.9%
tpch_q14/datafusion:parquet 39530848 / 40376056 / -2.1% 66186401 / 74962393 / -11.7% 🟢 0.60 / 0.54 / +10.9%
tpch_q15/datafusion:parquet 46299458 / 47197160 / -1.9% 68828754 / 72707545 / -5.3% 0.67 / 0.65 / +3.6%
tpch_q16/datafusion:parquet 38828653 / 38473766 / +0.9% 56515402 / 58815077 / -3.9% 0.69 / 0.65 / +5.0%
tpch_q17/datafusion:parquet 116693677 / 116375674 / +0.3% 145593749 / 146110937 / -0.4% 0.80 / 0.80 / +0.6%
tpch_q18/datafusion:parquet 114672382 / 116386376 / -1.5% 138151422 / 142096456 / -2.8% 0.83 / 0.82 / +1.3%
tpch_q19/datafusion:parquet 49949168 / 50781478 / -1.6% 78261247 / 83550660 / -6.3% 0.64 / 0.61 / +5.0%
tpch_q20/datafusion:parquet 57329626 / 58160827 / -1.4% 87297941 / 89540151 / -2.5% 0.66 / 0.65 / +1.1%
tpch_q21/datafusion:parquet 98688348 / 99459394 / -0.8% 123174639 / 127790331 / -3.6% 0.80 / 0.78 / +2.9%
tpch_q22/datafusion:parquet 42230613 / 41572634 / +1.6% 59874898 / 62653466 / -4.4% 0.71 / 0.66 / +6.3%
duckdb / vortex-file-compressed / ns (0.981x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11037160 / 10962672 / +0.7% 21994257 / 19879719 / +10.6% 🔴 0.50 / 0.55 / -9.0%
tpch_q02/duckdb:vortex-file-compressed 17481085 / 17541079 / -0.3% 33452963 / 28442435 / +17.6% 🔴 0.52 / 0.62 / -15.3%
tpch_q03/duckdb:vortex-file-compressed 17984203 / 18271860 / -1.6% 36326824 / 35107134 / +3.5% 0.50 / 0.52 / -4.9%
tpch_q04/duckdb:vortex-file-compressed 17771381 / 17537932 / +1.3% 32582093 / 31681770 / +2.8% 0.55 / 0.55 / -1.5%
tpch_q05/duckdb:vortex-file-compressed 21590786 / 21783428 / -0.9% 35481672 / 35622363 / -0.4% 0.61 / 0.61 / -0.5%
tpch_q06/duckdb:vortex-file-compressed 5300376 / 6199448 / -14.5% 🟢 13611031 / 15872295 / -14.2% 🟢 0.39 / 0.39 / -0.3%
tpch_q07/duckdb:vortex-file-compressed 21085928 / 21095327 / -0.0% 36916180 / 37174700 / -0.7% 0.57 / 0.57 / +0.7%
tpch_q08/duckdb:vortex-file-compressed 23308394 / 23948562 / -2.7% 38635572 / 38150833 / +1.3% 0.60 / 0.63 / -3.9%
tpch_q09/duckdb:vortex-file-compressed 29891730 / 30531518 / -2.1% 50401814 / 48570149 / +3.8% 0.59 / 0.63 / -5.7%
tpch_q10/duckdb:vortex-file-compressed 28309592 / 28151437 / +0.6% 45723681 / 49913305 / -8.4% 0.62 / 0.56 / +9.8%
tpch_q11/duckdb:vortex-file-compressed 8512452 / 11312073 / -24.7% 🟢 17190490 / 16676559 / +3.1% 0.50 / 0.68 / -27.0%
tpch_q12/duckdb:vortex-file-compressed 18178000 / 17231483 / +5.5% 33860671 / 36276544 / -6.7% 0.54 / 0.48 / +13.0%
tpch_q13/duckdb:vortex-file-compressed 21754967 / 21897598 / -0.7% 41379645 / 40725283 / +1.6% 0.53 / 0.54 / -2.2%
tpch_q14/duckdb:vortex-file-compressed 13469928 / 13396786 / +0.5% 25472901 / 26132851 / -2.5% 0.53 / 0.51 / +3.2%
tpch_q15/duckdb:vortex-file-compressed 10095079 / 10168511 / -0.7% 18882404 / 18733728 / +0.8% 0.53 / 0.54 / -1.5%
tpch_q16/duckdb:vortex-file-compressed 18464126 / 18393572 / +0.4% 24391876 / 25688708 / -5.0% 0.76 / 0.72 / +5.7%
tpch_q17/duckdb:vortex-file-compressed 15398219 / 15096269 / +2.0% 31479704 / 32777851 / -4.0% 0.49 / 0.46 / +6.2%
tpch_q18/duckdb:vortex-file-compressed 25878473 / 25974874 / -0.4% 36631312 / 41447647 / -11.6% 🟢 0.71 / 0.63 / +12.7%
tpch_q19/duckdb:vortex-file-compressed 23477962 / 23881014 / -1.7% 33824836 / 40423957 / -16.3% 🟢 0.69 / 0.59 / +17.5%
tpch_q20/duckdb:vortex-file-compressed 17175480 / 17852300 / -3.8% 33469205 / 35352646 / -5.3% 0.51 / 0.50 / +1.6%
tpch_q21/duckdb:vortex-file-compressed 67376811 / 66111873 / +1.9% 91424852 / 85985109 / +6.3% 0.74 / 0.77 / -4.2%
tpch_q22/duckdb:vortex-file-compressed 12903777 / 12289286 / +5.0% 22415601 / 23347343 / -4.0% 0.58 / 0.53 / +9.4%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60002894 / 60592597 / -1.0% 66928018 / 67175038 / -0.4% 0.90 / 0.90 / -0.6%
tpch_q02/duckdb:parquet 34789147 / 35186694 / -1.1% 42285569 / 43432881 / -2.6% 0.82 / 0.81 / +1.6%
tpch_q03/duckdb:parquet 61955150 / 62867665 / -1.5% 73754277 / 75186001 / -1.9% 0.84 / 0.84 / +0.5%
tpch_q04/duckdb:parquet 45466078 / 43675974 / +4.1% 55492801 / 53588932 / +3.6% 0.82 / 0.82 / +0.5%
tpch_q05/duckdb:parquet 60523176 / 61300994 / -1.3% 73183559 / 73458218 / -0.4% 0.83 / 0.83 / -0.9%
tpch_q06/duckdb:parquet 20170253 / 20375539 / -1.0% 24590370 / 25273179 / -2.7% 0.82 / 0.81 / +1.7%
tpch_q07/duckdb:parquet 60726181 / 61341889 / -1.0% 71457428 / 72819091 / -1.9% 0.85 / 0.84 / +0.9%
tpch_q08/duckdb:parquet 73279945 / 74042811 / -1.0% 87257942 / 87709360 / -0.5% 0.84 / 0.84 / -0.5%
tpch_q09/duckdb:parquet 113981740 / 114234210 / -0.2% 127418000 / 127669556 / -0.2% 0.89 / 0.89 / -0.0%
tpch_q10/duckdb:parquet 108221870 / 111120086 / -2.6% 122093107 / 121538427 / +0.5% 0.89 / 0.91 / -3.1%
tpch_q11/duckdb:parquet 19922882 / 20151406 / -1.1% 23270771 / 23880537 / -2.6% 0.86 / 0.84 / +1.5%
tpch_q12/duckdb:parquet 41360494 / 41790928 / -1.0% 48665948 / 49684496 / -2.1% 0.85 / 0.84 / +1.0%
tpch_q13/duckdb:parquet 238364979 / 239417261 / -0.4% 247614324 / 248637303 / -0.4% 0.96 / 0.96 / -0.0%
tpch_q14/duckdb:parquet 43520542 / 43868294 / -0.8% 52761707 / 52580539 / +0.3% 0.82 / 0.83 / -1.1%
tpch_q15/duckdb:parquet 24852035 / 25008733 / -0.6% 31101239 / 36282340 / -14.3% 🟢 0.80 / 0.69 / +15.9%
tpch_q16/duckdb:parquet 49841515 / 51400586 / -3.0% 58491114 / 57787992 / +1.2% 0.85 / 0.89 / -4.2%
tpch_q17/duckdb:parquet 44448588 / 44928401 / -1.1% 54234457 / 54643660 / -0.7% 0.82 / 0.82 / -0.3%
tpch_q18/duckdb:parquet 89519998 / 91143933 / -1.8% 102918189 / 104348797 / -1.4% 0.87 / 0.87 / -0.4%
tpch_q19/duckdb:parquet 61642503 / 61355364 / +0.5% 71396695 / 71583404 / -0.3% 0.86 / 0.86 / +0.7%
tpch_q20/duckdb:parquet 58663429 / 59178846 / -0.9% 70441461 / 71695674 / -1.7% 0.83 / 0.83 / +0.9%
tpch_q21/duckdb:parquet 136833066 / 137928740 / -0.8% 147845394 / 150099546 / -1.5% 0.93 / 0.92 / +0.7%
tpch_q22/duckdb:parquet 50382781 / 50761929 / -0.7% 57287836 / 58500299 / -2.1% 0.88 / 0.87 / +1.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 303cdaef vs base 008e3b75
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.1%
Engines: DataFusion No clear signal (-1.7%, low confidence) · DuckDB No clear signal (-6.3%, low confidence)
Vortex (geomean): hot 0.985x ➖ · cold 1.002x ➖
Parquet (geomean): hot 1.027x ➖ · cold 1.039x ➖
Shifts: Parquet (control) +2.7% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 210262023 / 202177374 / +4.0% 536962912 / 514382282 / +4.4% 0.39 / 0.39 / -0.4%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10567386 / 11188267 / -5.5% 49796263 / 47369367 / +5.1% 0.21 / 0.24 / -10.2%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11712832 / 11489987 / +1.9% 48157133 / 49218289 / -2.2% 0.24 / 0.23 / +4.2%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22932888 / 22898283 / +0.2% 68988416 / 68871776 / +0.2% 0.33 / 0.33 / -0.0%
clickbench-sorted_q37/datafusion:vortex-file-compressed 17968858 / 18889736 / -4.9% 61809803 / 58833630 / +5.1% 0.29 / 0.32 / -9.5%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17363906 / 17578764 / -1.2% 59335536 / 59804386 / -0.8% 0.29 / 0.29 / -0.4%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40010418 / 40431381 / -1.0% 92903655 / 95471574 / -2.7% 0.43 / 0.42 / +1.7%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12163010 / 12364642 / -1.6% 45973184 / 44671616 / +2.9% 0.26 / 0.28 / -4.4%
clickbench-sorted_q41/datafusion:vortex-file-compressed 12139255 / 11884640 / +2.1% 44192507 / 45478391 / -2.8% 0.27 / 0.26 / +5.1%
clickbench-sorted_q42/datafusion:vortex-file-compressed 10159428 / 9988859 / +1.7% 36689424 / 36544882 / +0.4% 0.28 / 0.27 / +1.3%
datafusion / parquet / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 753961086 / 767853862 / -1.8% 946504193 / 943196114 / +0.4% 0.80 / 0.81 / -2.2%
clickbench-sorted_q24/datafusion:parquet 9870931 / 9003622 / +9.6% 68877759 / 70855534 / -2.8% 0.14 / 0.13 / +12.8%
clickbench-sorted_q26/datafusion:parquet 9111032 / 9067958 / +0.5% 71783715 / 72229531 / -0.6% 0.13 / 0.13 / +1.1%
clickbench-sorted_q36/datafusion:parquet 93928606 / 94080832 / -0.2% 169419142 / 169358261 / +0.0% 0.55 / 0.56 / -0.2%
clickbench-sorted_q37/datafusion:parquet 64571504 / 63717246 / +1.3% 132623454 / 131159285 / +1.1% 0.49 / 0.49 / +0.2%
clickbench-sorted_q38/datafusion:parquet 87854956 / 87086638 / +0.9% 159914314 / 158508063 / +0.9% 0.55 / 0.55 / -0.0%
clickbench-sorted_q39/datafusion:parquet 159906562 / 158904340 / +0.6% 236812969 / 234675436 / +0.9% 0.68 / 0.68 / -0.3%
clickbench-sorted_q40/datafusion:parquet 44798714 / 43905790 / +2.0% 114568492 / 117978126 / -2.9% 0.39 / 0.37 / +5.1%
clickbench-sorted_q41/datafusion:parquet 42533716 / 41931482 / +1.4% 112250618 / 111807446 / +0.4% 0.38 / 0.38 / +1.0%
clickbench-sorted_q42/datafusion:parquet 26096964 / 26422306 / -1.2% 86464853 / 86764613 / -0.3% 0.30 / 0.30 / -0.9%
duckdb / vortex-file-compressed / ns (0.975x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 59231268 / 59286430 / -0.1% 92915081 / 92127280 / +0.9% 0.64 / 0.64 / -0.9%
clickbench-sorted_q24/duckdb:vortex-file-compressed 21297799 / 20654503 / +3.1% 31342885 / 35462210 / -11.6% 🟢 0.68 / 0.58 / +16.7%
clickbench-sorted_q26/duckdb:vortex-file-compressed 13206326 / 16515937 / -20.0% 🟢 28762808 / 25973337 / +10.7% 🔴 0.46 / 0.64 / -27.8%
clickbench-sorted_q36/duckdb:vortex-file-compressed 29574100 / 31307574 / -5.5% 63647298 / 64493644 / -1.3% 0.46 / 0.49 / -4.3%
clickbench-sorted_q37/duckdb:vortex-file-compressed 23099458 / 24043136 / -3.9% 52257070 / 55978920 / -6.6% 0.44 / 0.43 / +2.9%
clickbench-sorted_q38/duckdb:vortex-file-compressed 27473523 / 25527104 / +7.6% 57263963 / 61724452 / -7.2% 0.48 / 0.41 / +16.0%
clickbench-sorted_q39/duckdb:vortex-file-compressed 47149700 / 48081881 / -1.9% 99656071 / 101092105 / -1.4% 0.47 / 0.48 / -0.5%
clickbench-sorted_q40/duckdb:vortex-file-compressed 18444156 / 16823503 / +9.6% 38803050 / 39351749 / -1.4% 0.48 / 0.43 / +11.2%
clickbench-sorted_q41/duckdb:vortex-file-compressed 16079544 / 16549024 / -2.8% 39087757 / 37289683 / +4.8% 0.41 / 0.44 / -7.3%
clickbench-sorted_q42/duckdb:vortex-file-compressed 12339416 / 13369444 / -7.7% 33628581 / 30577855 / +10.0% 0.37 / 0.44 / -16.1%
duckdb / parquet / ns (1.041x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 128277178 / 124464182 / +3.1% 148121064 / 147540119 / +0.4% 0.87 / 0.84 / +2.7%
clickbench-sorted_q24/duckdb:parquet 17397448 / 17447936 / -0.3% 25927384 / 26190006 / -1.0% 0.67 / 0.67 / +0.7%
clickbench-sorted_q26/duckdb:parquet 13004814 / 12741704 / +2.1% 26492067 / 21135517 / +25.3% 🔴 0.49 / 0.60 / -18.6%
clickbench-sorted_q36/duckdb:parquet 48398976 / 42519431 / +13.8% 🔴 63757076 / 59289377 / +7.5% 0.76 / 0.72 / +5.9%
clickbench-sorted_q37/duckdb:parquet 31791565 / 30165187 / +5.4% 60659740 / 51901121 / +16.9% 🔴 0.52 / 0.58 / -9.8%
clickbench-sorted_q38/duckdb:parquet 40395424 / 38482698 / +5.0% 62907953 / 55862349 / +12.6% 🔴 0.64 / 0.69 / -6.8%
clickbench-sorted_q39/duckdb:parquet 72769007 / 68910540 / +5.6% 88550704 / 87047134 / +1.7% 0.82 / 0.79 / +3.8%
clickbench-sorted_q40/duckdb:parquet 16957374 / 17856076 / -5.0% 45225033 / 38640953 / +17.0% 🔴 0.37 / 0.46 / -18.9%
clickbench-sorted_q41/duckdb:parquet 16800080 / 15967082 / +5.2% 43397605 / 42506583 / +2.1% 0.39 / 0.38 / +3.1%
clickbench-sorted_q42/duckdb:parquet 11291816 / 10567508 / +6.9% 24601228 / 23731911 / +3.7% 0.46 / 0.45 / +3.1%

File Size Changes (100 files changed, +0.0% overall, 42↑ 58↓)
File Scale Format Base HEAD Change %
hits_010.vortex 1.0 vortex-file-compressed 168.12 MB 170.17 MB +2.04 MB +1.2%
hits_053.vortex 1.0 vortex-file-compressed 189.51 MB 191.56 MB +2.05 MB +1.1%
hits_064.vortex 1.0 vortex-file-compressed 190.74 MB 192.65 MB +1.91 MB +1.0%
hits_012.vortex 1.0 vortex-file-compressed 190.50 MB 192.38 MB +1.88 MB +1.0%
hits_007.vortex 1.0 vortex-file-compressed 199.62 MB 201.20 MB +1.58 MB +0.8%
hits_059.vortex 1.0 vortex-file-compressed 198.94 MB 200.35 MB +1.41 MB +0.7%
hits_028.vortex 1.0 vortex-file-compressed 152.07 MB 152.99 MB +947.63 KB +0.6%
hits_062.vortex 1.0 vortex-file-compressed 171.42 MB 172.15 MB +747.34 KB +0.4%
hits_071.vortex 1.0 vortex-file-compressed 139.26 MB 139.78 MB +525.30 KB +0.4%
hits_018.vortex 1.0 vortex-file-compressed 199.96 MB 200.66 MB +724.62 KB +0.4%
hits_047.vortex 1.0 vortex-file-compressed 153.75 MB 154.11 MB +361.47 KB +0.2%
hits_005.vortex 1.0 vortex-file-compressed 167.18 MB 167.53 MB +349.93 KB +0.2%
hits_036.vortex 1.0 vortex-file-compressed 171.97 MB 172.28 MB +320.48 KB +0.2%
hits_021.vortex 1.0 vortex-file-compressed 153.72 MB 153.99 MB +278.59 KB +0.2%
hits_004.vortex 1.0 vortex-file-compressed 130.57 MB 130.79 MB +218.35 KB +0.2%
hits_037.vortex 1.0 vortex-file-compressed 177.96 MB 178.23 MB +272.09 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.57 MB 130.76 MB +191.62 KB +0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.07 MB 101.20 MB +130.86 KB +0.1%
hits_084.vortex 1.0 vortex-file-compressed 153.91 MB 154.09 MB +188.52 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.23 MB 130.38 MB +148.97 KB +0.1%
hits_086.vortex 1.0 vortex-file-compressed 191.75 MB 191.96 MB +215.00 KB +0.1%
hits_081.vortex 1.0 vortex-file-compressed 200.97 MB 201.17 MB +209.27 KB +0.1%
hits_020.vortex 1.0 vortex-file-compressed 159.85 MB 160.01 MB +159.49 KB +0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.22 MB 130.35 MB +129.35 KB +0.1%
hits_043.vortex 1.0 vortex-file-compressed 126.73 MB 126.84 MB +113.10 KB +0.1%
hits_058.vortex 1.0 vortex-file-compressed 154.36 MB 154.46 MB +99.28 KB +0.1%
hits_096.vortex 1.0 vortex-file-compressed 200.43 MB 200.55 MB +126.62 KB +0.1%
hits_039.vortex 1.0 vortex-file-compressed 161.63 MB 161.71 MB +83.41 KB +0.1%
hits_060.vortex 1.0 vortex-file-compressed 192.70 MB 192.79 MB +89.34 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.32 MB 147.37 MB +49.43 KB +0.0%
hits_085.vortex 1.0 vortex-file-compressed 200.78 MB 200.84 MB +64.70 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.22 MB 147.26 MB +38.10 KB +0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.76 MB 181.80 MB +45.95 KB +0.0%
hits_024.vortex 1.0 vortex-file-compressed 161.06 MB 161.09 MB +38.34 KB +0.0%
hits_077.vortex 1.0 vortex-file-compressed 172.96 MB 173.00 MB +39.28 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.02 MB 189.06 MB +41.54 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.78 MB 171.81 MB +28.66 KB +0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.08 MB 130.09 MB +17.14 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 127.05 MB 127.06 MB +15.94 KB +0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.20 MB 159.22 MB +17.65 KB +0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.77 MB 159.78 MB +9.45 KB +0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.58 MB 161.58 MB +408 B +0.0%
hits_033.vortex 1.0 vortex-file-compressed 201.19 MB 201.19 MB 672 B -0.0%
hits_015.vortex 1.0 vortex-file-compressed 130.35 MB 130.35 MB 2.35 KB -0.0%
hits_042.vortex 1.0 vortex-file-compressed 202.20 MB 202.19 MB 6.39 KB -0.0%
hits_046.vortex 1.0 vortex-file-compressed 100.68 MB 100.68 MB 5.33 KB -0.0%
hits_008.vortex 1.0 vortex-file-compressed 139.40 MB 139.40 MB 7.49 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.58 MB 136.57 MB 7.66 KB -0.0%
hits_038.vortex 1.0 vortex-file-compressed 189.56 MB 189.55 MB 14.15 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 161.39 MB 161.38 MB 12.80 KB -0.0%
hits_011.vortex 1.0 vortex-file-compressed 200.17 MB 200.15 MB 17.66 KB -0.0%
hits_029.vortex 1.0 vortex-file-compressed 200.89 MB 200.87 MB 20.09 KB -0.0%
hits_088.vortex 1.0 vortex-file-compressed 172.78 MB 172.76 MB 17.93 KB -0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.24 MB 156.22 MB 17.34 KB -0.0%
hits_019.vortex 1.0 vortex-file-compressed 140.07 MB 140.05 MB 16.62 KB -0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.59 MB 161.58 MB 19.55 KB -0.0%
hits_089.vortex 1.0 vortex-file-compressed 130.70 MB 130.68 MB 16.25 KB -0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.82 MB 130.80 MB 19.55 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.90 MB 161.86 MB 31.95 KB -0.0%
hits_073.vortex 1.0 vortex-file-compressed 173.08 MB 173.04 MB 42.05 KB -0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.94 MB 194.88 MB 61.03 KB -0.0%
hits_070.vortex 1.0 vortex-file-compressed 200.94 MB 200.87 MB 67.85 KB -0.0%
hits_094.vortex 1.0 vortex-file-compressed 158.41 MB 158.36 MB 53.98 KB -0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.39 MB 172.33 MB 65.18 KB -0.0%
hits_014.vortex 1.0 vortex-file-compressed 172.84 MB 172.77 MB 69.66 KB -0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.65 MB 192.56 MB 82.84 KB -0.0%
hits_074.vortex 1.0 vortex-file-compressed 200.15 MB 200.06 MB 95.16 KB -0.0%
hits_068.vortex 1.0 vortex-file-compressed 160.45 MB 160.37 MB 87.19 KB -0.1%
hits_013.vortex 1.0 vortex-file-compressed 161.81 MB 161.72 MB 88.90 KB -0.1%
hits_030.vortex 1.0 vortex-file-compressed 131.21 MB 131.13 MB 74.36 KB -0.1%
hits_044.vortex 1.0 vortex-file-compressed 201.07 MB 200.95 MB 126.95 KB -0.1%
hits_098.vortex 1.0 vortex-file-compressed 137.81 MB 137.73 MB 90.09 KB -0.1%
hits_022.vortex 1.0 vortex-file-compressed 200.02 MB 199.89 MB 140.80 KB -0.1%
hits_090.vortex 1.0 vortex-file-compressed 192.37 MB 192.24 MB 138.06 KB -0.1%
hits_092.vortex 1.0 vortex-file-compressed 200.76 MB 200.58 MB 177.18 KB -0.1%
hits_035.vortex 1.0 vortex-file-compressed 102.18 MB 102.09 MB 93.28 KB -0.1%
hits_040.vortex 1.0 vortex-file-compressed 144.38 MB 144.25 MB 134.72 KB -0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.92 MB 130.79 MB 129.77 KB -0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.98 MB 180.81 MB 182.56 KB -0.1%
hits_066.vortex 1.0 vortex-file-compressed 163.25 MB 163.05 MB 202.15 KB -0.1%
hits_056.vortex 1.0 vortex-file-compressed 135.13 MB 134.96 MB 173.93 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 131.05 MB 130.88 MB 169.15 KB -0.1%
hits_055.vortex 1.0 vortex-file-compressed 200.96 MB 200.70 MB 266.04 KB -0.1%
hits_072.vortex 1.0 vortex-file-compressed 102.06 MB 101.92 MB 136.12 KB -0.1%
hits_069.vortex 1.0 vortex-file-compressed 143.13 MB 142.91 MB 225.88 KB -0.2%
hits_048.vortex 1.0 vortex-file-compressed 200.73 MB 200.41 MB 334.99 KB -0.2%
hits_049.vortex 1.0 vortex-file-compressed 191.40 MB 191.08 MB 334.59 KB -0.2%
hits_016.vortex 1.0 vortex-file-compressed 179.99 MB 179.66 MB 334.01 KB -0.2%
hits_002.vortex 1.0 vortex-file-compressed 161.76 MB 161.43 MB 338.45 KB -0.2%
hits_045.vortex 1.0 vortex-file-compressed 140.22 MB 139.93 MB 296.38 KB -0.2%
hits_095.vortex 1.0 vortex-file-compressed 154.00 MB 153.68 MB 325.79 KB -0.2%
hits_026.vortex 1.0 vortex-file-compressed 130.80 MB 130.50 MB 304.80 KB -0.2%
hits_006.vortex 1.0 vortex-file-compressed 126.90 MB 126.61 MB 301.25 KB -0.2%
hits_032.vortex 1.0 vortex-file-compressed 154.34 MB 153.96 MB 385.42 KB -0.2%
hits_082.vortex 1.0 vortex-file-compressed 139.70 MB 139.30 MB 410.77 KB -0.3%
hits_051.vortex 1.0 vortex-file-compressed 173.40 MB 172.89 MB 525.90 KB -0.3%
hits_054.vortex 1.0 vortex-file-compressed 147.83 MB 147.34 MB 499.35 KB -0.3%
hits_076.vortex 1.0 vortex-file-compressed 161.60 MB 160.29 MB 1.31 MB -0.8%
hits_001.vortex 1.0 vortex-file-compressed 190.74 MB 188.69 MB 2.05 MB -1.1%
hits_027.vortex 1.0 vortex-file-compressed 192.29 MB 189.58 MB 2.71 MB -1.4%

Totals:

  • vortex-file-compressed: 15.96 GB → 15.97 GB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 303cdaef vs base 008e3b75
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.9%
Engines: DataFusion No clear signal (+3.8%, environment too noisy confidence) · DuckDB No clear signal (-18.3%, environment too noisy confidence)
Vortex (geomean): hot 1.020x ➖ · cold 0.946x ➖
Parquet (geomean): hot 1.107x ➖ · cold 1.110x ➖
Shifts: Parquet (control) +10.7% · Median polish +8.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.097x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 55832066 / 52616896 / +6.1% 104299739 / 134143913 / -22.2% 0.54 / 0.39 / +36.5%
fineweb_q01/datafusion:vortex-file-compressed 434727632 / 367835794 / +18.2% 781854915 / 536405426 / +45.8% 🔴 0.56 / 0.69 / -18.9%
fineweb_q02/datafusion:vortex-file-compressed 429132762 / 401791115 / +6.8% 689660099 / 544713676 / +26.6% 0.62 / 0.74 / -15.6%
fineweb_q03/datafusion:vortex-file-compressed 758753004 / 473567678 / +60.2% 🔴 676572870 / 756426577 / -10.6% 1.12 / 0.63 / +79.1%
fineweb_q04/datafusion:vortex-file-compressed 597804222 / 445803446 / +34.1% 🔴 518548399 / 604995590 / -14.3% 1.15 / 0.74 / +56.5%
fineweb_q05/datafusion:vortex-file-compressed 451312649 / 482936586 / -6.5% 478509028 / 451868935 / +5.9% 0.94 / 1.07 / -11.8%
fineweb_q06/datafusion:vortex-file-compressed 770895370 / 741278351 / +4.0% 717536627 / 726474893 / -1.2% 1.07 / 1.02 / +5.3%
fineweb_q07/datafusion:vortex-file-compressed 561970222 / 487451974 / +15.3% 464798645 / 417737716 / +11.3% 1.21 / 1.17 / +3.6%
fineweb_q08/datafusion:vortex-file-compressed 190375226 / 265983630 / -28.4% 192854785 / 336484963 / -42.7% 🟢 0.99 / 0.79 / +24.9%
datafusion / parquet / ns (1.057x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 637780118 / 481901846 / +32.3% 🔴 794990091 / 770915103 / +3.1% 0.80 / 0.63 / +28.3%
fineweb_q01/datafusion:parquet 854077385 / 705605238 / +21.0% 836625592 / 702681222 / +19.1% 1.02 / 1.00 / +1.7%
fineweb_q02/datafusion:parquet 735864550 / 914923273 / -19.6% 763241878 / 926365455 / -17.6% 0.96 / 0.99 / -2.4%
fineweb_q03/datafusion:parquet 930606525 / 705202388 / +32.0% 🔴 1216742871 / 767486802 / +58.5% 🔴 0.76 / 0.92 / -16.8%
fineweb_q04/datafusion:parquet 1002598953 / 861944518 / +16.3% 835368844 / 686764069 / +21.6% 1.20 / 1.26 / -4.4%
fineweb_q05/datafusion:parquet 678144202 / 765186630 / -11.4% 758961111 / 785666545 / -3.4% 0.89 / 0.97 / -8.3%
fineweb_q06/datafusion:parquet 696285676 / 787044744 / -11.5% 590034848 / 833654331 / -29.2% 1.18 / 0.94 / +25.0%
fineweb_q07/datafusion:parquet 790608902 / 768135330 / +2.9% 1035650292 / 719690454 / +43.9% 🔴 0.76 / 1.07 / -28.5%
fineweb_q08/datafusion:parquet 746008283 / 723775068 / +3.1% 985653798 / 740419421 / +33.1% 🔴 0.76 / 0.98 / -22.6%
duckdb / vortex-file-compressed / ns (0.948x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 72017860 / 90292795 / -20.2% 64939623 / 135586882 / -52.1% 🟢 1.11 / 0.67 / +66.5%
fineweb_q01/duckdb:vortex-file-compressed 413039925 / 406756810 / +1.5% 427008069 / 463704094 / -7.9% 0.97 / 0.88 / +10.3%
fineweb_q02/duckdb:vortex-file-compressed 595469299 / 832792294 / -28.5% 591224966 / 637062935 / -7.2% 1.01 / 1.31 / -23.0%
fineweb_q03/duckdb:vortex-file-compressed 954407196 / 1001689544 / -4.7% 1035543036 / 1068717272 / -3.1% 0.92 / 0.94 / -1.7%
fineweb_q04/duckdb:vortex-file-compressed 1041325168 / 1007352292 / +3.4% 1032555807 / 1061680081 / -2.7% 1.01 / 0.95 / +6.3%
fineweb_q05/duckdb:vortex-file-compressed 953819160 / 893976232 / +6.7% 1092497630 / 963409289 / +13.4% 0.87 / 0.93 / -5.9%
fineweb_q06/duckdb:vortex-file-compressed 1233277024 / 1247023694 / -1.1% 1174530294 / 1284024835 / -8.5% 1.05 / 0.97 / +8.1%
fineweb_q07/duckdb:vortex-file-compressed 960273472 / 963984322 / -0.4% 992493532 / 1027164124 / -3.4% 0.97 / 0.94 / +3.1%
fineweb_q08/duckdb:vortex-file-compressed 423766550 / 409550554 / +3.5% 696705869 / 535902496 / +30.0% 🔴 0.61 / 0.76 / -20.4%
duckdb / parquet / ns (1.160x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 622116606 / 473860562 / +31.3% 🔴 737157341 / 565171140 / +30.4% 🔴 0.84 / 0.84 / +0.7%
fineweb_q01/duckdb:parquet 840956496 / 575996844 / +46.0% 🔴 643310984 / 544558797 / +18.1% 1.31 / 1.06 / +23.6%
fineweb_q02/duckdb:parquet 577632680 / 592984912 / -2.6% 611141728 / 585410698 / +4.4% 0.95 / 1.01 / -6.7%
fineweb_q03/duckdb:parquet 1752917413 / 1413648306 / +24.0% 1951311543 / 1457898844 / +33.8% 🔴 0.90 / 0.97 / -7.4%
fineweb_q04/duckdb:parquet 867796436 / 722713456 / +20.1% 894226873 / 742711943 / +20.4% 0.97 / 0.97 / -0.3%
fineweb_q05/duckdb:parquet 965774679 / 921567416 / +4.8% 855410122 / 994301462 / -14.0% 1.13 / 0.93 / +21.8%
fineweb_q06/duckdb:parquet 1535724094 / 1698732416 / -9.6% 1895994949 / 1792355218 / +5.8% 0.81 / 0.95 / -14.5%
fineweb_q07/duckdb:parquet 1111564370 / 1047703771 / +6.1% 1089112959 / 1117234140 / -2.5% 1.02 / 0.94 / +8.8%
fineweb_q08/duckdb:parquet 662091010 / 486262394 / +36.2% 🔴 570514418 / 508535161 / +12.2% 1.16 / 0.96 / +21.4%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 303cdaef vs base a65c6537
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-0.9%, environment too noisy confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.000x ➖
Parquet (geomean): hot 1.009x ➖ · cold 1.013x ➖
Shifts: Parquet (control) +0.9% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1225580 / 1253244 / -2.2% 19110529 / 19854098 / -3.7% 0.06 / 0.06 / +1.6%
clickbench_q01/datafusion:vortex-file-compressed 5795813 / 6104594 / -5.1% 33141932 / 33605895 / -1.4% 0.17 / 0.18 / -3.7%
clickbench_q02/datafusion:vortex-file-compressed 10710779 / 11000370 / -2.6% 39272297 / 40098671 / -2.1% 0.27 / 0.27 / -0.6%
clickbench_q03/datafusion:vortex-file-compressed 11962173 / 11638826 / +2.8% 52304545 / 53279480 / -1.8% 0.23 / 0.22 / +4.7%
clickbench_q04/datafusion:vortex-file-compressed 55571152 / 56252674 / -1.2% 90924124 / 89852525 / +1.2% 0.61 / 0.63 / -2.4%
clickbench_q05/datafusion:vortex-file-compressed 75762355 / 75949040 / -0.2% 118730528 / 117429927 / +1.1% 0.64 / 0.65 / -1.3%
clickbench_q06/datafusion:vortex-file-compressed 1260806 / 1243698 / +1.4% 19749269 / 19613620 / +0.7% 0.06 / 0.06 / +0.7%
clickbench_q07/datafusion:vortex-file-compressed 9626798 / 9823806 / -2.0% 33223004 / 32411858 / +2.5% 0.29 / 0.30 / -4.4%
clickbench_q08/datafusion:vortex-file-compressed 79658730 / 75978734 / +4.8% 112797012 / 111825358 / +0.9% 0.71 / 0.68 / +3.9%
clickbench_q09/datafusion:vortex-file-compressed 169800998 / 172073283 / -1.3% 207959606 / 211015438 / -1.4% 0.82 / 0.82 / +0.1%
clickbench_q10/datafusion:vortex-file-compressed 25442832 / 25251033 / +0.8% 64314501 / 66610296 / -3.4% 0.40 / 0.38 / +4.4%
clickbench_q11/datafusion:vortex-file-compressed 26776862 / 26159926 / +2.4% 65392281 / 67888500 / -3.7% 0.41 / 0.39 / +6.3%
clickbench_q12/datafusion:vortex-file-compressed 72268012 / 72320355 / -0.1% 116523366 / 114350587 / +1.9% 0.62 / 0.63 / -1.9%
clickbench_q13/datafusion:vortex-file-compressed 119511188 / 117110659 / +2.0% 178349681 / 178120347 / +0.1% 0.67 / 0.66 / +1.9%
clickbench_q14/datafusion:vortex-file-compressed 74993358 / 75736343 / -1.0% 118746529 / 122845388 / -3.3% 0.63 / 0.62 / +2.4%
clickbench_q15/datafusion:vortex-file-compressed 62225680 / 62005172 / +0.4% 92658568 / 94734057 / -2.2% 0.67 / 0.65 / +2.6%
clickbench_q16/datafusion:vortex-file-compressed 149478922 / 153125711 / -2.4% 208327478 / 202772257 / +2.7% 0.72 / 0.76 / -5.0%
clickbench_q17/datafusion:vortex-file-compressed 151534329 / 148557969 / +2.0% 208261438 / 210646886 / -1.1% 0.73 / 0.71 / +3.2%
clickbench_q18/datafusion:vortex-file-compressed 298660968 / 298679324 / -0.0% 374690815 / 374987317 / -0.1% 0.80 / 0.80 / +0.1%
clickbench_q19/datafusion:vortex-file-compressed 7679044 / 7755610 / -1.0% 47323767 / 44456432 / +6.4% 0.16 / 0.17 / -7.0%
clickbench_q20/datafusion:vortex-file-compressed 62218902 / 61032503 / +1.9% 228752555 / 232720532 / -1.7% 0.27 / 0.26 / +3.7%
clickbench_q21/datafusion:vortex-file-compressed 90225546 / 89106200 / +1.3% 273049080 / 272577151 / +0.2% 0.33 / 0.33 / +1.1%
clickbench_q22/datafusion:vortex-file-compressed 103085094 / 101948026 / +1.1% 343167709 / 349312070 / -1.8% 0.30 / 0.29 / +2.9%
clickbench_q23/datafusion:vortex-file-compressed 207531198 / 195018304 / +6.4% 523251042 / 535795513 / -2.3% 0.40 / 0.36 / +9.0%
clickbench_q24/datafusion:vortex-file-compressed 16508256 / 16316292 / +1.2% 61366164 / 61580477 / -0.3% 0.27 / 0.26 / +1.5%
clickbench_q25/datafusion:vortex-file-compressed 18123104 / 17947388 / +1.0% 54862967 / 56912482 / -3.6% 0.33 / 0.32 / +4.8%
clickbench_q26/datafusion:vortex-file-compressed 16544312 / 16841492 / -1.8% 62607263 / 64762455 / -3.3% 0.26 / 0.26 / +1.6%
clickbench_q27/datafusion:vortex-file-compressed 99198040 / 98671758 / +0.5% 239977256 / 242463722 / -1.0% 0.41 / 0.41 / +1.6%
clickbench_q28/datafusion:vortex-file-compressed 561053234 / 564856294 / -0.7% 625164563 / 620320106 / +0.8% 0.90 / 0.91 / -1.4%
clickbench_q29/datafusion:vortex-file-compressed 23365042 / 22846181 / +2.3% 50377699 / 51559110 / -2.3% 0.46 / 0.44 / +4.7%
clickbench_q30/datafusion:vortex-file-compressed 58472630 / 60970045 / -4.1% 106165026 / 108411674 / -2.1% 0.55 / 0.56 / -2.1%
clickbench_q31/datafusion:vortex-file-compressed 70700570 / 73643918 / -4.0% 147648797 / 150215995 / -1.7% 0.48 / 0.49 / -2.3%
clickbench_q32/datafusion:vortex-file-compressed 305868204 / 297636006 / +2.8% 389889616 / 388720166 / +0.3% 0.78 / 0.77 / +2.5%
clickbench_q33/datafusion:vortex-file-compressed 328878416 / 329989645 / -0.3% 428494815 / 429064267 / -0.1% 0.77 / 0.77 / -0.2%
clickbench_q34/datafusion:vortex-file-compressed 333186341 / 334097428 / -0.3% 429218716 / 423924305 / +1.2% 0.78 / 0.79 / -1.5%
clickbench_q35/datafusion:vortex-file-compressed 57334079 / 55704550 / +2.9% 85842586 / 87169267 / -1.5% 0.67 / 0.64 / +4.5%
clickbench_q36/datafusion:vortex-file-compressed 37778514 / 37338169 / +1.2% 63487780 / 64906949 / -2.2% 0.60 / 0.58 / +3.4%
clickbench_q37/datafusion:vortex-file-compressed 21651327 / 21719736 / -0.3% 45766574 / 46605572 / -1.8% 0.47 / 0.47 / +1.5%
clickbench_q38/datafusion:vortex-file-compressed 11728858 / 11531990 / +1.7% 38170303 / 37230035 / +2.5% 0.31 / 0.31 / -0.8%
clickbench_q39/datafusion:vortex-file-compressed 78790680 / 78384854 / +0.5% 107565363 / 109109723 / -1.4% 0.73 / 0.72 / +2.0%
clickbench_q40/datafusion:vortex-file-compressed 11428470 / 11518415 / -0.8% 35130332 / 36585828 / -4.0% 0.33 / 0.31 / +3.3%
clickbench_q41/datafusion:vortex-file-compressed 10736462 / 10970846 / -2.1% 34166192 / 34750595 / -1.7% 0.31 / 0.32 / -0.5%
clickbench_q42/datafusion:vortex-file-compressed 11189735 / 11053092 / +1.2% 35507007 / 34782775 / +2.1% 0.32 / 0.32 / -0.8%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1292546 / 1276854 / +1.2% 49328164 / 48415487 / +1.9% 0.03 / 0.03 / -0.6%
clickbench_q01/datafusion:parquet 16376016 / 16338007 / +0.2% 71641919 / 74428912 / -3.7% 0.23 / 0.22 / +4.1%
clickbench_q02/datafusion:parquet 18849049 / 18968022 / -0.6% 83715469 / 84885710 / -1.4% 0.23 / 0.22 / +0.8%
clickbench_q03/datafusion:parquet 17631212 / 17780842 / -0.8% 83221048 / 81434447 / +2.2% 0.21 / 0.22 / -3.0%
clickbench_q04/datafusion:parquet 62804854 / 63188308 / -0.6% 131873797 / 126299319 / +4.4% 0.48 / 0.50 / -4.8%
clickbench_q05/datafusion:parquet 90514192 / 88841347 / +1.9% 159193971 / 159462630 / -0.2% 0.57 / 0.56 / +2.1%
clickbench_q06/datafusion:parquet 1277275 / 1278119 / -0.1% 47823345 / 48269767 / -0.9% 0.03 / 0.03 / +0.9%
clickbench_q07/datafusion:parquet 16909044 / 16824260 / +0.5% 68970771 / 68485198 / +0.7% 0.25 / 0.25 / -0.2%
clickbench_q08/datafusion:parquet 85506326 / 87554366 / -2.3% 164119863 / 162073117 / +1.3% 0.52 / 0.54 / -3.6%
clickbench_q09/datafusion:parquet 187528874 / 189838528 / -1.2% 265635432 / 269849566 / -1.6% 0.71 / 0.70 / +0.4%
clickbench_q10/datafusion:parquet 37089928 / 36571271 / +1.4% 99920498 / 101100882 / -1.2% 0.37 / 0.36 / +2.6%
clickbench_q11/datafusion:parquet 42904433 / 43115244 / -0.5% 110611460 / 109261671 / +1.2% 0.39 / 0.39 / -1.7%
clickbench_q12/datafusion:parquet 97537550 / 95974058 / +1.6% 164552795 / 163862631 / +0.4% 0.59 / 0.59 / +1.2%
clickbench_q13/datafusion:parquet 150032208 / 147314624 / +1.8% 232031301 / 228875433 / +1.4% 0.65 / 0.64 / +0.5%
clickbench_q14/datafusion:parquet 101981818 / 102174375 / -0.2% 175895779 / 172143343 / +2.2% 0.58 / 0.59 / -2.3%
clickbench_q15/datafusion:parquet 72098646 / 70996126 / +1.6% 130007920 / 131762045 / -1.3% 0.55 / 0.54 / +2.9%
clickbench_q16/datafusion:parquet 157771717 / 157432430 / +0.2% 237115711 / 239427269 / -1.0% 0.67 / 0.66 / +1.2%
clickbench_q17/datafusion:parquet 157656981 / 156966294 / +0.4% 237837866 / 239841469 / -0.8% 0.66 / 0.65 / +1.3%
clickbench_q18/datafusion:parquet 315916951 / 316939801 / -0.3% 421705122 / 419888897 / +0.4% 0.75 / 0.75 / -0.8%
clickbench_q19/datafusion:parquet 19190412 / 19038334 / +0.8% 74901226 / 75256190 / -0.5% 0.26 / 0.25 / +1.3%
clickbench_q20/datafusion:parquet 181013110 / 179586806 / +0.8% 294667082 / 277739853 / +6.1% 0.61 / 0.65 / -5.0%
clickbench_q21/datafusion:parquet 175335764 / 173953949 / +0.8% 303437302 / 290798371 / +4.3% 0.58 / 0.60 / -3.4%
clickbench_q22/datafusion:parquet 262801536 / 261457367 / +0.5% 438696982 / 412132013 / +6.4% 0.60 / 0.63 / -5.6%
clickbench_q23/datafusion:parquet 1181085686 / 1195108448 / -1.2% 1230661552 / 1230504753 / +0.0% 0.96 / 0.97 / -1.2%
clickbench_q24/datafusion:parquet 30314407 / 30015034 / +1.0% 87864011 / 86218417 / +1.9% 0.35 / 0.35 / -0.9%
clickbench_q25/datafusion:parquet 36568672 / 37091626 / -1.4% 99685272 / 99964263 / -0.3% 0.37 / 0.37 / -1.1%
clickbench_q26/datafusion:parquet 30871488 / 30645528 / +0.7% 85898590 / 88020565 / -2.4% 0.36 / 0.35 / +3.2%
clickbench_q27/datafusion:parquet 193796876 / 194454424 / -0.3% 294964843 / 286448954 / +3.0% 0.66 / 0.68 / -3.2%
clickbench_q28/datafusion:parquet 622832552 / 623834138 / -0.2% 701263395 / 695662344 / +0.8% 0.89 / 0.90 / -1.0%
clickbench_q29/datafusion:parquet 29531788 / 29159228 / +1.3% 91265371 / 91642504 / -0.4% 0.32 / 0.32 / +1.7%
clickbench_q30/datafusion:parquet 90521786 / 91641498 / -1.2% 171037551 / 168872438 / +1.3% 0.53 / 0.54 / -2.5%
clickbench_q31/datafusion:parquet 106426395 / 104883696 / +1.5% 193794716 / 191942580 / +1.0% 0.55 / 0.55 / +0.5%
clickbench_q32/datafusion:parquet 328301919 / 328067324 / +0.1% 433836104 / 425204107 / +2.0% 0.76 / 0.77 / -1.9%
clickbench_q33/datafusion:parquet 382611795 / 387004562 / -1.1% 473058590 / 472597643 / +0.1% 0.81 / 0.82 / -1.2%
clickbench_q34/datafusion:parquet 385734286 / 384671310 / +0.3% 479200123 / 474232083 / +1.0% 0.80 / 0.81 / -0.8%
clickbench_q35/datafusion:parquet 63151342 / 62973294 / +0.3% 121904841 / 124121475 / -1.8% 0.52 / 0.51 / +2.1%
clickbench_q36/datafusion:parquet 73594648 / 73592270 / +0.0% 132257859 / 133779768 / -1.1% 0.56 / 0.55 / +1.2%
clickbench_q37/datafusion:parquet 35451647 / 35440082 / +0.0% 91156700 / 91656973 / -0.5% 0.39 / 0.39 / +0.6%
clickbench_q38/datafusion:parquet 47666228 / 47864858 / -0.4% 105418188 / 106618852 / -1.1% 0.45 / 0.45 / +0.7%
clickbench_q39/datafusion:parquet 144225948 / 143991143 / +0.2% 208887981 / 207257560 / +0.8% 0.69 / 0.69 / -0.6%
clickbench_q40/datafusion:parquet 20387184 / 20271676 / +0.6% 75456693 / 77151214 / -2.2% 0.27 / 0.26 / +2.8%
clickbench_q41/datafusion:parquet 18904567 / 18911974 / -0.0% 74980482 / 75628855 / -0.9% 0.25 / 0.25 / +0.8%
clickbench_q42/datafusion:parquet 19314985 / 19292986 / +0.1% 74265835 / 75051081 / -1.0% 0.26 / 0.26 / +1.2%
duckdb / vortex-file-compressed / ns (1.007x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1704598 / 1538754 / +10.8% 🔴 24968233 / 24469684 / +2.0% 0.07 / 0.06 / +8.6%
clickbench_q01/duckdb:vortex-file-compressed 14688950 / 12004464 / +22.4% 🔴 28209749 / 29130745 / -3.2% 0.52 / 0.41 / +26.4%
clickbench_q02/duckdb:vortex-file-compressed 13986347 / 13626508 / +2.6% 32571768 / 33617235 / -3.1% 0.43 / 0.41 / +5.9%
clickbench_q03/duckdb:vortex-file-compressed 18539194 / 18390720 / +0.8% 47563145 / 47362053 / +0.4% 0.39 / 0.39 / +0.4%
clickbench_q04/duckdb:vortex-file-compressed 72124220 / 70108202 / +2.9% 102086804 / 103469983 / -1.3% 0.71 / 0.68 / +4.3%
clickbench_q05/duckdb:vortex-file-compressed 68688362 / 70125336 / -2.0% 97071262 / 97456258 / -0.4% 0.71 / 0.72 / -1.7%
clickbench_q06/duckdb:vortex-file-compressed 2048350 / 1881139 / +8.9% 29055119 / 31328103 / -7.3% 0.07 / 0.06 / +17.4%
clickbench_q07/duckdb:vortex-file-compressed 14150070 / 16714627 / -15.3% 🟢 34119722 / 32011144 / +6.6% 0.41 / 0.52 / -20.6%
clickbench_q08/duckdb:vortex-file-compressed 84717182 / 82775262 / +2.3% 122078330 / 127631232 / -4.4% 0.69 / 0.65 / +7.0%
clickbench_q09/duckdb:vortex-file-compressed 106463378 / 108016663 / -1.4% 160235230 / 143401961 / +11.7% 🔴 0.66 / 0.75 / -11.8%
clickbench_q10/duckdb:vortex-file-compressed 33661324 / 33971144 / -0.9% 67842443 / 63278305 / +7.2% 0.50 / 0.54 / -7.6%
clickbench_q11/duckdb:vortex-file-compressed 35409586 / 36368098 / -2.6% 71214881 / 69232494 / +2.9% 0.50 / 0.53 / -5.3%
clickbench_q12/duckdb:vortex-file-compressed 78573090 / 73096681 / +7.5% 106311293 / 103452173 / +2.8% 0.74 / 0.71 / +4.6%
clickbench_q13/duckdb:vortex-file-compressed 154131759 / 142425184 / +8.2% 191018842 / 185862126 / +2.8% 0.81 / 0.77 / +5.3%
clickbench_q14/duckdb:vortex-file-compressed 78768080 / 78075288 / +0.9% 106143744 / 111666844 / -4.9% 0.74 / 0.70 / +6.1%
clickbench_q15/duckdb:vortex-file-compressed 93033604 / 92890405 / +0.2% 129108087 / 128381747 / +0.6% 0.72 / 0.72 / -0.4%
clickbench_q16/duckdb:vortex-file-compressed 162296737 / 163983984 / -1.0% 211914342 / 203933056 / +3.9% 0.77 / 0.80 / -4.8%
clickbench_q17/duckdb:vortex-file-compressed 165871866 / 163682544 / +1.3% 206648196 / 204054897 / +1.3% 0.80 / 0.80 / +0.1%
clickbench_q18/duckdb:vortex-file-compressed 311429905 / 318607559 / -2.3% 373786066 / 406172561 / -8.0% 0.83 / 0.78 / +6.2%
clickbench_q19/duckdb:vortex-file-compressed 16202926 / 15965413 / +1.5% 37999744 / 41062916 / -7.5% 0.43 / 0.39 / +9.7%
clickbench_q20/duckdb:vortex-file-compressed 113549014 / 111109108 / +2.2% 192310469 / 186849958 / +2.9% 0.59 / 0.59 / -0.7%
clickbench_q21/duckdb:vortex-file-compressed 162820296 / 162899957 / -0.0% 293135914 / 288566107 / +1.6% 0.56 / 0.56 / -1.6%
clickbench_q22/duckdb:vortex-file-compressed 237109034 / 247953338 / -4.4% 421527856 / 431659519 / -2.3% 0.56 / 0.57 / -2.1%
clickbench_q23/duckdb:vortex-file-compressed 61700812 / 58254160 / +5.9% 109968640 / 92704956 / +18.6% 🔴 0.56 / 0.63 / -10.7%
clickbench_q24/duckdb:vortex-file-compressed 24336086 / 25942898 / -6.2% 41148356 / 42490012 / -3.2% 0.59 / 0.61 / -3.1%
clickbench_q25/duckdb:vortex-file-compressed 33666976 / 33469596 / +0.6% 59001768 / 56847918 / +3.8% 0.57 / 0.59 / -3.1%
clickbench_q26/duckdb:vortex-file-compressed 20334153 / 19520754 / +4.2% 37075161 / 36810098 / +0.7% 0.55 / 0.53 / +3.4%
clickbench_q27/duckdb:vortex-file-compressed 148422754 / 144902705 / +2.4% 244232503 / 241342121 / +1.2% 0.61 / 0.60 / +1.2%
clickbench_q28/duckdb:vortex-file-compressed 635287655 / 658460388 / -3.5% 661439493 / 683357583 / -3.2% 0.96 / 0.96 / -0.3%
clickbench_q29/duckdb:vortex-file-compressed 20373200 / 20552210 / -0.9% 37488994 / 35115122 / +6.8% 0.54 / 0.59 / -7.1%
clickbench_q30/duckdb:vortex-file-compressed 65928968 / 65381580 / +0.8% 107160193 / 106004147 / +1.1% 0.62 / 0.62 / -0.3%
clickbench_q31/duckdb:vortex-file-compressed 124953552 / 127183786 / -1.8% 198003899 / 196239357 / +0.9% 0.63 / 0.65 / -2.6%
clickbench_q32/duckdb:vortex-file-compressed 457026272 / 447756828 / +2.1% 490689109 / 467631543 / +4.9% 0.93 / 0.96 / -2.7%
clickbench_q33/duckdb:vortex-file-compressed 398546647 / 393950270 / +1.2% 508490331 / 508399380 / +0.0% 0.78 / 0.77 / +1.1%
clickbench_q34/duckdb:vortex-file-compressed 415696860 / 411809358 / +0.9% 578694254 / 542749712 / +6.6% 0.72 / 0.76 / -5.3%
clickbench_q35/duckdb:vortex-file-compressed 101394339 / 102497618 / -1.1% 133939652 / 139193375 / -3.8% 0.76 / 0.74 / +2.8%
clickbench_q36/duckdb:vortex-file-compressed 16531428 / 15736192 / +5.1% 31975677 / 32978570 / -3.0% 0.52 / 0.48 / +8.3%
clickbench_q37/duckdb:vortex-file-compressed 11631092 / 11776118 / -1.2% 27558941 / 28661882 / -3.8% 0.42 / 0.41 / +2.7%
clickbench_q38/duckdb:vortex-file-compressed 13477430 / 13489172 / -0.1% 33624243 / 29562838 / +13.7% 🔴 0.40 / 0.46 / -12.2%
clickbench_q39/duckdb:vortex-file-compressed 22837814 / 24468380 / -6.7% 39405197 / 42700938 / -7.7% 0.58 / 0.57 / +1.1%
clickbench_q40/duckdb:vortex-file-compressed 10428651 / 10966366 / -4.9% 28629061 / 28287499 / +1.2% 0.36 / 0.39 / -6.0%
clickbench_q41/duckdb:vortex-file-compressed 15639960 / 12791422 / +22.3% 🔴 28251857 / 28485424 / -0.8% 0.55 / 0.45 / +23.3%
clickbench_q42/duckdb:vortex-file-compressed 11480294 / 14602521 / -21.4% 🟢 29952565 / 29331807 / +2.1% 0.38 / 0.50 / -23.0%
duckdb / parquet / ns (1.016x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 9319448 / 9553553 / -2.5% 23347757 / 23978120 / -2.6% 0.40 / 0.40 / +0.2%
clickbench_q01/duckdb:parquet 13353406 / 9982025 / +33.8% 🔴 21639246 / 20645205 / +4.8% 0.62 / 0.48 / +27.6%
clickbench_q02/duckdb:parquet 16832862 / 15187374 / +10.8% 🔴 32640779 / 31259954 / +4.4% 0.52 / 0.49 / +6.1%
clickbench_q03/duckdb:parquet 16041986 / 15183330 / +5.7% 51426235 / 50166654 / +2.5% 0.31 / 0.30 / +3.1%
clickbench_q04/duckdb:parquet 72825142 / 76186014 / -4.4% 90634707 / 92683011 / -2.2% 0.80 / 0.82 / -2.3%
clickbench_q05/duckdb:parquet 81933775 / 83524124 / -1.9% 121328780 / 118134935 / +2.7% 0.68 / 0.71 / -4.5%
clickbench_q06/duckdb:parquet 15813980 / 14676582 / +7.7% 25281404 / 24830081 / +1.8% 0.63 / 0.59 / +5.8%
clickbench_q07/duckdb:parquet 11071966 / 10740843 / +3.1% 23812603 / 22790866 / +4.5% 0.46 / 0.47 / -1.3%
clickbench_q08/duckdb:parquet 85389075 / 82500768 / +3.5% 126512957 / 122208171 / +3.5% 0.67 / 0.68 / -0.0%
clickbench_q09/duckdb:parquet 114121557 / 114589722 / -0.4% 162083302 / 158751142 / +2.1% 0.70 / 0.72 / -2.5%
clickbench_q10/duckdb:parquet 33252138 / 34566686 / -3.8% 69553953 / 69266598 / +0.4% 0.48 / 0.50 / -4.2%
clickbench_q11/duckdb:parquet 39493298 / 35868648 / +10.1% 🔴 75433842 / 74834757 / +0.8% 0.52 / 0.48 / +9.2%
clickbench_q12/duckdb:parquet 91921538 / 90876442 / +1.2% 142604342 / 133406461 / +6.9% 0.64 / 0.68 / -5.4%
clickbench_q13/duckdb:parquet 146324882 / 147354846 / -0.7% 207290999 / 226604157 / -8.5% 0.71 / 0.65 / +8.6%
clickbench_q14/duckdb:parquet 101009030 / 95666290 / +5.6% 150715132 / 137686147 / +9.5% 0.67 / 0.69 / -3.5%
clickbench_q15/duckdb:parquet 92347245 / 94691103 / -2.5% 117434581 / 129139051 / -9.1% 0.79 / 0.73 / +7.2%
clickbench_q16/duckdb:parquet 171729323 / 173875103 / -1.2% 227634834 / 231855447 / -1.8% 0.75 / 0.75 / +0.6%
clickbench_q17/duckdb:parquet 181157994 / 175331266 / +3.3% 242667930 / 231889583 / +4.6% 0.75 / 0.76 / -1.3%
clickbench_q18/duckdb:parquet 319108970 / 325888230 / -2.1% 404394093 / 440247274 / -8.1% 0.79 / 0.74 / +6.6%
clickbench_q19/duckdb:parquet 13557771 / 13631120 / -0.5% 42607956 / 40366010 / +5.6% 0.32 / 0.34 / -5.8%
clickbench_q20/duckdb:parquet 134783778 / 134955091 / -0.1% 247550978 / 237211468 / +4.4% 0.54 / 0.57 / -4.3%
clickbench_q21/duckdb:parquet 181665168 / 184820181 / -1.7% 324940198 / 319062142 / +1.8% 0.56 / 0.58 / -3.5%
clickbench_q22/duckdb:parquet 248060917 / 240954136 / +2.9% 412961889 / 401248052 / +2.9% 0.60 / 0.60 / +0.0%
clickbench_q23/duckdb:parquet 151687088 / 147316516 / +3.0% 188660321 / 170299137 / +10.8% 🔴 0.80 / 0.87 / -7.1%
clickbench_q24/duckdb:parquet 43319648 / 44077850 / -1.7% 63468516 / 58229698 / +9.0% 0.68 / 0.76 / -9.8%
clickbench_q25/duckdb:parquet 40360544 / 40074848 / +0.7% 87830237 / 87755790 / +0.1% 0.46 / 0.46 / +0.6%
clickbench_q26/duckdb:parquet 30166885 / 30932933 / -2.5% 46246460 / 44387662 / +4.2% 0.65 / 0.70 / -6.4%
clickbench_q27/duckdb:parquet 147661824 / 142390626 / +3.7% 260964757 / 255041620 / +2.3% 0.57 / 0.56 / +1.3%
clickbench_q28/duckdb:parquet 900461726 / 907486782 / -0.8% 997958425 / 1024139972 / -2.6% 0.90 / 0.89 / +1.8%
clickbench_q29/duckdb:parquet 17176838 / 17063719 / +0.7% 33833877 / 28841886 / +17.3% 🔴 0.51 / 0.59 / -14.2%
clickbench_q30/duckdb:parquet 91309721 / 91277937 / +0.0% 178497896 / 168647384 / +5.8% 0.51 / 0.54 / -5.5%
clickbench_q31/duckdb:parquet 143933644 / 143994254 / -0.0% 290978074 / 289845469 / +0.4% 0.49 / 0.50 / -0.4%
clickbench_q32/duckdb:parquet 439843406 / 440518651 / -0.2% 492583457 / 485215467 / +1.5% 0.89 / 0.91 / -1.6%
clickbench_q33/duckdb:parquet 445149172 / 450879019 / -1.3% 480777764 / 470451429 / +2.2% 0.93 / 0.96 / -3.4%
clickbench_q34/duckdb:parquet 461923382 / 446685279 / +3.4% 503858171 / 498549632 / +1.1% 0.92 / 0.90 / +2.3%
clickbench_q35/duckdb:parquet 103958556 / 105426400 / -1.4% 129013266 / 127785344 / +1.0% 0.81 / 0.83 / -2.3%
clickbench_q36/duckdb:parquet 30884462 / 31251456 / -1.2% 41940271 / 41767934 / +0.4% 0.74 / 0.75 / -1.6%
clickbench_q37/duckdb:parquet 23066944 / 22761188 / +1.3% 32550360 / 31642067 / +2.9% 0.71 / 0.72 / -1.5%
clickbench_q38/duckdb:parquet 24278397 / 24641746 / -1.5% 33773528 / 35930791 / -6.0% 0.72 / 0.69 / +4.8%
clickbench_q39/duckdb:parquet 56625086 / 57166078 / -0.9% 67785128 / 66337216 / +2.2% 0.84 / 0.86 / -3.1%
clickbench_q40/duckdb:parquet 12795022 / 12668964 / +1.0% 23001006 / 22638598 / +1.6% 0.56 / 0.56 / -0.6%
clickbench_q41/duckdb:parquet 13378004 / 12439968 / +7.5% 23943389 / 22336625 / +7.2% 0.56 / 0.56 / +0.3%
clickbench_q42/duckdb:parquet 14567152 / 14443638 / +0.9% 25642724 / 24542509 / +4.5% 0.57 / 0.59 / -3.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 303cdaef vs base a65c6537
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (+0.6%, low confidence) · DuckDB No clear signal (-2.6%, low confidence)
Vortex (geomean): hot 0.982x ➖ · cold 1.010x ➖
Parquet (geomean): hot 0.992x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -0.8% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 92180874 / 97702289 / -5.7% 167138292 / 169208339 / -1.2% 0.55 / 0.58 / -4.5%
tpch_q02/datafusion:vortex-file-compressed 64559699 / 65087727 / -0.8% 95262097 / 95746788 / -0.5% 0.68 / 0.68 / -0.3%
tpch_q03/datafusion:vortex-file-compressed 65502331 / 65212355 / +0.4% 122910715 / 118734306 / +3.5% 0.53 / 0.55 / -3.0%
tpch_q04/datafusion:vortex-file-compressed 35058991 / 35583170 / -1.5% 79361413 / 82084192 / -3.3% 0.44 / 0.43 / +1.9%
tpch_q05/datafusion:vortex-file-compressed 118866489 / 117124300 / +1.5% 190765169 / 178738147 / +6.7% 0.62 / 0.66 / -4.9%
tpch_q06/datafusion:vortex-file-compressed 14671568 / 15790361 / -7.1% 69102120 / 69484514 / -0.6% 0.21 / 0.23 / -6.6%
tpch_q07/datafusion:vortex-file-compressed 142648987 / 139164767 / +2.5% 201301502 / 196149323 / +2.6% 0.71 / 0.71 / -0.1%
tpch_q08/datafusion:vortex-file-compressed 142691368 / 144868557 / -1.5% 210818353 / 200625360 / +5.1% 0.68 / 0.72 / -6.3%
tpch_q09/datafusion:vortex-file-compressed 194012840 / 183589236 / +5.7% 260424522 / 254958755 / +2.1% 0.74 / 0.72 / +3.5%
tpch_q10/datafusion:vortex-file-compressed 74390520 / 74214031 / +0.2% 137450182 / 148408040 / -7.4% 0.54 / 0.50 / +8.2%
tpch_q11/datafusion:vortex-file-compressed 43047559 / 43200542 / -0.4% 68153555 / 70456954 / -3.3% 0.63 / 0.61 / +3.0%
tpch_q12/datafusion:vortex-file-compressed 45138835 / 45514909 / -0.8% 93347917 / 97986735 / -4.7% 0.48 / 0.46 / +4.1%
tpch_q13/datafusion:vortex-file-compressed 46760348 / 47668165 / -1.9% 76968386 / 78262244 / -1.7% 0.61 / 0.61 / -0.3%
tpch_q14/datafusion:vortex-file-compressed 25229728 / 25086394 / +0.6% 98589132 / 95837113 / +2.9% 0.26 / 0.26 / -2.2%
tpch_q15/datafusion:vortex-file-compressed 37301753 / 37823500 / -1.4% 98508737 / 101444634 / -2.9% 0.38 / 0.37 / +1.6%
tpch_q16/datafusion:vortex-file-compressed 37675060 / 37598782 / +0.2% 66846812 / 66272899 / +0.9% 0.56 / 0.57 / -0.7%
tpch_q17/datafusion:vortex-file-compressed 180136627 / 177462041 / +1.5% 222037164 / 231818726 / -4.2% 0.81 / 0.77 / +6.0%
tpch_q18/datafusion:vortex-file-compressed 207117797 / 206540077 / +0.3% 261509512 / 268220462 / -2.5% 0.79 / 0.77 / +2.9%
tpch_q19/datafusion:vortex-file-compressed 35197315 / 35187644 / +0.0% 93970058 / 98133659 / -4.2% 0.37 / 0.36 / +4.5%
tpch_q20/datafusion:vortex-file-compressed 62603259 / 63462325 / -1.4% 126556433 / 125685046 / +0.7% 0.49 / 0.50 / -2.0%
tpch_q21/datafusion:vortex-file-compressed 181225756 / 181802421 / -0.3% 236241351 / 243187874 / -2.9% 0.77 / 0.75 / +2.6%
tpch_q22/datafusion:vortex-file-compressed 25773372 / 25863192 / -0.3% 53878413 / 56197168 / -4.1% 0.48 / 0.46 / +3.9%
datafusion / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83639551 / 83357413 / +0.3% 133385175 / 135456533 / -1.5% 0.63 / 0.62 / +1.9%
tpch_q02/datafusion:parquet 135573945 / 135752661 / -0.1% 168453852 / 169856464 / -0.8% 0.80 / 0.80 / +0.7%
tpch_q03/datafusion:parquet 124244248 / 126177302 / -1.5% 200304247 / 194830287 / +2.8% 0.62 / 0.65 / -4.2%
tpch_q04/datafusion:parquet 53480124 / 54168292 / -1.3% 106087689 / 112383052 / -5.6% 0.50 / 0.48 / +4.6%
tpch_q05/datafusion:parquet 164390786 / 165205949 / -0.5% 245563679 / 245860713 / -0.1% 0.67 / 0.67 / -0.4%
tpch_q06/datafusion:parquet 31807261 / 32507765 / -2.2% 84180390 / 88149134 / -4.5% 0.38 / 0.37 / +2.5%
tpch_q07/datafusion:parquet 215011552 / 216765148 / -0.8% 295489343 / 280741652 / +5.3% 0.73 / 0.77 / -5.8%
tpch_q08/datafusion:parquet 209832435 / 210257672 / -0.2% 294222327 / 291002158 / +1.1% 0.71 / 0.72 / -1.3%
tpch_q09/datafusion:parquet 283643253 / 280872446 / +1.0% 367613784 / 361555183 / +1.7% 0.77 / 0.78 / -0.7%
tpch_q10/datafusion:parquet 306872819 / 305984554 / +0.3% 376972482 / 369109483 / +2.1% 0.81 / 0.83 / -1.8%
tpch_q11/datafusion:parquet 96564697 / 97615567 / -1.1% 120692114 / 121290628 / -0.5% 0.80 / 0.80 / -0.6%
tpch_q12/datafusion:parquet 78526946 / 79827107 / -1.6% 135992425 / 130171906 / +4.5% 0.58 / 0.61 / -5.8%
tpch_q13/datafusion:parquet 194349472 / 195548910 / -0.6% 232997614 / 230845582 / +0.9% 0.83 / 0.85 / -1.5%
tpch_q14/datafusion:parquet 76124160 / 75808752 / +0.4% 175930540 / 196024822 / -10.3% 🟢 0.43 / 0.39 / +11.9%
tpch_q15/datafusion:parquet 77770186 / 79515866 / -2.2% 141690352 / 141207851 / +0.3% 0.55 / 0.56 / -2.5%
tpch_q16/datafusion:parquet 83986387 / 86079562 / -2.4% 110061587 / 110105439 / -0.0% 0.76 / 0.78 / -2.4%
tpch_q17/datafusion:parquet 205132593 / 208704860 / -1.7% 266371422 / 266679505 / -0.1% 0.77 / 0.78 / -1.6%
tpch_q18/datafusion:parquet 261887572 / 269929519 / -3.0% 324459542 / 325844039 / -0.4% 0.81 / 0.83 / -2.6%
tpch_q19/datafusion:parquet 97495672 / 98573606 / -1.1% 171641332 / 173155743 / -0.9% 0.57 / 0.57 / -0.2%
tpch_q20/datafusion:parquet 152102047 / 154312913 / -1.4% 213148918 / 221655164 / -3.8% 0.71 / 0.70 / +2.5%
tpch_q21/datafusion:parquet 228780906 / 234447166 / -2.4% 305134499 / 315377700 / -3.2% 0.75 / 0.74 / +0.9%
tpch_q22/datafusion:parquet 160933894 / 162366486 / -0.9% 184935171 / 187950654 / -1.6% 0.87 / 0.86 / +0.7%
duckdb / vortex-file-compressed / ns (0.969x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 50980692 / 53874807 / -5.4% 90028132 / 95691008 / -5.9% 0.57 / 0.56 / +0.6%
tpch_q02/duckdb:vortex-file-compressed 32567635 / 32380196 / +0.6% 50791570 / 45610549 / +11.4% 🔴 0.64 / 0.71 / -9.7%
tpch_q03/duckdb:vortex-file-compressed 56639964 / 57777056 / -2.0% 111135127 / 110149045 / +0.9% 0.51 / 0.52 / -2.8%
tpch_q04/duckdb:vortex-file-compressed 79755641 / 80469603 / -0.9% 126881674 / 116005281 / +9.4% 0.63 / 0.69 / -9.4%
tpch_q05/duckdb:vortex-file-compressed 67702226 / 65967743 / +2.6% 129143585 / 114150813 / +13.1% 🔴 0.52 / 0.58 / -9.3%
tpch_q06/duckdb:vortex-file-compressed 21865018 / 21499472 / +1.7% 71455090 / 58602150 / +21.9% 🔴 0.31 / 0.37 / -16.6%
tpch_q07/duckdb:vortex-file-compressed 58370787 / 58724703 / -0.6% 130023810 / 113157062 / +14.9% 🔴 0.45 / 0.52 / -13.5%
tpch_q08/duckdb:vortex-file-compressed 87056820 / 88348069 / -1.5% 161712056 / 150249776 / +7.6% 0.54 / 0.59 / -8.4%
tpch_q09/duckdb:vortex-file-compressed 165956645 / 167087078 / -0.7% 240932582 / 227484651 / +5.9% 0.69 / 0.73 / -6.2%
tpch_q10/duckdb:vortex-file-compressed 112475627 / 113797254 / -1.2% 174981046 / 199859131 / -12.4% 🟢 0.64 / 0.57 / +12.9%
tpch_q11/duckdb:vortex-file-compressed 16891724 / 20186140 / -16.3% 🟢 31325600 / 32879396 / -4.7% 0.54 / 0.61 / -12.2%
tpch_q12/duckdb:vortex-file-compressed 54888756 / 57810204 / -5.1% 113054774 / 98472082 / +14.8% 🔴 0.49 / 0.59 / -17.3%
tpch_q13/duckdb:vortex-file-compressed 91425607 / 90814933 / +0.7% 143140698 / 136373692 / +5.0% 0.64 / 0.67 / -4.1%
tpch_q14/duckdb:vortex-file-compressed 32918671 / 31448577 / +4.7% 78535161 / 74998838 / +4.7% 0.42 / 0.42 / -0.0%
tpch_q15/duckdb:vortex-file-compressed 41114970 / 39451099 / +4.2% 103979622 / 87400339 / +19.0% 🔴 0.40 / 0.45 / -12.4%
tpch_q16/duckdb:vortex-file-compressed 42447969 / 42394651 / +0.1% 53405922 / 55175058 / -3.2% 0.79 / 0.77 / +3.4%
tpch_q17/duckdb:vortex-file-compressed 63929388 / 76482224 / -16.4% 🟢 127358100 / 159151483 / -20.0% 🟢 0.50 / 0.48 / +4.5%
tpch_q18/duckdb:vortex-file-compressed 130231137 / 135182491 / -3.7% 161652576 / 165216507 / -2.2% 0.81 / 0.82 / -1.5%
tpch_q19/duckdb:vortex-file-compressed 39816479 / 48005097 / -17.1% 🟢 93806370 / 106677564 / -12.1% 🟢 0.42 / 0.45 / -5.7%
tpch_q20/duckdb:vortex-file-compressed 58596093 / 60384074 / -3.0% 124815328 / 115703780 / +7.9% 0.47 / 0.52 / -10.0%
tpch_q21/duckdb:vortex-file-compressed 236315928 / 244934361 / -3.5% 284019213 / 283950363 / +0.0% 0.83 / 0.86 / -3.5%
tpch_q22/duckdb:vortex-file-compressed 40463008 / 41065997 / -1.5% 56255735 / 56683644 / -0.8% 0.72 / 0.72 / -0.7%
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70370352 / 69942011 / +0.6% 88767706 / 87384645 / +1.6% 0.79 / 0.80 / -1.0%
tpch_q02/duckdb:parquet 70574127 / 71165721 / -0.8% 83127712 / 82356591 / +0.9% 0.85 / 0.86 / -1.8%
tpch_q03/duckdb:parquet 114233390 / 116565922 / -2.0% 171015316 / 154750066 / +10.5% 🔴 0.67 / 0.75 / -11.3%
tpch_q04/duckdb:parquet 74766814 / 74506296 / +0.3% 96668750 / 111792067 / -13.5% 🟢 0.77 / 0.67 / +16.0%
tpch_q05/duckdb:parquet 124880022 / 125609495 / -0.6% 173195765 / 179837123 / -3.7% 0.72 / 0.70 / +3.2%
tpch_q06/duckdb:parquet 33836379 / 34673035 / -2.4% 47803367 / 49603772 / -3.6% 0.71 / 0.70 / +1.3%
tpch_q07/duckdb:parquet 89697195 / 89130403 / +0.6% 133432553 / 153874627 / -13.3% 🟢 0.67 / 0.58 / +16.1%
tpch_q08/duckdb:parquet 143583123 / 142986115 / +0.4% 187910806 / 186975435 / +0.5% 0.76 / 0.76 / -0.1%
tpch_q09/duckdb:parquet 221994062 / 223730113 / -0.8% 264614640 / 263051019 / +0.6% 0.84 / 0.85 / -1.4%
tpch_q10/duckdb:parquet 471906397 / 471836983 / +0.0% 519818888 / 521327821 / -0.3% 0.91 / 0.91 / +0.3%
tpch_q11/duckdb:parquet 30633168 / 30571664 / +0.2% 39072583 / 37750436 / +3.5% 0.78 / 0.81 / -3.2%
tpch_q12/duckdb:parquet 74715656 / 74668469 / +0.1% 95034355 / 93022468 / +2.2% 0.79 / 0.80 / -2.1%
tpch_q13/duckdb:parquet 317434769 / 318310180 / -0.3% 337484917 / 329868773 / +2.3% 0.94 / 0.96 / -2.5%
tpch_q14/duckdb:parquet 103025213 / 103649894 / -0.6% 134026789 / 133443184 / +0.4% 0.77 / 0.78 / -1.0%
tpch_q15/duckdb:parquet 44595999 / 43037907 / +3.6% 77474504 / 77677149 / -0.3% 0.58 / 0.55 / +3.9%
tpch_q16/duckdb:parquet 113821700 / 114590765 / -0.7% 127144611 / 124544666 / +2.1% 0.90 / 0.92 / -2.7%
tpch_q17/duckdb:parquet 75967177 / 77015493 / -1.4% 102863783 / 103887848 / -1.0% 0.74 / 0.74 / -0.4%
tpch_q18/duckdb:parquet 202221765 / 207583709 / -2.6% 169022949 / 166911713 / +1.3% 1.20 / 1.24 / -3.8%
tpch_q19/duckdb:parquet 161871220 / 174812775 / -7.4% 190031046 / 195353661 / -2.7% 0.85 / 0.89 / -4.8%
tpch_q20/duckdb:parquet 128216366 / 129390359 / -0.9% 165837015 / 169206647 / -2.0% 0.77 / 0.76 / +1.1%
tpch_q21/duckdb:parquet 267564024 / 261346254 / +2.4% 290695420 / 289444049 / +0.4% 0.92 / 0.90 / +1.9%
tpch_q22/duckdb:parquet 262740321 / 261905889 / +0.3% 272512025 / 271440052 / +0.4% 0.96 / 0.96 / -0.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 303cdaef vs base 008e3b75
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.002x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24256279 / 23944632 / +1.3% 43594506 / 44252415 / -1.5% 0.56 / 0.54 / +2.8%
tpcds_q02/datafusion:vortex-file-compressed 45438798 / 45626076 / -0.4% 63069738 / 63360023 / -0.5% 0.72 / 0.72 / +0.0%
tpcds_q03/datafusion:vortex-file-compressed 11904578 / 11565544 / +2.9% 31555345 / 28716767 / +9.9% 0.38 / 0.40 / -6.3%
tpcds_q04/datafusion:vortex-file-compressed 113816904 / 113488243 / +0.3% 144324669 / 139190873 / +3.7% 0.79 / 0.82 / -3.3%
tpcds_q05/datafusion:vortex-file-compressed 61180288 / 59873861 / +2.2% 82643199 / 82721809 / -0.1% 0.74 / 0.72 / +2.3%
tpcds_q06/datafusion:vortex-file-compressed 23890440 / 23969100 / -0.3% 47929127 / 46692293 / +2.6% 0.50 / 0.51 / -2.9%
tpcds_q07/datafusion:vortex-file-compressed 33469554 / 32185364 / +4.0% 59601195 / 56363804 / +5.7% 0.56 / 0.57 / -1.7%
tpcds_q08/datafusion:vortex-file-compressed 25716006 / 25480644 / +0.9% 45742511 / 46651251 / -1.9% 0.56 / 0.55 / +2.9%
tpcds_q09/datafusion:vortex-file-compressed 17100678 / 17486297 / -2.2% 35790754 / 35461343 / +0.9% 0.48 / 0.49 / -3.1%
tpcds_q10/datafusion:vortex-file-compressed 28987029 / 28917850 / +0.2% 51269169 / 52242832 / -1.9% 0.57 / 0.55 / +2.1%
tpcds_q11/datafusion:vortex-file-compressed 62858561 / 62893276 / -0.1% 89183168 / 88892061 / +0.3% 0.70 / 0.71 / -0.4%
tpcds_q12/datafusion:vortex-file-compressed 16604604 / 16407603 / +1.2% 32418644 / 32723333 / -0.9% 0.51 / 0.50 / +2.2%
tpcds_q13/datafusion:vortex-file-compressed 34253370 / 34256082 / -0.0% 54798189 / 56293963 / -2.7% 0.63 / 0.61 / +2.7%
tpcds_q14/datafusion:vortex-file-compressed 91634635 / 92233977 / -0.6% 121203286 / 121334683 / -0.1% 0.76 / 0.76 / -0.5%
tpcds_q15/datafusion:vortex-file-compressed 23923230 / 23934493 / -0.0% 45235198 / 45283920 / -0.1% 0.53 / 0.53 / +0.1%
tpcds_q16/datafusion:vortex-file-compressed 20798754 / 20711589 / +0.4% 43903220 / 41533396 / +5.7% 0.47 / 0.50 / -5.0%
tpcds_q17/datafusion:vortex-file-compressed 58076517 / 58800054 / -1.2% 84057860 / 77273772 / +8.8% 0.69 / 0.76 / -9.2%
tpcds_q18/datafusion:vortex-file-compressed 68057011 / 68519670 / -0.7% 95688483 / 96367612 / -0.7% 0.71 / 0.71 / +0.0%
tpcds_q19/datafusion:vortex-file-compressed 18516148 / 18247522 / +1.5% 41790060 / 40767748 / +2.5% 0.44 / 0.45 / -1.0%
tpcds_q20/datafusion:vortex-file-compressed 17699312 / 17920652 / -1.2% 36835662 / 34524131 / +6.7% 0.48 / 0.52 / -7.4%
tpcds_q21/datafusion:vortex-file-compressed 16860037 / 17376068 / -3.0% 40923665 / 42281249 / -3.2% 0.41 / 0.41 / +0.2%
tpcds_q22/datafusion:vortex-file-compressed 49375355 / 50138894 / -1.5% 71513409 / 72856866 / -1.8% 0.69 / 0.69 / +0.3%
tpcds_q23/datafusion:vortex-file-compressed 72085275 / 72414822 / -0.5% 101312996 / 103042124 / -1.7% 0.71 / 0.70 / +1.2%
tpcds_q24/datafusion:vortex-file-compressed 71180789 / 70402866 / +1.1% 96277876 / 94866680 / +1.5% 0.74 / 0.74 / -0.4%
tpcds_q25/datafusion:vortex-file-compressed 55549708 / 52387048 / +6.0% 76089516 / 83680683 / -9.1% 0.73 / 0.63 / +16.6%
tpcds_q26/datafusion:vortex-file-compressed 29880498 / 30270383 / -1.3% 52050547 / 52908832 / -1.6% 0.57 / 0.57 / +0.3%
tpcds_q27/datafusion:vortex-file-compressed 62430881 / 65032116 / -4.0% 89702059 / 91856804 / -2.3% 0.70 / 0.71 / -1.7%
tpcds_q28/datafusion:vortex-file-compressed 18587268 / 18346325 / +1.3% 38575256 / 35207379 / +9.6% 0.48 / 0.52 / -7.5%
tpcds_q29/datafusion:vortex-file-compressed 62690622 / 62861850 / -0.3% 84060603 / 85531534 / -1.7% 0.75 / 0.73 / +1.5%
tpcds_q30/datafusion:vortex-file-compressed 27478034 / 27576848 / -0.4% 45048844 / 45640060 / -1.3% 0.61 / 0.60 / +0.9%
tpcds_q31/datafusion:vortex-file-compressed 65085602 / 64814594 / +0.4% 93973749 / 92705531 / +1.4% 0.69 / 0.70 / -0.9%
tpcds_q32/datafusion:vortex-file-compressed 13674980 / 13999488 / -2.3% 32257727 / 32152752 / +0.3% 0.42 / 0.44 / -2.6%
tpcds_q33/datafusion:vortex-file-compressed 26932106 / 26766554 / +0.6% 48966420 / 49177034 / -0.4% 0.55 / 0.54 / +1.1%
tpcds_q34/datafusion:vortex-file-compressed 19022636 / 18238702 / +4.3% 39119223 / 39430315 / -0.8% 0.49 / 0.46 / +5.1%
tpcds_q35/datafusion:vortex-file-compressed 36577774 / 35424722 / +3.3% 59088387 / 59183523 / -0.2% 0.62 / 0.60 / +3.4%
tpcds_q36/datafusion:vortex-file-compressed 48443407 / 48132178 / +0.6% 71219553 / 73734801 / -3.4% 0.68 / 0.65 / +4.2%
tpcds_q37/datafusion:vortex-file-compressed 14395256 / 13758870 / +4.6% 38002033 / 36018988 / +5.5% 0.38 / 0.38 / -0.8%
tpcds_q38/datafusion:vortex-file-compressed 29655756 / 29925345 / -0.9% 52833044 / 53210686 / -0.7% 0.56 / 0.56 / -0.2%
tpcds_q39/datafusion:vortex-file-compressed 65420196 / 65940362 / -0.8% 93633164 / 92671857 / +1.0% 0.70 / 0.71 / -1.8%
tpcds_q40/datafusion:vortex-file-compressed 25609934 / 25009368 / +2.4% 45688938 / 46929423 / -2.6% 0.56 / 0.53 / +5.2%
tpcds_q41/datafusion:vortex-file-compressed 16825636 / 16586309 / +1.4% 31492933 / 31644447 / -0.5% 0.53 / 0.52 / +1.9%
tpcds_q42/datafusion:vortex-file-compressed 11306257 / 11529220 / -1.9% 28405039 / 28614074 / -0.7% 0.40 / 0.40 / -1.2%
tpcds_q43/datafusion:vortex-file-compressed 13592704 / 13911632 / -2.3% 33031439 / 33571025 / -1.6% 0.41 / 0.41 / -0.7%
tpcds_q44/datafusion:vortex-file-compressed 25810362 / 26251406 / -1.7% 52463185 / 52371513 / +0.2% 0.49 / 0.50 / -1.9%
tpcds_q45/datafusion:vortex-file-compressed 27296966 / 27263066 / +0.1% 49598164 / 49052242 / +1.1% 0.55 / 0.56 / -1.0%
tpcds_q46/datafusion:vortex-file-compressed 24550869 / 24437004 / +0.5% 47375525 / 48791195 / -2.9% 0.52 / 0.50 / +3.5%
tpcds_q47/datafusion:vortex-file-compressed 78012166 / 78135034 / -0.2% 107217974 / 106113519 / +1.0% 0.73 / 0.74 / -1.2%
tpcds_q48/datafusion:vortex-file-compressed 31499014 / 31258688 / +0.8% 53774930 / 53333144 / +0.8% 0.59 / 0.59 / -0.1%
tpcds_q49/datafusion:vortex-file-compressed 59409669 / 59930230 / -0.9% 83592152 / 85451765 / -2.2% 0.71 / 0.70 / +1.3%
tpcds_q50/datafusion:vortex-file-compressed 34859242 / 34526961 / +1.0% 57262139 / 57449848 / -0.3% 0.61 / 0.60 / +1.3%
tpcds_q51/datafusion:vortex-file-compressed 60811502 / 61035381 / -0.4% 82099708 / 84618244 / -3.0% 0.74 / 0.72 / +2.7%
tpcds_q52/datafusion:vortex-file-compressed 11693109 / 11748707 / -0.5% 29688557 / 27930818 / +6.3% 0.39 / 0.42 / -6.4%
tpcds_q53/datafusion:vortex-file-compressed 18637522 / 18216327 / +2.3% 38798429 / 37997189 / +2.1% 0.48 / 0.48 / +0.2%
tpcds_q54/datafusion:vortex-file-compressed 33818468 / 33920417 / -0.3% 58174675 / 62750045 / -7.3% 0.58 / 0.54 / +7.5%
tpcds_q55/datafusion:vortex-file-compressed 11482850 / 11245705 / +2.1% 28124553 / 28188740 / -0.2% 0.41 / 0.40 / +2.3%
tpcds_q56/datafusion:vortex-file-compressed 26507632 / 26464688 / +0.2% 50238269 / 48840075 / +2.9% 0.53 / 0.54 / -2.6%
tpcds_q57/datafusion:vortex-file-compressed 73169896 / 74167211 / -1.3% 97758362 / 98465998 / -0.7% 0.75 / 0.75 / -0.6%
tpcds_q58/datafusion:vortex-file-compressed 40853354 / 41249084 / -1.0% 69056608 / 67319746 / +2.6% 0.59 / 0.61 / -3.5%
tpcds_q59/datafusion:vortex-file-compressed 32586702 / 31924354 / +2.1% 55099673 / 54144615 / +1.8% 0.59 / 0.59 / +0.3%
tpcds_q60/datafusion:vortex-file-compressed 26802574 / 27159804 / -1.3% 48457677 / 50901478 / -4.8% 0.55 / 0.53 / +3.7%
tpcds_q61/datafusion:vortex-file-compressed 24219326 / 24347702 / -0.5% 45072873 / 50017222 / -9.9% 0.54 / 0.49 / +10.4%
tpcds_q62/datafusion:vortex-file-compressed 17278078 / 17024742 / +1.5% 36678896 / 36321766 / +1.0% 0.47 / 0.47 / +0.5%
tpcds_q63/datafusion:vortex-file-compressed 18728180 / 18413362 / +1.7% 38502846 / 38499775 / +0.0% 0.49 / 0.48 / +1.7%
tpcds_q64/datafusion:vortex-file-compressed 321436674 / 321037089 / +0.1% 360928416 / 354688730 / +1.8% 0.89 / 0.91 / -1.6%
tpcds_q65/datafusion:vortex-file-compressed 75542741 / 75097098 / +0.6% 96995646 / 96770974 / +0.2% 0.78 / 0.78 / +0.4%
tpcds_q66/datafusion:vortex-file-compressed 52500062 / 52967277 / -0.9% 75800441 / 75171023 / +0.8% 0.69 / 0.70 / -1.7%
tpcds_q67/datafusion:vortex-file-compressed 55459608 / 55324120 / +0.2% 84696149 / 85587996 / -1.0% 0.65 / 0.65 / +1.3%
tpcds_q68/datafusion:vortex-file-compressed 23947243 / 23685562 / +1.1% 51592509 / 51381132 / +0.4% 0.46 / 0.46 / +0.7%
tpcds_q69/datafusion:vortex-file-compressed 28426019 / 28707298 / -1.0% 49841265 / 50470403 / -1.2% 0.57 / 0.57 / +0.3%
tpcds_q70/datafusion:vortex-file-compressed 72429494 / 72025520 / +0.6% 97067524 / 93776194 / +3.5% 0.75 / 0.77 / -2.8%
tpcds_q71/datafusion:vortex-file-compressed 19636615 / 18159404 / +8.1% 39680180 / 41887972 / -5.3% 0.49 / 0.43 / +14.2%
tpcds_q72/datafusion:vortex-file-compressed 472926205 / 465659867 / +1.6% 495112969 / 497308625 / -0.4% 0.96 / 0.94 / +2.0%
tpcds_q73/datafusion:vortex-file-compressed 17001504 / 17718763 / -4.0% 38888422 / 38990035 / -0.3% 0.44 / 0.45 / -3.8%
tpcds_q74/datafusion:vortex-file-compressed 45703228 / 45280226 / +0.9% 70743651 / 70242389 / +0.7% 0.65 / 0.64 / +0.2%
tpcds_q75/datafusion:vortex-file-compressed 131852414 / 130251274 / +1.2% 156257874 / 156682580 / -0.3% 0.84 / 0.83 / +1.5%
tpcds_q76/datafusion:vortex-file-compressed 42197563 / 40455272 / +4.3% 64301409 / 66442063 / -3.2% 0.66 / 0.61 / +7.8%
tpcds_q77/datafusion:vortex-file-compressed 36118437 / 34309500 / +5.3% 57779808 / 59051342 / -2.2% 0.63 / 0.58 / +7.6%
tpcds_q78/datafusion:vortex-file-compressed 80142724 / 80612112 / -0.6% 111051842 / 111623482 / -0.5% 0.72 / 0.72 / -0.1%
tpcds_q79/datafusion:vortex-file-compressed 21256367 / 20881810 / +1.8% 44141993 / 42525460 / +3.8% 0.48 / 0.49 / -1.9%
tpcds_q80/datafusion:vortex-file-compressed 78086621 / 76256435 / +2.4% 110732893 / 109234447 / +1.4% 0.71 / 0.70 / +1.0%
tpcds_q81/datafusion:vortex-file-compressed 28224124 / 28012670 / +0.8% 44735671 / 46862834 / -4.5% 0.63 / 0.60 / +5.5%
tpcds_q82/datafusion:vortex-file-compressed 13608992 / 13566985 / +0.3% 38379187 / 37121293 / +3.4% 0.35 / 0.37 / -3.0%
tpcds_q83/datafusion:vortex-file-compressed 36623074 / 36414138 / +0.6% 58056496 / 58130773 / -0.1% 0.63 / 0.63 / +0.7%
tpcds_q84/datafusion:vortex-file-compressed 12296827 / 11746696 / +4.7% 29169892 / 28388012 / +2.8% 0.42 / 0.41 / +1.9%
tpcds_q85/datafusion:vortex-file-compressed 59727278 / 59769642 / -0.1% 85757456 / 85392918 / +0.4% 0.70 / 0.70 / -0.5%
tpcds_q86/datafusion:vortex-file-compressed 16393290 / 16553338 / -1.0% 33445005 / 33224289 / +0.7% 0.49 / 0.50 / -1.6%
tpcds_q87/datafusion:vortex-file-compressed 30391186 / 29745330 / +2.2% 52475242 / 52673204 / -0.4% 0.58 / 0.56 / +2.6%
tpcds_q88/datafusion:vortex-file-compressed 33933481 / 34068132 / -0.4% 67146944 / 61879292 / +8.5% 0.51 / 0.55 / -8.2%
tpcds_q89/datafusion:vortex-file-compressed 21052764 / 21398384 / -1.6% 42387549 / 41363662 / +2.5% 0.50 / 0.52 / -4.0%
tpcds_q90/datafusion:vortex-file-compressed 10442874 / 10323099 / +1.2% 27347441 / 26229320 / +4.3% 0.38 / 0.39 / -3.0%
tpcds_q91/datafusion:vortex-file-compressed 16827020 / 17440682 / -3.5% 36622815 / 35137744 / +4.2% 0.46 / 0.50 / -7.4%
tpcds_q92/datafusion:vortex-file-compressed 13653026 / 13947698 / -2.1% 32046551 / 32326740 / -0.9% 0.43 / 0.43 / -1.3%
tpcds_q93/datafusion:vortex-file-compressed 24220815 / 23858753 / +1.5% 45174286 / 47096560 / -4.1% 0.54 / 0.51 / +5.8%
tpcds_q94/datafusion:vortex-file-compressed 19920002 / 19793544 / +0.6% 39825627 / 40705687 / -2.2% 0.50 / 0.49 / +2.9%
tpcds_q95/datafusion:vortex-file-compressed 45884423 / 46380054 / -1.1% 69442826 / 66874889 / +3.8% 0.66 / 0.69 / -4.7%
tpcds_q96/datafusion:vortex-file-compressed 9640542 / 9572342 / +0.7% 24872727 / 26725248 / -6.9% 0.39 / 0.36 / +8.2%
tpcds_q97/datafusion:vortex-file-compressed 21376776 / 21283462 / +0.4% 44222065 / 44723599 / -1.1% 0.48 / 0.48 / +1.6%
tpcds_q98/datafusion:vortex-file-compressed 17038138 / 17190722 / -0.9% 36549776 / 37750050 / -3.2% 0.47 / 0.46 / +2.4%
tpcds_q99/datafusion:vortex-file-compressed 19461898 / 19293053 / +0.9% 38803032 / 38501544 / +0.8% 0.50 / 0.50 / +0.1%
datafusion / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 31114572 / 31005024 / +0.4% 46510820 / 46454086 / +0.1% 0.67 / 0.67 / +0.2%
tpcds_q02/datafusion:parquet 44431826 / 45909644 / -3.2% 62913421 / 60676820 / +3.7% 0.71 / 0.76 / -6.7%
tpcds_q03/datafusion:parquet 19079082 / 18619656 / +2.5% 33609141 / 32500711 / +3.4% 0.57 / 0.57 / -0.9%
tpcds_q04/datafusion:parquet 196218222 / 193763444 / +1.3% 233566705 / 229540795 / +1.8% 0.84 / 0.84 / -0.5%
tpcds_q05/datafusion:parquet 73057670 / 71867003 / +1.7% 97895115 / 98129012 / -0.2% 0.75 / 0.73 / +1.9%
tpcds_q06/datafusion:parquet 34458945 / 34799214 / -1.0% 54090509 / 53791743 / +0.6% 0.64 / 0.65 / -1.5%
tpcds_q07/datafusion:parquet 45982618 / 46554747 / -1.2% 69294449 / 67846949 / +2.1% 0.66 / 0.69 / -3.3%
tpcds_q08/datafusion:parquet 39784760 / 39130737 / +1.7% 59653093 / 54280775 / +9.9% 0.67 / 0.72 / -7.5%
tpcds_q09/datafusion:parquet 30189597 / 29289976 / +3.1% 46125772 / 44293632 / +4.1% 0.65 / 0.66 / -1.0%
tpcds_q10/datafusion:parquet 50622994 / 49938382 / +1.4% 64498817 / 64471152 / +0.0% 0.78 / 0.77 / +1.3%
tpcds_q11/datafusion:parquet 94232196 / 92763504 / +1.6% 120422786 / 120440986 / -0.0% 0.78 / 0.77 / +1.6%
tpcds_q12/datafusion:parquet 24564586 / 24073314 / +2.0% 37281481 / 37453459 / -0.5% 0.66 / 0.64 / +2.5%
tpcds_q13/datafusion:parquet 45611998 / 45574878 / +0.1% 69440578 / 66183790 / +4.9% 0.66 / 0.69 / -4.6%
tpcds_q14/datafusion:parquet 139141716 / 136380319 / +2.0% 156919702 / 155073710 / +1.2% 0.89 / 0.88 / +0.8%
tpcds_q15/datafusion:parquet 31144822 / 31287927 / -0.5% 48945056 / 49952535 / -2.0% 0.64 / 0.63 / +1.6%
tpcds_q16/datafusion:parquet 37408407 / 36047113 / +3.8% 57205007 / 55347527 / +3.4% 0.65 / 0.65 / +0.4%
tpcds_q17/datafusion:parquet 74306236 / 73519334 / +1.1% 102034958 / 103492366 / -1.4% 0.73 / 0.71 / +2.5%
tpcds_q18/datafusion:parquet 60166128 / 59439410 / +1.2% 83729976 / 80409366 / +4.1% 0.72 / 0.74 / -2.8%
tpcds_q19/datafusion:parquet 32164890 / 32002288 / +0.5% 50809565 / 49286049 / +3.1% 0.63 / 0.65 / -2.5%
tpcds_q20/datafusion:parquet 25763140 / 25479374 / +1.1% 39358018 / 38489094 / +2.3% 0.65 / 0.66 / -1.1%
tpcds_q21/datafusion:parquet 20362150 / 20214415 / +0.7% 34694476 / 33160959 / +4.6% 0.59 / 0.61 / -3.7%
tpcds_q22/datafusion:parquet 77755286 / 77500992 / +0.3% 94319498 / 92801235 / +1.6% 0.82 / 0.84 / -1.3%
tpcds_q23/datafusion:parquet 116724812 / 116106581 / +0.5% 144846227 / 141503947 / +2.4% 0.81 / 0.82 / -1.8%
tpcds_q24/datafusion:parquet 90446438 / 89013950 / +1.6% 119488363 / 118961161 / +0.4% 0.76 / 0.75 / +1.2%
tpcds_q25/datafusion:parquet 75277128 / 74539123 / +1.0% 104154089 / 106596233 / -2.3% 0.72 / 0.70 / +3.4%
tpcds_q26/datafusion:parquet 43535204 / 43348022 / +0.4% 62202422 / 64382014 / -3.4% 0.70 / 0.67 / +4.0%
tpcds_q27/datafusion:parquet 77476709 / 78329337 / -1.1% 102091033 / 102692731 / -0.6% 0.76 / 0.76 / -0.5%
tpcds_q28/datafusion:parquet 27017698 / 26757328 / +1.0% 44313372 / 41952954 / +5.6% 0.61 / 0.64 / -4.4%
tpcds_q29/datafusion:parquet 77129658 / 75756120 / +1.8% 103601550 / 103631056 / -0.0% 0.74 / 0.73 / +1.8%
tpcds_q30/datafusion:parquet 45987896 / 44101217 / +4.3% 69432149 / 67253111 / +3.2% 0.66 / 0.66 / +1.0%
tpcds_q31/datafusion:parquet 89146433 / 89295999 / -0.2% 111397267 / 108805876 / +2.4% 0.80 / 0.82 / -2.5%
tpcds_q32/datafusion:parquet 24746994 / 25666290 / -3.6% 43228491 / 42281440 / +2.2% 0.57 / 0.61 / -5.7%
tpcds_q33/datafusion:parquet 39433645 / 39762458 / -0.8% 60336169 / 58297693 / +3.5% 0.65 / 0.68 / -4.2%
tpcds_q34/datafusion:parquet 24075782 / 24069558 / +0.0% 40807859 / 39540637 / +3.2% 0.59 / 0.61 / -3.1%
tpcds_q35/datafusion:parquet 54542075 / 55853634 / -2.3% 76373431 / 73446652 / +4.0% 0.71 / 0.76 / -6.1%
tpcds_q36/datafusion:parquet 51551409 / 51129418 / +0.8% 81688582 / 76591878 / +6.7% 0.63 / 0.67 / -5.5%
tpcds_q37/datafusion:parquet 26122100 / 26007518 / +0.4% 42104227 / 41080837 / +2.5% 0.62 / 0.63 / -2.0%
tpcds_q38/datafusion:parquet 43433596 / 44884920 / -3.2% 69013553 / 66785023 / +3.3% 0.63 / 0.67 / -6.4%
tpcds_q39/datafusion:parquet 70884224 / 70952100 / -0.1% 91695474 / 89378838 / +2.6% 0.77 / 0.79 / -2.6%
tpcds_q40/datafusion:parquet 29774387 / 29590158 / +0.6% 51402563 / 50244295 / +2.3% 0.58 / 0.59 / -1.6%
tpcds_q41/datafusion:parquet 20040380 / 20019784 / +0.1% 34916553 / 34850592 / +0.2% 0.57 / 0.57 / -0.1%
tpcds_q42/datafusion:parquet 17815560 / 18034923 / -1.2% 32794492 / 31134194 / +5.3% 0.54 / 0.58 / -6.2%
tpcds_q43/datafusion:parquet 19520892 / 19607252 / -0.4% 33790721 / 34137413 / -1.0% 0.58 / 0.57 / +0.6%
tpcds_q44/datafusion:parquet 34876342 / 33737514 / +3.4% 54019927 / 52192830 / +3.5% 0.65 / 0.65 / -0.1%
tpcds_q45/datafusion:parquet 38364106 / 38160508 / +0.5% 56730338 / 55006603 / +3.1% 0.68 / 0.69 / -2.5%
tpcds_q46/datafusion:parquet 29949608 / 29944062 / +0.0% 53113012 / 51613734 / +2.9% 0.56 / 0.58 / -2.8%
tpcds_q47/datafusion:parquet 98371290 / 98200062 / +0.2% 126679135 / 126410005 / +0.2% 0.78 / 0.78 / -0.0%
tpcds_q48/datafusion:parquet 40908458 / 41760328 / -2.0% 63924539 / 61288991 / +4.3% 0.64 / 0.68 / -6.1%
tpcds_q49/datafusion:parquet 75906307 / 73906077 / +2.7% 98084933 / 104591531 / -6.2% 0.77 / 0.71 / +9.5%
tpcds_q50/datafusion:parquet 47407112 / 47956312 / -1.1% 74783671 / 72081012 / +3.7% 0.63 / 0.67 / -4.7%
tpcds_q51/datafusion:parquet 71261124 / 71345630 / -0.1% 95030030 / 93540922 / +1.6% 0.75 / 0.76 / -1.7%
tpcds_q52/datafusion:parquet 18405964 / 18765806 / -1.9% 33941195 / 34233526 / -0.9% 0.54 / 0.55 / -1.1%
tpcds_q53/datafusion:parquet 22617840 / 22552532 / +0.3% 41697389 / 41858915 / -0.4% 0.54 / 0.54 / +0.7%
tpcds_q54/datafusion:parquet 55155631 / 54650718 / +0.9% 76316411 / 76592096 / -0.4% 0.72 / 0.71 / +1.3%
tpcds_q55/datafusion:parquet 18040124 / 18179276 / -0.8% 32684364 / 34174399 / -4.4% 0.55 / 0.53 / +3.8%
tpcds_q56/datafusion:parquet 46262554 / 47166456 / -1.9% 65270478 / 62812715 / +3.9% 0.71 / 0.75 / -5.6%
tpcds_q57/datafusion:parquet 101066889 / 100364208 / +0.7% 121659697 / 121264745 / +0.3% 0.83 / 0.83 / +0.4%
tpcds_q58/datafusion:parquet 65554105 / 64274738 / +2.0% 85575770 / 84278930 / +1.5% 0.77 / 0.76 / +0.4%
tpcds_q59/datafusion:parquet 46199290 / 47956144 / -3.7% 65060292 / 63961444 / +1.7% 0.71 / 0.75 / -5.3%
tpcds_q60/datafusion:parquet 45214843 / 44804952 / +0.9% 63788221 / 64213536 / -0.7% 0.71 / 0.70 / +1.6%
tpcds_q61/datafusion:parquet 39004778 / 36546796 / +6.7% 56349958 / 59218806 / -4.8% 0.69 / 0.62 / +12.2%
tpcds_q62/datafusion:parquet 25109302 / 25202335 / -0.4% 40163141 / 40026787 / +0.3% 0.63 / 0.63 / -0.7%
tpcds_q63/datafusion:parquet 22305966 / 22299165 / +0.0% 41307167 / 40487904 / +2.0% 0.54 / 0.55 / -2.0%
tpcds_q64/datafusion:parquet 209834448 / 208691002 / +0.5% 239599793 / 242277457 / -1.1% 0.88 / 0.86 / +1.7%
tpcds_q65/datafusion:parquet 39078602 / 37230172 / +5.0% 58098100 / 57832086 / +0.5% 0.67 / 0.64 / +4.5%
tpcds_q66/datafusion:parquet 62623539 / 62032864 / +1.0% 82553822 / 79492802 / +3.9% 0.76 / 0.78 / -2.8%
tpcds_q67/datafusion:parquet 70334628 / 69747791 / +0.8% 98850104 / 97272068 / +1.6% 0.71 / 0.72 / -0.8%
tpcds_q68/datafusion:parquet 30036826 / 29680026 / +1.2% 53162012 / 52287049 / +1.7% 0.57 / 0.57 / -0.5%
tpcds_q69/datafusion:parquet 51479730 / 51161896 / +0.6% 65336691 / 65579218 / -0.4% 0.79 / 0.78 / +1.0%
tpcds_q70/datafusion:parquet 37310108 / 37055058 / +0.7% 57991926 / 57839251 / +0.3% 0.64 / 0.64 / +0.4%
tpcds_q71/datafusion:parquet 28518104 / 28732981 / -0.7% 43750526 / 44337757 / -1.3% 0.65 / 0.65 / +0.6%
tpcds_q72/datafusion:parquet 552954465 / 551128308 / +0.3% 592174375 / 593379498 / -0.2% 0.93 / 0.93 / +0.5%
tpcds_q73/datafusion:parquet 23079044 / 23289042 / -0.9% 39707030 / 39624203 / +0.2% 0.58 / 0.59 / -1.1%
tpcds_q74/datafusion:parquet 68832984 / 69589604 / -1.1% 90169517 / 89194195 / +1.1% 0.76 / 0.78 / -2.2%
tpcds_q75/datafusion:parquet 144156942 / 147731910 / -2.4% 181802727 / 186237829 / -2.4% 0.79 / 0.79 / -0.0%
tpcds_q76/datafusion:parquet 54275254 / 54787944 / -0.9% 73378933 / 74041921 / -0.9% 0.74 / 0.74 / -0.0%
tpcds_q77/datafusion:parquet 56242268 / 55992443 / +0.4% 76621968 / 76856306 / -0.3% 0.73 / 0.73 / +0.8%
tpcds_q78/datafusion:parquet 91318411 / 93147375 / -2.0% 121447469 / 123665593 / -1.8% 0.75 / 0.75 / -0.2%
tpcds_q79/datafusion:parquet 26215898 / 25802948 / +1.6% 46406226 / 46696850 / -0.6% 0.56 / 0.55 / +2.2%
tpcds_q80/datafusion:parquet 81983438 / 82807218 / -1.0% 115634534 / 116586313 / -0.8% 0.71 / 0.71 / -0.2%
tpcds_q81/datafusion:parquet 42002643 / 41386223 / +1.5% 63925644 / 63749199 / +0.3% 0.66 / 0.65 / +1.2%
tpcds_q82/datafusion:parquet 26416282 / 26866182 / -1.7% 40994841 / 41276077 / -0.7% 0.64 / 0.65 / -1.0%
tpcds_q83/datafusion:parquet 56999968 / 57091744 / -0.2% 71367703 / 73345128 / -2.7% 0.80 / 0.78 / +2.6%
tpcds_q84/datafusion:parquet 30333597 / 30714283 / -1.2% 44858987 / 45749778 / -1.9% 0.68 / 0.67 / +0.7%
tpcds_q85/datafusion:parquet 84200697 / 83578886 / +0.7% 107207136 / 107695703 / -0.5% 0.79 / 0.78 / +1.2%
tpcds_q86/datafusion:parquet 20491795 / 20314138 / +0.9% 35393163 / 36086784 / -1.9% 0.58 / 0.56 / +2.9%
tpcds_q87/datafusion:parquet 45175474 / 46590276 / -3.0% 61553450 / 62012492 / -0.7% 0.73 / 0.75 / -2.3%
tpcds_q88/datafusion:parquet 48460458 / 47269750 / +2.5% 70155638 / 67399213 / +4.1% 0.69 / 0.70 / -1.5%
tpcds_q89/datafusion:parquet 25815160 / 25682230 / +0.5% 45135351 / 43915557 / +2.8% 0.57 / 0.58 / -2.2%
tpcds_q90/datafusion:parquet 20106993 / 19439516 / +3.4% 33352728 / 30597151 / +9.0% 0.60 / 0.64 / -5.1%
tpcds_q91/datafusion:parquet 37691764 / 36565612 / +3.1% 54570258 / 54869858 / -0.5% 0.69 / 0.67 / +3.6%
tpcds_q92/datafusion:parquet 26149546 / 25815938 / +1.3% 44042651 / 42154754 / +4.5% 0.59 / 0.61 / -3.0%
tpcds_q93/datafusion:parquet 26937349 / 26815832 / +0.5% 50177389 / 48690384 / +3.1% 0.54 / 0.55 / -2.5%
tpcds_q94/datafusion:parquet 34492875 / 34724510 / -0.7% 52267460 / 49783309 / +5.0% 0.66 / 0.70 / -5.4%
tpcds_q95/datafusion:parquet 63798963 / 64546842 / -1.2% 83179033 / 82243054 / +1.1% 0.77 / 0.78 / -2.3%
tpcds_q96/datafusion:parquet 16442366 / 16622684 / -1.1% 29963102 / 30840685 / -2.8% 0.55 / 0.54 / +1.8%
tpcds_q97/datafusion:parquet 35432136 / 35955326 / -1.5% 55675250 / 54417477 / +2.3% 0.64 / 0.66 / -3.7%
tpcds_q98/datafusion:parquet 25504749 / 25397899 / +0.4% 40924465 / 40983174 / -0.1% 0.62 / 0.62 / +0.6%
tpcds_q99/datafusion:parquet 29855300 / 29387549 / +1.6% 44524013 / 44513892 / +0.0% 0.67 / 0.66 / +1.6%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15132203 / 15174725 / -0.3% 25163701 / 23438287 / +7.4% 0.60 / 0.65 / -7.1%
tpcds_q02/duckdb:vortex-file-compressed 15173818 / 14970261 / +1.4% 20329030 / 20746612 / -2.0% 0.75 / 0.72 / +3.4%
tpcds_q03/duckdb:vortex-file-compressed 11508504 / 11203152 / +2.7% 20444055 / 20855876 / -2.0% 0.56 / 0.54 / +4.8%
tpcds_q04/duckdb:vortex-file-compressed 50493615 / 49666481 / +1.7% 60884654 / 59278077 / +2.7% 0.83 / 0.84 / -1.0%
tpcds_q05/duckdb:vortex-file-compressed 19212400 / 18926130 / +1.5% 29519584 / 29310641 / +0.7% 0.65 / 0.65 / +0.8%
tpcds_q06/duckdb:vortex-file-compressed 26748770 / 26768356 / -0.1% 40365671 / 41544094 / -2.8% 0.66 / 0.64 / +2.8%
tpcds_q07/duckdb:vortex-file-compressed 16953876 / 15566488 / +8.9% 29513152 / 29841392 / -1.1% 0.57 / 0.52 / +10.1%
tpcds_q08/duckdb:vortex-file-compressed 19235026 / 19189037 / +0.2% 28091768 / 28466386 / -1.3% 0.68 / 0.67 / +1.6%
tpcds_q09/duckdb:vortex-file-compressed 10271160 / 10696604 / -4.0% 17628987 / 17947416 / -1.8% 0.58 / 0.60 / -2.2%
tpcds_q10/duckdb:vortex-file-compressed 27494713 / 29410066 / -6.5% 42463726 / 40923271 / +3.8% 0.65 / 0.72 / -9.9%
tpcds_q11/duckdb:vortex-file-compressed 40429163 / 40334083 / +0.2% 51395241 / 51086245 / +0.6% 0.79 / 0.79 / -0.4%
tpcds_q12/duckdb:vortex-file-compressed 10198682 / 10091874 / +1.1% 16622227 / 16767032 / -0.9% 0.61 / 0.60 / +1.9%
tpcds_q13/duckdb:vortex-file-compressed 22773298 / 21794531 / +4.5% 35219762 / 35757602 / -1.5% 0.65 / 0.61 / +6.1%
tpcds_q14/duckdb:vortex-file-compressed 59515136 / 58486914 / +1.8% 69232319 / 72128580 / -4.0% 0.86 / 0.81 / +6.0%
tpcds_q15/duckdb:vortex-file-compressed 20825758 / 20826081 / -0.0% 27697396 / 25462061 / +8.8% 0.75 / 0.82 / -8.1%
tpcds_q16/duckdb:vortex-file-compressed 17804875 / 17433432 / +2.1% 29118145 / 26776445 / +8.7% 0.61 / 0.65 / -6.1%
tpcds_q17/duckdb:vortex-file-compressed 30156739 / 30146062 / +0.0% 45400384 / 45355756 / +0.1% 0.66 / 0.66 / -0.1%
tpcds_q18/duckdb:vortex-file-compressed 28612823 / 28721650 / -0.4% 39027899 / 39865588 / -2.1% 0.73 / 0.72 / +1.8%
tpcds_q19/duckdb:vortex-file-compressed 24574278 / 23981464 / +2.5% 34743550 / 35190808 / -1.3% 0.71 / 0.68 / +3.8%
tpcds_q20/duckdb:vortex-file-compressed 10567006 / 10744504 / -1.7% 15500477 / 15442125 / +0.4% 0.68 / 0.70 / -2.0%
tpcds_q21/duckdb:vortex-file-compressed 9867110 / 10060532 / -1.9% 19976079 / 18036393 / +10.8% 🔴 0.49 / 0.56 / -11.4%
tpcds_q22/duckdb:vortex-file-compressed 29584076 / 29682344 / -0.3% 40179988 / 39393124 / +2.0% 0.74 / 0.75 / -2.3%
tpcds_q23/duckdb:vortex-file-compressed 36705953 / 36415945 / +0.8% 46880144 / 46180493 / +1.5% 0.78 / 0.79 / -0.7%
tpcds_q24/duckdb:vortex-file-compressed 28357244 / 27872624 / +1.7% 40381135 / 39232622 / +2.9% 0.70 / 0.71 / -1.2%
tpcds_q25/duckdb:vortex-file-compressed 25602378 / 25794259 / -0.7% 43215079 / 40880515 / +5.7% 0.59 / 0.63 / -6.1%
tpcds_q26/duckdb:vortex-file-compressed 13380032 / 13499856 / -0.9% 20843207 / 19877609 / +4.9% 0.64 / 0.68 / -5.5%
tpcds_q27/duckdb:vortex-file-compressed 18000308 / 17078193 / +5.4% 33009701 / 30752338 / +7.3% 0.55 / 0.56 / -1.8%
tpcds_q28/duckdb:vortex-file-compressed 7815624 / 8483308 / -7.9% 12208218 / 13167347 / -7.3% 0.64 / 0.64 / -0.6%
tpcds_q29/duckdb:vortex-file-compressed 28838570 / 28800928 / +0.1% 44843460 / 47380060 / -5.4% 0.64 / 0.61 / +5.8%
tpcds_q30/duckdb:vortex-file-compressed 19156316 / 19316939 / -0.8% 29724684 / 28014652 / +6.1% 0.64 / 0.69 / -6.5%
tpcds_q31/duckdb:vortex-file-compressed 19302610 / 19618848 / -1.6% 29716872 / 25930402 / +14.6% 🔴 0.65 / 0.76 / -14.1%
tpcds_q32/duckdb:vortex-file-compressed 9997497 / 10062642 / -0.6% 16687286 / 16549987 / +0.8% 0.60 / 0.61 / -1.5%
tpcds_q33/duckdb:vortex-file-compressed 16731022 / 17132708 / -2.3% 29524528 / 31814258 / -7.2% 0.57 / 0.54 / +5.2%
tpcds_q34/duckdb:vortex-file-compressed 15560443 / 15773759 / -1.4% 22172928 / 24768855 / -10.5% 🟢 0.70 / 0.64 / +10.2%
tpcds_q35/duckdb:vortex-file-compressed 46683044 / 45979626 / +1.5% 63136608 / 62716197 / +0.7% 0.74 / 0.73 / +0.9%
tpcds_q36/duckdb:vortex-file-compressed 15134052 / 15026000 / +0.7% 27144174 / 30352856 / -10.6% 🟢 0.56 / 0.50 / +12.6%
tpcds_q37/duckdb:vortex-file-compressed 13882355 / 13771497 / +0.8% 22794424 / 22807942 / -0.1% 0.61 / 0.60 / +0.9%
tpcds_q38/duckdb:vortex-file-compressed 22317692 / 22583096 / -1.2% 29219536 / 28997216 / +0.8% 0.76 / 0.78 / -1.9%
tpcds_q39/duckdb:vortex-file-compressed 18269103 / 18414698 / -0.8% 29370291 / 28847039 / +1.8% 0.62 / 0.64 / -2.6%
tpcds_q40/duckdb:vortex-file-compressed 13098431 / 13212012 / -0.9% 21095437 / 19656799 / +7.3% 0.62 / 0.67 / -7.6%
tpcds_q41/duckdb:vortex-file-compressed 6589858 / 6568104 / +0.3% 9474948 / 9224477 / +2.7% 0.70 / 0.71 / -2.3%
tpcds_q42/duckdb:vortex-file-compressed 8104932 / 8036792 / +0.8% 19870320 / 17929297 / +10.8% 🔴 0.41 / 0.45 / -9.0%
tpcds_q43/duckdb:vortex-file-compressed 10220251 / 9941688 / +2.8% 18038083 / 18277534 / -1.3% 0.57 / 0.54 / +4.2%
tpcds_q44/duckdb:vortex-file-compressed 14090432 / 13992585 / +0.7% 23720629 / 24805279 / -4.4% 0.59 / 0.56 / +5.3%
tpcds_q45/duckdb:vortex-file-compressed 22143613 / 22443652 / -1.3% 29078429 / 28455032 / +2.2% 0.76 / 0.79 / -3.5%
tpcds_q46/duckdb:vortex-file-compressed 19483144 / 18690948 / +4.2% 33293924 / 28843277 / +15.4% 🔴 0.59 / 0.65 / -9.7%
tpcds_q47/duckdb:vortex-file-compressed 30715873 / 31816685 / -3.5% 44261431 / 43324789 / +2.2% 0.69 / 0.73 / -5.5%
tpcds_q48/duckdb:vortex-file-compressed 19870728 / 19534848 / +1.7% 32624384 / 32572378 / +0.2% 0.61 / 0.60 / +1.6%
tpcds_q49/duckdb:vortex-file-compressed 16931468 / 17029163 / -0.6% 30789737 / 30989304 / -0.6% 0.55 / 0.55 / +0.1%
tpcds_q50/duckdb:vortex-file-compressed 16726416 / 16790533 / -0.4% 29322409 / 33321798 / -12.0% 🟢 0.57 / 0.50 / +13.2%
tpcds_q51/duckdb:vortex-file-compressed 76661698 / 76364468 / +0.4% 64529416 / 60493286 / +6.7% 1.19 / 1.26 / -5.9%
tpcds_q52/duckdb:vortex-file-compressed 8352196 / 8196388 / +1.9% 18188046 / 18256053 / -0.4% 0.46 / 0.45 / +2.3%
tpcds_q53/duckdb:vortex-file-compressed 15274911 / 14396797 / +6.1% 28099336 / 28292624 / -0.7% 0.54 / 0.51 / +6.8%
tpcds_q54/duckdb:vortex-file-compressed 20662166 / 20544224 / +0.6% 31563284 / 31704322 / -0.4% 0.65 / 0.65 / +1.0%
tpcds_q55/duckdb:vortex-file-compressed 8396098 / 8665776 / -3.1% 17961025 / 18220904 / -1.4% 0.47 / 0.48 / -1.7%
tpcds_q56/duckdb:vortex-file-compressed 17561581 / 16877996 / +4.1% 33723259 / 29302968 / +15.1% 🔴 0.52 / 0.58 / -9.6%
tpcds_q57/duckdb:vortex-file-compressed 24678102 / 24216650 / +1.9% 31246033 / 34064789 / -8.3% 0.79 / 0.71 / +11.1%
tpcds_q58/duckdb:vortex-file-compressed 18644807 / 18638217 / +0.0% 28739463 / 28387316 / +1.2% 0.65 / 0.66 / -1.2%
tpcds_q59/duckdb:vortex-file-compressed 18648596 / 19128011 / -2.5% 24629360 / 25923591 / -5.0% 0.76 / 0.74 / +2.6%
tpcds_q60/duckdb:vortex-file-compressed 17871622 / 17565302 / +1.7% 30255106 / 30324918 / -0.2% 0.59 / 0.58 / +2.0%
tpcds_q61/duckdb:vortex-file-compressed 20536138 / 19839376 / +3.5% 32680103 / 32656999 / +0.1% 0.63 / 0.61 / +3.4%
tpcds_q62/duckdb:vortex-file-compressed 10349750 / 10243416 / +1.0% 16773637 / 16978348 / -1.2% 0.62 / 0.60 / +2.3%
tpcds_q63/duckdb:vortex-file-compressed 13559024 / 13504986 / +0.4% 24212222 / 23609884 / +2.6% 0.56 / 0.57 / -2.1%
tpcds_q64/duckdb:vortex-file-compressed 62839056 / 63654686 / -1.3% 80563167 / 79431334 / +1.4% 0.78 / 0.80 / -2.7%
tpcds_q65/duckdb:vortex-file-compressed 14042187 / 13735000 / +2.2% 24212155 / 22720553 / +6.6% 0.58 / 0.60 / -4.1%
tpcds_q66/duckdb:vortex-file-compressed 20984766 / 21319756 / -1.6% 27164198 / 31893872 / -14.8% 🟢 0.77 / 0.67 / +15.6%
tpcds_q67/duckdb:vortex-file-compressed 65654656 / 65444164 / +0.3% 80852472 / 82975711 / -2.6% 0.81 / 0.79 / +3.0%
tpcds_q68/duckdb:vortex-file-compressed 18356822 / 18026888 / +1.8% 31555676 / 35366093 / -10.8% 🟢 0.58 / 0.51 / +14.1%
tpcds_q69/duckdb:vortex-file-compressed 28920686 / 29173732 / -0.9% 42947006 / 43287720 / -0.8% 0.67 / 0.67 / -0.1%
tpcds_q70/duckdb:vortex-file-compressed 19173263 / 18800690 / +2.0% 34157967 / 29716635 / +14.9% 🔴 0.56 / 0.63 / -11.3%
tpcds_q71/duckdb:vortex-file-compressed 12469504 / 12668826 / -1.6% 24841700 / 22892939 / +8.5% 0.50 / 0.55 / -9.3%
tpcds_q72/duckdb:vortex-file-compressed 61407739 / 62570943 / -1.9% 76708346 / 75567235 / +1.5% 0.80 / 0.83 / -3.3%
tpcds_q73/duckdb:vortex-file-compressed 15163540 / 14655652 / +3.5% 24360960 / 21205706 / +14.9% 🔴 0.62 / 0.69 / -9.9%
tpcds_q74/duckdb:vortex-file-compressed 27442200 / 27652030 / -0.8% 38353710 / 36806383 / +4.2% 0.72 / 0.75 / -4.8%
tpcds_q75/duckdb:vortex-file-compressed 28836391 / 28623820 / +0.7% 39969588 / 48745151 / -18.0% 🟢 0.72 / 0.59 / +22.9%
tpcds_q76/duckdb:vortex-file-compressed 12694296 / 12845277 / -1.2% 24385166 / 24485462 / -0.4% 0.52 / 0.52 / -0.8%
tpcds_q77/duckdb:vortex-file-compressed 16123197 / 16022393 / +0.6% 26725747 / 29295774 / -8.8% 0.60 / 0.55 / +10.3%
tpcds_q78/duckdb:vortex-file-compressed 37226228 / 36977899 / +0.7% 47593650 / 47653067 / -0.1% 0.78 / 0.78 / +0.8%
tpcds_q79/duckdb:vortex-file-compressed 15042104 / 14598966 / +3.0% 29991012 / 29278121 / +2.4% 0.50 / 0.50 / +0.6%
tpcds_q80/duckdb:vortex-file-compressed 27912532 / 27953193 / -0.1% 45524956 / 43556031 / +4.5% 0.61 / 0.64 / -4.5%
tpcds_q81/duckdb:vortex-file-compressed 22651559 / 22094680 / +2.5% 33537878 / 34779936 / -3.6% 0.68 / 0.64 / +6.3%
tpcds_q82/duckdb:vortex-file-compressed 34237769 / 32537864 / +5.2% 40179695 / 39066381 / +2.8% 0.85 / 0.83 / +2.3%
tpcds_q83/duckdb:vortex-file-compressed 18444044 / 20264490 / -9.0% 26795912 / 26525071 / +1.0% 0.69 / 0.76 / -9.9%
tpcds_q84/duckdb:vortex-file-compressed 16370626 / 15263993 / +7.2% 19480817 / 21723051 / -10.3% 🟢 0.84 / 0.70 / +19.6%
tpcds_q85/duckdb:vortex-file-compressed 31504427 / 31785320 / -0.9% 41567568 / 41788391 / -0.5% 0.76 / 0.76 / -0.4%
tpcds_q86/duckdb:vortex-file-compressed 10846142 / 10828548 / +0.2% 19240722 / 21075800 / -8.7% 0.56 / 0.51 / +9.7%
tpcds_q87/duckdb:vortex-file-compressed 23962236 / 24197138 / -1.0% 30048598 / 30889211 / -2.7% 0.80 / 0.78 / +1.8%
tpcds_q88/duckdb:vortex-file-compressed 32616932 / 33392563 / -2.3% 44992085 / 47242281 / -4.8% 0.72 / 0.71 / +2.6%
tpcds_q89/duckdb:vortex-file-compressed 13891871 / 13988674 / -0.7% 24253507 / 23340818 / +3.9% 0.57 / 0.60 / -4.4%
tpcds_q90/duckdb:vortex-file-compressed 7544577 / 7659062 / -1.5% 14998259 / 14569811 / +2.9% 0.50 / 0.53 / -4.3%
tpcds_q91/duckdb:vortex-file-compressed 15853398 / 15310598 / +3.5% 21816283 / 21938915 / -0.6% 0.73 / 0.70 / +4.1%
tpcds_q92/duckdb:vortex-file-compressed 12968264 / 13187678 / -1.7% 21297272 / 21101004 / +0.9% 0.61 / 0.62 / -2.6%
tpcds_q93/duckdb:vortex-file-compressed 17427444 / 17009504 / +2.5% 24194055 / 25852249 / -6.4% 0.72 / 0.66 / +9.5%
tpcds_q94/duckdb:vortex-file-compressed 16443470 / 16404956 / +0.2% 26905256 / 28292862 / -4.9% 0.61 / 0.58 / +5.4%
tpcds_q95/duckdb:vortex-file-compressed 71074097 / 71631534 / -0.8% 79891465 / 81763767 / -2.3% 0.89 / 0.88 / +1.5%
tpcds_q96/duckdb:vortex-file-compressed 7432443 / 7559997 / -1.7% 17406555 / 17512922 / -0.6% 0.43 / 0.43 / -1.1%
tpcds_q97/duckdb:vortex-file-compressed 22184680 / 22162848 / +0.1% 30566853 / 30254558 / +1.0% 0.73 / 0.73 / -0.9%
tpcds_q98/duckdb:vortex-file-compressed 13224858 / 13578982 / -2.6% 23565108 / 24052134 / -2.0% 0.56 / 0.56 / -0.6%
tpcds_q99/duckdb:vortex-file-compressed 13464619 / 13481806 / -0.1% 22324466 / 20387924 / +9.5% 0.60 / 0.66 / -8.8%
duckdb / parquet / ns (1.002x ➖, 3↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24306459 / 26681794 / -8.9% 34568344 / 34295419 / +0.8% 0.70 / 0.78 / -9.6%
tpcds_q02/duckdb:parquet 15276159 / 16746910 / -8.8% 20005220 / 19475553 / +2.7% 0.76 / 0.86 / -11.2%
tpcds_q03/duckdb:parquet 8867934 / 8696742 / +2.0% 15575760 / 14941242 / +4.2% 0.57 / 0.58 / -2.2%
tpcds_q04/duckdb:parquet 127476788 / 127405652 / +0.1% 131946387 / 132423859 / -0.4% 0.97 / 0.96 / +0.4%
tpcds_q05/duckdb:parquet 21539552 / 21693992 / -0.7% 25507087 / 27228190 / -6.3% 0.84 / 0.80 / +6.0%
tpcds_q06/duckdb:parquet 26308854 / 26320744 / -0.0% 36783662 / 37055386 / -0.7% 0.72 / 0.71 / +0.7%
tpcds_q07/duckdb:parquet 15282538 / 15095874 / +1.2% 27030942 / 23053838 / +17.3% 🔴 0.57 / 0.65 / -13.7%
tpcds_q08/duckdb:parquet 25442191 / 28526146 / -10.8% 🟢 36892596 / 36482369 / +1.1% 0.69 / 0.78 / -11.8%
tpcds_q09/duckdb:parquet 19104120 / 19457452 / -1.8% 26897147 / 22271198 / +20.8% 🔴 0.71 / 0.87 / -18.7%
tpcds_q10/duckdb:parquet 27448904 / 27493188 / -0.2% 38395661 / 40069669 / -4.2% 0.71 / 0.69 / +4.2%
tpcds_q11/duckdb:parquet 71123226 / 70880685 / +0.3% 76284654 / 76605245 / -0.4% 0.93 / 0.93 / +0.8%
tpcds_q12/duckdb:parquet 12580256 / 12540800 / +0.3% 17416970 / 17473983 / -0.3% 0.72 / 0.72 / +0.6%
tpcds_q13/duckdb:parquet 23858268 / 23583898 / +1.2% 32127765 / 31750852 / +1.2% 0.74 / 0.74 / -0.0%
tpcds_q14/duckdb:parquet 60684226 / 61066080 / -0.6% 68366763 / 70323122 / -2.8% 0.89 / 0.87 / +2.2%
tpcds_q15/duckdb:parquet 24957874 / 24597026 / +1.5% 30499908 / 30326673 / +0.6% 0.82 / 0.81 / +0.9%
tpcds_q16/duckdb:parquet 19692114 / 20511477 / -4.0% 28692450 / 27909373 / +2.8% 0.69 / 0.73 / -6.6%
tpcds_q17/duckdb:parquet 32346068 / 32484632 / -0.4% 40223310 / 40581398 / -0.9% 0.80 / 0.80 / +0.5%
tpcds_q18/duckdb:parquet 39613870 / 38887306 / +1.9% 49756766 / 49217364 / +1.1% 0.80 / 0.79 / +0.8%
tpcds_q19/duckdb:parquet 25252332 / 24299426 / +3.9% 32104992 / 31997063 / +0.3% 0.79 / 0.76 / +3.6%
tpcds_q20/duckdb:parquet 13709966 / 13539249 / +1.3% 18376997 / 17488879 / +5.1% 0.75 / 0.77 / -3.6%
tpcds_q21/duckdb:parquet 9436380 / 9370455 / +0.7% 13067840 / 15034028 / -13.1% 🟢 0.72 / 0.62 / +15.9%
tpcds_q22/duckdb:parquet 35525136 / 34918759 / +1.7% 42199203 / 39088953 / +8.0% 0.84 / 0.89 / -5.8%
tpcds_q23/duckdb:parquet 40277810 / 40336561 / -0.1% 46778797 / 47209149 / -0.9% 0.86 / 0.85 / +0.8%
tpcds_q24/duckdb:parquet 33233821 / 34958662 / -4.9% 43504484 / 43511084 / -0.0% 0.76 / 0.80 / -4.9%
tpcds_q25/duckdb:parquet 30019658 / 30154612 / -0.4% 39891204 / 42138963 / -5.3% 0.75 / 0.72 / +5.2%
tpcds_q26/duckdb:parquet 31062160 / 31209231 / -0.5% 37824273 / 37847419 / -0.1% 0.82 / 0.82 / -0.4%
tpcds_q27/duckdb:parquet 31647986 / 32423474 / -2.4% 41307819 / 46121572 / -10.4% 🟢 0.77 / 0.70 / +9.0%
tpcds_q28/duckdb:parquet 17018210 / 17089390 / -0.4% 19823812 / 19840317 / -0.1% 0.86 / 0.86 / -0.3%
tpcds_q29/duckdb:parquet 30625928 / 30649450 / -0.1% 39555245 / 39401770 / +0.4% 0.77 / 0.78 / -0.5%
tpcds_q30/duckdb:parquet 34125028 / 32327638 / +5.6% 42667154 / 41936933 / +1.7% 0.80 / 0.77 / +3.8%
tpcds_q31/duckdb:parquet 20421101 / 20319164 / +0.5% 25101614 / 25960348 / -3.3% 0.81 / 0.78 / +3.9%
tpcds_q32/duckdb:parquet 10948333 / 11239734 / -2.6% 17115785 / 16794307 / +1.9% 0.64 / 0.67 / -4.4%
tpcds_q33/duckdb:parquet 15839452 / 15884169 / -0.3% 23420293 / 23341870 / +0.3% 0.68 / 0.68 / -0.6%
tpcds_q34/duckdb:parquet 15995450 / 16007240 / -0.1% 22244131 / 22262791 / -0.1% 0.72 / 0.72 / +0.0%
tpcds_q35/duckdb:parquet 47375538 / 48159872 / -1.6% 59346019 / 59379379 / -0.1% 0.80 / 0.81 / -1.6%
tpcds_q36/duckdb:parquet 16288303 / 15063788 / +8.1% 25789691 / 23330451 / +10.5% 🔴 0.63 / 0.65 / -2.2%
tpcds_q37/duckdb:parquet 12574166 / 12792900 / -1.7% 17467575 / 16914866 / +3.3% 0.72 / 0.76 / -4.8%
tpcds_q38/duckdb:parquet 26340792 / 26089596 / +1.0% 30248760 / 31692749 / -4.6% 0.87 / 0.82 / +5.8%
tpcds_q39/duckdb:parquet 24842274 / 24594271 / +1.0% 27810532 / 29237578 / -4.9% 0.89 / 0.84 / +6.2%
tpcds_q40/duckdb:parquet 15935884 / 15895379 / +0.3% 21246518 / 20753403 / +2.4% 0.75 / 0.77 / -2.1%
tpcds_q41/duckdb:parquet 9865490 / 7677796 / +28.5% 🔴 15330272 / 13023641 / +17.7% 🔴 0.64 / 0.59 / +9.2%
tpcds_q42/duckdb:parquet 8367719 / 8311810 / +0.7% 15131539 / 14748042 / +2.6% 0.55 / 0.56 / -1.9%
tpcds_q43/duckdb:parquet 10677734 / 10540942 / +1.3% 15707954 / 15464635 / +1.6% 0.68 / 0.68 / -0.3%
tpcds_q44/duckdb:parquet 16147574 / 16227934 / -0.5% 24961565 / 22346859 / +11.7% 🔴 0.65 / 0.73 / -10.9%
tpcds_q45/duckdb:parquet 24743436 / 23173005 / +6.8% 32182768 / 29651260 / +8.5% 0.77 / 0.78 / -1.6%
tpcds_q46/duckdb:parquet 36383526 / 36272085 / +0.3% 45527864 / 46044265 / -1.1% 0.80 / 0.79 / +1.4%
tpcds_q47/duckdb:parquet 33019435 / 30805416 / +7.2% 36974908 / 37901927 / -2.4% 0.89 / 0.81 / +9.9%
tpcds_q48/duckdb:parquet 21081618 / 20956396 / +0.6% 28649674 / 30778703 / -6.9% 0.74 / 0.68 / +8.1%
tpcds_q49/duckdb:parquet 19074010 / 18769722 / +1.6% 28845062 / 28724180 / +0.4% 0.66 / 0.65 / +1.2%
tpcds_q50/duckdb:parquet 17567018 / 17471078 / +0.5% 24920099 / 25288865 / -1.5% 0.70 / 0.69 / +2.0%
tpcds_q51/duckdb:parquet 53464240 / 52689720 / +1.5% 86578846 / 65779851 / +31.6% 🔴 0.62 / 0.80 / -22.9%
tpcds_q52/duckdb:parquet 8623089 / 8565710 / +0.7% 14948713 / 14789428 / +1.1% 0.58 / 0.58 / -0.4%
tpcds_q53/duckdb:parquet 11409794 / 12708015 / -10.2% 🟢 17119650 / 20517235 / -16.6% 🟢 0.67 / 0.62 / +7.6%
tpcds_q54/duckdb:parquet 20069224 / 21386888 / -6.2% 29958014 / 29491045 / +1.6% 0.67 / 0.73 / -7.6%
tpcds_q55/duckdb:parquet 8469718 / 8523208 / -0.6% 15610242 / 15299486 / +2.0% 0.54 / 0.56 / -2.6%
tpcds_q56/duckdb:parquet 17981563 / 16288336 / +10.4% 🔴 24521737 / 26329080 / -6.9% 0.73 / 0.62 / +18.5%
tpcds_q57/duckdb:parquet 29166964 / 28905620 / +0.9% 33943291 / 37431848 / -9.3% 0.86 / 0.77 / +11.3%
tpcds_q58/duckdb:parquet 18407592 / 18021428 / +2.1% 26794938 / 25851611 / +3.6% 0.69 / 0.70 / -1.5%
tpcds_q59/duckdb:parquet 20071840 / 22794229 / -11.9% 🟢 25373237 / 25599328 / -0.9% 0.79 / 0.89 / -11.2%
tpcds_q60/duckdb:parquet 16716058 / 16857354 / -0.8% 25758672 / 24452471 / +5.3% 0.65 / 0.69 / -5.9%
tpcds_q61/duckdb:parquet 21471890 / 21687257 / -1.0% 28982439 / 29478087 / -1.7% 0.74 / 0.74 / +0.7%
tpcds_q62/duckdb:parquet 10819946 / 10788003 / +0.3% 14218362 / 14546031 / -2.3% 0.76 / 0.74 / +2.6%
tpcds_q63/duckdb:parquet 10810429 / 10764165 / +0.4% 16653080 / 16697322 / -0.3% 0.65 / 0.64 / +0.7%
tpcds_q64/duckdb:parquet 51830814 / 51719860 / +0.2% 67389088 / 67355631 / +0.0% 0.77 / 0.77 / +0.2%
tpcds_q65/duckdb:parquet 14433524 / 14504660 / -0.5% 22855235 / 21604157 / +5.8% 0.63 / 0.67 / -5.9%
tpcds_q66/duckdb:parquet 24538905 / 24639772 / -0.4% 34886371 / 31744931 / +9.9% 0.70 / 0.78 / -9.4%
tpcds_q67/duckdb:parquet 77135368 / 76657418 / +0.6% 85242243 / 83434897 / +2.2% 0.90 / 0.92 / -1.5%
tpcds_q68/duckdb:parquet 29056724 / 29357509 / -1.0% 40694628 / 41084379 / -0.9% 0.71 / 0.71 / -0.1%
tpcds_q69/duckdb:parquet 28563486 / 28803842 / -0.8% 38867310 / 39302154 / -1.1% 0.73 / 0.73 / +0.3%
tpcds_q70/duckdb:parquet 15949016 / 17322512 / -7.9% 25412517 / 25220924 / +0.8% 0.63 / 0.69 / -8.6%
tpcds_q71/duckdb:parquet 14578748 / 15203480 / -4.1% 20844793 / 21236248 / -1.8% 0.70 / 0.72 / -2.3%
tpcds_q72/duckdb:parquet 81992684 / 81441527 / +0.7% 91229566 / 87196936 / +4.6% 0.90 / 0.93 / -3.8%
tpcds_q73/duckdb:parquet 13422690 / 13374854 / +0.4% 19296071 / 19587745 / -1.5% 0.70 / 0.68 / +1.9%
tpcds_q74/duckdb:parquet 100160122 / 98420680 / +1.8% 106095215 / 106671524 / -0.5% 0.94 / 0.92 / +2.3%
tpcds_q75/duckdb:parquet 39913362 / 40278414 / -0.9% 50144428 / 57481411 / -12.8% 🟢 0.80 / 0.70 / +13.6%
tpcds_q76/duckdb:parquet 13515642 / 13356154 / +1.2% 21005744 / 23145724 / -9.2% 0.64 / 0.58 / +11.5%
tpcds_q77/duckdb:parquet 16691136 / 16796132 / -0.6% 25836311 / 25875528 / -0.2% 0.65 / 0.65 / -0.5%
tpcds_q78/duckdb:parquet 48219688 / 48144388 / +0.2% 54464736 / 53919711 / +1.0% 0.89 / 0.89 / -0.8%
tpcds_q79/duckdb:parquet 20295492 / 20298701 / -0.0% 28729726 / 28626127 / +0.4% 0.71 / 0.71 / -0.4%
tpcds_q80/duckdb:parquet 31436469 / 31002113 / +1.4% 45380009 / 40545120 / +11.9% 🔴 0.69 / 0.76 / -9.4%
tpcds_q81/duckdb:parquet 29911755 / 29838088 / +0.2% 37924045 / 41612002 / -8.9% 0.79 / 0.72 / +10.0%
tpcds_q82/duckdb:parquet 14422160 / 13834890 / +4.2% 18452411 / 22346491 / -17.4% 🟢 0.78 / 0.62 / +26.2%
tpcds_q83/duckdb:parquet 17080534 / 15665164 / +9.0% 24274804 / 21366354 / +13.6% 🔴 0.70 / 0.73 / -4.0%
tpcds_q84/duckdb:parquet 18591888 / 17242160 / +7.8% 23304050 / 23617134 / -1.3% 0.80 / 0.73 / +9.3%
tpcds_q85/duckdb:parquet 34623710 / 36160694 / -4.3% 45880381 / 48390961 / -5.2% 0.75 / 0.75 / +1.0%
tpcds_q86/duckdb:parquet 12185914 / 10930517 / +11.5% 🔴 15734138 / 18337341 / -14.2% 🟢 0.77 / 0.60 / +29.9%
tpcds_q87/duckdb:parquet 28020688 / 28096210 / -0.3% 35472827 / 35537348 / -0.2% 0.79 / 0.79 / -0.1%
tpcds_q88/duckdb:parquet 26929700 / 26995833 / -0.2% 31962507 / 32084981 / -0.4% 0.84 / 0.84 / +0.1%
tpcds_q89/duckdb:parquet 12639574 / 12624297 / +0.1% 19074276 / 18767920 / +1.6% 0.66 / 0.67 / -1.5%
tpcds_q90/duckdb:parquet 6783916 / 6761345 / +0.3% 11155517 / 10888907 / +2.4% 0.61 / 0.62 / -2.1%
tpcds_q91/duckdb:parquet 20704080 / 20866918 / -0.8% 28849327 / 28532609 / +1.1% 0.72 / 0.73 / -1.9%
tpcds_q92/duckdb:parquet 11386140 / 11607429 / -1.9% 18824668 / 18196095 / +3.5% 0.60 / 0.64 / -5.2%
tpcds_q93/duckdb:parquet 21402926 / 21321062 / +0.4% 28722446 / 29122586 / -1.4% 0.75 / 0.73 / +1.8%
tpcds_q94/duckdb:parquet 15820720 / 15891199 / -0.4% 25404391 / 25097173 / +1.2% 0.62 / 0.63 / -1.6%
tpcds_q95/duckdb:parquet 89612948 / 89555672 / +0.1% 99592561 / 95450341 / +4.3% 0.90 / 0.94 / -4.1%
tpcds_q96/duckdb:parquet 7007046 / 6921042 / +1.2% 10760680 / 11161851 / -3.6% 0.65 / 0.62 / +5.0%
tpcds_q97/duckdb:parquet 25866422 / 25802417 / +0.2% 32229875 / 32005822 / +0.7% 0.80 / 0.81 / -0.4%
tpcds_q98/duckdb:parquet 14981363 / 15226447 / -1.6% 22020530 / 25101539 / -12.3% 🟢 0.68 / 0.61 / +12.2%
tpcds_q99/duckdb:parquet 17473858 / 17206993 / +1.6% 20956690 / 21245792 / -1.4% 0.83 / 0.81 / +3.0%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 303cdaef vs base a65c6537
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 1.012x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.005x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9048968 / 9046222 / +0.0% 9448021 / 9512904 / -0.7% 0.96 / 0.95 / +0.7%
statpopgen_q01/duckdb:vortex-file-compressed 10316256 / 10354572 / -0.4% 15072271 / 13651165 / +10.4% 🔴 0.68 / 0.76 / -9.8%
statpopgen_q02/duckdb:vortex-file-compressed 306070514 / 307700384 / -0.5% 351545775 / 351487698 / +0.0% 0.87 / 0.88 / -0.5%
statpopgen_q03/duckdb:vortex-file-compressed 812882674 / 814617600 / -0.2% 809423964 / 833309952 / -2.9% 1.00 / 0.98 / +2.7%
statpopgen_q04/duckdb:vortex-file-compressed 819508041 / 823901187 / -0.5% 824343523 / 824403723 / -0.0% 0.99 / 1.00 / -0.5%
statpopgen_q05/duckdb:vortex-file-compressed 317993860 / 319049321 / -0.3% 361407906 / 340213115 / +6.2% 0.88 / 0.94 / -6.2%
statpopgen_q06/duckdb:vortex-file-compressed 1140385790 / 1133351164 / +0.6% 1138959239 / 1149322228 / -0.9% 1.00 / 0.99 / +1.5%
statpopgen_q07/duckdb:vortex-file-compressed 129175992 / 130978225 / -1.4% 192795932 / 188655020 / +2.2% 0.67 / 0.69 / -3.5%
statpopgen_q08/duckdb:vortex-file-compressed 143445951 / 142215630 / +0.9% 158287179 / 158164487 / +0.1% 0.91 / 0.90 / +0.8%
statpopgen_q09/duckdb:vortex-file-compressed 609234242 / 612151772 / -0.5% 626095234 / 630686109 / -0.7% 0.97 / 0.97 / +0.3%
statpopgen_q10/duckdb:vortex-file-compressed 1912601824 / 1907690160 / +0.3% 1892678340 / 1885391820 / +0.4% 1.01 / 1.01 / -0.1%
duckdb / parquet / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 247413262 / 246909558 / +0.2% 248195990 / 245750857 / +1.0% 1.00 / 1.00 / -0.8%
statpopgen_q01/duckdb:parquet 303468822 / 301292498 / +0.7% 304998271 / 305962581 / -0.3% 0.99 / 0.98 / +1.0%
statpopgen_q02/duckdb:parquet 547263975 / 528643484 / +3.5% 568304458 / 583092274 / -2.5% 0.96 / 0.91 / +6.2%
statpopgen_q03/duckdb:parquet 838612436 / 868149166 / -3.4% 824292470 / 896890247 / -8.1% 1.02 / 0.97 / +5.1%
statpopgen_q04/duckdb:parquet 879017240 / 848197592 / +3.6% 901313172 / 875604653 / +2.9% 0.98 / 0.97 / +0.7%
statpopgen_q05/duckdb:parquet 586532823 / 582235004 / +0.7% 583958502 / 604209909 / -3.4% 1.00 / 0.96 / +4.2%
statpopgen_q06/duckdb:parquet 707911292 / 726052634 / -2.5% 738933117 / 695242267 / +6.3% 0.96 / 1.04 / -8.3%
statpopgen_q07/duckdb:parquet 611132977 / 607922870 / +0.5% 697575462 / 669901362 / +4.1% 0.88 / 0.91 / -3.5%
statpopgen_q08/duckdb:parquet 616682048 / 618351482 / -0.3% 707587388 / 721288804 / -1.9% 0.87 / 0.86 / +1.7%
statpopgen_q09/duckdb:parquet 796381988 / 799046228 / -0.3% 841994621 / 806906275 / +4.3% 0.95 / 0.99 / -4.5%
statpopgen_q10/duckdb:parquet 1514752838 / 1507021316 / +0.5% 1384442612 / 1334833705 / +3.7% 1.09 / 1.13 / -3.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 303cdaef vs base a65c6537
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.3%
Engines: DataFusion No clear signal (+5.7%, environment too noisy confidence) · DuckDB No clear signal (-7.8%, environment too noisy confidence)
Vortex (geomean): hot 1.039x ➖ · cold 1.024x ➖
Parquet (geomean): hot 1.052x ➖ · cold 1.104x ➖
Shifts: Parquet (control) +5.2% · Median polish +3.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.055x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 239443399 / 212725205 / +12.6% 1047321433 / 742272818 / +41.1% 🔴 0.23 / 0.29 / -20.2%
tpch_q02/datafusion:vortex-file-compressed 313339016 / 305555680 / +2.5% 707618758 / 601132950 / +17.7% 0.44 / 0.51 / -12.9%
tpch_q03/datafusion:vortex-file-compressed 366160063 / 364938203 / +0.3% 1117546066 / 910786440 / +22.7% 0.33 / 0.40 / -18.2%
tpch_q04/datafusion:vortex-file-compressed 220070522 / 171333856 / +28.4% 507147644 / 605488685 / -16.2% 0.43 / 0.28 / +53.4%
tpch_q05/datafusion:vortex-file-compressed 516229603 / 362718960 / +42.3% 🔴 848198633 / 508378563 / +66.8% 🔴 0.61 / 0.71 / -14.7%
tpch_q06/datafusion:vortex-file-compressed 288170049 / 241484945 / +19.3% 408329091 / 397659184 / +2.7% 0.71 / 0.61 / +16.2%
tpch_q07/datafusion:vortex-file-compressed 436147436 / 434089498 / +0.5% 613068170 / 451851178 / +35.7% 🔴 0.71 / 0.96 / -25.9%
tpch_q08/datafusion:vortex-file-compressed 511112152 / 529289879 / -3.4% 697045435 / 565674684 / +23.2% 0.73 / 0.94 / -21.6%
tpch_q09/datafusion:vortex-file-compressed 476040270 / 442683167 / +7.5% 531172765 / 549867428 / -3.4% 0.90 / 0.81 / +11.3%
tpch_q10/datafusion:vortex-file-compressed 381082629 / 376056650 / +1.3% 509476319 / 572640043 / -11.0% 0.75 / 0.66 / +13.9%
tpch_q11/datafusion:vortex-file-compressed 274261320 / 268932452 / +2.0% 452532048 / 380058424 / +19.1% 0.61 / 0.71 / -14.4%
tpch_q12/datafusion:vortex-file-compressed 292178032 / 294841063 / -0.9% 555445270 / 520380722 / +6.7% 0.53 / 0.57 / -7.2%
tpch_q13/datafusion:vortex-file-compressed 127896863 / 135641691 / -5.7% 335152529 / 388548851 / -13.7% 0.38 / 0.35 / +9.3%
tpch_q14/datafusion:vortex-file-compressed 181531310 / 251850406 / -27.9% 320597990 / 783644361 / -59.1% 🟢 0.57 / 0.32 / +76.2%
tpch_q15/datafusion:vortex-file-compressed 282910032 / 279017452 / +1.4% 475004402 / 484974886 / -2.1% 0.60 / 0.58 / +3.5%
tpch_q16/datafusion:vortex-file-compressed 145953223 / 152618919 / -4.4% 302357972 / 274045649 / +10.3% 0.48 / 0.56 / -13.3%
tpch_q17/datafusion:vortex-file-compressed 266908899 / 274160668 / -2.6% 396506809 / 428724871 / -7.5% 0.67 / 0.64 / +5.3%
tpch_q18/datafusion:vortex-file-compressed 253584169 / 208817203 / +21.4% 513768746 / 376315877 / +36.5% 🔴 0.49 / 0.55 / -11.1%
tpch_q19/datafusion:vortex-file-compressed 342591700 / 308245462 / +11.1% 452577617 / 457492497 / -1.1% 0.76 / 0.67 / +12.3%
tpch_q20/datafusion:vortex-file-compressed 279368860 / 257043625 / +8.7% 452608749 / 425751727 / +6.3% 0.62 / 0.60 / +2.2%
tpch_q21/datafusion:vortex-file-compressed 440316421 / 432719854 / +1.8% 608719223 / 566710463 / +7.4% 0.72 / 0.76 / -5.3%
tpch_q22/datafusion:vortex-file-compressed 197498407 / 157868873 / +25.1% 431575690 / 331209463 / +30.3% 🔴 0.46 / 0.48 / -4.0%
datafusion / parquet / ns (0.998x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 190513647 / 164987468 / +15.5% 551786986 / 405946140 / +35.9% 🔴 0.35 / 0.41 / -15.0%
tpch_q02/datafusion:parquet 261641700 / 280284840 / -6.7% 502971352 / 459266343 / +9.5% 0.52 / 0.61 / -14.8%
tpch_q03/datafusion:parquet 269129160 / 268265654 / +0.3% 742340140 / 675033428 / +10.0% 0.36 / 0.40 / -8.8%
tpch_q04/datafusion:parquet 129298953 / 131902666 / -2.0% 362378309 / 365647503 / -0.9% 0.36 / 0.36 / -1.1%
tpch_q05/datafusion:parquet 329538487 / 380236342 / -13.3% 452227834 / 470137041 / -3.8% 0.73 / 0.81 / -9.9%
tpch_q06/datafusion:parquet 143203787 / 154474436 / -7.3% 288469416 / 230913000 / +24.9% 0.50 / 0.67 / -25.8%
tpch_q07/datafusion:parquet 362087462 / 529011848 / -31.6% 🟢 527745963 / 650166941 / -18.8% 0.69 / 0.81 / -15.7%
tpch_q08/datafusion:parquet 431569164 / 421637347 / +2.4% 573686174 / 509426576 / +12.6% 0.75 / 0.83 / -9.1%
tpch_q09/datafusion:parquet 426375099 / 419247845 / +1.7% 623385591 / 597630612 / +4.3% 0.68 / 0.70 / -2.5%
tpch_q10/datafusion:parquet 397399833 / 388778496 / +2.2% 514562276 / 491410857 / +4.7% 0.77 / 0.79 / -2.4%
tpch_q11/datafusion:parquet 296106974 / 265239074 / +11.6% 501050345 / 449339448 / +11.5% 0.59 / 0.59 / +0.1%
tpch_q12/datafusion:parquet 196450694 / 205623570 / -4.5% 397915580 / 404482213 / -1.6% 0.49 / 0.51 / -2.9%
tpch_q13/datafusion:parquet 393564244 / 391592646 / +0.5% 487622788 / 553866356 / -12.0% 0.81 / 0.71 / +14.2%
tpch_q14/datafusion:parquet 170926430 / 163899079 / +4.3% 299788144 / 293497429 / +2.1% 0.57 / 0.56 / +2.1%
tpch_q15/datafusion:parquet 282336653 / 268358377 / +5.2% 471128201 / 435259702 / +8.2% 0.60 / 0.62 / -2.8%
tpch_q16/datafusion:parquet 108064873 / 111015330 / -2.7% 339007240 / 258759489 / +31.0% 🔴 0.32 / 0.43 / -25.7%
tpch_q17/datafusion:parquet 300741392 / 291605157 / +3.1% 385984482 / 399752423 / -3.4% 0.78 / 0.73 / +6.8%
tpch_q18/datafusion:parquet 412670399 / 379247252 / +8.8% 500732141 / 516612040 / -3.1% 0.82 / 0.73 / +12.3%
tpch_q19/datafusion:parquet 176249534 / 170541798 / +3.3% 293818734 / 285700864 / +2.8% 0.60 / 0.60 / +0.5%
tpch_q20/datafusion:parquet 256910031 / 286573888 / -10.4% 495961417 / 426211188 / +16.4% 0.52 / 0.67 / -23.0%
tpch_q21/datafusion:parquet 327293160 / 321014745 / +2.0% 437721705 / 408579336 / +7.1% 0.75 / 0.79 / -4.8%
tpch_q22/datafusion:parquet 194804649 / 154127759 / +26.4% 378896401 / 292548567 / +29.5% 0.51 / 0.53 / -2.4%
duckdb / vortex-file-compressed / ns (1.023x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 237658470 / 208197666 / +14.2% 260059647 / 305864149 / -15.0% 0.91 / 0.68 / +34.3%
tpch_q02/duckdb:vortex-file-compressed 412976315 / 366898195 / +12.6% 443988809 / 357336155 / +24.2% 0.93 / 1.03 / -9.4%
tpch_q03/duckdb:vortex-file-compressed 432411564 / 421274504 / +2.6% 616356720 / 467416553 / +31.9% 🔴 0.70 / 0.90 / -22.2%
tpch_q04/duckdb:vortex-file-compressed 237400070 / 223819578 / +6.1% 324202729 / 484383649 / -33.1% 🟢 0.73 / 0.46 / +58.5%
tpch_q05/duckdb:vortex-file-compressed 410498777 / 410640295 / -0.0% 425894544 / 447681233 / -4.9% 0.96 / 0.92 / +5.1%
tpch_q06/duckdb:vortex-file-compressed 262868632 / 257935392 / +1.9% 291105502 / 303125534 / -4.0% 0.90 / 0.85 / +6.1%
tpch_q07/duckdb:vortex-file-compressed 446031966 / 607393832 / -26.6% 490584873 / 562419682 / -12.8% 0.91 / 1.08 / -15.8%
tpch_q08/duckdb:vortex-file-compressed 600224859 / 589902323 / +1.7% 577157690 / 585994804 / -1.5% 1.04 / 1.01 / +3.3%
tpch_q09/duckdb:vortex-file-compressed 471324421 / 435773164 / +8.2% 490201715 / 439969516 / +11.4% 0.96 / 0.99 / -2.9%
tpch_q10/duckdb:vortex-file-compressed 460740495 / 472173616 / -2.4% 552089222 / 461179317 / +19.7% 0.83 / 1.02 / -18.5%
tpch_q11/duckdb:vortex-file-compressed 162816438 / 146132043 / +11.4% 191074312 / 153621534 / +24.4% 0.85 / 0.95 / -10.4%
tpch_q12/duckdb:vortex-file-compressed 616345621 / 743386427 / -17.1% 656824529 / 823920270 / -20.3% 0.94 / 0.90 / +4.0%
tpch_q13/duckdb:vortex-file-compressed 336552979 / 300385423 / +12.0% 325332685 / 302033533 / +7.7% 1.03 / 0.99 / +4.0%
tpch_q14/duckdb:vortex-file-compressed 246926698 / 234023785 / +5.5% 321783010 / 274017438 / +17.4% 0.77 / 0.85 / -10.1%
tpch_q15/duckdb:vortex-file-compressed 153745640 / 141598299 / +8.6% 186260059 / 181271521 / +2.8% 0.83 / 0.78 / +5.7%
tpch_q16/duckdb:vortex-file-compressed 178242790 / 176489959 / +1.0% 192953150 / 237633479 / -18.8% 0.92 / 0.74 / +24.4%
tpch_q17/duckdb:vortex-file-compressed 380203603 / 357184468 / +6.4% 419730660 / 390526380 / +7.5% 0.91 / 0.91 / -1.0%
tpch_q18/duckdb:vortex-file-compressed 332181627 / 322332547 / +3.1% 374348049 / 378776181 / -1.2% 0.89 / 0.85 / +4.3%
tpch_q19/duckdb:vortex-file-compressed 306684178 / 307764521 / -0.4% 339598516 / 329326474 / +3.1% 0.90 / 0.93 / -3.4%
tpch_q20/duckdb:vortex-file-compressed 348988619 / 347862366 / +0.3% 378032312 / 432740367 / -12.6% 0.92 / 0.80 / +14.8%
tpch_q21/duckdb:vortex-file-compressed 620873248 / 520827029 / +19.2% 644794362 / 796020354 / -19.0% 0.96 / 0.65 / +47.2%
tpch_q22/duckdb:vortex-file-compressed 108273973 / 115228285 / -6.0% 132808695 / 137939819 / -3.7% 0.82 / 0.84 / -2.4%
duckdb / parquet / ns (1.110x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 315386232 / 289608541 / +8.9% 364559137 / 302960714 / +20.3% 0.87 / 0.96 / -9.5%
tpch_q02/duckdb:parquet 644129343 / 597531100 / +7.8% 706473226 / 619301251 / +14.1% 0.91 / 0.96 / -5.5%
tpch_q03/duckdb:parquet 767000980 / 720143441 / +6.5% 965556237 / 803286481 / +20.2% 0.79 / 0.90 / -11.4%
tpch_q04/duckdb:parquet 448217736 / 422435410 / +6.1% 475434960 / 477157309 / -0.4% 0.94 / 0.89 / +6.5%
tpch_q05/duckdb:parquet 929672063 / 898204663 / +3.5% 944480998 / 843028830 / +12.0% 0.98 / 1.07 / -7.6%
tpch_q06/duckdb:parquet 312610222 / 287013906 / +8.9% 279078693 / 282938691 / -1.4% 1.12 / 1.01 / +10.4%
tpch_q07/duckdb:parquet 859501457 / 798494570 / +7.6% 925934826 / 755324137 / +22.6% 0.93 / 1.06 / -12.2%
tpch_q08/duckdb:parquet 1151743793 / 955472332 / +20.5% 1373677785 / 990540873 / +38.7% 🔴 0.84 / 0.96 / -13.1%
tpch_q09/duckdb:parquet 985007079 / 894095450 / +10.2% 1067554480 / 919616236 / +16.1% 0.92 / 0.97 / -5.1%
tpch_q10/duckdb:parquet 996583627 / 950985468 / +4.8% 1054532491 / 906571137 / +16.3% 0.95 / 1.05 / -9.9%
tpch_q11/duckdb:parquet 399303891 / 395840020 / +0.9% 395354371 / 375112411 / +5.4% 1.01 / 1.06 / -4.3%
tpch_q12/duckdb:parquet 658779579 / 496508327 / +32.7% 🔴 1001887511 / 573216361 / +74.8% 🔴 0.66 / 0.87 / -24.1%
tpch_q13/duckdb:parquet 772315066 / 736891887 / +4.8% 815485953 / 814743137 / +0.1% 0.95 / 0.90 / +4.7%
tpch_q14/duckdb:parquet 588610540 / 472620542 / +24.5% 445349139 / 472020094 / -5.7% 1.32 / 1.00 / +32.0%
tpch_q15/duckdb:parquet 460420615 / 356412119 / +29.2% 458048180 / 372116226 / +23.1% 1.01 / 0.96 / +4.9%
tpch_q16/duckdb:parquet 478152803 / 477607420 / +0.1% 468376338 / 473725549 / -1.1% 1.02 / 1.01 / +1.3%
tpch_q17/duckdb:parquet 472286384 / 455419186 / +3.7% 519861680 / 500091507 / +4.0% 0.91 / 0.91 / -0.2%
tpch_q18/duckdb:parquet 611823753 / 583780882 / +4.8% 581733163 / 683365729 / -14.9% 1.05 / 0.85 / +23.1%
tpch_q19/duckdb:parquet 582740915 / 519150904 / +12.2% 693611181 / 606076508 / +14.4% 0.84 / 0.86 / -1.9%
tpch_q20/duckdb:parquet 835039457 / 728657295 / +14.6% 905778652 / 786136970 / +15.2% 0.92 / 0.93 / -0.5%
tpch_q21/duckdb:parquet 815113888 / 643894150 / +26.6% 954683620 / 681471079 / +40.1% 🔴 0.85 / 0.94 / -9.6%
tpch_q22/duckdb:parquet 415021750 / 377779931 / +9.9% 450700400 / 356352818 / +26.5% 0.92 / 1.06 / -13.1%

@myrrc
myrrc marked this pull request as draft September 15, 2026 14:37
auto-merge was automatically disabled September 15, 2026 14:37

Pull request was converted to draft

@myrrc
myrrc marked this pull request as ready for review September 15, 2026 14:57
@myrrc
myrrc requested a review from joseph-isaacs September 15, 2026 14:57
@myrrc
myrrc enabled auto-merge (squash) September 15, 2026 15:30
Comment thread vortex-duckdb/src/projection.rs Outdated
Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc
myrrc requested a review from joseph-isaacs September 15, 2026 16:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants