Skip to content

duckdb: disable function serialization - #9891

Merged
myrrc merged 1 commit into
developfrom
myrrc/duckdb-no-serialize
Sep 16, 2026
Merged

myrrc merged 1 commit into
developfrom
myrrc/duckdb-no-serialize

Conversation

@myrrc

@myrrc myrrc commented Sep 15, 2026

Copy link
Copy Markdown
Contributor

Duckdb serializes internal function state only if you don't add
serialize/deserialize callbacks. This is wrong if filters are pushed down.
Tpch q11 plan was incorrect due to that, with 6 different scans replaced by one.

Disable function serialization with a hack (verify_serialization = false).

This is an upstream bug which is reported to duckdb:
duckdb/duckdb#25740

Signed-off-by: Mikhail Kot <mikhail@spiraldb.com>
@myrrc
myrrc requested a review from joseph-isaacs September 15, 2026 16:08
@myrrc myrrc added changelog/fix A bug fix ext/duckdb Relates to the DuckDB integration labels Sep 15, 2026
@myrrc
myrrc enabled auto-merge (squash) September 15, 2026 16:09
@myrrc

myrrc commented Sep 15, 2026

Copy link
Copy Markdown
Contributor Author

This is the same solution as @joseph-isaacs's https://github.com/vortex-data/vortex/pull/9802/changes, albeit with a different comment.

@codspeed

codspeed Bot commented Sep 15, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 10.06%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️ Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 2 improved benchmarks
❌ 4 regressed benchmarks
✅ 2192 untouched benchmarks
⏩ 218 skipped benchmarks1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime arrow_checked_add_u32_neon[16384] 13.5 µs 20.4 µs -33.72%
Simulation random_i8[0.5] 71.3 µs 94.9 µs -24.83%
Simulation decompress[u64, (4000, 1024)] 71.5 µs 86.8 µs -17.56%
WallTime deferred_i64_avx2[PerRowPerRow] 9.9 µs 11.5 µs -13.87%
Simulation random_i16[0.8] 96.4 µs 78.1 µs +23.5%
WallTime arrow_checked_add_u32_avx2[16384] 21.4 µs 17.6 µs +21.2%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing myrrc/duckdb-no-serialize (68fb80d) with develop (b5f43ba)

Open in CodSpeed

Footnotes

  1. 218 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 15, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Sep 15, 2026
@github-actions

github-actions Bot commented Sep 15, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 68fb80d statpopgen 1 Explore Profiling Data
🟢 Done 68fb80d clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 68fb80d fineweb-s3 1 Explore Profiling Data
🟢 Done 68fb80d tpch-nvme-10 1 Explore Profiling Data
🟢 Done 68fb80d fineweb 1 Explore Profiling Data
🟢 Done 68fb80d clickbench-nvme 1 Explore Profiling Data
🟢 Done 68fb80d tpcds-nvme 1 Explore Profiling Data
🟢 Done 68fb80d polarsignals 1 Explore Profiling Data
🟢 Done 68fb80d tpch-s3 1 Explore Profiling Data
🟢 Done 68fb80d tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 68fb80dc vs base a3e9d40e
Vortex (geomean): hot 1.006x ➖ · cold 1.012x ➖


datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45041558 / 45048800 / -0.0% 91171905 / 89636427 / +1.7% 0.49 / 0.50 / -1.7%
polarsignals_q01/datafusion:vortex-file-compressed 50806697 / 50762500 / +0.1% 114547025 / 113620930 / +0.8% 0.44 / 0.45 / -0.7%
polarsignals_q02/datafusion:vortex-file-compressed 36723788 / 35154268 / +4.5% 84381229 / 82866820 / +1.8% 0.44 / 0.42 / +2.6%
polarsignals_q03/datafusion:vortex-file-compressed 53735430 / 53863840 / -0.2% 116660850 / 119765667 / -2.6% 0.46 / 0.45 / +2.4%
polarsignals_q04/datafusion:vortex-file-compressed 9769616 / 9581426 / +2.0% 49357753 / 48475352 / +1.8% 0.20 / 0.20 / +0.1%
polarsignals_q05/datafusion:vortex-file-compressed 12176543 / 11814291 / +3.1% 54776159 / 53815151 / +1.8% 0.22 / 0.22 / +1.3%
polarsignals_q06/datafusion:vortex-file-compressed 21426334 / 21462794 / -0.2% 62017978 / 62848646 / -1.3% 0.35 / 0.34 / +1.2%
polarsignals_q07/datafusion:vortex-file-compressed 11391778 / 11502270 / -1.0% 53901850 / 52189174 / +3.3% 0.21 / 0.22 / -4.1%
polarsignals_q08/datafusion:vortex-file-compressed 97570207 / 97436432 / +0.1% 161779466 / 162705113 / -0.6% 0.60 / 0.60 / +0.7%
polarsignals_q09/datafusion:vortex-file-compressed 9872504 / 10088739 / -2.1% 50501388 / 47764314 / +5.7% 0.20 / 0.21 / -7.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 68fb80dc vs base a3e9d40e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 1.007x ➖ · cold 1.001x ➖
Parquet (geomean): hot 1.003x ➖ · cold 1.001x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16308050 / 16530859 / -1.3% 43156638 / 45074932 / -4.3% 0.38 / 0.37 / +3.0%
tpch_q02/datafusion:vortex-file-compressed 17520548 / 17446926 / +0.4% 35430528 / 36234198 / -2.2% 0.49 / 0.48 / +2.7%
tpch_q03/datafusion:vortex-file-compressed 19392512 / 19167512 / +1.2% 49605233 / 51441859 / -3.6% 0.39 / 0.37 / +4.9%
tpch_q04/datafusion:vortex-file-compressed 10328732 / 9910444 / +4.2% 31204454 / 31766924 / -1.8% 0.33 / 0.31 / +6.1%
tpch_q05/datafusion:vortex-file-compressed 37082422 / 36656374 / +1.2% 64441986 / 67108080 / -4.0% 0.58 / 0.55 / +5.3%
tpch_q06/datafusion:vortex-file-compressed 6298900 / 6126808 / +2.8% 28517202 / 27971909 / +1.9% 0.22 / 0.22 / +0.8%
tpch_q07/datafusion:vortex-file-compressed 51885244 / 51915884 / -0.1% 82057326 / 80487640 / +2.0% 0.63 / 0.65 / -2.0%
tpch_q08/datafusion:vortex-file-compressed 51988909 / 51930867 / +0.1% 79770655 / 79412832 / +0.5% 0.65 / 0.65 / -0.3%
tpch_q09/datafusion:vortex-file-compressed 49914886 / 49818326 / +0.2% 75709959 / 78404242 / -3.4% 0.66 / 0.64 / +3.8%
tpch_q10/datafusion:vortex-file-compressed 17011998 / 17129666 / -0.7% 48016368 / 46925224 / +2.3% 0.35 / 0.37 / -2.9%
tpch_q11/datafusion:vortex-file-compressed 15327319 / 15030321 / +2.0% 32692944 / 33725570 / -3.1% 0.47 / 0.45 / +5.2%
tpch_q12/datafusion:vortex-file-compressed 22689586 / 22949310 / -1.1% 44928268 / 47516407 / -5.4% 0.51 / 0.48 / +4.6%
tpch_q13/datafusion:vortex-file-compressed 19992472 / 19878435 / +0.6% 40402174 / 40572570 / -0.4% 0.49 / 0.49 / +1.0%
tpch_q14/datafusion:vortex-file-compressed 14990620 / 14961948 / +0.2% 37148718 / 38654389 / -3.9% 0.40 / 0.39 / +4.3%
tpch_q15/datafusion:vortex-file-compressed 18765385 / 18396342 / +2.0% 44010676 / 43702025 / +0.7% 0.43 / 0.42 / +1.3%
tpch_q16/datafusion:vortex-file-compressed 18652882 / 18486963 / +0.9% 36137419 / 38004954 / -4.9% 0.52 / 0.49 / +6.1%
tpch_q17/datafusion:vortex-file-compressed 28497497 / 27950329 / +2.0% 57481565 / 57595532 / -0.2% 0.50 / 0.49 / +2.2%
tpch_q18/datafusion:vortex-file-compressed 36725096 / 37199598 / -1.3% 57834993 / 55076254 / +5.0% 0.63 / 0.68 / -6.0%
tpch_q19/datafusion:vortex-file-compressed 13825967 / 13691901 / +1.0% 35198999 / 37790783 / -6.9% 0.39 / 0.36 / +8.4%
tpch_q20/datafusion:vortex-file-compressed 21049116 / 20948915 / +0.5% 45217770 / 44801666 / +0.9% 0.47 / 0.47 / -0.4%
tpch_q21/datafusion:vortex-file-compressed 40341458 / 39508262 / +2.1% 66789604 / 68469909 / -2.5% 0.60 / 0.58 / +4.7%
tpch_q22/datafusion:vortex-file-compressed 11217060 / 11418409 / -1.8% 31866292 / 32619023 / -2.3% 0.35 / 0.35 / +0.6%
datafusion / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67305239 / 67327366 / -0.0% 85599576 / 85814529 / -0.3% 0.79 / 0.78 / +0.2%
tpch_q02/datafusion:parquet 53803666 / 53390824 / +0.8% 70270084 / 70364368 / -0.1% 0.77 / 0.76 / +0.9%
tpch_q03/datafusion:parquet 72882813 / 71989181 / +1.2% 97764415 / 102020529 / -4.2% 0.75 / 0.71 / +5.6%
tpch_q04/datafusion:parquet 39880352 / 39382108 / +1.3% 58868926 / 61886318 / -4.9% 0.68 / 0.64 / +6.5%
tpch_q05/datafusion:parquet 88677578 / 88231773 / +0.5% 116959090 / 116186353 / +0.7% 0.76 / 0.76 / -0.2%
tpch_q06/datafusion:parquet 28279906 / 28032105 / +0.9% 47444521 / 47494174 / -0.1% 0.60 / 0.59 / +1.0%
tpch_q07/datafusion:parquet 97740372 / 95225252 / +2.6% 121368892 / 126390658 / -4.0% 0.81 / 0.75 / +6.9%
tpch_q08/datafusion:parquet 97699338 / 96536701 / +1.2% 125404154 / 126545631 / -0.9% 0.78 / 0.76 / +2.1%
tpch_q09/datafusion:parquet 114787298 / 114666734 / +0.1% 145175820 / 147837673 / -1.8% 0.79 / 0.78 / +1.9%
tpch_q10/datafusion:parquet 80060456 / 80045845 / +0.0% 110383175 / 111373205 / -0.9% 0.73 / 0.72 / +0.9%
tpch_q11/datafusion:parquet 39611919 / 39414776 / +0.5% 61648395 / 62639523 / -1.6% 0.64 / 0.63 / +2.1%
tpch_q12/datafusion:parquet 62587530 / 61895983 / +1.1% 87358385 / 85788972 / +1.8% 0.72 / 0.72 / -0.7%
tpch_q13/datafusion:parquet 159942633 / 158940084 / +0.6% 180505400 / 181758861 / -0.7% 0.89 / 0.87 / +1.3%
tpch_q14/datafusion:parquet 40086914 / 39426555 / +1.7% 65328023 / 66022894 / -1.1% 0.61 / 0.60 / +2.8%
tpch_q15/datafusion:parquet 46511216 / 46862262 / -0.7% 68001607 / 70691488 / -3.8% 0.68 / 0.66 / +3.2%
tpch_q16/datafusion:parquet 38329563 / 38380746 / -0.1% 56713281 / 57455499 / -1.3% 0.68 / 0.67 / +1.2%
tpch_q17/datafusion:parquet 116340459 / 116609932 / -0.2% 140861421 / 141690847 / -0.6% 0.83 / 0.82 / +0.4%
tpch_q18/datafusion:parquet 115564630 / 115290353 / +0.2% 134407944 / 134518153 / -0.1% 0.86 / 0.86 / +0.3%
tpch_q19/datafusion:parquet 49982465 / 49421300 / +1.1% 77329870 / 78833502 / -1.9% 0.65 / 0.63 / +3.1%
tpch_q20/datafusion:parquet 58842912 / 57668135 / +2.0% 83241035 / 81380717 / +2.3% 0.71 / 0.71 / -0.2%
tpch_q21/datafusion:parquet 98957139 / 98657186 / +0.3% 123007512 / 121330524 / +1.4% 0.80 / 0.81 / -1.1%
tpch_q22/datafusion:parquet 42345830 / 40615598 / +4.3% 59984340 / 56757113 / +5.7% 0.71 / 0.72 / -1.3%
duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 10732248 / 11765968 / -8.8% 22854120 / 23330575 / -2.0% 0.47 / 0.50 / -6.9%
tpch_q02/duckdb:vortex-file-compressed 17276269 / 17513808 / -1.4% 25404036 / 27241724 / -6.7% 0.68 / 0.64 / +5.8%
tpch_q03/duckdb:vortex-file-compressed 18391690 / 18479902 / -0.5% 39561135 / 33578919 / +17.8% 🔴 0.46 / 0.55 / -15.5%
tpch_q04/duckdb:vortex-file-compressed 17905705 / 17738790 / +0.9% 29436181 / 29704410 / -0.9% 0.61 / 0.60 / +1.9%
tpch_q05/duckdb:vortex-file-compressed 22667425 / 22200373 / +2.1% 33956277 / 33770340 / +0.6% 0.67 / 0.66 / +1.5%
tpch_q06/duckdb:vortex-file-compressed 6122380 / 5909826 / +3.6% 18338806 / 14911488 / +23.0% 🔴 0.33 / 0.40 / -15.8%
tpch_q07/duckdb:vortex-file-compressed 20654310 / 20139057 / +2.6% 37053427 / 37680590 / -1.7% 0.56 / 0.53 / +4.3%
tpch_q08/duckdb:vortex-file-compressed 23344896 / 24651911 / -5.3% 37546339 / 39075403 / -3.9% 0.62 / 0.63 / -1.4%
tpch_q09/duckdb:vortex-file-compressed 29773552 / 29498481 / +0.9% 48921712 / 45006588 / +8.7% 0.61 / 0.66 / -7.1%
tpch_q10/duckdb:vortex-file-compressed 29415265 / 28477533 / +3.3% 48187111 / 44744913 / +7.7% 0.61 / 0.64 / -4.1%
tpch_q11/duckdb:vortex-file-compressed 8642599 / 8018373 / +7.8% 13852064 / 15626764 / -11.4% 🟢 0.62 / 0.51 / +21.6%
tpch_q12/duckdb:vortex-file-compressed 17558646 / 16737394 / +4.9% 34425929 / 30114485 / +14.3% 🔴 0.51 / 0.56 / -8.2%
tpch_q13/duckdb:vortex-file-compressed 21658426 / 22068722 / -1.9% 44660561 / 39639273 / +12.7% 🔴 0.48 / 0.56 / -12.9%
tpch_q14/duckdb:vortex-file-compressed 13180001 / 13354071 / -1.3% 24023180 / 24856079 / -3.4% 0.55 / 0.54 / +2.1%
tpch_q15/duckdb:vortex-file-compressed 9746837 / 9490949 / +2.7% 19476830 / 18052096 / +7.9% 0.50 / 0.53 / -4.8%
tpch_q16/duckdb:vortex-file-compressed 18431521 / 18304675 / +0.7% 24752422 / 25487475 / -2.9% 0.74 / 0.72 / +3.7%
tpch_q17/duckdb:vortex-file-compressed 16033958 / 14820907 / +8.2% 37110534 / 31143772 / +19.2% 🔴 0.43 / 0.48 / -9.2%
tpch_q18/duckdb:vortex-file-compressed 25034010 / 25401520 / -1.4% 35048543 / 35072834 / -0.1% 0.71 / 0.72 / -1.4%
tpch_q19/duckdb:vortex-file-compressed 23701283 / 23836947 / -0.6% 37221330 / 38048158 / -2.2% 0.64 / 0.63 / +1.6%
tpch_q20/duckdb:vortex-file-compressed 17500317 / 17309107 / +1.1% 35616680 / 35326560 / +0.8% 0.49 / 0.49 / +0.3%
tpch_q21/duckdb:vortex-file-compressed 67658162 / 68800907 / -1.7% 85069325 / 84428498 / +0.8% 0.80 / 0.81 / -2.4%
tpch_q22/duckdb:vortex-file-compressed 12146488 / 12023874 / +1.0% 20078840 / 26053843 / -22.9% 🟢 0.60 / 0.46 / +31.1%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60125973 / 60252804 / -0.2% 67144354 / 66728750 / +0.6% 0.90 / 0.90 / -0.8%
tpch_q02/duckdb:parquet 34663587 / 34908117 / -0.7% 43829134 / 43991550 / -0.4% 0.79 / 0.79 / -0.3%
tpch_q03/duckdb:parquet 62057842 / 62363680 / -0.5% 74065575 / 73354688 / +1.0% 0.84 / 0.85 / -1.4%
tpch_q04/duckdb:parquet 43156860 / 43345711 / -0.4% 52988382 / 53230763 / -0.5% 0.81 / 0.81 / +0.0%
tpch_q05/duckdb:parquet 63275781 / 61060826 / +3.6% 75488008 / 72502180 / +4.1% 0.84 / 0.84 / -0.5%
tpch_q06/duckdb:parquet 20148804 / 20018991 / +0.6% 27122449 / 24291647 / +11.7% 🔴 0.74 / 0.82 / -9.9%
tpch_q07/duckdb:parquet 60812896 / 61009007 / -0.3% 72086279 / 72059989 / +0.0% 0.84 / 0.85 / -0.4%
tpch_q08/duckdb:parquet 73228117 / 73311268 / -0.1% 85698633 / 86445961 / -0.9% 0.85 / 0.85 / +0.8%
tpch_q09/duckdb:parquet 113726978 / 116632926 / -2.5% 126984147 / 126887144 / +0.1% 0.90 / 0.92 / -2.6%
tpch_q10/duckdb:parquet 108672174 / 108439685 / +0.2% 121979377 / 122041972 / -0.1% 0.89 / 0.89 / +0.3%
tpch_q11/duckdb:parquet 20167231 / 20019756 / +0.7% 26576617 / 24578381 / +8.1% 0.76 / 0.81 / -6.8%
tpch_q12/duckdb:parquet 41360794 / 41335316 / +0.1% 49072268 / 49457106 / -0.8% 0.84 / 0.84 / +0.8%
tpch_q13/duckdb:parquet 237658700 / 239058864 / -0.6% 247324027 / 247799147 / -0.2% 0.96 / 0.96 / -0.4%
tpch_q14/duckdb:parquet 43597113 / 43563688 / +0.1% 51501145 / 52418913 / -1.8% 0.85 / 0.83 / +1.9%
tpch_q15/duckdb:parquet 24819733 / 24964505 / -0.6% 31321734 / 31320665 / +0.0% 0.79 / 0.80 / -0.6%
tpch_q16/duckdb:parquet 50057922 / 50112727 / -0.1% 58824337 / 57453801 / +2.4% 0.85 / 0.87 / -2.4%
tpch_q17/duckdb:parquet 44527191 / 44555919 / -0.1% 54188660 / 54357458 / -0.3% 0.82 / 0.82 / +0.2%
tpch_q18/duckdb:parquet 90333762 / 90536075 / -0.2% 102332339 / 100541734 / +1.8% 0.88 / 0.90 / -2.0%
tpch_q19/duckdb:parquet 61091332 / 61152500 / -0.1% 70888000 / 70819062 / +0.1% 0.86 / 0.86 / -0.2%
tpch_q20/duckdb:parquet 58558669 / 61034689 / -4.1% 70882089 / 74348513 / -4.7% 0.83 / 0.82 / +0.6%
tpch_q21/duckdb:parquet 136920093 / 136501571 / +0.3% 147805829 / 147503609 / +0.2% 0.93 / 0.93 / +0.1%
tpch_q22/duckdb:parquet 50374362 / 50256806 / +0.2% 57998229 / 57844996 / +0.3% 0.87 / 0.87 / -0.0%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 68fb80dc vs base a3e9d40e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-1.7%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.006x ➖
Parquet (geomean): hot 1.014x ➖ · cold 0.985x ➖
Shifts: Parquet (control) +1.4% · Median polish +1.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 7097844 / 6797058 / +4.4% 20517705 / 23089082 / -11.1% 🟢 0.35 / 0.29 / +17.5%
fineweb_q01/datafusion:vortex-file-compressed 12007839 / 12484778 / -3.8% 46431953 / 46398649 / +0.1% 0.26 / 0.27 / -3.9%
fineweb_q02/datafusion:vortex-file-compressed 12633264 / 12220298 / +3.4% 53418494 / 52889604 / +1.0% 0.24 / 0.23 / +2.4%
fineweb_q03/datafusion:vortex-file-compressed 20095702 / 20337156 / -1.2% 101089350 / 111659106 / -9.5% 0.20 / 0.18 / +9.1%
fineweb_q04/datafusion:vortex-file-compressed 76625088 / 77016915 / -0.5% 155125380 / 168765319 / -8.1% 0.49 / 0.46 / +8.2%
fineweb_q05/datafusion:vortex-file-compressed 60147920 / 61109366 / -1.6% 135603553 / 138218553 / -1.9% 0.44 / 0.44 / +0.3%
fineweb_q06/datafusion:vortex-file-compressed 19827976 / 18947872 / +4.6% 101591664 / 112061521 / -9.3% 0.20 / 0.17 / +15.4%
fineweb_q07/datafusion:vortex-file-compressed 18645552 / 17493076 / +6.6% 111898115 / 110545979 / +1.2% 0.17 / 0.16 / +5.3%
fineweb_q08/datafusion:vortex-file-compressed 11046376 / 11059144 / -0.1% 46256200 / 48588972 / -4.8% 0.24 / 0.23 / +4.9%
datafusion / parquet / ns (1.013x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9693990 / 9407380 / +3.0% 32453505 / 34803017 / -6.8% 0.30 / 0.27 / +10.5%
fineweb_q01/datafusion:parquet 74888719 / 73933500 / +1.3% 148945036 / 159970671 / -6.9% 0.50 / 0.46 / +8.8%
fineweb_q02/datafusion:parquet 75629248 / 74192203 / +1.9% 148176113 / 162075353 / -8.6% 0.51 / 0.46 / +11.5%
fineweb_q03/datafusion:parquet 74954828 / 75511218 / -0.7% 145232532 / 157146875 / -7.6% 0.52 / 0.48 / +7.4%
fineweb_q04/datafusion:parquet 83653576 / 82518815 / +1.4% 145455518 / 157620632 / -7.7% 0.58 / 0.52 / +9.9%
fineweb_q05/datafusion:parquet 80942222 / 80043089 / +1.1% 144504658 / 158717844 / -9.0% 0.56 / 0.50 / +11.1%
fineweb_q06/datafusion:parquet 75355142 / 73809234 / +2.1% 151681770 / 165199872 / -8.2% 0.50 / 0.45 / +11.2%
fineweb_q07/datafusion:parquet 74975302 / 74556658 / +0.6% 145747092 / 151673163 / -3.9% 0.51 / 0.49 / +4.7%
fineweb_q08/datafusion:parquet 73815194 / 73352006 / +0.6% 146260597 / 155940526 / -6.2% 0.50 / 0.47 / +7.3%
duckdb / vortex-file-compressed / ns (0.998x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 1961581 / 2065274 / -5.0% 5625228 / 4824774 / +16.6% 🔴 0.35 / 0.43 / -18.5%
fineweb_q01/duckdb:vortex-file-compressed 21508710 / 24834914 / -13.4% 🟢 54111372 / 57722962 / -6.3% 0.40 / 0.43 / -7.6%
fineweb_q02/duckdb:vortex-file-compressed 19185063 / 21777903 / -11.9% 🟢 60454698 / 50557735 / +19.6% 🔴 0.32 / 0.43 / -26.3%
fineweb_q03/duckdb:vortex-file-compressed 27398480 / 27250206 / +0.5% 119436144 / 118677278 / +0.6% 0.23 / 0.23 / -0.1%
fineweb_q04/duckdb:vortex-file-compressed 80501893 / 74748860 / +7.7% 113632404 / 114429897 / -0.7% 0.71 / 0.65 / +8.5%
fineweb_q05/duckdb:vortex-file-compressed 65746949 / 60552247 / +8.6% 144307203 / 129131645 / +11.8% 🔴 0.46 / 0.47 / -2.8%
fineweb_q06/duckdb:vortex-file-compressed 40134394 / 41652160 / -3.6% 134240007 / 115337039 / +16.4% 🔴 0.30 / 0.36 / -17.2%
fineweb_q07/duckdb:vortex-file-compressed 33488024 / 30352555 / +10.3% 🔴 112232905 / 115768885 / -3.1% 0.30 / 0.26 / +13.8%
fineweb_q08/duckdb:vortex-file-compressed 6682344 / 6149182 / +8.7% 14384497 / 13534149 / +6.3% 0.46 / 0.45 / +2.2%
duckdb / parquet / ns (1.016x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23917540 / 21838956 / +9.5% 26120170 / 22579978 / +15.7% 🔴 0.92 / 0.97 / -5.3%
fineweb_q01/duckdb:parquet 44913612 / 44595887 / +0.7% 55137079 / 54083319 / +1.9% 0.81 / 0.82 / -1.2%
fineweb_q02/duckdb:parquet 43926046 / 43240156 / +1.6% 54248793 / 52046788 / +4.2% 0.81 / 0.83 / -2.5%
fineweb_q03/duckdb:parquet 94465596 / 93859072 / +0.6% 190439532 / 170874529 / +11.4% 🔴 0.50 / 0.55 / -9.7%
fineweb_q04/duckdb:parquet 152277086 / 149992559 / +1.5% 212799305 / 203981643 / +4.3% 0.72 / 0.74 / -2.7%
fineweb_q05/duckdb:parquet 146976058 / 142058840 / +3.5% 200261741 / 195900697 / +2.2% 0.73 / 0.73 / +1.2%
fineweb_q06/duckdb:parquet 70483805 / 70692325 / -0.3% 115670255 / 121198626 / -4.6% 0.61 / 0.58 / +4.5%
fineweb_q07/duckdb:parquet 73267665 / 71369805 / +2.7% 155837525 / 150612711 / +3.5% 0.47 / 0.47 / -0.8%
fineweb_q08/duckdb:parquet 23891203 / 25177616 / -5.1% 27342699 / 26354583 / +3.7% 0.87 / 0.96 / -8.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 68fb80dc vs base a3e9d40e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.3%
Engines: DataFusion No clear signal (-1.9%, low confidence) · DuckDB No clear signal (-2.7%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.000x ➖
Parquet (geomean): hot 1.019x ➖ · cold 1.004x ➖
Shifts: Parquet (control) +1.9% · Median polish +1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 185349748 / 177189990 / +4.6% 540957467 / 581757559 / -7.0% 0.34 / 0.30 / +12.5%
clickbench-sorted_q24/datafusion:vortex-file-compressed 11105772 / 11067995 / +0.3% 47214043 / 49043837 / -3.7% 0.24 / 0.23 / +4.2%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11937992 / 11552021 / +3.3% 49837408 / 49587536 / +0.5% 0.24 / 0.23 / +2.8%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23324242 / 23738589 / -1.7% 69088475 / 62819155 / +10.0% 0.34 / 0.38 / -10.7%
clickbench-sorted_q37/datafusion:vortex-file-compressed 17719264 / 18686422 / -5.2% 58626939 / 56700620 / +3.4% 0.30 / 0.33 / -8.3%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17418868 / 17216392 / +1.2% 58173441 / 57729267 / +0.8% 0.30 / 0.30 / +0.4%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40324866 / 40903864 / -1.4% 89037566 / 89569374 / -0.6% 0.45 / 0.46 / -0.8%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12424598 / 12086076 / +2.8% 42418439 / 42142773 / +0.7% 0.29 / 0.29 / +2.1%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11795380 / 12508800 / -5.7% 43416953 / 41784676 / +3.9% 0.27 / 0.30 / -9.2%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9855668 / 10026056 / -1.7% 35916406 / 36197350 / -0.8% 0.27 / 0.28 / -0.9%
datafusion / parquet / ns (1.015x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 760595094 / 755953682 / +0.6% 956904369 / 977546510 / -2.1% 0.79 / 0.77 / +2.8%
clickbench-sorted_q24/datafusion:parquet 8723996 / 8528804 / +2.3% 72276751 / 74195262 / -2.6% 0.12 / 0.11 / +5.0%
clickbench-sorted_q26/datafusion:parquet 9386437 / 8987784 / +4.4% 73445551 / 72271640 / +1.6% 0.13 / 0.12 / +2.8%
clickbench-sorted_q36/datafusion:parquet 94192349 / 93291458 / +1.0% 169792221 / 171264871 / -0.9% 0.55 / 0.54 / +1.8%
clickbench-sorted_q37/datafusion:parquet 64929332 / 63842156 / +1.7% 132074895 / 131487312 / +0.4% 0.49 / 0.49 / +1.3%
clickbench-sorted_q38/datafusion:parquet 88182656 / 87197213 / +1.1% 164531935 / 154930569 / +6.2% 0.54 / 0.56 / -4.8%
clickbench-sorted_q39/datafusion:parquet 160631779 / 159300322 / +0.8% 236889597 / 231877282 / +2.2% 0.68 / 0.69 / -1.3%
clickbench-sorted_q40/datafusion:parquet 44717241 / 44225582 / +1.1% 114730766 / 111130173 / +3.2% 0.39 / 0.40 / -2.1%
clickbench-sorted_q41/datafusion:parquet 42480708 / 41591958 / +2.1% 112861940 / 108645228 / +3.9% 0.38 / 0.38 / -1.7%
clickbench-sorted_q42/datafusion:parquet 26272444 / 26215738 / +0.2% 89084023 / 87191031 / +2.2% 0.29 / 0.30 / -1.9%
duckdb / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 57788761 / 61602635 / -6.2% 81195856 / 89996303 / -9.8% 0.71 / 0.68 / +4.0%
clickbench-sorted_q24/duckdb:vortex-file-compressed 18575214 / 20671646 / -10.1% 🟢 29807145 / 38026427 / -21.6% 🟢 0.62 / 0.54 / +14.6%
clickbench-sorted_q26/duckdb:vortex-file-compressed 14423367 / 15799067 / -8.7% 26034836 / 24129883 / +7.9% 0.55 / 0.65 / -15.4%
clickbench-sorted_q36/duckdb:vortex-file-compressed 31006352 / 29286456 / +5.9% 66174554 / 65209186 / +1.5% 0.47 / 0.45 / +4.3%
clickbench-sorted_q37/duckdb:vortex-file-compressed 27161224 / 24814920 / +9.5% 55940467 / 51927729 / +7.7% 0.49 / 0.48 / +1.6%
clickbench-sorted_q38/duckdb:vortex-file-compressed 26539243 / 25560216 / +3.8% 55162162 / 58264668 / -5.3% 0.48 / 0.44 / +9.7%
clickbench-sorted_q39/duckdb:vortex-file-compressed 47806912 / 48625068 / -1.7% 93006336 / 92118290 / +1.0% 0.51 / 0.53 / -2.6%
clickbench-sorted_q40/duckdb:vortex-file-compressed 15970560 / 15231326 / +4.9% 38044918 / 36692571 / +3.7% 0.42 / 0.42 / +1.1%
clickbench-sorted_q41/duckdb:vortex-file-compressed 16154063 / 15808710 / +2.2% 38325692 / 35641459 / +7.5% 0.42 / 0.44 / -5.0%
clickbench-sorted_q42/duckdb:vortex-file-compressed 12615834 / 12982071 / -2.8% 31274874 / 29603774 / +5.6% 0.40 / 0.44 / -8.0%
duckdb / parquet / ns (1.023x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 126929436 / 122013976 / +4.0% 142693814 / 133593071 / +6.8% 0.89 / 0.91 / -2.6%
clickbench-sorted_q24/duckdb:parquet 17993788 / 17499203 / +2.8% 25464630 / 30260092 / -15.8% 🟢 0.71 / 0.58 / +22.2%
clickbench-sorted_q26/duckdb:parquet 12883750 / 13000482 / -0.9% 25102922 / 24365954 / +3.0% 0.51 / 0.53 / -3.8%
clickbench-sorted_q36/duckdb:parquet 44282572 / 42957688 / +3.1% 67638919 / 59328508 / +14.0% 🔴 0.65 / 0.72 / -9.6%
clickbench-sorted_q37/duckdb:parquet 32471160 / 30001834 / +8.2% 45753658 / 44256451 / +3.4% 0.71 / 0.68 / +4.7%
clickbench-sorted_q38/duckdb:parquet 40031223 / 40359928 / -0.8% 54411665 / 55545192 / -2.0% 0.74 / 0.73 / +1.3%
clickbench-sorted_q39/duckdb:parquet 73363108 / 69318930 / +5.8% 89194173 / 87506654 / +1.9% 0.82 / 0.79 / +3.8%
clickbench-sorted_q40/duckdb:parquet 18172413 / 17431560 / +4.3% 36099799 / 36126022 / -0.1% 0.50 / 0.48 / +4.3%
clickbench-sorted_q41/duckdb:parquet 17700390 / 18081311 / -2.1% 34555943 / 36390942 / -5.0% 0.51 / 0.50 / +3.1%
clickbench-sorted_q42/duckdb:parquet 10978735 / 11108582 / -1.2% 24413435 / 26593394 / -8.2% 0.45 / 0.42 / +7.7%

File Size Changes (100 files changed, -0.0% overall, 45↑ 55↓)
File Scale Format Base HEAD Change %
hits_086.vortex 1.0 vortex-file-compressed 191.76 MB 195.32 MB +3.56 MB +1.9%
hits_027.vortex 1.0 vortex-file-compressed 189.47 MB 191.54 MB +2.07 MB +1.1%
hits_012.vortex 1.0 vortex-file-compressed 190.72 MB 192.65 MB +1.93 MB +1.0%
hits_056.vortex 1.0 vortex-file-compressed 135.09 MB 136.08 MB +1017.28 KB +0.7%
hits_064.vortex 1.0 vortex-file-compressed 190.38 MB 191.62 MB +1.24 MB +0.6%
hits_071.vortex 1.0 vortex-file-compressed 139.29 MB 140.08 MB +808.12 KB +0.6%
hits_072.vortex 1.0 vortex-file-compressed 101.87 MB 102.08 MB +215.29 KB +0.2%
hits_093.vortex 1.0 vortex-file-compressed 130.79 MB 130.97 MB +185.53 KB +0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.61 MB 100.74 MB +132.31 KB +0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.53 MB 130.69 MB +163.47 KB +0.1%
hits_004.vortex 1.0 vortex-file-compressed 130.58 MB 130.73 MB +153.93 KB +0.1%
hits_038.vortex 1.0 vortex-file-compressed 189.55 MB 189.74 MB +202.20 KB +0.1%
hits_077.vortex 1.0 vortex-file-compressed 172.88 MB 173.02 MB +146.05 KB +0.1%
hits_073.vortex 1.0 vortex-file-compressed 172.95 MB 173.08 MB +129.73 KB +0.1%
hits_025.vortex 1.0 vortex-file-compressed 172.23 MB 172.35 MB +121.46 KB +0.1%
hits_008.vortex 1.0 vortex-file-compressed 139.42 MB 139.51 MB +97.17 KB +0.1%
hits_014.vortex 1.0 vortex-file-compressed 172.67 MB 172.78 MB +117.08 KB +0.1%
hits_054.vortex 1.0 vortex-file-compressed 147.23 MB 147.32 MB +93.44 KB +0.1%
hits_043.vortex 1.0 vortex-file-compressed 126.72 MB 126.79 MB +68.71 KB +0.1%
hits_082.vortex 1.0 vortex-file-compressed 139.15 MB 139.22 MB +73.64 KB +0.1%
hits_085.vortex 1.0 vortex-file-compressed 200.67 MB 200.77 MB +101.82 KB +0.0%
hits_028.vortex 1.0 vortex-file-compressed 152.23 MB 152.30 MB +68.20 KB +0.0%
hits_009.vortex 1.0 vortex-file-compressed 100.99 MB 101.03 MB +44.18 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.89 MB 171.96 MB +72.09 KB +0.0%
hits_096.vortex 1.0 vortex-file-compressed 200.38 MB 200.46 MB +82.35 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.59 MB 126.64 MB +49.18 KB +0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.64 MB 130.68 MB +45.35 KB +0.0%
hits_088.vortex 1.0 vortex-file-compressed 172.81 MB 172.86 MB +57.95 KB +0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.12 MB 131.16 MB +40.66 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 178.07 MB 178.12 MB +49.35 KB +0.0%
hits_059.vortex 1.0 vortex-file-compressed 200.36 MB 200.41 MB +53.78 KB +0.0%
hits_062.vortex 1.0 vortex-file-compressed 171.24 MB 171.28 MB +45.38 KB +0.0%
hits_087.vortex 1.0 vortex-file-compressed 161.60 MB 161.64 MB +41.65 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.59 MB 161.63 MB +35.42 KB +0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.78 MB 153.81 MB +29.19 KB +0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.21 MB 156.24 MB +27.65 KB +0.0%
hits_090.vortex 1.0 vortex-file-compressed 192.22 MB 192.25 MB +33.96 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.35 MB 147.37 MB +24.88 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.61 MB 161.64 MB +27.07 KB +0.0%
hits_051.vortex 1.0 vortex-file-compressed 172.84 MB 172.87 MB +27.44 KB +0.0%
hits_092.vortex 1.0 vortex-file-compressed 200.58 MB 200.60 MB +20.52 KB +0.0%
hits_060.vortex 1.0 vortex-file-compressed 192.81 MB 192.82 MB +12.27 KB +0.0%
hits_063.vortex 1.0 vortex-file-compressed 130.73 MB 130.73 MB +5.62 KB +0.0%
hits_023.vortex 1.0 vortex-file-compressed 194.89 MB 194.90 MB +5.06 KB +0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.61 MB 192.62 MB +1.16 KB +0.0%
hits_033.vortex 1.0 vortex-file-compressed 200.95 MB 200.95 MB 240 B -0.0%
hits_098.vortex 1.0 vortex-file-compressed 137.63 MB 137.63 MB 4.89 KB -0.0%
hits_036.vortex 1.0 vortex-file-compressed 172.02 MB 172.02 MB 6.64 KB -0.0%
hits_029.vortex 1.0 vortex-file-compressed 200.92 MB 200.91 MB 10.59 KB -0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.10 MB 189.09 MB 13.83 KB -0.0%
hits_018.vortex 1.0 vortex-file-compressed 200.85 MB 200.84 MB 16.22 KB -0.0%
hits_058.vortex 1.0 vortex-file-compressed 154.41 MB 154.40 MB 13.71 KB -0.0%
hits_016.vortex 1.0 vortex-file-compressed 179.92 MB 179.90 MB 18.85 KB -0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.80 MB 159.77 MB 26.03 KB -0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.12 MB 159.09 MB 31.77 KB -0.0%
hits_041.vortex 1.0 vortex-file-compressed 130.32 MB 130.29 MB 26.45 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.48 MB 130.45 MB 28.35 KB -0.0%
hits_053.vortex 1.0 vortex-file-compressed 189.57 MB 189.53 MB 41.32 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.52 MB 136.49 MB 30.10 KB -0.0%
hits_032.vortex 1.0 vortex-file-compressed 154.05 MB 154.01 MB 36.10 KB -0.0%
hits_055.vortex 1.0 vortex-file-compressed 200.79 MB 200.73 MB 61.68 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 127.09 MB 127.05 MB 40.95 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.14 MB 191.08 MB 62.06 KB -0.0%
hits_010.vortex 1.0 vortex-file-compressed 169.01 MB 168.95 MB 59.82 KB -0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.61 MB 161.55 MB 61.79 KB -0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.84 MB 130.79 MB 53.66 KB -0.0%
hits_035.vortex 1.0 vortex-file-compressed 102.20 MB 102.15 MB 47.69 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.93 MB 161.84 MB 87.18 KB -0.1%
hits_024.vortex 1.0 vortex-file-compressed 161.25 MB 161.17 MB 87.18 KB -0.1%
hits_021.vortex 1.0 vortex-file-compressed 153.80 MB 153.71 MB 86.76 KB -0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.33 MB 130.25 MB 76.35 KB -0.1%
hits_074.vortex 1.0 vortex-file-compressed 200.29 MB 200.17 MB 120.30 KB -0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.23 MB 167.13 MB 103.12 KB -0.1%
hits_001.vortex 1.0 vortex-file-compressed 188.85 MB 188.73 MB 118.50 KB -0.1%
hits_034.vortex 1.0 vortex-file-compressed 181.76 MB 181.65 MB 115.05 KB -0.1%
hits_069.vortex 1.0 vortex-file-compressed 142.86 MB 142.76 MB 97.24 KB -0.1%
hits_044.vortex 1.0 vortex-file-compressed 201.10 MB 200.95 MB 150.12 KB -0.1%
hits_076.vortex 1.0 vortex-file-compressed 161.66 MB 161.52 MB 141.90 KB -0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.68 MB 153.55 MB 141.27 KB -0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.46 MB 160.31 MB 150.31 KB -0.1%
hits_007.vortex 1.0 vortex-file-compressed 201.37 MB 201.19 MB 191.15 KB -0.1%
hits_017.vortex 1.0 vortex-file-compressed 147.34 MB 147.19 MB 151.52 KB -0.1%
hits_022.vortex 1.0 vortex-file-compressed 200.14 MB 199.94 MB 207.83 KB -0.1%
hits_042.vortex 1.0 vortex-file-compressed 202.23 MB 202.02 MB 219.32 KB -0.1%
hits_081.vortex 1.0 vortex-file-compressed 201.24 MB 201.02 MB 223.98 KB -0.1%
hits_070.vortex 1.0 vortex-file-compressed 201.17 MB 200.91 MB 273.26 KB -0.1%
hits_052.vortex 1.0 vortex-file-compressed 130.29 MB 130.11 MB 178.38 KB -0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.23 MB 140.03 MB 202.55 KB -0.1%
hits_094.vortex 1.0 vortex-file-compressed 158.52 MB 158.25 MB 278.95 KB -0.2%
hits_015.vortex 1.0 vortex-file-compressed 130.53 MB 130.30 MB 230.70 KB -0.2%
hits_045.vortex 1.0 vortex-file-compressed 139.88 MB 139.44 MB 451.71 KB -0.3%
hits_011.vortex 1.0 vortex-file-compressed 200.16 MB 199.22 MB 970.65 KB -0.5%
hits_084.vortex 1.0 vortex-file-compressed 154.80 MB 153.97 MB 852.84 KB -0.5%
hits_048.vortex 1.0 vortex-file-compressed 200.76 MB 199.63 MB 1.13 MB -0.6%
hits_079.vortex 1.0 vortex-file-compressed 181.96 MB 180.90 MB 1.05 MB -0.6%
hits_040.vortex 1.0 vortex-file-compressed 145.00 MB 143.90 MB 1.10 MB -0.8%
hits_066.vortex 1.0 vortex-file-compressed 164.17 MB 162.89 MB 1.28 MB -0.8%
hits_013.vortex 1.0 vortex-file-compressed 161.85 MB 160.00 MB 1.85 MB -1.1%
hits_061.vortex 1.0 vortex-file-compressed 161.32 MB 159.42 MB 1.91 MB -1.2%
hits_020.vortex 1.0 vortex-file-compressed 160.18 MB 158.27 MB 1.91 MB -1.2%

Totals:

  • vortex-file-compressed: 15.96 GB → 15.96 GB (-0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 68fb80dc vs base a3e9d40e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Engines: DataFusion No clear signal (+1.3%, low confidence) · DuckDB No clear signal (+1.3%, low confidence)
Vortex (geomean): hot 1.021x ➖ · cold 0.993x ➖
Parquet (geomean): hot 1.008x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +0.8% · Median polish +1.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.019x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 95899416 / 94113765 / +1.9% 159183033 / 158727312 / +0.3% 0.60 / 0.59 / +1.6%
tpch_q02/datafusion:vortex-file-compressed 65118881 / 64307896 / +1.3% 93855397 / 97931225 / -4.2% 0.69 / 0.66 / +5.7%
tpch_q03/datafusion:vortex-file-compressed 64249664 / 62901001 / +2.1% 115169798 / 120833690 / -4.7% 0.56 / 0.52 / +7.2%
tpch_q04/datafusion:vortex-file-compressed 35534997 / 34746505 / +2.3% 77424648 / 78228483 / -1.0% 0.46 / 0.44 / +3.3%
tpch_q05/datafusion:vortex-file-compressed 118545950 / 117140568 / +1.2% 176368936 / 183915006 / -4.1% 0.67 / 0.64 / +5.5%
tpch_q06/datafusion:vortex-file-compressed 15060333 / 14442109 / +4.3% 64023578 / 76973206 / -16.8% 🟢 0.24 / 0.19 / +25.4%
tpch_q07/datafusion:vortex-file-compressed 140450760 / 138363156 / +1.5% 192602289 / 194262750 / -0.9% 0.73 / 0.71 / +2.4%
tpch_q08/datafusion:vortex-file-compressed 143035156 / 142574976 / +0.3% 203756438 / 218421078 / -6.7% 0.70 / 0.65 / +7.5%
tpch_q09/datafusion:vortex-file-compressed 209710673 / 183961384 / +14.0% 🔴 265019262 / 256992710 / +3.1% 0.79 / 0.72 / +10.5%
tpch_q10/datafusion:vortex-file-compressed 73601225 / 72781313 / +1.1% 139692652 / 136980849 / +2.0% 0.53 / 0.53 / -0.8%
tpch_q11/datafusion:vortex-file-compressed 43092017 / 43028725 / +0.1% 65157116 / 68797965 / -5.3% 0.66 / 0.63 / +5.7%
tpch_q12/datafusion:vortex-file-compressed 45548750 / 43814663 / +4.0% 88853333 / 90912494 / -2.3% 0.51 / 0.48 / +6.4%
tpch_q13/datafusion:vortex-file-compressed 46246658 / 46687935 / -0.9% 84350651 / 78855558 / +7.0% 0.55 / 0.59 / -7.4%
tpch_q14/datafusion:vortex-file-compressed 25851850 / 24791378 / +4.3% 101002786 / 100805776 / +0.2% 0.26 / 0.25 / +4.1%
tpch_q15/datafusion:vortex-file-compressed 36832034 / 37096832 / -0.7% 99603964 / 101277785 / -1.7% 0.37 / 0.37 / +1.0%
tpch_q16/datafusion:vortex-file-compressed 37405977 / 37021778 / +1.0% 66556591 / 66094749 / +0.7% 0.56 / 0.56 / +0.3%
tpch_q17/datafusion:vortex-file-compressed 178717836 / 172875169 / +3.4% 221855966 / 226116272 / -1.9% 0.81 / 0.76 / +5.4%
tpch_q18/datafusion:vortex-file-compressed 201928979 / 200956445 / +0.5% 260033734 / 266322703 / -2.4% 0.78 / 0.75 / +2.9%
tpch_q19/datafusion:vortex-file-compressed 34720332 / 34282654 / +1.3% 91252480 / 98251528 / -7.1% 0.38 / 0.35 / +9.0%
tpch_q20/datafusion:vortex-file-compressed 63124114 / 63062119 / +0.1% 115643237 / 127913090 / -9.6% 0.55 / 0.49 / +10.7%
tpch_q21/datafusion:vortex-file-compressed 179556109 / 180112657 / -0.3% 244713065 / 244225692 / +0.2% 0.73 / 0.74 / -0.5%
tpch_q22/datafusion:vortex-file-compressed 25551777 / 25547403 / +0.0% 51383355 / 56772585 / -9.5% 0.50 / 0.45 / +10.5%
datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83480550 / 82214783 / +1.5% 127441632 / 134354002 / -5.1% 0.66 / 0.61 / +7.0%
tpch_q02/datafusion:parquet 135996137 / 137316258 / -1.0% 161614001 / 167549202 / -3.5% 0.84 / 0.82 / +2.7%
tpch_q03/datafusion:parquet 126418208 / 125013199 / +1.1% 193157684 / 197537902 / -2.2% 0.65 / 0.63 / +3.4%
tpch_q04/datafusion:parquet 54067284 / 53744825 / +0.6% 98835091 / 104085758 / -5.0% 0.55 / 0.52 / +5.9%
tpch_q05/datafusion:parquet 164274963 / 164318681 / -0.0% 246030464 / 246017875 / +0.0% 0.67 / 0.67 / -0.0%
tpch_q06/datafusion:parquet 32455616 / 32058282 / +1.2% 80874415 / 86249488 / -6.2% 0.40 / 0.37 / +8.0%
tpch_q07/datafusion:parquet 217985981 / 213566806 / +2.1% 286486637 / 292537677 / -2.1% 0.76 / 0.73 / +4.2%
tpch_q08/datafusion:parquet 212007607 / 211157976 / +0.4% 293380121 / 294814609 / -0.5% 0.72 / 0.72 / +0.9%
tpch_q09/datafusion:parquet 282482806 / 284083975 / -0.6% 360806044 / 357282138 / +1.0% 0.78 / 0.80 / -1.5%
tpch_q10/datafusion:parquet 304350927 / 306869501 / -0.8% 366565993 / 367126945 / -0.2% 0.83 / 0.84 / -0.7%
tpch_q11/datafusion:parquet 97610827 / 97110205 / +0.5% 119570705 / 120644118 / -0.9% 0.82 / 0.80 / +1.4%
tpch_q12/datafusion:parquet 79455411 / 78602841 / +1.1% 132412440 / 128573495 / +3.0% 0.60 / 0.61 / -1.8%
tpch_q13/datafusion:parquet 196663613 / 194639019 / +1.0% 229509219 / 228484552 / +0.4% 0.86 / 0.85 / +0.6%
tpch_q14/datafusion:parquet 75050721 / 75605266 / -0.7% 194097482 / 194840576 / -0.4% 0.39 / 0.39 / -0.4%
tpch_q15/datafusion:parquet 79473278 / 78072539 / +1.8% 140316475 / 139742383 / +0.4% 0.57 / 0.56 / +1.4%
tpch_q16/datafusion:parquet 85185018 / 84671741 / +0.6% 107619201 / 110140772 / -2.3% 0.79 / 0.77 / +3.0%
tpch_q17/datafusion:parquet 204461742 / 203084333 / +0.7% 268394829 / 266799691 / +0.6% 0.76 / 0.76 / +0.1%
tpch_q18/datafusion:parquet 268814970 / 264017793 / +1.8% 317589667 / 316215287 / +0.4% 0.85 / 0.83 / +1.4%
tpch_q19/datafusion:parquet 98085074 / 98614029 / -0.5% 168622168 / 173977312 / -3.1% 0.58 / 0.57 / +2.6%
tpch_q20/datafusion:parquet 153720530 / 152947033 / +0.5% 214280602 / 213393591 / +0.4% 0.72 / 0.72 / +0.1%
tpch_q21/datafusion:parquet 235433062 / 231319508 / +1.8% 311874578 / 316242587 / -1.4% 0.75 / 0.73 / +3.2%
tpch_q22/datafusion:parquet 163489186 / 161887038 / +1.0% 182640814 / 184735444 / -1.1% 0.90 / 0.88 / +2.1%
duckdb / vortex-file-compressed / ns (1.024x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 54184838 / 52366336 / +3.5% 97157253 / 94892318 / +2.4% 0.56 / 0.55 / +1.1%
tpch_q02/duckdb:vortex-file-compressed 31942460 / 32780072 / -2.6% 47198748 / 46909830 / +0.6% 0.68 / 0.70 / -3.2%
tpch_q03/duckdb:vortex-file-compressed 57564178 / 57914610 / -0.6% 102852239 / 107750792 / -4.5% 0.56 / 0.54 / +4.1%
tpch_q04/duckdb:vortex-file-compressed 79721527 / 79403647 / +0.4% 116248997 / 114359761 / +1.7% 0.69 / 0.69 / -1.2%
tpch_q05/duckdb:vortex-file-compressed 66502521 / 64622317 / +2.9% 117771455 / 117761037 / +0.0% 0.56 / 0.55 / +2.9%
tpch_q06/duckdb:vortex-file-compressed 21030064 / 21385366 / -1.7% 60442444 / 60740765 / -0.5% 0.35 / 0.35 / -1.2%
tpch_q07/duckdb:vortex-file-compressed 61610897 / 59589270 / +3.4% 124120092 / 126494397 / -1.9% 0.50 / 0.47 / +5.4%
tpch_q08/duckdb:vortex-file-compressed 85045932 / 85867632 / -1.0% 143993345 / 144036771 / -0.0% 0.59 / 0.60 / -0.9%
tpch_q09/duckdb:vortex-file-compressed 167436776 / 164914198 / +1.5% 237605960 / 238098202 / -0.2% 0.70 / 0.69 / +1.7%
tpch_q10/duckdb:vortex-file-compressed 115045914 / 114220081 / +0.7% 190793088 / 187036086 / +2.0% 0.60 / 0.61 / -1.3%
tpch_q11/duckdb:vortex-file-compressed 19154207 / 16162533 / +18.5% 🔴 32975637 / 30644135 / +7.6% 0.58 / 0.53 / +10.1%
tpch_q12/duckdb:vortex-file-compressed 55414012 / 53547756 / +3.5% 98116955 / 99992912 / -1.9% 0.56 / 0.54 / +5.5%
tpch_q13/duckdb:vortex-file-compressed 91376348 / 89803959 / +1.8% 136543362 / 136001057 / +0.4% 0.67 / 0.66 / +1.3%
tpch_q14/duckdb:vortex-file-compressed 32145162 / 32076120 / +0.2% 77349360 / 83250913 / -7.1% 0.42 / 0.39 / +7.9%
tpch_q15/duckdb:vortex-file-compressed 41104094 / 38974895 / +5.5% 90952448 / 84585801 / +7.5% 0.45 / 0.46 / -1.9%
tpch_q16/duckdb:vortex-file-compressed 42328332 / 42173543 / +0.4% 52722462 / 53969938 / -2.3% 0.80 / 0.78 / +2.7%
tpch_q17/duckdb:vortex-file-compressed 77043360 / 73678472 / +4.6% 153326937 / 153079676 / +0.2% 0.50 / 0.48 / +4.4%
tpch_q18/duckdb:vortex-file-compressed 135473131 / 131320686 / +3.2% 162152320 / 159995569 / +1.3% 0.84 / 0.82 / +1.8%
tpch_q19/duckdb:vortex-file-compressed 50658366 / 49539000 / +2.3% 124706141 / 109123467 / +14.3% 🔴 0.41 / 0.45 / -10.5%
tpch_q20/duckdb:vortex-file-compressed 61038336 / 59009064 / +3.4% 120447726 / 110341450 / +9.2% 0.51 / 0.53 / -5.2%
tpch_q21/duckdb:vortex-file-compressed 240052035 / 239492725 / +0.2% 287638335 / 279929273 / +2.8% 0.83 / 0.86 / -2.5%
tpch_q22/duckdb:vortex-file-compressed 41504014 / 39986792 / +3.8% 62191233 / 57800255 / +7.6% 0.67 / 0.69 / -3.5%
duckdb / parquet / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70535240 / 69944627 / +0.8% 101920402 / 87461425 / +16.5% 🔴 0.69 / 0.80 / -13.5%
tpch_q02/duckdb:parquet 70896045 / 70383675 / +0.7% 82524344 / 81162102 / +1.7% 0.86 / 0.87 / -0.9%
tpch_q03/duckdb:parquet 114629838 / 112104101 / +2.3% 154196399 / 146003852 / +5.6% 0.74 / 0.77 / -3.2%
tpch_q04/duckdb:parquet 74500876 / 73799747 / +1.0% 98557757 / 95226329 / +3.5% 0.76 / 0.77 / -2.5%
tpch_q05/duckdb:parquet 124809928 / 123543374 / +1.0% 174676831 / 160660571 / +8.7% 0.71 / 0.77 / -7.1%
tpch_q06/duckdb:parquet 34791139 / 34227037 / +1.6% 49187905 / 59560424 / -17.4% 🟢 0.71 / 0.57 / +23.1%
tpch_q07/duckdb:parquet 89660144 / 88513148 / +1.3% 129454529 / 127606407 / +1.4% 0.69 / 0.69 / -0.2%
tpch_q08/duckdb:parquet 142547822 / 141396383 / +0.8% 205299981 / 185278708 / +10.8% 🔴 0.69 / 0.76 / -9.0%
tpch_q09/duckdb:parquet 221911385 / 220953173 / +0.4% 270714444 / 265223468 / +2.1% 0.82 / 0.83 / -1.6%
tpch_q10/duckdb:parquet 471212214 / 469806157 / +0.3% 514608270 / 504419509 / +2.0% 0.92 / 0.93 / -1.7%
tpch_q11/duckdb:parquet 30652712 / 30284752 / +1.2% 37693795 / 37226636 / +1.3% 0.81 / 0.81 / -0.0%
tpch_q12/duckdb:parquet 75189512 / 75168886 / +0.0% 94435398 / 95196141 / -0.8% 0.80 / 0.79 / +0.8%
tpch_q13/duckdb:parquet 314831439 / 315488253 / -0.2% 331222754 / 325851721 / +1.6% 0.95 / 0.97 / -1.8%
tpch_q14/duckdb:parquet 106349309 / 104693479 / +1.6% 136580366 / 133231252 / +2.5% 0.78 / 0.79 / -0.9%
tpch_q15/duckdb:parquet 43895965 / 43329487 / +1.3% 67540148 / 66908275 / +0.9% 0.65 / 0.65 / +0.4%
tpch_q16/duckdb:parquet 114170846 / 113457681 / +0.6% 122905609 / 123807823 / -0.7% 0.93 / 0.92 / +1.4%
tpch_q17/duckdb:parquet 73074036 / 72958451 / +0.2% 105655874 / 104731200 / +0.9% 0.69 / 0.70 / -0.7%
tpch_q18/duckdb:parquet 204940867 / 199295812 / +2.8% 176312797 / 168880103 / +4.4% 1.16 / 1.18 / -1.5%
tpch_q19/duckdb:parquet 161320649 / 161168692 / +0.1% 202995854 / 191698315 / +5.9% 0.79 / 0.84 / -5.5%
tpch_q20/duckdb:parquet 128062572 / 128371465 / -0.2% 163254687 / 160690929 / +1.6% 0.78 / 0.80 / -1.8%
tpch_q21/duckdb:parquet 273364117 / 262798296 / +4.0% 315947636 / 289969881 / +9.0% 0.87 / 0.91 / -4.5%
tpch_q22/duckdb:parquet 262067160 / 259310125 / +1.1% 272810337 / 269619849 / +1.2% 0.96 / 0.96 / -0.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 68fb80dc vs base a3e9d40e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (-1.2%, low confidence)
Vortex (geomean): hot 1.017x ➖ · cold 1.039x ➖
Parquet (geomean): hot 1.020x ➖ · cold 1.038x ➖
Shifts: Parquet (control) +2.0% · Median polish +1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.018x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1250684 / 1203810 / +3.9% 22135671 / 20807861 / +6.4% 0.06 / 0.06 / -2.3%
clickbench_q01/datafusion:vortex-file-compressed 5954070 / 6218124 / -4.2% 34784590 / 30769447 / +13.0% 🔴 0.17 / 0.20 / -15.3%
clickbench_q02/datafusion:vortex-file-compressed 10942464 / 10125254 / +8.1% 37496127 / 36162367 / +3.7% 0.29 / 0.28 / +4.2%
clickbench_q03/datafusion:vortex-file-compressed 11647076 / 11024908 / +5.6% 55318917 / 53259294 / +3.9% 0.21 / 0.21 / +1.7%
clickbench_q04/datafusion:vortex-file-compressed 55197082 / 54263120 / +1.7% 92173944 / 91971908 / +0.2% 0.60 / 0.59 / +1.5%
clickbench_q05/datafusion:vortex-file-compressed 73716072 / 72096899 / +2.2% 117727980 / 114945547 / +2.4% 0.63 / 0.63 / -0.2%
clickbench_q06/datafusion:vortex-file-compressed 1263950 / 1227894 / +2.9% 21959036 / 20750679 / +5.8% 0.06 / 0.06 / -2.7%
clickbench_q07/datafusion:vortex-file-compressed 10018050 / 9744160 / +2.8% 37929396 / 33904268 / +11.9% 🔴 0.26 / 0.29 / -8.1%
clickbench_q08/datafusion:vortex-file-compressed 77579658 / 74625980 / +4.0% 120378691 / 116074821 / +3.7% 0.64 / 0.64 / +0.2%
clickbench_q09/datafusion:vortex-file-compressed 174444391 / 169868628 / +2.7% 208495800 / 202581721 / +2.9% 0.84 / 0.84 / -0.2%
clickbench_q10/datafusion:vortex-file-compressed 24852853 / 22878864 / +8.6% 68735405 / 66346320 / +3.6% 0.36 / 0.34 / +4.9%
clickbench_q11/datafusion:vortex-file-compressed 27566781 / 26696106 / +3.3% 71169534 / 67579571 / +5.3% 0.39 / 0.40 / -1.9%
clickbench_q12/datafusion:vortex-file-compressed 73006386 / 72387445 / +0.9% 116257035 / 110826187 / +4.9% 0.63 / 0.65 / -3.9%
clickbench_q13/datafusion:vortex-file-compressed 117787120 / 116987576 / +0.7% 184144016 / 176121469 / +4.6% 0.64 / 0.66 / -3.7%
clickbench_q14/datafusion:vortex-file-compressed 75179780 / 75284760 / -0.1% 120887039 / 116539384 / +3.7% 0.62 / 0.65 / -3.7%
clickbench_q15/datafusion:vortex-file-compressed 61787192 / 63254498 / -2.3% 98348214 / 95805003 / +2.7% 0.63 / 0.66 / -4.8%
clickbench_q16/datafusion:vortex-file-compressed 149363729 / 149695288 / -0.2% 210572590 / 201326711 / +4.6% 0.71 / 0.74 / -4.6%
clickbench_q17/datafusion:vortex-file-compressed 150358797 / 147344361 / +2.0% 214098233 / 202823150 / +5.6% 0.70 / 0.73 / -3.3%
clickbench_q18/datafusion:vortex-file-compressed 292718210 / 290488650 / +0.8% 384934287 / 384020481 / +0.2% 0.76 / 0.76 / +0.5%
clickbench_q19/datafusion:vortex-file-compressed 7860994 / 7600206 / +3.4% 48379233 / 47014043 / +2.9% 0.16 / 0.16 / +0.5%
clickbench_q20/datafusion:vortex-file-compressed 63095774 / 61489346 / +2.6% 229289970 / 229750324 / -0.2% 0.28 / 0.27 / +2.8%
clickbench_q21/datafusion:vortex-file-compressed 91230256 / 85271800 / +7.0% 272051642 / 270851495 / +0.4% 0.34 / 0.31 / +6.5%
clickbench_q22/datafusion:vortex-file-compressed 102614966 / 102064614 / +0.5% 344265232 / 346300001 / -0.6% 0.30 / 0.29 / +1.1%
clickbench_q23/datafusion:vortex-file-compressed 199066656 / 207106536 / -3.9% 529971393 / 529437475 / +0.1% 0.38 / 0.39 / -4.0%
clickbench_q24/datafusion:vortex-file-compressed 16113122 / 16194856 / -0.5% 65333364 / 61642790 / +6.0% 0.25 / 0.26 / -6.1%
clickbench_q25/datafusion:vortex-file-compressed 17845995 / 17487574 / +2.0% 58835728 / 56148325 / +4.8% 0.30 / 0.31 / -2.6%
clickbench_q26/datafusion:vortex-file-compressed 17129218 / 15831104 / +8.2% 66792893 / 62935092 / +6.1% 0.26 / 0.25 / +2.0%
clickbench_q27/datafusion:vortex-file-compressed 97421204 / 94011476 / +3.6% 256409929 / 238544563 / +7.5% 0.38 / 0.39 / -3.6%
clickbench_q28/datafusion:vortex-file-compressed 559600942 / 562483414 / -0.5% 618542368 / 617460788 / +0.2% 0.90 / 0.91 / -0.7%
clickbench_q29/datafusion:vortex-file-compressed 22854363 / 22875916 / -0.1% 50231267 / 49812751 / +0.8% 0.45 / 0.46 / -0.9%
clickbench_q30/datafusion:vortex-file-compressed 57556528 / 57994452 / -0.8% 109683914 / 107198607 / +2.3% 0.52 / 0.54 / -3.0%
clickbench_q31/datafusion:vortex-file-compressed 70533062 / 70091830 / +0.6% 151687823 / 149092989 / +1.7% 0.46 / 0.47 / -1.1%
clickbench_q32/datafusion:vortex-file-compressed 315590406 / 295837608 / +6.7% 386965799 / 379422598 / +2.0% 0.82 / 0.78 / +4.6%
clickbench_q33/datafusion:vortex-file-compressed 329766390 / 329672442 / +0.0% 422590115 / 416226086 / +1.5% 0.78 / 0.79 / -1.5%
clickbench_q34/datafusion:vortex-file-compressed 337636305 / 326535624 / +3.4% 440361522 / 417748654 / +5.4% 0.77 / 0.78 / -1.9%
clickbench_q35/datafusion:vortex-file-compressed 55657657 / 56754052 / -1.9% 90433345 / 84632308 / +6.9% 0.62 / 0.67 / -8.2%
clickbench_q36/datafusion:vortex-file-compressed 37215323 / 36760604 / +1.2% 66493941 / 64903977 / +2.4% 0.56 / 0.57 / -1.2%
clickbench_q37/datafusion:vortex-file-compressed 21866860 / 21693941 / +0.8% 48994905 / 46892154 / +4.5% 0.45 / 0.46 / -3.5%
clickbench_q38/datafusion:vortex-file-compressed 11766167 / 11697307 / +0.6% 41159790 / 39476802 / +4.3% 0.29 / 0.30 / -3.5%
clickbench_q39/datafusion:vortex-file-compressed 77964404 / 77859096 / +0.1% 111092379 / 109135098 / +1.8% 0.70 / 0.71 / -1.6%
clickbench_q40/datafusion:vortex-file-compressed 11314072 / 11218571 / +0.9% 38291054 / 35537799 / +7.7% 0.30 / 0.32 / -6.4%
clickbench_q41/datafusion:vortex-file-compressed 10577493 / 10555835 / +0.2% 36947688 / 35299479 / +4.7% 0.29 / 0.30 / -4.3%
clickbench_q42/datafusion:vortex-file-compressed 10850643 / 10605164 / +2.3% 36686443 / 35594702 / +3.1% 0.30 / 0.30 / -0.7%
datafusion / parquet / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1255068 / 1259136 / -0.3% 52810568 / 49654610 / +6.4% 0.02 / 0.03 / -6.3%
clickbench_q01/datafusion:parquet 16220718 / 16006051 / +1.3% 74897416 / 69024397 / +8.5% 0.22 / 0.23 / -6.6%
clickbench_q02/datafusion:parquet 18644394 / 18865067 / -1.2% 86112634 / 83548610 / +3.1% 0.22 / 0.23 / -4.1%
clickbench_q03/datafusion:parquet 17037000 / 16565450 / +2.8% 82483641 / 79641622 / +3.6% 0.21 / 0.21 / -0.7%
clickbench_q04/datafusion:parquet 62124312 / 62439942 / -0.5% 129199152 / 123720705 / +4.4% 0.48 / 0.50 / -4.7%
clickbench_q05/datafusion:parquet 89701582 / 88788904 / +1.0% 164508142 / 156027303 / +5.4% 0.55 / 0.57 / -4.2%
clickbench_q06/datafusion:parquet 1311229 / 1263744 / +3.8% 50596514 / 48732548 / +3.8% 0.03 / 0.03 / -0.1%
clickbench_q07/datafusion:parquet 16771738 / 16803128 / -0.2% 69305961 / 69155792 / +0.2% 0.24 / 0.24 / -0.4%
clickbench_q08/datafusion:parquet 88625535 / 85866228 / +3.2% 162452764 / 159351774 / +1.9% 0.55 / 0.54 / +1.2%
clickbench_q09/datafusion:parquet 190223534 / 188112161 / +1.1% 273188112 / 261898172 / +4.3% 0.70 / 0.72 / -3.1%
clickbench_q10/datafusion:parquet 36711120 / 35602360 / +3.1% 104563478 / 99348735 / +5.2% 0.35 / 0.36 / -2.0%
clickbench_q11/datafusion:parquet 42776717 / 42386618 / +0.9% 113164994 / 106158899 / +6.6% 0.38 / 0.40 / -5.3%
clickbench_q12/datafusion:parquet 96472447 / 96016788 / +0.5% 167216958 / 160689443 / +4.1% 0.58 / 0.60 / -3.4%
clickbench_q13/datafusion:parquet 149793018 / 148217538 / +1.1% 232012235 / 225465245 / +2.9% 0.65 / 0.66 / -1.8%
clickbench_q14/datafusion:parquet 101976136 / 101202307 / +0.8% 177097420 / 169632360 / +4.4% 0.58 / 0.60 / -3.5%
clickbench_q15/datafusion:parquet 73562548 / 72259010 / +1.8% 138717273 / 131360504 / +5.6% 0.53 / 0.55 / -3.6%
clickbench_q16/datafusion:parquet 155841516 / 155087352 / +0.5% 242490616 / 232919580 / +4.1% 0.64 / 0.67 / -3.5%
clickbench_q17/datafusion:parquet 157945692 / 158873116 / -0.6% 242499528 / 234712268 / +3.3% 0.65 / 0.68 / -3.8%
clickbench_q18/datafusion:parquet 319967230 / 314150996 / +1.9% 428450461 / 415970865 / +3.0% 0.75 / 0.76 / -1.1%
clickbench_q19/datafusion:parquet 19108296 / 18849186 / +1.4% 77540680 / 75986354 / +2.0% 0.25 / 0.25 / -0.7%
clickbench_q20/datafusion:parquet 178666693 / 179455707 / -0.4% 299267884 / 276423059 / +8.3% 0.60 / 0.65 / -8.0%
clickbench_q21/datafusion:parquet 175365793 / 172729932 / +1.5% 318049945 / 289480441 / +9.9% 0.55 / 0.60 / -7.6%
clickbench_q22/datafusion:parquet 263034370 / 256609998 / +2.5% 456672817 / 412240867 / +10.8% 🔴 0.58 / 0.62 / -7.5%
clickbench_q23/datafusion:parquet 1174353542 / 1142506846 / +2.8% 1240884816 / 1229376929 / +0.9% 0.95 / 0.93 / +1.8%
clickbench_q24/datafusion:parquet 30513628 / 29645155 / +2.9% 92629396 / 86573736 / +7.0% 0.33 / 0.34 / -3.8%
clickbench_q25/datafusion:parquet 36732824 / 36389316 / +0.9% 106192075 / 99090517 / +7.2% 0.35 / 0.37 / -5.8%
clickbench_q26/datafusion:parquet 30837999 / 29937228 / +3.0% 92311924 / 88448784 / +4.4% 0.33 / 0.34 / -1.3%
clickbench_q27/datafusion:parquet 193773850 / 192164174 / +0.8% 312572622 / 280178750 / +11.6% 🔴 0.62 / 0.69 / -9.6%
clickbench_q28/datafusion:parquet 626836362 / 619806040 / +1.1% 709997391 / 695326210 / +2.1% 0.88 / 0.89 / -1.0%
clickbench_q29/datafusion:parquet 29128241 / 29039416 / +0.3% 93133073 / 93395133 / -0.3% 0.31 / 0.31 / +0.6%
clickbench_q30/datafusion:parquet 91894242 / 90307382 / +1.8% 177054657 / 167385847 / +5.8% 0.52 / 0.54 / -3.8%
clickbench_q31/datafusion:parquet 102912913 / 102654244 / +0.3% 203566969 / 189362427 / +7.5% 0.51 / 0.54 / -6.7%
clickbench_q32/datafusion:parquet 323643252 / 330353936 / -2.0% 438127484 / 432815889 / +1.2% 0.74 / 0.76 / -3.2%
clickbench_q33/datafusion:parquet 381305840 / 377965780 / +0.9% 479043085 / 472679349 / +1.3% 0.80 / 0.80 / -0.5%
clickbench_q34/datafusion:parquet 385568640 / 381859031 / +1.0% 482231631 / 471822152 / +2.2% 0.80 / 0.81 / -1.2%
clickbench_q35/datafusion:parquet 62799238 / 63717296 / -1.4% 125721975 / 125891828 / -0.1% 0.50 / 0.51 / -1.3%
clickbench_q36/datafusion:parquet 73434515 / 72777374 / +0.9% 136575337 / 133919248 / +2.0% 0.54 / 0.54 / -1.1%
clickbench_q37/datafusion:parquet 35496922 / 35328517 / +0.5% 92426385 / 91747704 / +0.7% 0.38 / 0.39 / -0.3%
clickbench_q38/datafusion:parquet 47394363 / 47275787 / +0.3% 109484914 / 105956897 / +3.3% 0.43 / 0.45 / -3.0%
clickbench_q39/datafusion:parquet 144243996 / 143279750 / +0.7% 210825393 / 206150694 / +2.3% 0.68 / 0.70 / -1.6%
clickbench_q40/datafusion:parquet 20114246 / 19994926 / +0.6% 79905347 / 77328476 / +3.3% 0.25 / 0.26 / -2.6%
clickbench_q41/datafusion:parquet 18838896 / 18594767 / +1.3% 77475732 / 76859671 / +0.8% 0.24 / 0.24 / +0.5%
clickbench_q42/datafusion:parquet 19392308 / 19040886 / +1.8% 75048349 / 74827102 / +0.3% 0.26 / 0.25 / +1.5%
duckdb / vortex-file-compressed / ns (1.016x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1712318 / 1525383 / +12.3% 🔴 26323782 / 26310448 / +0.1% 0.07 / 0.06 / +12.2%
clickbench_q01/duckdb:vortex-file-compressed 13645966 / 12820614 / +6.4% 29485928 / 28855175 / +2.2% 0.46 / 0.44 / +4.2%
clickbench_q02/duckdb:vortex-file-compressed 13281990 / 15146794 / -12.3% 🟢 33406611 / 34136788 / -2.1% 0.40 / 0.44 / -10.4%
clickbench_q03/duckdb:vortex-file-compressed 17316303 / 18777368 / -7.8% 50729654 / 42978626 / +18.0% 🔴 0.34 / 0.44 / -21.9%
clickbench_q04/duckdb:vortex-file-compressed 69587423 / 67804569 / +2.6% 102215402 / 99392147 / +2.8% 0.68 / 0.68 / -0.2%
clickbench_q05/duckdb:vortex-file-compressed 68399925 / 65736069 / +4.1% 97986476 / 89717159 / +9.2% 0.70 / 0.73 / -4.7%
clickbench_q06/duckdb:vortex-file-compressed 1945874 / 1812348 / +7.4% 29080515 / 31509496 / -7.7% 0.07 / 0.06 / +16.3%
clickbench_q07/duckdb:vortex-file-compressed 16245054 / 13913238 / +16.8% 🔴 32386828 / 32808976 / -1.3% 0.50 / 0.42 / +18.3%
clickbench_q08/duckdb:vortex-file-compressed 82140745 / 82270953 / -0.2% 130153532 / 118689370 / +9.7% 0.63 / 0.69 / -9.0%
clickbench_q09/duckdb:vortex-file-compressed 108456676 / 105758125 / +2.6% 152376783 / 140350591 / +8.6% 0.71 / 0.75 / -5.5%
clickbench_q10/duckdb:vortex-file-compressed 32904981 / 32302656 / +1.9% 73539967 / 65769294 / +11.8% 🔴 0.45 / 0.49 / -8.9%
clickbench_q11/duckdb:vortex-file-compressed 34991732 / 35135476 / -0.4% 74660489 / 67079101 / +11.3% 🔴 0.47 / 0.52 / -10.5%
clickbench_q12/duckdb:vortex-file-compressed 75004242 / 73407616 / +2.2% 108019831 / 104161214 / +3.7% 0.69 / 0.70 / -1.5%
clickbench_q13/duckdb:vortex-file-compressed 134474162 / 132316970 / +1.6% 184711467 / 170476649 / +8.4% 0.73 / 0.78 / -6.2%
clickbench_q14/duckdb:vortex-file-compressed 79223410 / 76276620 / +3.9% 110504933 / 105309584 / +4.9% 0.72 / 0.72 / -1.0%
clickbench_q15/duckdb:vortex-file-compressed 93197518 / 91860541 / +1.5% 133191611 / 125605163 / +6.0% 0.70 / 0.73 / -4.3%
clickbench_q16/duckdb:vortex-file-compressed 159881814 / 156332804 / +2.3% 211016202 / 204921387 / +3.0% 0.76 / 0.76 / -0.7%
clickbench_q17/duckdb:vortex-file-compressed 164196080 / 161471778 / +1.7% 212488363 / 201243328 / +5.6% 0.77 / 0.80 / -3.7%
clickbench_q18/duckdb:vortex-file-compressed 316956828 / 311092776 / +1.9% 377166931 / 377864934 / -0.2% 0.84 / 0.82 / +2.1%
clickbench_q19/duckdb:vortex-file-compressed 17270182 / 16784006 / +2.9% 40658315 / 39332947 / +3.4% 0.42 / 0.43 / -0.5%
clickbench_q20/duckdb:vortex-file-compressed 111350122 / 108432236 / +2.7% 201615614 / 183865764 / +9.7% 0.55 / 0.59 / -6.3%
clickbench_q21/duckdb:vortex-file-compressed 157827512 / 157942018 / -0.1% 306587552 / 292154355 / +4.9% 0.51 / 0.54 / -4.8%
clickbench_q22/duckdb:vortex-file-compressed 236799563 / 238526428 / -0.7% 463604428 / 425247031 / +9.0% 0.51 / 0.56 / -8.9%
clickbench_q23/duckdb:vortex-file-compressed 59740171 / 62518756 / -4.4% 104603854 / 108968575 / -4.0% 0.57 / 0.57 / -0.5%
clickbench_q24/duckdb:vortex-file-compressed 27017870 / 27812894 / -2.9% 45053377 / 41149732 / +9.5% 0.60 / 0.68 / -11.3%
clickbench_q25/duckdb:vortex-file-compressed 32405990 / 33894362 / -4.4% 52117746 / 52621640 / -1.0% 0.62 / 0.64 / -3.5%
clickbench_q26/duckdb:vortex-file-compressed 19843934 / 19149752 / +3.6% 40974566 / 33052080 / +24.0% 🔴 0.48 / 0.58 / -16.4%
clickbench_q27/duckdb:vortex-file-compressed 145635114 / 144128856 / +1.0% 259504619 / 237635856 / +9.2% 0.56 / 0.61 / -7.5%
clickbench_q28/duckdb:vortex-file-compressed 595713091 / 565673673 / +5.3% 669017743 / 646744836 / +3.4% 0.89 / 0.87 / +1.8%
clickbench_q29/duckdb:vortex-file-compressed 17579368 / 16533538 / +6.3% 38720327 / 36358945 / +6.5% 0.45 / 0.45 / -0.2%
clickbench_q30/duckdb:vortex-file-compressed 65475806 / 65575372 / -0.2% 113002852 / 106956315 / +5.7% 0.58 / 0.61 / -5.5%
clickbench_q31/duckdb:vortex-file-compressed 125136566 / 121749766 / +2.8% 210467406 / 190730823 / +10.3% 🔴 0.59 / 0.64 / -6.9%
clickbench_q32/duckdb:vortex-file-compressed 444020283 / 438997020 / +1.1% 500702501 / 486274010 / +3.0% 0.89 / 0.90 / -1.8%
clickbench_q33/duckdb:vortex-file-compressed 393352456 / 384337559 / +2.3% 509860410 / 491050498 / +3.8% 0.77 / 0.78 / -1.4%
clickbench_q34/duckdb:vortex-file-compressed 416619634 / 400217468 / +4.1% 543766217 / 529966152 / +2.6% 0.77 / 0.76 / +1.5%
clickbench_q35/duckdb:vortex-file-compressed 103485502 / 101380758 / +2.1% 136657450 / 133781203 / +2.1% 0.76 / 0.76 / -0.1%
clickbench_q36/duckdb:vortex-file-compressed 17277633 / 16335942 / +5.8% 33243906 / 31824400 / +4.5% 0.52 / 0.51 / +1.2%
clickbench_q37/duckdb:vortex-file-compressed 12209562 / 11458842 / +6.6% 29144428 / 30590620 / -4.7% 0.42 / 0.37 / +11.8%
clickbench_q38/duckdb:vortex-file-compressed 12758591 / 13012720 / -2.0% 30210530 / 27925818 / +8.2% 0.42 / 0.47 / -9.4%
clickbench_q39/duckdb:vortex-file-compressed 23257383 / 23271136 / -0.1% 42036186 / 40317442 / +4.3% 0.55 / 0.58 / -4.1%
clickbench_q40/duckdb:vortex-file-compressed 10938966 / 10801752 / +1.3% 27766081 / 29920801 / -7.2% 0.39 / 0.36 / +9.1%
clickbench_q41/duckdb:vortex-file-compressed 11706963 / 11352422 / +3.1% 27731884 / 31176792 / -11.0% 🟢 0.42 / 0.36 / +15.9%
clickbench_q42/duckdb:vortex-file-compressed 12819195 / 14117313 / -9.2% 29199646 / 33175502 / -12.0% 🟢 0.44 / 0.43 / +3.2%
duckdb / parquet / ns (1.029x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8410090 / 7892799 / +6.6% 20116928 / 19995045 / +0.6% 0.42 / 0.39 / +5.9%
clickbench_q01/duckdb:parquet 9778263 / 9238914 / +5.8% 20215163 / 19067687 / +6.0% 0.48 / 0.48 / -0.2%
clickbench_q02/duckdb:parquet 16746214 / 15444474 / +8.4% 35693654 / 32671989 / +9.2% 0.47 / 0.47 / -0.8%
clickbench_q03/duckdb:parquet 16506238 / 15832940 / +4.3% 55826431 / 49190302 / +13.5% 🔴 0.30 / 0.32 / -8.1%
clickbench_q04/duckdb:parquet 71143020 / 68271282 / +4.2% 101873759 / 90934047 / +12.0% 🔴 0.70 / 0.75 / -7.0%
clickbench_q05/duckdb:parquet 83226717 / 78416454 / +6.1% 122855639 / 111301713 / +10.4% 🔴 0.68 / 0.70 / -3.8%
clickbench_q06/duckdb:parquet 14973904 / 15596664 / -4.0% 24144270 / 22181819 / +8.8% 0.62 / 0.70 / -11.8%
clickbench_q07/duckdb:parquet 11081640 / 9763063 / +13.5% 🔴 21179208 / 20141560 / +5.2% 0.52 / 0.48 / +7.9%
clickbench_q08/duckdb:parquet 85623984 / 84214472 / +1.7% 131254587 / 122193990 / +7.4% 0.65 / 0.69 / -5.3%
clickbench_q09/duckdb:parquet 114625980 / 112719632 / +1.7% 163472910 / 154755689 / +5.6% 0.70 / 0.73 / -3.7%
clickbench_q10/duckdb:parquet 32757961 / 32181360 / +1.8% 67992987 / 67285522 / +1.1% 0.48 / 0.48 / +0.7%
clickbench_q11/duckdb:parquet 36286890 / 36208200 / +0.2% 77497854 / 74205972 / +4.4% 0.47 / 0.49 / -4.0%
clickbench_q12/duckdb:parquet 91876039 / 90858834 / +1.1% 130122276 / 129546823 / +0.4% 0.71 / 0.70 / +0.7%
clickbench_q13/duckdb:parquet 144987184 / 140476792 / +3.2% 217264923 / 206316318 / +5.3% 0.67 / 0.68 / -2.0%
clickbench_q14/duckdb:parquet 98277294 / 95220104 / +3.2% 152261445 / 141199391 / +7.8% 0.65 / 0.67 / -4.3%
clickbench_q15/duckdb:parquet 94478947 / 90540978 / +4.3% 125309120 / 118538899 / +5.7% 0.75 / 0.76 / -1.3%
clickbench_q16/duckdb:parquet 175361716 / 166125464 / +5.6% 224031796 / 222001406 / +0.9% 0.78 / 0.75 / +4.6%
clickbench_q17/duckdb:parquet 186644083 / 170470562 / +9.5% 232421731 / 229626960 / +1.2% 0.80 / 0.74 / +8.2%
clickbench_q18/duckdb:parquet 328154936 / 320700148 / +2.3% 415832965 / 402983771 / +3.2% 0.79 / 0.80 / -0.8%
clickbench_q19/duckdb:parquet 13221907 / 13456283 / -1.7% 42167986 / 40935078 / +3.0% 0.31 / 0.33 / -4.6%
clickbench_q20/duckdb:parquet 133785840 / 131922522 / +1.4% 244423515 / 243756136 / +0.3% 0.55 / 0.54 / +1.1%
clickbench_q21/duckdb:parquet 180562815 / 176222202 / +2.5% 323862576 / 316231144 / +2.4% 0.56 / 0.56 / +0.0%
clickbench_q22/duckdb:parquet 243520163 / 239961686 / +1.5% 424845285 / 406150384 / +4.6% 0.57 / 0.59 / -3.0%
clickbench_q23/duckdb:parquet 147840108 / 143256294 / +3.2% 167497529 / 164908166 / +1.6% 0.88 / 0.87 / +1.6%
clickbench_q24/duckdb:parquet 42790573 / 42310410 / +1.1% 63346711 / 60114097 / +5.4% 0.68 / 0.70 / -4.0%
clickbench_q25/duckdb:parquet 40268863 / 40109394 / +0.4% 93953868 / 87183158 / +7.8% 0.43 / 0.46 / -6.8%
clickbench_q26/duckdb:parquet 32097904 / 28986782 / +10.7% 🔴 49569831 / 48384669 / +2.4% 0.65 / 0.60 / +8.1%
clickbench_q27/duckdb:parquet 144636568 / 144319550 / +0.2% 260703328 / 252894052 / +3.1% 0.55 / 0.57 / -2.8%
clickbench_q28/duckdb:parquet 904109464 / 891773023 / +1.4% 999421605 / 980819435 / +1.9% 0.90 / 0.91 / -0.5%
clickbench_q29/duckdb:parquet 18095109 / 17292380 / +4.6% 31689352 / 31421638 / +0.9% 0.57 / 0.55 / +3.8%
clickbench_q30/duckdb:parquet 91950992 / 90504816 / +1.6% 172613781 / 172607941 / +0.0% 0.53 / 0.52 / +1.6%
clickbench_q31/duckdb:parquet 146923096 / 142484192 / +3.1% 270333904 / 289397666 / -6.6% 0.54 / 0.49 / +10.4%
clickbench_q32/duckdb:parquet 436223314 / 430037568 / +1.4% 490612081 / 470519477 / +4.3% 0.89 / 0.91 / -2.7%
clickbench_q33/duckdb:parquet 452106714 / 441420798 / +2.4% 480775080 / 457274528 / +5.1% 0.94 / 0.97 / -2.6%
clickbench_q34/duckdb:parquet 467367436 / 450258853 / +3.8% 488952012 / 477431307 / +2.4% 0.96 / 0.94 / +1.4%
clickbench_q35/duckdb:parquet 101398929 / 99293749 / +2.1% 123433684 / 126673030 / -2.6% 0.82 / 0.78 / +4.8%
clickbench_q36/duckdb:parquet 31371599 / 30801312 / +1.9% 41446172 / 41115550 / +0.8% 0.76 / 0.75 / +1.0%
clickbench_q37/duckdb:parquet 22455303 / 22770934 / -1.4% 31574290 / 32274862 / -2.2% 0.71 / 0.71 / +0.8%
clickbench_q38/duckdb:parquet 25370018 / 23728112 / +6.9% 35041580 / 33721898 / +3.9% 0.72 / 0.70 / +2.9%
clickbench_q39/duckdb:parquet 56578332 / 56599634 / -0.0% 66600862 / 65654541 / +1.4% 0.85 / 0.86 / -1.5%
clickbench_q40/duckdb:parquet 12497300 / 13208486 / -5.4% 21981339 / 21458670 / +2.4% 0.57 / 0.62 / -7.6%
clickbench_q41/duckdb:parquet 13568755 / 13546774 / +0.2% 22769480 / 22141781 / +2.8% 0.60 / 0.61 / -2.6%
clickbench_q42/duckdb:parquet 14840525 / 14100848 / +5.2% 24010477 / 24423298 / -1.7% 0.62 / 0.58 / +7.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 68fb80dc vs base a3e9d40e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.008x ➖ · cold 0.990x ➖
Parquet (geomean): hot 1.006x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +0.6% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 24057535 / 24258426 / -0.8% 43583084 / 43486917 / +0.2% 0.55 / 0.56 / -1.0%
tpcds_q02/datafusion:vortex-file-compressed 45001038 / 45589074 / -1.3% 61066903 / 63432573 / -3.7% 0.74 / 0.72 / +2.5%
tpcds_q03/datafusion:vortex-file-compressed 11686718 / 11898040 / -1.8% 27930647 / 29033155 / -3.8% 0.42 / 0.41 / +2.1%
tpcds_q04/datafusion:vortex-file-compressed 112539594 / 112213410 / +0.3% 142220901 / 144186765 / -1.4% 0.79 / 0.78 / +1.7%
tpcds_q05/datafusion:vortex-file-compressed 59683851 / 59417276 / +0.4% 82499574 / 80695265 / +2.2% 0.72 / 0.74 / -1.7%
tpcds_q06/datafusion:vortex-file-compressed 23526840 / 23656590 / -0.5% 45373617 / 45434125 / -0.1% 0.52 / 0.52 / -0.4%
tpcds_q07/datafusion:vortex-file-compressed 33321919 / 32891336 / +1.3% 59217571 / 57053025 / +3.8% 0.56 / 0.58 / -2.4%
tpcds_q08/datafusion:vortex-file-compressed 25346272 / 25017964 / +1.3% 41885527 / 44402065 / -5.7% 0.61 / 0.56 / +7.4%
tpcds_q09/datafusion:vortex-file-compressed 17023252 / 17746656 / -4.1% 33920470 / 35609887 / -4.7% 0.50 / 0.50 / +0.7%
tpcds_q10/datafusion:vortex-file-compressed 28461756 / 28300898 / +0.6% 49712048 / 50362868 / -1.3% 0.57 / 0.56 / +1.9%
tpcds_q11/datafusion:vortex-file-compressed 63176289 / 62182420 / +1.6% 89913917 / 88920311 / +1.1% 0.70 / 0.70 / +0.5%
tpcds_q12/datafusion:vortex-file-compressed 16153423 / 16467908 / -1.9% 31648909 / 33384711 / -5.2% 0.51 / 0.49 / +3.5%
tpcds_q13/datafusion:vortex-file-compressed 33934170 / 34330496 / -1.2% 53919616 / 52667679 / +2.4% 0.63 / 0.65 / -3.4%
tpcds_q14/datafusion:vortex-file-compressed 91794097 / 90797656 / +1.1% 123720264 / 121749692 / +1.6% 0.74 / 0.75 / -0.5%
tpcds_q15/datafusion:vortex-file-compressed 23828300 / 23800310 / +0.1% 43236694 / 44246466 / -2.3% 0.55 / 0.54 / +2.5%
tpcds_q16/datafusion:vortex-file-compressed 20644186 / 20990268 / -1.6% 41918117 / 41963069 / -0.1% 0.49 / 0.50 / -1.5%
tpcds_q17/datafusion:vortex-file-compressed 61606972 / 54412543 / +13.2% 🔴 83628746 / 83548090 / +0.1% 0.74 / 0.65 / +13.1%
tpcds_q18/datafusion:vortex-file-compressed 68179626 / 68650458 / -0.7% 93766034 / 93548859 / +0.2% 0.73 / 0.73 / -0.9%
tpcds_q19/datafusion:vortex-file-compressed 18518338 / 17795188 / +4.1% 39329103 / 40331219 / -2.5% 0.47 / 0.44 / +6.7%
tpcds_q20/datafusion:vortex-file-compressed 17367817 / 17950662 / -3.2% 34264616 / 35425136 / -3.3% 0.51 / 0.51 / +0.0%
tpcds_q21/datafusion:vortex-file-compressed 16981124 / 16527374 / +2.7% 37682286 / 39782272 / -5.3% 0.45 / 0.42 / +8.5%
tpcds_q22/datafusion:vortex-file-compressed 50071404 / 49856998 / +0.4% 71670972 / 70831497 / +1.2% 0.70 / 0.70 / -0.7%
tpcds_q23/datafusion:vortex-file-compressed 72136959 / 71573584 / +0.8% 100857840 / 101149601 / -0.3% 0.72 / 0.71 / +1.1%
tpcds_q24/datafusion:vortex-file-compressed 71059965 / 70496559 / +0.8% 93470433 / 96872683 / -3.5% 0.76 / 0.73 / +4.5%
tpcds_q25/datafusion:vortex-file-compressed 48853102 / 55943539 / -12.7% 🟢 84102513 / 79503780 / +5.8% 0.58 / 0.70 / -17.4%
tpcds_q26/datafusion:vortex-file-compressed 30247848 / 30000686 / +0.8% 52489553 / 50726533 / +3.5% 0.58 / 0.59 / -2.6%
tpcds_q27/datafusion:vortex-file-compressed 63547782 / 60967809 / +4.2% 87144436 / 92465646 / -5.8% 0.73 / 0.66 / +10.6%
tpcds_q28/datafusion:vortex-file-compressed 18368632 / 18114788 / +1.4% 35812381 / 38888120 / -7.9% 0.51 / 0.47 / +10.1%
tpcds_q29/datafusion:vortex-file-compressed 61444288 / 54062897 / +13.7% 🔴 85313405 / 77711422 / +9.8% 0.72 / 0.70 / +3.5%
tpcds_q30/datafusion:vortex-file-compressed 27884290 / 27965374 / -0.3% 44291532 / 45993282 / -3.7% 0.63 / 0.61 / +3.5%
tpcds_q31/datafusion:vortex-file-compressed 65201023 / 64865431 / +0.5% 91557874 / 93383834 / -2.0% 0.71 / 0.69 / +2.5%
tpcds_q32/datafusion:vortex-file-compressed 13889458 / 13149522 / +5.6% 29838416 / 32303161 / -7.6% 0.47 / 0.41 / +14.4%
tpcds_q33/datafusion:vortex-file-compressed 26877759 / 26550018 / +1.2% 48478451 / 49054203 / -1.2% 0.55 / 0.54 / +2.4%
tpcds_q34/datafusion:vortex-file-compressed 18838764 / 18365294 / +2.6% 37583848 / 39732817 / -5.4% 0.50 / 0.46 / +8.4%
tpcds_q35/datafusion:vortex-file-compressed 36241891 / 36040838 / +0.6% 57368754 / 58642897 / -2.2% 0.63 / 0.61 / +2.8%
tpcds_q36/datafusion:vortex-file-compressed 49245260 / 48652440 / +1.2% 74846483 / 70744488 / +5.8% 0.66 / 0.69 / -4.3%
tpcds_q37/datafusion:vortex-file-compressed 13390162 / 13411154 / -0.2% 34913010 / 33241348 / +5.0% 0.38 / 0.40 / -4.9%
tpcds_q38/datafusion:vortex-file-compressed 30222949 / 30049968 / +0.6% 51875054 / 53190814 / -2.5% 0.58 / 0.56 / +3.1%
tpcds_q39/datafusion:vortex-file-compressed 66490159 / 65277920 / +1.9% 88363457 / 90503934 / -2.4% 0.75 / 0.72 / +4.3%
tpcds_q40/datafusion:vortex-file-compressed 25574458 / 25173705 / +1.6% 45817540 / 46872097 / -2.2% 0.56 / 0.54 / +3.9%
tpcds_q41/datafusion:vortex-file-compressed 16482124 / 16530166 / -0.3% 32208173 / 31636584 / +1.8% 0.51 / 0.52 / -2.1%
tpcds_q42/datafusion:vortex-file-compressed 11394778 / 11196066 / +1.8% 28183653 / 27681785 / +1.8% 0.40 / 0.40 / -0.0%
tpcds_q43/datafusion:vortex-file-compressed 13341369 / 13254736 / +0.7% 31479999 / 31652520 / -0.5% 0.42 / 0.42 / +1.2%
tpcds_q44/datafusion:vortex-file-compressed 26085259 / 26676514 / -2.2% 49771342 / 49747815 / +0.0% 0.52 / 0.54 / -2.3%
tpcds_q45/datafusion:vortex-file-compressed 27255315 / 27898088 / -2.3% 47964103 / 48650003 / -1.4% 0.57 / 0.57 / -0.9%
tpcds_q46/datafusion:vortex-file-compressed 24731218 / 24621373 / +0.4% 46669788 / 48895635 / -4.6% 0.53 / 0.50 / +5.2%
tpcds_q47/datafusion:vortex-file-compressed 77923196 / 78166695 / -0.3% 106326725 / 106482099 / -0.1% 0.73 / 0.73 / -0.2%
tpcds_q48/datafusion:vortex-file-compressed 31294198 / 31601572 / -1.0% 51972105 / 51031300 / +1.8% 0.60 / 0.62 / -2.8%
tpcds_q49/datafusion:vortex-file-compressed 59116530 / 59327542 / -0.4% 82129317 / 90943400 / -9.7% 0.72 / 0.65 / +10.3%
tpcds_q50/datafusion:vortex-file-compressed 34169991 / 34839896 / -1.9% 55471990 / 55876659 / -0.7% 0.62 / 0.62 / -1.2%
tpcds_q51/datafusion:vortex-file-compressed 60920453 / 60891662 / +0.0% 83670257 / 83319807 / +0.4% 0.73 / 0.73 / -0.4%
tpcds_q52/datafusion:vortex-file-compressed 11770480 / 11643338 / +1.1% 28181547 / 28213338 / -0.1% 0.42 / 0.41 / +1.2%
tpcds_q53/datafusion:vortex-file-compressed 18353490 / 18320642 / +0.2% 37076189 / 38131164 / -2.8% 0.50 / 0.48 / +3.0%
tpcds_q54/datafusion:vortex-file-compressed 33842485 / 34796984 / -2.7% 58648110 / 61580929 / -4.8% 0.58 / 0.57 / +2.1%
tpcds_q55/datafusion:vortex-file-compressed 11222501 / 11382946 / -1.4% 25937671 / 28317547 / -8.4% 0.43 / 0.40 / +7.6%
tpcds_q56/datafusion:vortex-file-compressed 26847587 / 26718280 / +0.5% 48140081 / 50522928 / -4.7% 0.56 / 0.53 / +5.5%
tpcds_q57/datafusion:vortex-file-compressed 73163888 / 73464416 / -0.4% 97523622 / 99412908 / -1.9% 0.75 / 0.74 / +1.5%
tpcds_q58/datafusion:vortex-file-compressed 40672174 / 40841814 / -0.4% 66865610 / 66913471 / -0.1% 0.61 / 0.61 / -0.3%
tpcds_q59/datafusion:vortex-file-compressed 32525272 / 31819810 / +2.2% 53711382 / 52908261 / +1.5% 0.61 / 0.60 / +0.7%
tpcds_q60/datafusion:vortex-file-compressed 26511247 / 26723948 / -0.8% 47805493 / 48215646 / -0.9% 0.55 / 0.55 / +0.1%
tpcds_q61/datafusion:vortex-file-compressed 24218452 / 24390042 / -0.7% 45931736 / 46997713 / -2.3% 0.53 / 0.52 / +1.6%
tpcds_q62/datafusion:vortex-file-compressed 17098907 / 17399164 / -1.7% 36094446 / 36702869 / -1.7% 0.47 / 0.47 / -0.1%
tpcds_q63/datafusion:vortex-file-compressed 18717667 / 18529954 / +1.0% 39240021 / 39800857 / -1.4% 0.48 / 0.47 / +2.5%
tpcds_q64/datafusion:vortex-file-compressed 320112509 / 327705225 / -2.3% 361983206 / 354116835 / +2.2% 0.88 / 0.93 / -4.4%
tpcds_q65/datafusion:vortex-file-compressed 76003921 / 74825878 / +1.6% 93545048 / 95928986 / -2.5% 0.81 / 0.78 / +4.2%
tpcds_q66/datafusion:vortex-file-compressed 52859424 / 52539886 / +0.6% 75588982 / 74141279 / +2.0% 0.70 / 0.71 / -1.3%
tpcds_q67/datafusion:vortex-file-compressed 56047611 / 55313594 / +1.3% 85443215 / 85351635 / +0.1% 0.66 / 0.65 / +1.2%
tpcds_q68/datafusion:vortex-file-compressed 23647342 / 24191406 / -2.2% 49106265 / 48485995 / +1.3% 0.48 / 0.50 / -3.5%
tpcds_q69/datafusion:vortex-file-compressed 28707856 / 28403497 / +1.1% 47876064 / 50772043 / -5.7% 0.60 / 0.56 / +7.2%
tpcds_q70/datafusion:vortex-file-compressed 71337435 / 70849389 / +0.7% 92919439 / 93295986 / -0.4% 0.77 / 0.76 / +1.1%
tpcds_q71/datafusion:vortex-file-compressed 19584126 / 19607404 / -0.1% 40161651 / 41296493 / -2.7% 0.49 / 0.47 / +2.7%
tpcds_q72/datafusion:vortex-file-compressed 467205600 / 448204949 / +4.2% 505668896 / 529657817 / -4.5% 0.92 / 0.85 / +9.2%
tpcds_q73/datafusion:vortex-file-compressed 17774434 / 16984862 / +4.6% 37143586 / 38440472 / -3.4% 0.48 / 0.44 / +8.3%
tpcds_q74/datafusion:vortex-file-compressed 45291862 / 45076129 / +0.5% 69950176 / 70234652 / -0.4% 0.65 / 0.64 / +0.9%
tpcds_q75/datafusion:vortex-file-compressed 130182002 / 128582316 / +1.2% 155238871 / 159878549 / -2.9% 0.84 / 0.80 / +4.3%
tpcds_q76/datafusion:vortex-file-compressed 42586112 / 43580557 / -2.3% 61368744 / 64383422 / -4.7% 0.69 / 0.68 / +2.5%
tpcds_q77/datafusion:vortex-file-compressed 38162258 / 35493616 / +7.5% 58411031 / 60648016 / -3.7% 0.65 / 0.59 / +11.6%
tpcds_q78/datafusion:vortex-file-compressed 80169881 / 79565136 / +0.8% 107199883 / 108235451 / -1.0% 0.75 / 0.74 / +1.7%
tpcds_q79/datafusion:vortex-file-compressed 21471892 / 21541676 / -0.3% 43488715 / 43446998 / +0.1% 0.49 / 0.50 / -0.4%
tpcds_q80/datafusion:vortex-file-compressed 77316012 / 77414352 / -0.1% 110917404 / 108016297 / +2.7% 0.70 / 0.72 / -2.7%
tpcds_q81/datafusion:vortex-file-compressed 28164128 / 28122358 / +0.1% 44938630 / 46488648 / -3.3% 0.63 / 0.60 / +3.6%
tpcds_q82/datafusion:vortex-file-compressed 14311792 / 13423604 / +6.6% 35191171 / 35319652 / -0.4% 0.41 / 0.38 / +7.0%
tpcds_q83/datafusion:vortex-file-compressed 36631619 / 35558030 / +3.0% 59872884 / 60158294 / -0.5% 0.61 / 0.59 / +3.5%
tpcds_q84/datafusion:vortex-file-compressed 12112445 / 11864715 / +2.1% 28063033 / 27613226 / +1.6% 0.43 / 0.43 / +0.5%
tpcds_q85/datafusion:vortex-file-compressed 59366370 / 59542447 / -0.3% 84007922 / 84093327 / -0.1% 0.71 / 0.71 / -0.2%
tpcds_q86/datafusion:vortex-file-compressed 16577966 / 16145282 / +2.7% 32743528 / 33951400 / -3.6% 0.51 / 0.48 / +6.5%
tpcds_q87/datafusion:vortex-file-compressed 29846080 / 29938736 / -0.3% 52904291 / 52323185 / +1.1% 0.56 / 0.57 / -1.4%
tpcds_q88/datafusion:vortex-file-compressed 34645084 / 34492858 / +0.4% 59867119 / 60642107 / -1.3% 0.58 / 0.57 / +1.7%
tpcds_q89/datafusion:vortex-file-compressed 21395752 / 21346306 / +0.2% 40449433 / 41482597 / -2.5% 0.53 / 0.51 / +2.8%
tpcds_q90/datafusion:vortex-file-compressed 10368862 / 10181224 / +1.8% 26473765 / 26941285 / -1.7% 0.39 / 0.38 / +3.6%
tpcds_q91/datafusion:vortex-file-compressed 17029005 / 17043892 / -0.1% 36910493 / 36720497 / +0.5% 0.46 / 0.46 / -0.6%
tpcds_q92/datafusion:vortex-file-compressed 13794470 / 13962384 / -1.2% 31907509 / 31455453 / +1.4% 0.43 / 0.44 / -2.6%
tpcds_q93/datafusion:vortex-file-compressed 23873364 / 23622348 / +1.1% 43550155 / 44397608 / -1.9% 0.55 / 0.53 / +3.0%
tpcds_q94/datafusion:vortex-file-compressed 19408860 / 19414528 / -0.0% 38535769 / 40126706 / -4.0% 0.50 / 0.48 / +4.1%
tpcds_q95/datafusion:vortex-file-compressed 46258003 / 46139580 / +0.3% 67762688 / 68985046 / -1.8% 0.68 / 0.67 / +2.1%
tpcds_q96/datafusion:vortex-file-compressed 9326454 / 9567452 / -2.5% 24014976 / 26452093 / -9.2% 0.39 / 0.36 / +7.4%
tpcds_q97/datafusion:vortex-file-compressed 21138176 / 21558021 / -1.9% 44995680 / 44121584 / +2.0% 0.47 / 0.49 / -3.9%
tpcds_q98/datafusion:vortex-file-compressed 16971676 / 17278820 / -1.8% 37213546 / 36995347 / +0.6% 0.46 / 0.47 / -2.4%
tpcds_q99/datafusion:vortex-file-compressed 19391155 / 19464753 / -0.4% 38217195 / 38115771 / +0.3% 0.51 / 0.51 / -0.6%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 30146662 / 30309917 / -0.5% 46879468 / 50897073 / -7.9% 0.64 / 0.60 / +8.0%
tpcds_q02/datafusion:parquet 44898037 / 45232094 / -0.7% 60676170 / 62503523 / -2.9% 0.74 / 0.72 / +2.3%
tpcds_q03/datafusion:parquet 18981872 / 18891830 / +0.5% 31905591 / 34940639 / -8.7% 0.59 / 0.54 / +10.0%
tpcds_q04/datafusion:parquet 196615356 / 193633510 / +1.5% 225692776 / 225555099 / +0.1% 0.87 / 0.86 / +1.5%
tpcds_q05/datafusion:parquet 71834764 / 71405850 / +0.6% 93705692 / 92404494 / +1.4% 0.77 / 0.77 / -0.8%
tpcds_q06/datafusion:parquet 34606298 / 34645974 / -0.1% 51064408 / 56416219 / -9.5% 0.68 / 0.61 / +10.4%
tpcds_q07/datafusion:parquet 46388656 / 47190845 / -1.7% 67234239 / 67325694 / -0.1% 0.69 / 0.70 / -1.6%
tpcds_q08/datafusion:parquet 39823282 / 39092708 / +1.9% 53831304 / 56517283 / -4.8% 0.74 / 0.69 / +7.0%
tpcds_q09/datafusion:parquet 30051188 / 32843524 / -8.5% 47191524 / 46232439 / +2.1% 0.64 / 0.71 / -10.4%
tpcds_q10/datafusion:parquet 50126384 / 49294128 / +1.7% 65114353 / 65621348 / -0.8% 0.77 / 0.75 / +2.5%
tpcds_q11/datafusion:parquet 93617818 / 94195176 / -0.6% 116929006 / 120778476 / -3.2% 0.80 / 0.78 / +2.7%
tpcds_q12/datafusion:parquet 24244419 / 24550540 / -1.2% 35802911 / 38042705 / -5.9% 0.68 / 0.65 / +4.9%
tpcds_q13/datafusion:parquet 45050938 / 44624306 / +1.0% 67949630 / 67454408 / +0.7% 0.66 / 0.66 / +0.2%
tpcds_q14/datafusion:parquet 137325303 / 139626798 / -1.6% 156506422 / 155604838 / +0.6% 0.88 / 0.90 / -2.2%
tpcds_q15/datafusion:parquet 30586894 / 31034706 / -1.4% 47756616 / 49815478 / -4.1% 0.64 / 0.62 / +2.8%
tpcds_q16/datafusion:parquet 37374781 / 37046604 / +0.9% 55434745 / 57601726 / -3.8% 0.67 / 0.64 / +4.8%
tpcds_q17/datafusion:parquet 75224126 / 74380450 / +1.1% 100796770 / 102887912 / -2.0% 0.75 / 0.72 / +3.2%
tpcds_q18/datafusion:parquet 58205976 / 58877338 / -1.1% 77546480 / 78513522 / -1.2% 0.75 / 0.75 / +0.1%
tpcds_q19/datafusion:parquet 32107272 / 31677208 / +1.4% 47406634 / 48812112 / -2.9% 0.68 / 0.65 / +4.4%
tpcds_q20/datafusion:parquet 26059102 / 25292730 / +3.0% 37491039 / 38642153 / -3.0% 0.70 / 0.65 / +6.2%
tpcds_q21/datafusion:parquet 20546578 / 20215080 / +1.6% 33829527 / 35480389 / -4.7% 0.61 / 0.57 / +6.6%
tpcds_q22/datafusion:parquet 78133777 / 77727310 / +0.5% 93708183 / 93292810 / +0.4% 0.83 / 0.83 / +0.1%
tpcds_q23/datafusion:parquet 113713812 / 118640706 / -4.2% 140231090 / 140488000 / -0.2% 0.81 / 0.84 / -4.0%
tpcds_q24/datafusion:parquet 89233732 / 89138541 / +0.1% 119956995 / 118253758 / +1.4% 0.74 / 0.75 / -1.3%
tpcds_q25/datafusion:parquet 75852839 / 74908282 / +1.3% 100983049 / 103227135 / -2.2% 0.75 / 0.73 / +3.5%
tpcds_q26/datafusion:parquet 43030136 / 42304636 / +1.7% 57843765 / 57806225 / +0.1% 0.74 / 0.73 / +1.6%
tpcds_q27/datafusion:parquet 76947166 / 76462386 / +0.6% 101146618 / 111354494 / -9.2% 0.76 / 0.69 / +10.8%
tpcds_q28/datafusion:parquet 26725918 / 26442050 / +1.1% 43985801 / 45322738 / -2.9% 0.61 / 0.58 / +4.1%
tpcds_q29/datafusion:parquet 76304814 / 75196819 / +1.5% 102036015 / 102507926 / -0.5% 0.75 / 0.73 / +1.9%
tpcds_q30/datafusion:parquet 45268611 / 45965999 / -1.5% 65882511 / 67546336 / -2.5% 0.69 / 0.68 / +1.0%
tpcds_q31/datafusion:parquet 89309768 / 88321195 / +1.1% 107793618 / 107765449 / +0.0% 0.83 / 0.82 / +1.1%
tpcds_q32/datafusion:parquet 25559030 / 25874882 / -1.2% 41268047 / 42336644 / -2.5% 0.62 / 0.61 / +1.3%
tpcds_q33/datafusion:parquet 40332542 / 39615167 / +1.8% 56128389 / 56871005 / -1.3% 0.72 / 0.70 / +3.2%
tpcds_q34/datafusion:parquet 23806782 / 23624752 / +0.8% 37772411 / 38831460 / -2.7% 0.63 / 0.61 / +3.6%
tpcds_q35/datafusion:parquet 53403391 / 54197624 / -1.5% 71123124 / 72909269 / -2.4% 0.75 / 0.74 / +1.0%
tpcds_q36/datafusion:parquet 52555632 / 52823766 / -0.5% 75577925 / 76326342 / -1.0% 0.70 / 0.69 / +0.5%
tpcds_q37/datafusion:parquet 25759462 / 25109162 / +2.6% 38062347 / 38782332 / -1.9% 0.68 / 0.65 / +4.5%
tpcds_q38/datafusion:parquet 44058250 / 44301914 / -0.6% 61991853 / 63641251 / -2.6% 0.71 / 0.70 / +2.1%
tpcds_q39/datafusion:parquet 71396788 / 72463674 / -1.5% 92247085 / 93502986 / -1.3% 0.77 / 0.77 / -0.1%
tpcds_q40/datafusion:parquet 28560700 / 27704106 / +3.1% 50616638 / 51425192 / -1.6% 0.56 / 0.54 / +4.7%
tpcds_q41/datafusion:parquet 19838327 / 20239158 / -2.0% 33661048 / 34169754 / -1.5% 0.59 / 0.59 / -0.5%
tpcds_q42/datafusion:parquet 18193590 / 18221411 / -0.2% 32388121 / 33022410 / -1.9% 0.56 / 0.55 / +1.8%
tpcds_q43/datafusion:parquet 19455468 / 19936042 / -2.4% 32169284 / 32899982 / -2.2% 0.60 / 0.61 / -0.2%
tpcds_q44/datafusion:parquet 32929268 / 32266954 / +2.1% 51589284 / 50716849 / +1.7% 0.64 / 0.64 / +0.3%
tpcds_q45/datafusion:parquet 38492156 / 37521920 / +2.6% 53127296 / 54726751 / -2.9% 0.72 / 0.69 / +5.7%
tpcds_q46/datafusion:parquet 29392342 / 29675655 / -1.0% 49190903 / 51422308 / -4.3% 0.60 / 0.58 / +3.5%
tpcds_q47/datafusion:parquet 97200558 / 97043011 / +0.2% 123336696 / 123552161 / -0.2% 0.79 / 0.79 / +0.3%
tpcds_q48/datafusion:parquet 41177334 / 40945264 / +0.6% 60112088 / 60435291 / -0.5% 0.69 / 0.68 / +1.1%
tpcds_q49/datafusion:parquet 73219030 / 71884920 / +1.9% 101808320 / 96434556 / +5.6% 0.72 / 0.75 / -3.5%
tpcds_q50/datafusion:parquet 47670470 / 47926504 / -0.5% 69699617 / 69431032 / +0.4% 0.68 / 0.69 / -0.9%
tpcds_q51/datafusion:parquet 71532898 / 71422914 / +0.2% 93016702 / 93253530 / -0.3% 0.77 / 0.77 / +0.4%
tpcds_q52/datafusion:parquet 18721064 / 18624668 / +0.5% 31557498 / 31426707 / +0.4% 0.59 / 0.59 / +0.1%
tpcds_q53/datafusion:parquet 22463950 / 22578796 / -0.5% 39500835 / 40066981 / -1.4% 0.57 / 0.56 / +0.9%
tpcds_q54/datafusion:parquet 54608290 / 54903260 / -0.5% 75009563 / 73830999 / +1.6% 0.73 / 0.74 / -2.1%
tpcds_q55/datafusion:parquet 17974309 / 17980475 / -0.0% 31055408 / 33779385 / -8.1% 0.58 / 0.53 / +8.7%
tpcds_q56/datafusion:parquet 45764271 / 46235482 / -1.0% 61925353 / 62995749 / -1.7% 0.74 / 0.73 / +0.7%
tpcds_q57/datafusion:parquet 99740585 / 100243537 / -0.5% 124236249 / 122613980 / +1.3% 0.80 / 0.82 / -1.8%
tpcds_q58/datafusion:parquet 64491123 / 63887570 / +0.9% 83342301 / 84235619 / -1.1% 0.77 / 0.76 / +2.0%
tpcds_q59/datafusion:parquet 48054178 / 47472712 / +1.2% 64231869 / 64579410 / -0.5% 0.75 / 0.74 / +1.8%
tpcds_q60/datafusion:parquet 44750616 / 45042289 / -0.6% 61339431 / 63157675 / -2.9% 0.73 / 0.71 / +2.3%
tpcds_q61/datafusion:parquet 38694742 / 38585686 / +0.3% 59424420 / 58571183 / +1.5% 0.65 / 0.66 / -1.2%
tpcds_q62/datafusion:parquet 25045208 / 25056667 / -0.0% 39011350 / 41102389 / -5.1% 0.64 / 0.61 / +5.3%
tpcds_q63/datafusion:parquet 21938080 / 21944046 / -0.0% 39966321 / 41676539 / -4.1% 0.55 / 0.53 / +4.3%
tpcds_q64/datafusion:parquet 206508569 / 209749652 / -1.5% 236227141 / 239983864 / -1.6% 0.87 / 0.87 / +0.0%
tpcds_q65/datafusion:parquet 37619764 / 37227958 / +1.1% 58653636 / 58789862 / -0.2% 0.64 / 0.63 / +1.3%
tpcds_q66/datafusion:parquet 61994618 / 61732828 / +0.4% 80869439 / 81739321 / -1.1% 0.77 / 0.76 / +1.5%
tpcds_q67/datafusion:parquet 68979194 / 69576515 / -0.9% 96826004 / 98329673 / -1.5% 0.71 / 0.71 / +0.7%
tpcds_q68/datafusion:parquet 29256826 / 29622808 / -1.2% 52020982 / 51478717 / +1.1% 0.56 / 0.58 / -2.3%
tpcds_q69/datafusion:parquet 50318744 / 50689398 / -0.7% 65097045 / 65091906 / +0.0% 0.77 / 0.78 / -0.7%
tpcds_q70/datafusion:parquet 36960738 / 37027066 / -0.2% 57893975 / 58427627 / -0.9% 0.64 / 0.63 / +0.7%
tpcds_q71/datafusion:parquet 27158641 / 29138822 / -6.8% 43651137 / 43538306 / +0.3% 0.62 / 0.67 / -7.0%
tpcds_q72/datafusion:parquet 560054318 / 550784804 / +1.7% 579028522 / 587279356 / -1.4% 0.97 / 0.94 / +3.1%
tpcds_q73/datafusion:parquet 23097952 / 22970090 / +0.6% 38144406 / 38419270 / -0.7% 0.61 / 0.60 / +1.3%
tpcds_q74/datafusion:parquet 68857980 / 69613592 / -1.1% 89487350 / 89289041 / +0.2% 0.77 / 0.78 / -1.3%
tpcds_q75/datafusion:parquet 143504460 / 145446385 / -1.3% 183184824 / 184366650 / -0.6% 0.78 / 0.79 / -0.7%
tpcds_q76/datafusion:parquet 54423022 / 51739631 / +5.2% 70543663 / 73876491 / -4.5% 0.77 / 0.70 / +10.2%
tpcds_q77/datafusion:parquet 56070177 / 55527719 / +1.0% 75086308 / 79918778 / -6.0% 0.75 / 0.69 / +7.5%
tpcds_q78/datafusion:parquet 88389982 / 91906644 / -3.8% 123319497 / 124412450 / -0.9% 0.72 / 0.74 / -3.0%
tpcds_q79/datafusion:parquet 26354276 / 25887622 / +1.8% 44843574 / 45939922 / -2.4% 0.59 / 0.56 / +4.3%
tpcds_q80/datafusion:parquet 81230524 / 80330196 / +1.1% 114757095 / 114147203 / +0.5% 0.71 / 0.70 / +0.6%
tpcds_q81/datafusion:parquet 41553928 / 42458380 / -2.1% 61311808 / 58915995 / +4.1% 0.68 / 0.72 / -6.0%
tpcds_q82/datafusion:parquet 26064888 / 27282410 / -4.5% 41166429 / 38824966 / +6.0% 0.63 / 0.70 / -9.9%
tpcds_q83/datafusion:parquet 57943396 / 57385322 / +1.0% 77843431 / 77514968 / +0.4% 0.74 / 0.74 / +0.5%
tpcds_q84/datafusion:parquet 30937638 / 30049006 / +3.0% 45351050 / 44683492 / +1.5% 0.68 / 0.67 / +1.4%
tpcds_q85/datafusion:parquet 83631022 / 82165291 / +1.8% 108109587 / 107718407 / +0.4% 0.77 / 0.76 / +1.4%
tpcds_q86/datafusion:parquet 20362569 / 20403623 / -0.2% 35284281 / 36311866 / -2.8% 0.58 / 0.56 / +2.7%
tpcds_q87/datafusion:parquet 46678708 / 46105095 / +1.2% 62441839 / 63569916 / -1.8% 0.75 / 0.73 / +3.1%
tpcds_q88/datafusion:parquet 48016821 / 47579910 / +0.9% 63084159 / 66401434 / -5.0% 0.76 / 0.72 / +6.2%
tpcds_q89/datafusion:parquet 25889444 / 25274621 / +2.4% 43700683 / 44851968 / -2.6% 0.59 / 0.56 / +5.1%
tpcds_q90/datafusion:parquet 19404961 / 20034822 / -3.1% 32279427 / 32842193 / -1.7% 0.60 / 0.61 / -1.5%
tpcds_q91/datafusion:parquet 35757686 / 36491995 / -2.0% 52147739 / 53378988 / -2.3% 0.69 / 0.68 / +0.3%
tpcds_q92/datafusion:parquet 25972770 / 26080752 / -0.4% 41046947 / 42376939 / -3.1% 0.63 / 0.62 / +2.8%
tpcds_q93/datafusion:parquet 26395804 / 26533392 / -0.5% 47499452 / 48511614 / -2.1% 0.56 / 0.55 / +1.6%
tpcds_q94/datafusion:parquet 34714705 / 34269407 / +1.3% 50341305 / 50375158 / -0.1% 0.69 / 0.68 / +1.4%
tpcds_q95/datafusion:parquet 61775538 / 63406740 / -2.6% 80274312 / 78921418 / +1.7% 0.77 / 0.80 / -4.2%
tpcds_q96/datafusion:parquet 16653454 / 16537448 / +0.7% 28858536 / 30340006 / -4.9% 0.58 / 0.55 / +5.9%
tpcds_q97/datafusion:parquet 35168322 / 35239540 / -0.2% 53745265 / 50534177 / +6.4% 0.65 / 0.70 / -6.2%
tpcds_q98/datafusion:parquet 25256920 / 25121478 / +0.5% 39043564 / 40163364 / -2.8% 0.65 / 0.63 / +3.4%
tpcds_q99/datafusion:parquet 29418431 / 29494294 / -0.3% 44341702 / 44941432 / -1.3% 0.66 / 0.66 / +1.1%
duckdb / vortex-file-compressed / ns (1.010x ➖, 2↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15029121 / 15045652 / -0.1% 22620481 / 22634280 / -0.1% 0.66 / 0.66 / -0.0%
tpcds_q02/duckdb:vortex-file-compressed 14903914 / 15066318 / -1.1% 21127421 / 19984568 / +5.7% 0.71 / 0.75 / -6.4%
tpcds_q03/duckdb:vortex-file-compressed 14354898 / 11393213 / +26.0% 🔴 20536973 / 19976103 / +2.8% 0.70 / 0.57 / +22.6%
tpcds_q04/duckdb:vortex-file-compressed 50633248 / 49858450 / +1.6% 59525447 / 60330014 / -1.3% 0.85 / 0.83 / +2.9%
tpcds_q05/duckdb:vortex-file-compressed 18343857 / 18801122 / -2.4% 25033675 / 29372934 / -14.8% 🟢 0.73 / 0.64 / +14.5%
tpcds_q06/duckdb:vortex-file-compressed 27035196 / 26939004 / +0.4% 39409801 / 39316664 / +0.2% 0.69 / 0.69 / +0.1%
tpcds_q07/duckdb:vortex-file-compressed 15785601 / 16089715 / -1.9% 28101188 / 30211546 / -7.0% 0.56 / 0.53 / +5.5%
tpcds_q08/duckdb:vortex-file-compressed 18859659 / 19317666 / -2.4% 26936494 / 26508445 / +1.6% 0.70 / 0.73 / -3.9%
tpcds_q09/duckdb:vortex-file-compressed 13364962 / 10141987 / +31.8% 🔴 21284279 / 17580355 / +21.1% 🔴 0.63 / 0.58 / +8.8%
tpcds_q10/duckdb:vortex-file-compressed 27637374 / 27428221 / +0.8% 41524531 / 41072303 / +1.1% 0.67 / 0.67 / -0.3%
tpcds_q11/duckdb:vortex-file-compressed 41303828 / 39944194 / +3.4% 49397268 / 49870929 / -0.9% 0.84 / 0.80 / +4.4%
tpcds_q12/duckdb:vortex-file-compressed 10202748 / 10552701 / -3.3% 16095729 / 16198656 / -0.6% 0.63 / 0.65 / -2.7%
tpcds_q13/duckdb:vortex-file-compressed 21828138 / 22832876 / -4.4% 31687815 / 34363328 / -7.8% 0.69 / 0.66 / +3.7%
tpcds_q14/duckdb:vortex-file-compressed 59023621 / 60768366 / -2.9% 71772080 / 71129319 / +0.9% 0.82 / 0.85 / -3.7%
tpcds_q15/duckdb:vortex-file-compressed 21038518 / 20716325 / +1.6% 27884314 / 25745536 / +8.3% 0.75 / 0.80 / -6.2%
tpcds_q16/duckdb:vortex-file-compressed 17627605 / 17455218 / +1.0% 31097366 / 25628901 / +21.3% 🔴 0.57 / 0.68 / -16.8%
tpcds_q17/duckdb:vortex-file-compressed 30999470 / 29994896 / +3.3% 44112639 / 43824628 / +0.7% 0.70 / 0.68 / +2.7%
tpcds_q18/duckdb:vortex-file-compressed 28505246 / 28695790 / -0.7% 38260738 / 37823020 / +1.2% 0.75 / 0.76 / -1.8%
tpcds_q19/duckdb:vortex-file-compressed 23329044 / 23729830 / -1.7% 36000033 / 33472904 / +7.5% 0.65 / 0.71 / -8.6%
tpcds_q20/duckdb:vortex-file-compressed 11043536 / 10628156 / +3.9% 15829540 / 16320418 / -3.0% 0.70 / 0.65 / +7.1%
tpcds_q21/duckdb:vortex-file-compressed 9901200 / 11159370 / -11.3% 🟢 17073354 / 18628642 / -8.3% 0.58 / 0.60 / -3.2%
tpcds_q22/duckdb:vortex-file-compressed 28976740 / 28759588 / +0.8% 39320700 / 39195263 / +0.3% 0.74 / 0.73 / +0.4%
tpcds_q23/duckdb:vortex-file-compressed 35861020 / 35790907 / +0.2% 46026068 / 46965090 / -2.0% 0.78 / 0.76 / +2.2%
tpcds_q24/duckdb:vortex-file-compressed 27892470 / 27933572 / -0.1% 41472193 / 39463970 / +5.1% 0.67 / 0.71 / -5.0%
tpcds_q25/duckdb:vortex-file-compressed 25843751 / 25249884 / +2.4% 40820542 / 38892117 / +5.0% 0.63 / 0.65 / -2.5%
tpcds_q26/duckdb:vortex-file-compressed 13569608 / 13311864 / +1.9% 19928772 / 20791264 / -4.1% 0.68 / 0.64 / +6.3%
tpcds_q27/duckdb:vortex-file-compressed 17481720 / 17533700 / -0.3% 31011589 / 28754067 / +7.9% 0.56 / 0.61 / -7.6%
tpcds_q28/duckdb:vortex-file-compressed 13326913 / 9361788 / +42.4% 🔴 22865752 / 17899589 / +27.7% 🔴 0.58 / 0.52 / +11.4%
tpcds_q29/duckdb:vortex-file-compressed 29494346 / 28211586 / +4.5% 45831710 / 43598255 / +5.1% 0.64 / 0.65 / -0.5%
tpcds_q30/duckdb:vortex-file-compressed 19479282 / 19355786 / +0.6% 28711620 / 30103320 / -4.6% 0.68 / 0.64 / +5.5%
tpcds_q31/duckdb:vortex-file-compressed 19592182 / 19156539 / +2.3% 26270927 / 27391723 / -4.1% 0.75 / 0.70 / +6.6%
tpcds_q32/duckdb:vortex-file-compressed 10202851 / 10370851 / -1.6% 17387953 / 20299064 / -14.3% 🟢 0.59 / 0.51 / +14.9%
tpcds_q33/duckdb:vortex-file-compressed 16595086 / 17642654 / -5.9% 27891103 / 30052452 / -7.2% 0.59 / 0.59 / +1.4%
tpcds_q34/duckdb:vortex-file-compressed 15409056 / 15460911 / -0.3% 22898562 / 23772076 / -3.7% 0.67 / 0.65 / +3.5%
tpcds_q35/duckdb:vortex-file-compressed 46351339 / 46021426 / +0.7% 59192046 / 61457773 / -3.7% 0.78 / 0.75 / +4.6%
tpcds_q36/duckdb:vortex-file-compressed 15869142 / 15306990 / +3.7% 25284865 / 28380576 / -10.9% 🟢 0.63 / 0.54 / +16.4%
tpcds_q37/duckdb:vortex-file-compressed 13781850 / 13935466 / -1.1% 26457580 / 22922037 / +15.4% 🔴 0.52 / 0.61 / -14.3%
tpcds_q38/duckdb:vortex-file-compressed 22195410 / 22078332 / +0.5% 29932015 / 30423945 / -1.6% 0.74 / 0.73 / +2.2%
tpcds_q39/duckdb:vortex-file-compressed 18346201 / 19015499 / -3.5% 26794275 / 28374405 / -5.6% 0.68 / 0.67 / +2.2%
tpcds_q40/duckdb:vortex-file-compressed 13238080 / 13188678 / +0.4% 19169201 / 19309160 / -0.7% 0.69 / 0.68 / +1.1%
tpcds_q41/duckdb:vortex-file-compressed 6729496 / 6469400 / +4.0% 9982105 / 9127689 / +9.4% 0.67 / 0.71 / -4.9%
tpcds_q42/duckdb:vortex-file-compressed 8182626 / 8313466 / -1.6% 16395333 / 16596730 / -1.2% 0.50 / 0.50 / -0.4%
tpcds_q43/duckdb:vortex-file-compressed 10245951 / 10168554 / +0.8% 17695375 / 17747761 / -0.3% 0.58 / 0.57 / +1.1%
tpcds_q44/duckdb:vortex-file-compressed 16104240 / 13888414 / +16.0% 🔴 29336775 / 25260841 / +16.1% 🔴 0.55 / 0.55 / -0.2%
tpcds_q45/duckdb:vortex-file-compressed 22488696 / 22416130 / +0.3% 28560208 / 30964034 / -7.8% 0.79 / 0.72 / +8.8%
tpcds_q46/duckdb:vortex-file-compressed 18479770 / 18480462 / -0.0% 30365047 / 30006865 / +1.2% 0.61 / 0.62 / -1.2%
tpcds_q47/duckdb:vortex-file-compressed 30841890 / 30503990 / +1.1% 40851411 / 40249043 / +1.5% 0.75 / 0.76 / -0.4%
tpcds_q48/duckdb:vortex-file-compressed 20386118 / 19590680 / +4.1% 30193769 / 33174439 / -9.0% 0.68 / 0.59 / +14.3%
tpcds_q49/duckdb:vortex-file-compressed 16917894 / 16684794 / +1.4% 28922927 / 27244959 / +6.2% 0.58 / 0.61 / -4.5%
tpcds_q50/duckdb:vortex-file-compressed 17261682 / 16788636 / +2.8% 31327701 / 27533792 / +13.8% 🔴 0.55 / 0.61 / -9.6%
tpcds_q51/duckdb:vortex-file-compressed 77027635 / 76274130 / +1.0% 65029578 / 62443984 / +4.1% 1.18 / 1.22 / -3.0%
tpcds_q52/duckdb:vortex-file-compressed 9708034 / 8794598 / +10.4% 🔴 16541534 / 16831128 / -1.7% 0.59 / 0.52 / +12.3%
tpcds_q53/duckdb:vortex-file-compressed 14654060 / 14355218 / +2.1% 24103412 / 24745528 / -2.6% 0.61 / 0.58 / +4.8%
tpcds_q54/duckdb:vortex-file-compressed 20449160 / 20199703 / +1.2% 28909355 / 29321303 / -1.4% 0.71 / 0.69 / +2.7%
tpcds_q55/duckdb:vortex-file-compressed 8768462 / 8075347 / +8.6% 16490596 / 20164924 / -18.2% 🟢 0.53 / 0.40 / +32.8%
tpcds_q56/duckdb:vortex-file-compressed 17555792 / 17045854 / +3.0% 29624076 / 27870856 / +6.3% 0.59 / 0.61 / -3.1%
tpcds_q57/duckdb:vortex-file-compressed 24230052 / 24209978 / +0.1% 31186514 / 30974503 / +0.7% 0.78 / 0.78 / -0.6%
tpcds_q58/duckdb:vortex-file-compressed 17666069 / 18271094 / -3.3% 25905965 / 29818576 / -13.1% 🟢 0.68 / 0.61 / +11.3%
tpcds_q59/duckdb:vortex-file-compressed 18869902 / 18766210 / +0.6% 24125660 / 31058345 / -22.3% 🟢 0.78 / 0.60 / +29.4%
tpcds_q60/duckdb:vortex-file-compressed 18222175 / 17644514 / +3.3% 28659895 / 28601896 / +0.2% 0.64 / 0.62 / +3.1%
tpcds_q61/duckdb:vortex-file-compressed 19927266 / 19377496 / +2.8% 31939319 / 30785810 / +3.7% 0.62 / 0.63 / -0.9%
tpcds_q62/duckdb:vortex-file-compressed 10228130 / 10123908 / +1.0% 15832875 / 18655836 / -15.1% 🟢 0.65 / 0.54 / +19.0%
tpcds_q63/duckdb:vortex-file-compressed 13545107 / 13609610 / -0.5% 24370123 / 22930959 / +6.3% 0.56 / 0.59 / -6.4%
tpcds_q64/duckdb:vortex-file-compressed 63387688 / 62233933 / +1.9% 78626944 / 80754957 / -2.6% 0.81 / 0.77 / +4.6%
tpcds_q65/duckdb:vortex-file-compressed 15643166 / 13472304 / +16.1% 🔴 28817674 / 22663036 / +27.2% 🔴 0.54 / 0.59 / -8.7%
tpcds_q66/duckdb:vortex-file-compressed 21079896 / 21029113 / +0.2% 28952896 / 30563205 / -5.3% 0.73 / 0.69 / +5.8%
tpcds_q67/duckdb:vortex-file-compressed 66068545 / 65069529 / +1.5% 88204632 / 82193450 / +7.3% 0.75 / 0.79 / -5.4%
tpcds_q68/duckdb:vortex-file-compressed 18180099 / 18256477 / -0.4% 28488012 / 32026984 / -11.0% 🟢 0.64 / 0.57 / +12.0%
tpcds_q69/duckdb:vortex-file-compressed 29217685 / 28830238 / +1.3% 42297609 / 44531673 / -5.0% 0.69 / 0.65 / +6.7%
tpcds_q70/duckdb:vortex-file-compressed 18523006 / 18897273 / -2.0% 31267224 / 29016182 / +7.8% 0.59 / 0.65 / -9.0%
tpcds_q71/duckdb:vortex-file-compressed 12644310 / 12761706 / -0.9% 21869597 / 23223901 / -5.8% 0.58 / 0.55 / +5.2%
tpcds_q72/duckdb:vortex-file-compressed 61655930 / 62483531 / -1.3% 76196802 / 78664380 / -3.1% 0.81 / 0.79 / +1.9%
tpcds_q73/duckdb:vortex-file-compressed 14855107 / 15161731 / -2.0% 20006080 / 23755005 / -15.8% 🟢 0.74 / 0.64 / +16.3%
tpcds_q74/duckdb:vortex-file-compressed 27281538 / 27420398 / -0.5% 35678045 / 35675649 / +0.0% 0.76 / 0.77 / -0.5%
tpcds_q75/duckdb:vortex-file-compressed 27903128 / 28715143 / -2.8% 38354855 / 39880414 / -3.8% 0.73 / 0.72 / +1.0%
tpcds_q76/duckdb:vortex-file-compressed 11896525 / 12648963 / -5.9% 24281485 / 23741657 / +2.3% 0.49 / 0.53 / -8.0%
tpcds_q77/duckdb:vortex-file-compressed 15774454 / 16198262 / -2.6% 23401409 / 23352740 / +0.2% 0.67 / 0.69 / -2.8%
tpcds_q78/duckdb:vortex-file-compressed 36831635 / 37464788 / -1.7% 46670612 / 47859557 / -2.5% 0.79 / 0.78 / +0.8%
tpcds_q79/duckdb:vortex-file-compressed 14626240 / 14598717 / +0.2% 25022497 / 23823103 / +5.0% 0.58 / 0.61 / -4.6%
tpcds_q80/duckdb:vortex-file-compressed 28455110 / 27185050 / +4.7% 41522881 / 42154706 / -1.5% 0.69 / 0.64 / +6.3%
tpcds_q81/duckdb:vortex-file-compressed 22327896 / 22402558 / -0.3% 31759856 / 28936950 / +9.8% 0.70 / 0.77 / -9.2%
tpcds_q82/duckdb:vortex-file-compressed 31922974 / 31405754 / +1.6% 39373203 / 39553263 / -0.5% 0.81 / 0.79 / +2.1%
tpcds_q83/duckdb:vortex-file-compressed 20112636 / 20961227 / -4.0% 24813449 / 24547236 / +1.1% 0.81 / 0.85 / -5.1%
tpcds_q84/duckdb:vortex-file-compressed 12634284 / 12626028 / +0.1% 21558550 / 18861758 / +14.3% 🔴 0.59 / 0.67 / -12.5%
tpcds_q85/duckdb:vortex-file-compressed 31504844 / 31109180 / +1.3% 42719155 / 43071805 / -0.8% 0.74 / 0.72 / +2.1%
tpcds_q86/duckdb:vortex-file-compressed 10668732 / 10997869 / -3.0% 17289870 / 17245358 / +0.3% 0.62 / 0.64 / -3.2%
tpcds_q87/duckdb:vortex-file-compressed 24120259 / 24352950 / -1.0% 31414893 / 31070435 / +1.1% 0.77 / 0.78 / -2.0%
tpcds_q88/duckdb:vortex-file-compressed 33678264 / 32302662 / +4.3% 49712861 / 46772785 / +6.3% 0.68 / 0.69 / -1.9%
tpcds_q89/duckdb:vortex-file-compressed 13966403 / 13792077 / +1.3% 22505050 / 23509624 / -4.3% 0.62 / 0.59 / +5.8%
tpcds_q90/duckdb:vortex-file-compressed 8410336 / 7432348 / +13.2% 🔴 15660497 / 12869715 / +21.7% 🔴 0.54 / 0.58 / -7.0%
tpcds_q91/duckdb:vortex-file-compressed 15247815 / 15247972 / -0.0% 21199977 / 21198463 / +0.0% 0.72 / 0.72 / -0.0%
tpcds_q92/duckdb:vortex-file-compressed 13086320 / 13046147 / +0.3% 21103675 / 21213398 / -0.5% 0.62 / 0.61 / +0.8%
tpcds_q93/duckdb:vortex-file-compressed 17912478 / 16816568 / +6.5% 24832169 / 25188420 / -1.4% 0.72 / 0.67 / +8.0%
tpcds_q94/duckdb:vortex-file-compressed 16123400 / 16344416 / -1.4% 28790397 / 25089229 / +14.8% 🔴 0.56 / 0.65 / -14.0%
tpcds_q95/duckdb:vortex-file-compressed 45152552 / 71180804 / -36.6% 🟢 52888078 / 78700966 / -32.8% 🟢 0.85 / 0.90 / -5.6%
tpcds_q96/duckdb:vortex-file-compressed 7250552 / 7696746 / -5.8% 13964080 / 18373996 / -24.0% 🟢 0.52 / 0.42 / +24.0%
tpcds_q97/duckdb:vortex-file-compressed 22208224 / 22011854 / +0.9% 28541009 / 29609142 / -3.6% 0.78 / 0.74 / +4.7%
tpcds_q98/duckdb:vortex-file-compressed 13258836 / 13277296 / -0.1% 21222045 / 21130187 / +0.4% 0.62 / 0.63 / -0.6%
tpcds_q99/duckdb:vortex-file-compressed 13370153 / 13307196 / +0.5% 19247590 / 21778714 / -11.6% 🟢 0.69 / 0.61 / +13.7%
duckdb / parquet / ns (1.012x ➖, 3↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 25555079 / 23352048 / +9.4% 33985556 / 31537617 / +7.8% 0.75 / 0.74 / +1.6%
tpcds_q02/duckdb:parquet 15216396 / 15330742 / -0.7% 19454754 / 20056645 / -3.0% 0.78 / 0.76 / +2.3%
tpcds_q03/duckdb:parquet 8787487 / 8625940 / +1.9% 15504241 / 15614842 / -0.7% 0.57 / 0.55 / +2.6%
tpcds_q04/duckdb:parquet 127366266 / 126773416 / +0.5% 132315605 / 132303195 / +0.0% 0.96 / 0.96 / +0.5%
tpcds_q05/duckdb:parquet 21438799 / 21559506 / -0.6% 25268840 / 25088043 / +0.7% 0.85 / 0.86 / -1.3%
tpcds_q06/duckdb:parquet 26781575 / 26578738 / +0.8% 37358215 / 37593376 / -0.6% 0.72 / 0.71 / +1.4%
tpcds_q07/duckdb:parquet 15268217 / 14993852 / +1.8% 23136948 / 22841055 / +1.3% 0.66 / 0.66 / +0.5%
tpcds_q08/duckdb:parquet 25647812 / 25580714 / +0.3% 32705425 / 34977263 / -6.5% 0.78 / 0.73 / +7.2%
tpcds_q09/duckdb:parquet 19767424 / 18405865 / +7.4% 23248335 / 26081220 / -10.9% 🟢 0.85 / 0.71 / +20.5%
tpcds_q10/duckdb:parquet 27804774 / 27539359 / +1.0% 38183699 / 37489357 / +1.9% 0.73 / 0.73 / -0.9%
tpcds_q11/duckdb:parquet 71398642 / 71440337 / -0.1% 76446508 / 77831120 / -1.8% 0.93 / 0.92 / +1.8%
tpcds_q12/duckdb:parquet 12737304 / 12450487 / +2.3% 17260421 / 16971087 / +1.7% 0.74 / 0.73 / +0.6%
tpcds_q13/duckdb:parquet 23954626 / 23714144 / +1.0% 31289425 / 31484182 / -0.6% 0.77 / 0.75 / +1.6%
tpcds_q14/duckdb:parquet 60314942 / 60515676 / -0.3% 67897971 / 67626209 / +0.4% 0.89 / 0.89 / -0.7%
tpcds_q15/duckdb:parquet 24900008 / 24715510 / +0.7% 30517327 / 30977104 / -1.5% 0.82 / 0.80 / +2.3%
tpcds_q16/duckdb:parquet 19718157 / 19680642 / +0.2% 29019575 / 31140137 / -6.8% 0.68 / 0.63 / +7.5%
tpcds_q17/duckdb:parquet 32360434 / 32332846 / +0.1% 40254998 / 40071293 / +0.5% 0.80 / 0.81 / -0.4%
tpcds_q18/duckdb:parquet 40307296 / 38515624 / +4.7% 50475817 / 50312271 / +0.3% 0.80 / 0.77 / +4.3%
tpcds_q19/duckdb:parquet 24366542 / 24229674 / +0.6% 31289666 / 31324434 / -0.1% 0.78 / 0.77 / +0.7%
tpcds_q20/duckdb:parquet 16112746 / 13345092 / +20.7% 🔴 18441704 / 18216248 / +1.2% 0.87 / 0.73 / +19.3%
tpcds_q21/duckdb:parquet 9457122 / 9349622 / +1.1% 13045324 / 13063792 / -0.1% 0.72 / 0.72 / +1.3%
tpcds_q22/duckdb:parquet 36626456 / 34693719 / +5.6% 39154118 / 39572318 / -1.1% 0.94 / 0.88 / +6.7%
tpcds_q23/duckdb:parquet 40399390 / 40096737 / +0.8% 46851317 / 47085373 / -0.5% 0.86 / 0.85 / +1.3%
tpcds_q24/duckdb:parquet 34766318 / 33085888 / +5.1% 44432926 / 46386739 / -4.2% 0.78 / 0.71 / +9.7%
tpcds_q25/duckdb:parquet 30025964 / 29657736 / +1.2% 40633060 / 40363917 / +0.7% 0.74 / 0.73 / +0.6%
tpcds_q26/duckdb:parquet 31121354 / 30929484 / +0.6% 38995894 / 41497897 / -6.0% 0.80 / 0.75 / +7.1%
tpcds_q27/duckdb:parquet 31939132 / 31426096 / +1.6% 40563705 / 40433582 / +0.3% 0.79 / 0.78 / +1.3%
tpcds_q28/duckdb:parquet 18267784 / 17021784 / +7.3% 22013212 / 19459611 / +13.1% 🔴 0.83 / 0.87 / -5.1%
tpcds_q29/duckdb:parquet 30710570 / 30254785 / +1.5% 39668147 / 41896731 / -5.3% 0.77 / 0.72 / +7.2%
tpcds_q30/duckdb:parquet 32258528 / 32311669 / -0.2% 43298471 / 41238244 / +5.0% 0.75 / 0.78 / -4.9%
tpcds_q31/duckdb:parquet 20607972 / 19925798 / +3.4% 25274837 / 23922656 / +5.7% 0.82 / 0.83 / -2.1%
tpcds_q32/duckdb:parquet 11230350 / 10927976 / +2.8% 17855321 / 17445194 / +2.4% 0.63 / 0.63 / +0.4%
tpcds_q33/duckdb:parquet 16657758 / 15536878 / +7.2% 24522437 / 23311182 / +5.2% 0.68 / 0.67 / +1.9%
tpcds_q34/duckdb:parquet 16106274 / 15974960 / +0.8% 22323897 / 21728245 / +2.7% 0.72 / 0.74 / -1.9%
tpcds_q35/duckdb:parquet 48851346 / 48769035 / +0.2% 57338465 / 56493939 / +1.5% 0.85 / 0.86 / -1.3%
tpcds_q36/duckdb:parquet 16401950 / 16614340 / -1.3% 22541194 / 22464771 / +0.3% 0.73 / 0.74 / -1.6%
tpcds_q37/duckdb:parquet 11456934 / 11393614 / +0.6% 17402686 / 16439839 / +5.9% 0.66 / 0.69 / -5.0%
tpcds_q38/duckdb:parquet 26148296 / 26468302 / -1.2% 30605470 / 30508259 / +0.3% 0.85 / 0.87 / -1.5%
tpcds_q39/duckdb:parquet 24465518 / 25802698 / -5.2% 28966060 / 29531301 / -1.9% 0.84 / 0.87 / -3.3%
tpcds_q40/duckdb:parquet 16004227 / 15670038 / +2.1% 21797224 / 21503955 / +1.4% 0.73 / 0.73 / +0.8%
tpcds_q41/duckdb:parquet 7710174 / 7635004 / +1.0% 14047302 / 13832400 / +1.6% 0.55 / 0.55 / -0.6%
tpcds_q42/duckdb:parquet 8338166 / 8291932 / +0.6% 15002215 / 15327075 / -2.1% 0.56 / 0.54 / +2.7%
tpcds_q43/duckdb:parquet 10638383 / 10503962 / +1.3% 16043393 / 15701349 / +2.2% 0.66 / 0.67 / -0.9%
tpcds_q44/duckdb:parquet 16081280 / 15907908 / +1.1% 22186027 / 22582294 / -1.8% 0.72 / 0.70 / +2.9%
tpcds_q45/duckdb:parquet 23037536 / 22941414 / +0.4% 28952169 / 28731045 / +0.8% 0.80 / 0.80 / -0.3%
tpcds_q46/duckdb:parquet 36208129 / 35824610 / +1.1% 45356118 / 47021629 / -3.5% 0.80 / 0.76 / +4.8%
tpcds_q47/duckdb:parquet 31287568 / 31041402 / +0.8% 37531726 / 37467282 / +0.2% 0.83 / 0.83 / +0.6%
tpcds_q48/duckdb:parquet 21051256 / 20782306 / +1.3% 28960593 / 28159478 / +2.8% 0.73 / 0.74 / -1.5%
tpcds_q49/duckdb:parquet 18924839 / 18732192 / +1.0% 27309124 / 27301918 / +0.0% 0.69 / 0.69 / +1.0%
tpcds_q50/duckdb:parquet 17520816 / 17409758 / +0.6% 25204922 / 26810295 / -6.0% 0.70 / 0.65 / +7.0%
tpcds_q51/duckdb:parquet 53642682 / 53070688 / +1.1% 60126023 / 61614166 / -2.4% 0.89 / 0.86 / +3.6%
tpcds_q52/duckdb:parquet 8474768 / 8472758 / +0.0% 15004288 / 15341158 / -2.2% 0.56 / 0.55 / +2.3%
tpcds_q53/duckdb:parquet 11646460 / 11399011 / +2.2% 16853111 / 20886854 / -19.3% 🟢 0.69 / 0.55 / +26.6%
tpcds_q54/duckdb:parquet 20731730 / 20097378 / +3.2% 30472393 / 29687549 / +2.6% 0.68 / 0.68 / +0.5%
tpcds_q55/duckdb:parquet 8408272 / 8484828 / -0.9% 15097289 / 18361716 / -17.8% 🟢 0.56 / 0.46 / +20.5%
tpcds_q56/duckdb:parquet 16157894 / 16151527 / +0.0% 22984324 / 23378542 / -1.7% 0.70 / 0.69 / +1.8%
tpcds_q57/duckdb:parquet 29073665 / 32505820 / -10.6% 🟢 34345617 / 35286675 / -2.7% 0.85 / 0.92 / -8.1%
tpcds_q58/duckdb:parquet 18063086 / 18458678 / -2.1% 25951845 / 26043828 / -0.4% 0.70 / 0.71 / -1.8%
tpcds_q59/duckdb:parquet 20026150 / 19865357 / +0.8% 25073730 / 25092431 / -0.1% 0.80 / 0.79 / +0.9%
tpcds_q60/duckdb:parquet 16761374 / 16837206 / -0.5% 24233461 / 24662808 / -1.7% 0.69 / 0.68 / +1.3%
tpcds_q61/duckdb:parquet 21675067 / 21465174 / +1.0% 28402971 / 32871968 / -13.6% 🟢 0.76 / 0.65 / +16.9%
tpcds_q62/duckdb:parquet 10756396 / 10579738 / +1.7% 15047184 / 14989244 / +0.4% 0.71 / 0.71 / +1.3%
tpcds_q63/duckdb:parquet 10698920 / 10751542 / -0.5% 17770112 / 16387626 / +8.4% 0.60 / 0.66 / -8.2%
tpcds_q64/duckdb:parquet 52567029 / 52011177 / +1.1% 71559517 / 65237595 / +9.7% 0.73 / 0.80 / -7.9%
tpcds_q65/duckdb:parquet 14585261 / 14439966 / +1.0% 24606017 / 20747557 / +18.6% 🔴 0.59 / 0.70 / -14.8%
tpcds_q66/duckdb:parquet 24598087 / 24161584 / +1.8% 31529341 / 30885905 / +2.1% 0.78 / 0.78 / -0.3%
tpcds_q67/duckdb:parquet 76469628 / 78113346 / -2.1% 84697219 / 86741986 / -2.4% 0.90 / 0.90 / +0.3%
tpcds_q68/duckdb:parquet 29128246 / 32709273 / -10.9% 🟢 40459133 / 40313039 / +0.4% 0.72 / 0.81 / -11.3%
tpcds_q69/duckdb:parquet 28550077 / 28463645 / +0.3% 38760400 / 38652740 / +0.3% 0.74 / 0.74 / +0.0%
tpcds_q70/duckdb:parquet 15933738 / 16081538 / -0.9% 22789024 / 23558476 / -3.3% 0.70 / 0.68 / +2.4%
tpcds_q71/duckdb:parquet 14660970 / 14709520 / -0.3% 20142405 / 20604824 / -2.2% 0.73 / 0.71 / +2.0%
tpcds_q72/duckdb:parquet 81305990 / 81383026 / -0.1% 87270393 / 89209961 / -2.2% 0.93 / 0.91 / +2.1%
tpcds_q73/duckdb:parquet 13401175 / 14187348 / -5.5% 19406703 / 19351225 / +0.3% 0.69 / 0.73 / -5.8%
tpcds_q74/duckdb:parquet 98218750 / 97912474 / +0.3% 108870029 / 107825264 / +1.0% 0.90 / 0.91 / -0.6%
tpcds_q75/duckdb:parquet 40011014 / 39763630 / +0.6% 51280160 / 51144758 / +0.3% 0.78 / 0.78 / +0.4%
tpcds_q76/duckdb:parquet 13492668 / 13783530 / -2.1% 20732329 / 21272724 / -2.5% 0.65 / 0.65 / +0.4%
tpcds_q77/duckdb:parquet 16796154 / 16711963 / +0.5% 24664705 / 25196390 / -2.1% 0.68 / 0.66 / +2.7%
tpcds_q78/duckdb:parquet 48476578 / 47880601 / +1.2% 52679701 / 55863819 / -5.7% 0.92 / 0.86 / +7.4%
tpcds_q79/duckdb:parquet 20401172 / 20178668 / +1.1% 31069019 / 29135051 / +6.6% 0.66 / 0.69 / -5.2%
tpcds_q80/duckdb:parquet 31359276 / 31067675 / +0.9% 39945595 / 39599132 / +0.9% 0.79 / 0.78 / +0.1%
tpcds_q81/duckdb:parquet 32144072 / 29422394 / +9.3% 41665559 / 38788916 / +7.4% 0.77 / 0.76 / +1.7%
tpcds_q82/duckdb:parquet 14016995 / 12662362 / +10.7% 🔴 20684582 / 18755979 / +10.3% 🔴 0.68 / 0.68 / +0.4%
tpcds_q83/duckdb:parquet 16210716 / 15552430 / +4.2% 20610195 / 20924590 / -1.5% 0.79 / 0.74 / +5.8%
tpcds_q84/duckdb:parquet 17224126 / 17142968 / +0.5% 23582954 / 23231413 / +1.5% 0.73 / 0.74 / -1.0%
tpcds_q85/duckdb:parquet 34472214 / 34006142 / +1.4% 47769165 / 45590717 / +4.8% 0.72 / 0.75 / -3.3%
tpcds_q86/duckdb:parquet 13132153 / 10791930 / +21.7% 🔴 15774354 / 18013336 / -12.4% 🟢 0.83 / 0.60 / +39.0%
tpcds_q87/duckdb:parquet 29854520 / 28026134 / +6.5% 31997859 / 35596416 / -10.1% 🟢 0.93 / 0.79 / +18.5%
tpcds_q88/duckdb:parquet 27207972 / 26807972 / +1.5% 31863179 / 37879711 / -15.9% 🟢 0.85 / 0.71 / +20.7%
tpcds_q89/duckdb:parquet 12655920 / 12404224 / +2.0% 19125420 / 18911872 / +1.1% 0.66 / 0.66 / +0.9%
tpcds_q90/duckdb:parquet 6808470 / 8171182 / -16.7% 🟢 13658970 / 11151242 / +22.5% 🔴 0.50 / 0.73 / -32.0%
tpcds_q91/duckdb:parquet 20796060 / 20460686 / +1.6% 28974640 / 29795985 / -2.8% 0.72 / 0.69 / +4.5%
tpcds_q92/duckdb:parquet 11411969 / 11205708 / +1.8% 18406065 / 19828623 / -7.2% 0.62 / 0.57 / +9.7%
tpcds_q93/duckdb:parquet 21701680 / 21607737 / +0.4% 30336787 / 28947958 / +4.8% 0.72 / 0.75 / -4.2%
tpcds_q94/duckdb:parquet 16024638 / 15631476 / +2.5% 24713516 / 27995681 / -11.7% 🟢 0.65 / 0.56 / +16.1%
tpcds_q95/duckdb:parquet 91149104 / 89792508 / +1.5% 96434864 / 96198368 / +0.2% 0.95 / 0.93 / +1.3%
tpcds_q96/duckdb:parquet 6879345 / 6882484 / -0.0% 10663221 / 10528119 / +1.3% 0.65 / 0.65 / -1.3%
tpcds_q97/duckdb:parquet 25825370 / 25622762 / +0.8% 32145554 / 32089753 / +0.2% 0.80 / 0.80 / +0.6%
tpcds_q98/duckdb:parquet 15120861 / 14740022 / +2.6% 21859990 / 22011651 / -0.7% 0.69 / 0.67 / +3.3%
tpcds_q99/duckdb:parquet 17166314 / 17213930 / -0.3% 21711486 / 21848941 / -0.6% 0.79 / 0.79 / +0.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 68fb80dc vs base a3e9d40e
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.6%
Engines: DataFusion No clear signal (-5.4%, environment too noisy confidence) · DuckDB No clear signal (-1.7%, environment too noisy confidence)
Vortex (geomean): hot 1.088x ➖ · cold 1.008x ➖
Parquet (geomean): hot 1.128x ➖ · cold 1.125x ➖
Shifts: Parquet (control) +12.8% · Median polish +9.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.082x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 50540676 / 44577412 / +13.4% 166637172 / 112993247 / +47.5% 🔴 0.30 / 0.39 / -23.1%
fineweb_q01/datafusion:vortex-file-compressed 481225111 / 383993691 / +25.3% 572253465 / 593108468 / -3.5% 0.84 / 0.65 / +29.9%
fineweb_q02/datafusion:vortex-file-compressed 544668508 / 379260586 / +43.6% 🔴 830805824 / 644518601 / +28.9% 0.66 / 0.59 / +11.4%
fineweb_q03/datafusion:vortex-file-compressed 505552021 / 506293400 / -0.1% 909168895 / 912454508 / -0.4% 0.56 / 0.55 / +0.2%
fineweb_q04/datafusion:vortex-file-compressed 423770898 / 396289282 / +6.9% 458286499 / 428436503 / +7.0% 0.92 / 0.92 / -0.0%
fineweb_q05/datafusion:vortex-file-compressed 408650636 / 608047588 / -32.8% 🟢 571836027 / 817046453 / -30.0% 🟢 0.71 / 0.74 / -4.0%
fineweb_q06/datafusion:vortex-file-compressed 747023459 / 1369705918 / -45.5% 🟢 760267157 / 1500336422 / -49.3% 🟢 0.98 / 0.91 / +7.6%
fineweb_q07/datafusion:vortex-file-compressed 454607284 / 453338774 / +0.3% 452484626 / 552970156 / -18.2% 1.00 / 0.82 / +22.5%
fineweb_q08/datafusion:vortex-file-compressed 462384976 / 182372650 / +153.5% 🔴 508339984 / 194879042 / +160.8% 🔴 0.91 / 0.94 / -2.8%
datafusion / parquet / ns (1.144x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 901618038 / 482646796 / +86.8% 🔴 935312020 / 731846959 / +27.8% 0.96 / 0.66 / +46.2%
fineweb_q01/datafusion:parquet 871831232 / 849840920 / +2.6% 835282961 / 802658154 / +4.1% 1.04 / 1.06 / -1.4%
fineweb_q02/datafusion:parquet 716336726 / 792094594 / -9.6% 855340386 / 688614600 / +24.2% 0.84 / 1.15 / -27.2%
fineweb_q03/datafusion:parquet 777666342 / 955667468 / -18.6% 885515626 / 785697322 / +12.7% 0.88 / 1.22 / -27.8%
fineweb_q04/datafusion:parquet 1044195140 / 682203358 / +53.1% 🔴 943335814 / 598567138 / +57.6% 🔴 1.11 / 1.14 / -2.9%
fineweb_q05/datafusion:parquet 907615278 / 749621635 / +21.1% 828958764 / 670620604 / +23.6% 1.09 / 1.12 / -2.1%
fineweb_q06/datafusion:parquet 844948527 / 835846155 / +1.1% 847020786 / 816257225 / +3.8% 1.00 / 1.02 / -2.6%
fineweb_q07/datafusion:parquet 1002721016 / 901757795 / +11.2% 913490653 / 1073520719 / -14.9% 1.10 / 0.84 / +30.7%
fineweb_q08/datafusion:parquet 803477116 / 705968488 / +13.8% 856863355 / 854922883 / +0.2% 0.94 / 0.83 / +13.6%
duckdb / vortex-file-compressed / ns (1.094x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 57551771 / 59141609 / -2.7% 54686624 / 78530578 / -30.4% 🟢 1.05 / 0.75 / +39.7%
fineweb_q01/duckdb:vortex-file-compressed 434775064 / 404685446 / +7.4% 506235747 / 466701609 / +8.5% 0.86 / 0.87 / -1.0%
fineweb_q02/duckdb:vortex-file-compressed 1200792716 / 592066152 / +102.8% 🔴 796845115 / 635043641 / +25.5% 1.51 / 0.93 / +61.6%
fineweb_q03/duckdb:vortex-file-compressed 949649987 / 1226033904 / -22.5% 1054472999 / 1269368846 / -16.9% 0.90 / 0.97 / -6.8%
fineweb_q04/duckdb:vortex-file-compressed 1037419602 / 1037781922 / -0.0% 1034932232 / 1010025143 / +2.5% 1.00 / 1.03 / -2.4%
fineweb_q05/duckdb:vortex-file-compressed 909986422 / 940921730 / -3.3% 1008119624 / 1012088365 / -0.4% 0.90 / 0.93 / -2.9%
fineweb_q06/duckdb:vortex-file-compressed 1706382842 / 1172888139 / +45.5% 🔴 1625755133 / 1191328428 / +36.5% 🔴 1.05 / 0.98 / +6.6%
fineweb_q07/duckdb:vortex-file-compressed 1028995771 / 1019300991 / +1.0% 1034526635 / 1174692908 / -11.9% 0.99 / 0.87 / +14.6%
fineweb_q08/duckdb:vortex-file-compressed 404913158 / 421394055 / -3.9% 469649841 / 577514746 / -18.7% 0.86 / 0.73 / +18.2%
duckdb / parquet / ns (1.113x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 545304260 / 487974800 / +11.7% 570044032 / 549626862 / +3.7% 0.96 / 0.89 / +7.7%
fineweb_q01/duckdb:parquet 655677156 / 584408003 / +12.2% 661365669 / 567003349 / +16.6% 0.99 / 1.03 / -3.8%
fineweb_q02/duckdb:parquet 650816572 / 621133878 / +4.8% 822533618 / 643749563 / +27.8% 0.79 / 0.96 / -18.0%
fineweb_q03/duckdb:parquet 1487953270 / 1379073245 / +7.9% 1503360216 / 1416286893 / +6.1% 0.99 / 0.97 / +1.6%
fineweb_q04/duckdb:parquet 786208094 / 720478992 / +9.1% 1037218784 / 739180452 / +40.3% 🔴 0.76 / 0.97 / -22.2%
fineweb_q05/duckdb:parquet 995694646 / 829764677 / +20.0% 1147654676 / 790346773 / +45.2% 🔴 0.87 / 1.05 / -17.4%
fineweb_q06/duckdb:parquet 2578201352 / 1572877756 / +63.9% 🔴 1649138973 / 1952571288 / -15.5% 1.56 / 0.81 / +94.1%
fineweb_q07/duckdb:parquet 1229761012 / 1269515075 / -3.1% 1279077371 / 1202234223 / +6.4% 0.96 / 1.06 / -9.0%
fineweb_q08/duckdb:parquet 517659557 / 581101516 / -10.9% 569898762 / 663426802 / -14.1% 0.91 / 0.88 / +3.7%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 68fb80dc vs base a3e9d40e
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.2%
Engines: DuckDB No clear signal (-1.2%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.043x ➖
Parquet (geomean): hot 1.015x ➖ · cold 1.017x ➖
Shifts: Parquet (control) +1.5% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9078831 / 8966714 / +1.3% 9347894 / 9477464 / -1.4% 0.97 / 0.95 / +2.7%
statpopgen_q01/duckdb:vortex-file-compressed 10323708 / 10180961 / +1.4% 13830090 / 13551911 / +2.1% 0.75 / 0.75 / -0.6%
statpopgen_q02/duckdb:vortex-file-compressed 307112748 / 304840020 / +0.7% 336523640 / 330949896 / +1.7% 0.91 / 0.92 / -0.9%
statpopgen_q03/duckdb:vortex-file-compressed 809160004 / 804836338 / +0.5% 832439892 / 812316275 / +2.5% 0.97 / 0.99 / -1.9%
statpopgen_q04/duckdb:vortex-file-compressed 801917757 / 813729071 / -1.5% 815899742 / 812450556 / +0.4% 0.98 / 1.00 / -1.9%
statpopgen_q05/duckdb:vortex-file-compressed 320219466 / 321551814 / -0.4% 369273480 / 346243502 / +6.7% 0.87 / 0.93 / -6.6%
statpopgen_q06/duckdb:vortex-file-compressed 1147192250 / 1138491066 / +0.8% 1153494443 / 1141148028 / +1.1% 0.99 / 1.00 / -0.3%
statpopgen_q07/duckdb:vortex-file-compressed 128877662 / 126042632 / +2.2% 142733588 / 138203667 / +3.3% 0.90 / 0.91 / -1.0%
statpopgen_q08/duckdb:vortex-file-compressed 142876702 / 142977456 / -0.1% 203101517 / 161376456 / +25.9% 🔴 0.70 / 0.89 / -20.6%
statpopgen_q09/duckdb:vortex-file-compressed 613385194 / 617008432 / -0.6% 643285722 / 624117185 / +3.1% 0.95 / 0.99 / -3.5%
statpopgen_q10/duckdb:vortex-file-compressed 1903947425 / 1924509760 / -1.1% 1981991485 / 1898795599 / +4.4% 0.96 / 1.01 / -5.2%
duckdb / parquet / ns (1.015x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 247217230 / 246468903 / +0.3% 245643604 / 245075258 / +0.2% 1.01 / 1.01 / +0.1%
statpopgen_q01/duckdb:parquet 305363266 / 303587200 / +0.6% 306060929 / 305671451 / +0.1% 1.00 / 0.99 / +0.5%
statpopgen_q02/duckdb:parquet 550124469 / 559468544 / -1.7% 563123051 / 552457209 / +1.9% 0.98 / 1.01 / -3.5%
statpopgen_q03/duckdb:parquet 868740970 / 830035829 / +4.7% 865829654 / 802737026 / +7.9% 1.00 / 1.03 / -3.0%
statpopgen_q04/duckdb:parquet 881981744 / 830139184 / +6.2% 893406027 / 819649139 / +9.0% 0.99 / 1.01 / -2.5%
statpopgen_q05/duckdb:parquet 587392726 / 586700256 / +0.1% 585181250 / 592237749 / -1.2% 1.00 / 0.99 / +1.3%
statpopgen_q06/duckdb:parquet 729285846 / 725285226 / +0.6% 716041941 / 738830425 / -3.1% 1.02 / 0.98 / +3.8%
statpopgen_q07/duckdb:parquet 613356184 / 614537808 / -0.2% 705964008 / 724308727 / -2.5% 0.87 / 0.85 / +2.4%
statpopgen_q08/duckdb:parquet 622513697 / 618931382 / +0.6% 695990972 / 690188240 / +0.8% 0.89 / 0.90 / -0.3%
statpopgen_q09/duckdb:parquet 805356494 / 787683012 / +2.2% 833435743 / 804548212 / +3.6% 0.97 / 0.98 / -1.3%
statpopgen_q10/duckdb:parquet 1440746620 / 1391018258 / +3.6% 1278730363 / 1242101519 / +2.9% 1.13 / 1.12 / +0.6%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 68fb80dc vs base a3e9d40e
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.5%
Engines: DataFusion No clear signal (-6.2%, environment too noisy confidence) · DuckDB No clear signal (+1.3%, environment too noisy confidence)
Vortex (geomean): hot 1.043x ➖ · cold 1.068x ➖
Parquet (geomean): hot 1.070x ➖ · cold 1.045x ➖
Shifts: Parquet (control) +7.0% · Median polish +7.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.009x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 213833698 / 226518560 / -5.6% 717812853 / 722073880 / -0.6% 0.30 / 0.31 / -5.0%
tpch_q02/datafusion:vortex-file-compressed 426137750 / 471470898 / -9.6% 768140051 / 1057876484 / -27.4% 0.55 / 0.45 / +24.5%
tpch_q03/datafusion:vortex-file-compressed 487173672 / 388159655 / +25.5% 1230869326 / 904145414 / +36.1% 🔴 0.40 / 0.43 / -7.8%
tpch_q04/datafusion:vortex-file-compressed 187634546 / 185107623 / +1.4% 557523503 / 433722774 / +28.5% 0.34 / 0.43 / -21.1%
tpch_q05/datafusion:vortex-file-compressed 392974233 / 370348762 / +6.1% 638243100 / 550521234 / +15.9% 0.62 / 0.67 / -8.5%
tpch_q06/datafusion:vortex-file-compressed 258880933 / 337733646 / -23.3% 461713876 / 532132740 / -13.2% 0.56 / 0.63 / -11.7%
tpch_q07/datafusion:vortex-file-compressed 428541020 / 427847187 / +0.2% 575432174 / 656347437 / -12.3% 0.74 / 0.65 / +14.2%
tpch_q08/datafusion:vortex-file-compressed 599293942 / 556705658 / +7.7% 676560276 / 788394549 / -14.2% 0.89 / 0.71 / +25.4%
tpch_q09/datafusion:vortex-file-compressed 857910466 / 495424294 / +73.2% 🔴 1068337741 / 459728347 / +132.4% 🔴 0.80 / 1.08 / -25.5%
tpch_q10/datafusion:vortex-file-compressed 408140520 / 411150985 / -0.7% 498393239 / 472908072 / +5.4% 0.82 / 0.87 / -5.8%
tpch_q11/datafusion:vortex-file-compressed 288741923 / 324097965 / -10.9% 396248320 / 471247167 / -15.9% 0.73 / 0.69 / +6.0%
tpch_q12/datafusion:vortex-file-compressed 327641400 / 373763836 / -12.3% 639349349 / 481237076 / +32.9% 🔴 0.51 / 0.78 / -34.0%
tpch_q13/datafusion:vortex-file-compressed 160208921 / 308060618 / -48.0% 🟢 446770679 / 537770711 / -16.9% 0.36 / 0.57 / -37.4%
tpch_q14/datafusion:vortex-file-compressed 200108627 / 189261742 / +5.7% 333318163 / 302762519 / +10.1% 0.60 / 0.63 / -4.0%
tpch_q15/datafusion:vortex-file-compressed 308388061 / 317740402 / -2.9% 491874284 / 495048902 / -0.6% 0.63 / 0.64 / -2.3%
tpch_q16/datafusion:vortex-file-compressed 158616777 / 187446474 / -15.4% 342325048 / 408457052 / -16.2% 0.46 / 0.46 / +1.0%
tpch_q17/datafusion:vortex-file-compressed 339340893 / 343031671 / -1.1% 577939737 / 452849728 / +27.6% 0.59 / 0.76 / -22.5%
tpch_q18/datafusion:vortex-file-compressed 287818704 / 386006998 / -25.4% 450392236 / 444854556 / +1.2% 0.64 / 0.87 / -26.4%
tpch_q19/datafusion:vortex-file-compressed 396844443 / 326424540 / +21.6% 475002270 / 696273623 / -31.8% 🟢 0.84 / 0.47 / +78.2%
tpch_q20/datafusion:vortex-file-compressed 285458529 / 295848154 / -3.5% 488961896 / 471209931 / +3.8% 0.58 / 0.63 / -7.0%
tpch_q21/datafusion:vortex-file-compressed 1263207674 / 511898142 / +146.8% 🔴 609445814 / 648464230 / -6.0% 2.07 / 0.79 / +162.6%
tpch_q22/datafusion:vortex-file-compressed 169030565 / 169472345 / -0.3% 418488215 / 440892010 / -5.1% 0.40 / 0.38 / +5.1%
datafusion / parquet / ns (1.076x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 181238961 / 165419955 / +9.6% 586446734 / 461106518 / +27.2% 0.31 / 0.36 / -13.9%
tpch_q02/datafusion:parquet 316680818 / 260346914 / +21.6% 508404835 / 453381520 / +12.1% 0.62 / 0.57 / +8.5%
tpch_q03/datafusion:parquet 273115337 / 277725423 / -1.7% 810999361 / 700355669 / +15.8% 0.34 / 0.40 / -15.1%
tpch_q04/datafusion:parquet 148143098 / 135256177 / +9.5% 379476241 / 425364758 / -10.8% 0.39 / 0.32 / +22.8%
tpch_q05/datafusion:parquet 407628827 / 340663552 / +19.7% 501733413 / 591928401 / -15.2% 0.81 / 0.58 / +41.2%
tpch_q06/datafusion:parquet 126719353 / 125966630 / +0.6% 312107487 / 219807348 / +42.0% 🔴 0.41 / 0.57 / -29.2%
tpch_q07/datafusion:parquet 416349059 / 340480917 / +22.3% 468864933 / 680149329 / -31.1% 🟢 0.89 / 0.50 / +77.4%
tpch_q08/datafusion:parquet 426624055 / 529227196 / -19.4% 674982636 / 703204789 / -4.0% 0.63 / 0.75 / -16.0%
tpch_q09/datafusion:parquet 442935049 / 420647697 / +5.3% 707751227 / 576010364 / +22.9% 0.63 / 0.73 / -14.3%
tpch_q10/datafusion:parquet 427129432 / 384788192 / +11.0% 501728161 / 501822888 / -0.0% 0.85 / 0.77 / +11.0%
tpch_q11/datafusion:parquet 290932062 / 262758999 / +10.7% 395801557 / 454900249 / -13.0% 0.74 / 0.58 / +27.3%
tpch_q12/datafusion:parquet 202908476 / 183763665 / +10.4% 581328574 / 407956681 / +42.5% 🔴 0.35 / 0.45 / -22.5%
tpch_q13/datafusion:parquet 397992466 / 399675370 / -0.4% 656903996 / 593920008 / +10.6% 0.61 / 0.67 / -10.0%
tpch_q14/datafusion:parquet 176705749 / 159683469 / +10.7% 291884532 / 288311655 / +1.2% 0.61 / 0.55 / +9.3%
tpch_q15/datafusion:parquet 316557117 / 259723893 / +21.9% 458761426 / 384475964 / +19.3% 0.69 / 0.68 / +2.1%
tpch_q16/datafusion:parquet 121517157 / 104367862 / +16.4% 273582789 / 290688063 / -5.9% 0.44 / 0.36 / +23.7%
tpch_q17/datafusion:parquet 362689348 / 364985317 / -0.6% 636006084 / 469149730 / +35.6% 🔴 0.57 / 0.78 / -26.7%
tpch_q18/datafusion:parquet 433341288 / 431257432 / +0.5% 564575440 / 611712709 / -7.7% 0.77 / 0.70 / +8.9%
tpch_q19/datafusion:parquet 188640832 / 255059518 / -26.0% 500436595 / 433769626 / +15.4% 0.38 / 0.59 / -35.9%
tpch_q20/datafusion:parquet 323930170 / 237560400 / +36.4% 🔴 527247534 / 481089486 / +9.6% 0.61 / 0.49 / +24.4%
tpch_q21/datafusion:parquet 343868325 / 298501662 / +15.2% 499969878 / 398571698 / +25.4% 0.69 / 0.75 / -8.2%
tpch_q22/datafusion:parquet 179723468 / 159154679 / +12.9% 348564896 / 311124526 / +12.0% 0.52 / 0.51 / +0.8%
duckdb / vortex-file-compressed / ns (1.078x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 194698182 / 212623940 / -8.4% 275308727 / 254902539 / +8.0% 0.71 / 0.83 / -15.2%
tpch_q02/duckdb:vortex-file-compressed 376588095 / 422747266 / -10.9% 367680595 / 375582483 / -2.1% 1.02 / 1.13 / -9.0%
tpch_q03/duckdb:vortex-file-compressed 505007665 / 452317085 / +11.6% 451347935 / 482608207 / -6.5% 1.12 / 0.94 / +19.4%
tpch_q04/duckdb:vortex-file-compressed 300212568 / 309534836 / -3.0% 324009085 / 490126020 / -33.9% 🟢 0.93 / 0.63 / +46.7%
tpch_q05/duckdb:vortex-file-compressed 389033102 / 482435338 / -19.4% 467307899 / 485743062 / -3.8% 0.83 / 0.99 / -16.2%
tpch_q06/duckdb:vortex-file-compressed 277988379 / 288539151 / -3.7% 265994234 / 299990432 / -11.3% 1.05 / 0.96 / +8.7%
tpch_q07/duckdb:vortex-file-compressed 493558408 / 470577858 / +4.9% 558851036 / 522726744 / +6.9% 0.88 / 0.90 / -1.9%
tpch_q08/duckdb:vortex-file-compressed 635323316 / 578628291 / +9.8% 587694743 / 628530722 / -6.5% 1.08 / 0.92 / +17.4%
tpch_q09/duckdb:vortex-file-compressed 453939627 / 543906936 / -16.5% 464091569 / 683768051 / -32.1% 🟢 0.98 / 0.80 / +23.0%
tpch_q10/duckdb:vortex-file-compressed 535143224 / 477056635 / +12.2% 990273379 / 462080241 / +114.3% 🔴 0.54 / 1.03 / -47.7%
tpch_q11/duckdb:vortex-file-compressed 177046471 / 131788983 / +34.3% 🔴 234423051 / 169929200 / +38.0% 🔴 0.76 / 0.78 / -2.6%
tpch_q12/duckdb:vortex-file-compressed 523651803 / 481566009 / +8.7% 487523934 / 509549398 / -4.3% 1.07 / 0.95 / +13.7%
tpch_q13/duckdb:vortex-file-compressed 356627254 / 341925525 / +4.3% 485053259 / 320080477 / +51.5% 🔴 0.74 / 1.07 / -31.2%
tpch_q14/duckdb:vortex-file-compressed 238093927 / 235201093 / +1.2% 284601718 / 305990183 / -7.0% 0.84 / 0.77 / +8.8%
tpch_q15/duckdb:vortex-file-compressed 168546902 / 157545024 / +7.0% 218237400 / 208850983 / +4.5% 0.77 / 0.75 / +2.4%
tpch_q16/duckdb:vortex-file-compressed 210164748 / 180663503 / +16.3% 248950853 / 188733761 / +31.9% 🔴 0.84 / 0.96 / -11.8%
tpch_q17/duckdb:vortex-file-compressed 434154192 / 486803225 / -10.8% 469932728 / 432643147 / +8.6% 0.92 / 1.13 / -17.9%
tpch_q18/duckdb:vortex-file-compressed 647653094 / 375479125 / +72.5% 🔴 882411394 / 394346115 / +123.8% 🔴 0.73 / 0.95 / -22.9%
tpch_q19/duckdb:vortex-file-compressed 411826513 / 323059517 / +27.5% 453622800 / 361584054 / +25.5% 0.91 / 0.89 / +1.6%
tpch_q20/duckdb:vortex-file-compressed 385468556 / 358435109 / +7.5% 434584165 / 432045666 / +0.6% 0.89 / 0.83 / +6.9%
tpch_q21/duckdb:vortex-file-compressed 756809163 / 626952138 / +20.7% 832903540 / 636867119 / +30.8% 🔴 0.91 / 0.98 / -7.7%
tpch_q22/duckdb:vortex-file-compressed 169988867 / 117184454 / +45.1% 🔴 210834893 / 155776068 / +35.3% 🔴 0.81 / 0.75 / +7.2%
duckdb / parquet / ns (1.064x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 323082900 / 304624211 / +6.1% 282675509 / 296574661 / -4.7% 1.14 / 1.03 / +11.3%
tpch_q02/duckdb:parquet 709320863 / 643393098 / +10.2% 765045811 / 593269740 / +29.0% 0.93 / 1.08 / -14.5%
tpch_q03/duckdb:parquet 762949635 / 761393959 / +0.2% 873852656 / 858891802 / +1.7% 0.87 / 0.89 / -1.5%
tpch_q04/duckdb:parquet 483168740 / 449688999 / +7.4% 614308203 / 522430785 / +17.6% 0.79 / 0.86 / -8.6%
tpch_q05/duckdb:parquet 987705464 / 922102799 / +7.1% 1044000780 / 1093068450 / -4.5% 0.95 / 0.84 / +12.1%
tpch_q06/duckdb:parquet 328106054 / 318813767 / +2.9% 305044457 / 353485764 / -13.7% 1.08 / 0.90 / +19.3%
tpch_q07/duckdb:parquet 945947495 / 884341110 / +7.0% 993017547 / 895379636 / +10.9% 0.95 / 0.99 / -3.6%
tpch_q08/duckdb:parquet 1034942731 / 1079322638 / -4.1% 1057947163 / 1056193163 / +0.2% 0.98 / 1.02 / -4.3%
tpch_q09/duckdb:parquet 1049633164 / 979874127 / +7.1% 989273976 / 986103854 / +0.3% 1.06 / 0.99 / +6.8%
tpch_q10/duckdb:parquet 984582076 / 969059770 / +1.6% 988255729 / 932167910 / +6.0% 1.00 / 1.04 / -4.2%
tpch_q11/duckdb:parquet 414791245 / 435105889 / -4.7% 415444856 / 370269184 / +12.2% 1.00 / 1.18 / -15.0%
tpch_q12/duckdb:parquet 549789729 / 509481079 / +7.9% 560918584 / 663676917 / -15.5% 0.98 / 0.77 / +27.7%
tpch_q13/duckdb:parquet 806775273 / 761051042 / +6.0% 800601737 / 868564195 / -7.8% 1.01 / 0.88 / +15.0%
tpch_q14/duckdb:parquet 576546618 / 492565893 / +17.0% 559056048 / 476932554 / +17.2% 1.03 / 1.03 / -0.1%
tpch_q15/duckdb:parquet 404039804 / 374622011 / +7.9% 389512458 / 373579734 / +4.3% 1.04 / 1.00 / +3.4%
tpch_q16/duckdb:parquet 577118001 / 488433144 / +18.2% 526097141 / 506498608 / +3.9% 1.10 / 0.96 / +13.8%
tpch_q17/duckdb:parquet 551482530 / 509777632 / +8.2% 507193430 / 522731186 / -3.0% 1.09 / 0.98 / +11.5%
tpch_q18/duckdb:parquet 720941716 / 643156274 / +12.1% 668064009 / 696122118 / -4.0% 1.08 / 0.92 / +16.8%
tpch_q19/duckdb:parquet 544115404 / 553134937 / -1.6% 626179559 / 749251527 / -16.4% 0.87 / 0.74 / +17.7%
tpch_q20/duckdb:parquet 863623069 / 741285196 / +16.5% 913928847 / 964738261 / -5.3% 0.94 / 0.77 / +23.0%
tpch_q21/duckdb:parquet 743544585 / 706893192 / +5.2% 651217090 / 726645259 / -10.4% 1.14 / 0.97 / +17.4%
tpch_q22/duckdb:parquet 439710566 / 414784047 / +6.0% 531618501 / 404635811 / +31.4% 🔴 0.83 / 1.03 / -19.3%

Comment thread vortex-sqllogictest/slt/tpch/duckdb/plans/q11.slt.no
@myrrc
myrrc requested a review from joseph-isaacs September 16, 2026 12:38
@myrrc
myrrc merged commit 824dee1 into develop Sep 16, 2026
158 of 161 checks passed
@myrrc
myrrc deleted the myrrc/duckdb-no-serialize branch September 16, 2026 13:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/fix A bug fix ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants