Skip to content

Opt-in direct I/O reads, and what segment alignment is actually worth - #9838

Draft
joseph-isaacs wants to merge 4 commits into
developfrom
claude/direct-io-reads-perf-3b5kk2
Draft

Opt-in direct I/O reads, and what segment alignment is actually worth#9838
joseph-isaacs wants to merge 4 commits into
developfrom
claude/direct-io-reads-perf-3b5kk2

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds opt-in O_DIRECT reads for local files, plus three segment padding policies for the writer, and measures what each is worth. Two findings drive the shape of this PR:

Direct I/O does not need aligned files. O_DIRECT constrains the pread — offset, length, and buffer address — not the file. The reader rounds the offset down to a block boundary, rounds the length up, reads into an over-aligned buffer, and slices the requested window back out. So every file Vortex has ever written can be read this way, with no format change and no migration. Widening is the code path, not a fallback, so it is exercised by every direct read rather than rotting.

4 KiB write alignment costs more than it saves. It grows files by ~1.9% and makes a direct-I/O reader transfer more bytes, not fewer, because reads are coalesced long before they reach the filesystem. The writer option is here because it is the only way to demonstrate that, and because Grouped is a strictly better version of it — not because it should be switched on.

Cold-cache reads are where direct I/O pays: −36.3% on a TPC-H lineitem scan, −34.0% on ClickBench, and a tail that collapses from a 6.3× spread to 1.08×.

Changes

vortex-io — lifts the direct-I/O primitives out of vortex-cuda, which already had a working O_DIRECT + statx(STATX_DIOALIGN) implementation for its pinned-buffer reader, into std_file, and wires them into FileReadAt. Both readers now share one implementation instead of two. Linux only; opt in with FileReadAtOptions::with_direct_io() or VORTEX_DIRECT_IO=1, and it falls back to buffered reads where the filesystem cannot serve O_DIRECT.

vortex-file — a SegmentPadding write option, defaulting to today's contiguous packing:

what it does
None pack contiguously, padding only to each segment's own alignment
Always start every segment on a block boundary
Grouped pad only when a segment would straddle a boundary, so small consecutive segments share a block
Proportional align a segment when its padding is within 1/ratio of its length

VORTEX_SEGMENT_PADDING (none, always, grouped, proportional[:ratio]) selects one without recompiling, mirroring VORTEX_DIRECT_IO.

vortex-bench — a direct-io binary. convert writes under each policy and reports sizes; analyze replays every policy over an already-written file's segment map, pricing storage growth and the bytes a direct reader would transfer, both per-segment and after the reader's own coalescing window; scan times full scans with buffered and direct reads. The replay reproduces the measured file sizes exactly, which is what makes its read estimates trustworthy rather than hand-waved.

What the padding costs

Replayed over the segment maps of ClickBench ×10 and TPC-H SF1. The read columns are the bytes a direct reader transfers, relative to the packed baseline — negative is better.

policy ClickBench growth 1 seg/io coalesced TPC-H growth 1 seg/io coalesced
none — — — — — —
Always +2.035% −1.02% +1.93% +1.868% −0.86% +1.76%
Grouped +1.005% −1.02% +0.90% +1.753% −0.86% +1.65%
Proportional 1/64 +0.493% −0.54% +0.40% +0.561% −0.62% +0.50%

Aligning saves ~1% when each segment is read on its own, but Vortex coalesces at 1 MiB/4 MiB — a 4 KiB gap never splits a run, so the padding is read along with the data. The coalesced column is the one that matches how the reader behaves, and there alignment is a straight loss.

The cost is structural: growth ≈ 2.7 kB × segment_count, within 1% on both datasets despite very different segment profiles. TPC-H SF1 lands at +1.868% against +1.800% measured on SF10, so scale factor barely moves it. The lever is segment count, not segment size.

Grouped is the one policy worth keeping. Every segment occupies exactly the blocks it would under Always — one apiece up to a block, len / block rounded up above — so it reads identically for strictly less padding, which a test asserts over ten thousand segments. The saving tracks how much of the file is small segments: ClickBench halves its padding (38.8% of its segments are under 4 KiB, holding 0.2% of the bytes), TPC-H gains 6%. There is no workload where Always is the better choice.

One pathology worth flagging: TPC-H region goes 5.00 kB → 27.74 kB under Always, a 5.5× blowup. Any many-small-files workload pays that repeatedly.

What direct I/O is worth

Full scans through ScanBuilder, page cache dropped between iterations:

buffered direct
TPC-H lineitem 1.867 s 1.189 s −36.3%
ClickBench — — −34.0%

Warm-cache it loses ~15% on I/O and breaks even end to end, which is the correct result — a page-cache read is a memcpy. The larger prize is the tail: under page-cache reclaim, buffered cold reads ranged over 6.3× (0.77–4.88 s) while direct ranged over 1.08×.

Measured direct reads over aligned files were never faster than over packed ones, across three paired rounds.

Testing

vortex-io 210 passed, vortex-file 190 passed, cargo clippy --all-targets --all-features clean on vortex-io, vortex-file and vortex-bench, cargo +nightly fmt --all applied. New tests cover block widening over unaligned files, the alignment-survives-slicing invariant, each padding policy's per-segment output, the whole-file bound on the proportional budget, and the block-equivalence of Grouped and Always.

Caveat on the timings: they come from a 4-vCPU VM on virtio, where drop_caches clears only the guest cache. Treat deltas under ~10% as noise. The last commit runs the CI benchmark suite with both switches on so these numbers can be re-taken on the bench hardware.

API Changes

Two additive, opt-in options, both defaulting to current behavior: FileReadAtOptions::with_direct_io() and VortexWriteOptions::with_segment_padding(). Nothing existing changes, and no file format change — alignment is a property of the read call, not the file.

⚠️ The last commit (bench: run CI benchmarks with direct I/O and 4 KiB segment alignment) sets VORTEX_DIRECT_IO=1 and VORTEX_SEGMENT_PADDING=always on the benchmark jobs. It is an experiment to get numbers on the bench hardware, not a proposed default — revert it before merging.

🤖 Generated with Claude Code

https://claude.ai/code/session_01URD7DrxrCfLu8xSnvtHCMU

Generated by Claude Code

joseph-isaacs and others added 4 commits September 10, 2026 23:00
@joseph-isaacs @claude
feat(io): opt-in direct I/O reads and block-aligned segment writes
4fd7717 
Direct I/O bypasses the page cache, which avoids a copy out of the cache
and stops a large scan evicting everything else, but Linux requires the
file offset, transfer length, and buffer address of every O_DIRECT read
to be block aligned. Vortex segments are aligned to their element width,
not to a block, so reads are widened to the enclosing blocks and sliced
back to the requested range. That keeps direct reads working on files
written by any Vortex version: no format change is required to enable it.

vortex-cuda already had this machinery for its pinned-buffer reader, so
lift it into vortex-io::std_file and have both readers share it. Enable
it per-reader with FileReadAtOptions, or with VORTEX_DIRECT_IO=1 to A/B
a deployment without recompiling. Filesystems that cannot serve O_DIRECT
reject the open, so fall back to buffered reads rather than failing.

Widening costs at most one block of over-read per physical read, so the
writer gains an opt-in SegmentPadding policy to remove it: Always pads
every segment to a 4KiB boundary, and Proportional pads a segment only
when the padding is within 1/64 of its length, which bounds the padding
added across a file to 1/64 of the segment bytes written. The default is
unchanged contiguous packing.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01URD7DrxrCfLu8xSnvtHCMU
@joseph-isaacs @claude
bench: measure direct I/O reads and segment padding policies
c0c91f4 
Adds a `direct-io` benchmark binary with three modes. `convert` writes
Parquet to Vortex under each SegmentPadding policy and reports sizes.
`analyze` replays every policy over an already-written file's segment map,
pricing storage growth and the bytes a direct-I/O reader would transfer,
both per-segment and after applying the reader's own coalescing window --
so a policy can be costed without rewriting terabytes. `scan` times full
scans through ScanBuilder with buffered and direct reads, optionally
dropping the page cache between iterations, and can resolve every segment
without decoding to isolate I/O from decompression.

The replay reproduces the measured file sizes exactly, which is what makes
its read-amplification estimates trustworthy.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01URD7DrxrCfLu8xSnvtHCMU
@joseph-isaacs @claude
feat(file): group small consecutive segments into shared blocks
964e353 
`SegmentPadding::Always` costs half a block per segment whether the segment
is a megabyte or forty bytes, and the small ones are numerous: 38.8% of
ClickBench segments are under 4 KiB while holding 0.2% of the bytes.

`Grouped` pads a segment only when it would otherwise straddle a block
boundary, so a run of small consecutive segments shares one block instead of
each burning a whole one. Every segment still occupies exactly the blocks it
would under `Always` -- one apiece up to a block, `len / block` rounded up
above that -- which a test asserts over ten thousand segments. It therefore
reads identically while padding strictly less, and there is no workload where
`Always` is the better choice.

Replayed over the segment maps:

               ClickBench x10            TPC-H SF1
               growth  1 seg/io   coalesced   growth  1 seg/io   coalesced
  always       2.035%    -1.02%      +1.93%   1.868%    -0.86%      +1.76%
  grouped      1.005%    -1.02%      +0.90%   1.753%    -0.86%      +1.65%

The saving tracks how much of the file is small segments, so ClickBench halves
its padding while TPC-H, which is nearly all large segments, gains 6%.

Also adds `VORTEX_SEGMENT_PADDING` (`none`, `always`, `grouped`,
`proportional[:ratio]`) so a deployment or benchmark can pick a policy without
recompiling, mirroring `VORTEX_DIRECT_IO`. Unset or empty keeps the packed
default.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01URD7DrxrCfLu8xSnvtHCMU
@joseph-isaacs @claude
bench: run CI benchmarks with direct I/O and 4 KiB segment alignment
0a5e328 
Sets `VORTEX_DIRECT_IO=1` and `VORTEX_SEGMENT_PADDING=always` on the jobs that
both generate the benchmark data and query it, so the PR run measures aligned
writes read back through `O_DIRECT` against develop's buffered, packed
baseline.

This is an experiment, not a proposed default: revert this commit before
merging.

Signed-off-by: "Joe Isaacs" <joe.isaacs@live.co.uk>

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01URD7DrxrCfLu8xSnvtHCMU
@joseph-isaacs joseph-isaacs added changelog/performance A performance improvement action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. labels Sep 11, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 11, 2026
@github-actions

github-actions Bot commented Sep 11, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 0a5e328 compress-bench 3 Explore Profiling Data
🟢 Done 0a5e328 tpch-s3-10 2 Explore Profiling Data
🟢 Done 0a5e328 appian-nvme 2 Explore Profiling Data
🟢 Done 0a5e328 random-access-bench 1 Explore Profiling Data
🟢 Done 0a5e328 statpopgen 1 Explore Profiling Data
🟢 Done 0a5e328 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 0a5e328 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 0a5e328 tpcds-nvme 1 Explore Profiling Data
🟢 Done 0a5e328 fineweb 1 Explore Profiling Data
🟢 Done 0a5e328 clickbench-nvme 1 Explore Profiling Data
🟢 Done 0a5e328 fineweb-s3 1 Explore Profiling Data
🟢 Done 0a5e328 tpch-nvme 1 Explore Profiling Data
🟢 Done 0a5e328 tpch-s3 1 Explore Profiling Data
🟢 Done 0a5e328 polarsignals 1 Explore Profiling Data
🟢 Done 0a5e328 string-bench 1 Explore Profiling Data
Previous Runs (3)
Status Commit Job Attempt Link
🟢 Done 0a5e328 compress-bench 2 Explore Profiling Data
🟢 Done 0a5e328 appian-nvme 1 Explore Profiling Data
🟢 Done 0a5e328 compress-bench 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 0a5e328f vs base c93f5a9a
Vortex (geomean): hot 0.999x ➖ · cold 0.936x ➖

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45768327 / 44853450 / +2.0% 85967661 / 91732179 / -6.3% 0.53 / 0.49 / +8.9%
polarsignals_q01/datafusion:vortex-file-compressed 51163653 / 51016473 / +0.3% 109718600 / 116699723 / -6.0% 0.47 / 0.44 / +6.7%
polarsignals_q02/datafusion:vortex-file-compressed 35725440 / 37078624 / -3.6% 73730596 / 77691804 / -5.1% 0.48 / 0.48 / +1.5%
polarsignals_q03/datafusion:vortex-file-compressed 53401646 / 53969870 / -1.1% 113931139 / 115498170 / -1.4% 0.47 / 0.47 / +0.3%
polarsignals_q04/datafusion:vortex-file-compressed 9576864 / 9517406 / +0.6% 44340995 / 48559031 / -8.7% 0.22 / 0.20 / +10.2%
polarsignals_q05/datafusion:vortex-file-compressed 12252308 / 11789586 / +3.9% 47538277 / 50887010 / -6.6% 0.26 / 0.23 / +11.2%
polarsignals_q06/datafusion:vortex-file-compressed 21722328 / 20780908 / +4.5% 56145849 / 62226849 / -9.8% 0.39 / 0.33 / +15.9%
polarsignals_q07/datafusion:vortex-file-compressed 10978831 / 11361316 / -3.4% 50141220 / 54962080 / -8.8% 0.22 / 0.21 / +5.9%
polarsignals_q08/datafusion:vortex-file-compressed 100291466 / 100565162 / -0.3% 155708950 / 161783535 / -3.8% 0.64 / 0.62 / +3.6%
polarsignals_q09/datafusion:vortex-file-compressed 9874346 / 10282563 / -4.0% 42969822 / 46263497 / -7.1% 0.23 / 0.22 / +3.4%
File Size Changes (1 files changed, +0.2% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
stacktraces.vortex 1000000 vortex-file-compressed 685.88 MB 687.11 MB +1.23 MB +0.2%

Totals:

  • vortex-file-compressed: 685.88 MB → 687.11 MB (+0.2%)

@github-actions

github-actions Bot commented Sep 11, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.4%
Engines: DataFusion No clear signal (+17.2%, environment too noisy confidence) · DuckDB No clear signal (+0.4%, environment too noisy confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.936x ➖
Parquet (geomean): hot 0.916x ➖ · cold 0.874x ➖
Shifts: Parquet (control) -8.4% · Median polish -1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-compact / ns (1.011x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 355642744 / 355835124 / -0.1% 1892487468 / 1208932289 / +56.5% 🔴 0.19 / 0.29 / -36.2%
tpch_q02/datafusion:vortex-compact 473445976 / 524771142 / -9.8% 1081629621 / 1231670840 / -12.2% 0.44 / 0.43 / +2.7%
tpch_q03/datafusion:vortex-compact 614331436 / 582798673 / +5.4% 1167458773 / 1523353210 / -23.4% 0.53 / 0.38 / +37.5%
tpch_q04/datafusion:vortex-compact 349413079 / 246422200 / +41.8% 🔴 653006374 / 773678441 / -15.6% 0.54 / 0.32 / +68.0%
tpch_q05/datafusion:vortex-compact 626316521 / 633318233 / -1.1% 869493948 / 825383598 / +5.3% 0.72 / 0.77 / -6.1%
tpch_q06/datafusion:vortex-compact 297206878 / 481780167 / -38.3% 🟢 513896013 / 670576215 / -23.4% 0.58 / 0.72 / -19.5%
tpch_q07/datafusion:vortex-compact 618520964 / 583414953 / +6.0% 762239524 / 676026984 / +12.8% 0.81 / 0.86 / -6.0%
tpch_q08/datafusion:vortex-compact 977660993 / 941895923 / +3.8% 1078883560 / 1097555874 / -1.7% 0.91 / 0.86 / +5.6%
tpch_q09/datafusion:vortex-compact 678808371 / 699852491 / -3.0% 994605341 / 966159529 / +2.9% 0.68 / 0.72 / -5.8%
tpch_q10/datafusion:vortex-compact 672370667 / 896457257 / -25.0% 1001944106 / 957984669 / +4.6% 0.67 / 0.94 / -28.3%
tpch_q11/datafusion:vortex-compact 506065084 / 719713007 / -29.7% 565201351 / 1025249013 / -44.9% 🟢 0.90 / 0.70 / +27.5%
tpch_q12/datafusion:vortex-compact 520612063 / 610005248 / -14.7% 819204034 / 906732264 / -9.7% 0.64 / 0.67 / -5.5%
tpch_q13/datafusion:vortex-compact 346327955 / 298454574 / +16.0% 679647581 / 618852531 / +9.8% 0.51 / 0.48 / +5.7%
tpch_q14/datafusion:vortex-compact 369637423 / 349305153 / +5.8% 624050287 / 521636461 / +19.6% 0.59 / 0.67 / -11.5%
tpch_q15/datafusion:vortex-compact 714018615 / 595138039 / +20.0% 905948351 / 932799864 / -2.9% 0.79 / 0.64 / +23.5%
tpch_q16/datafusion:vortex-compact 263517773 / 261902473 / +0.6% 423206627 / 474783107 / -10.9% 0.62 / 0.55 / +12.9%
tpch_q17/datafusion:vortex-compact 727524434 / 733061788 / -0.8% 835390996 / 861613384 / -3.0% 0.87 / 0.85 / +2.4%
tpch_q18/datafusion:vortex-compact 1156061156 / 612681942 / +88.7% 🔴 1154836230 / 681723500 / +69.4% 🔴 1.00 / 0.90 / +11.4%
tpch_q19/datafusion:vortex-compact 567064806 / 523331524 / +8.4% 596313732 / 674156508 / -11.5% 0.95 / 0.78 / +22.5%
tpch_q20/datafusion:vortex-compact 859776386 / 624883275 / +37.6% 🔴 1159984665 / 669876962 / +73.2% 🔴 0.74 / 0.93 / -20.5%
tpch_q21/datafusion:vortex-compact 799503760 / 737084153 / +8.5% 1085442771 / 964194572 / +12.6% 0.74 / 0.76 / -3.6%
tpch_q22/datafusion:vortex-compact 331129650 / 465852490 / -28.9% 654147601 / 677629971 / -3.5% 0.51 / 0.69 / -26.4%
datafusion / parquet / ns (0.863x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 269942545 / 400516236 / -32.6% 🟢 884400556 / 736404112 / +20.1% 0.31 / 0.54 / -43.9%
tpch_q02/datafusion:parquet 476445264 / 599637222 / -20.5% 947748398 / 1384627913 / -31.6% 🟢 0.50 / 0.43 / +16.1%
tpch_q03/datafusion:parquet 585938031 / 583826908 / +0.4% 1265373610 / 1236520169 / +2.3% 0.46 / 0.47 / -1.9%
tpch_q04/datafusion:parquet 392557548 / 413806718 / -5.1% 610143942 / 604562524 / +0.9% 0.64 / 0.68 / -6.0%
tpch_q05/datafusion:parquet 684414150 / 1028079828 / -33.4% 🟢 794479725 / 1219182501 / -34.8% 🟢 0.86 / 0.84 / +2.2%
tpch_q06/datafusion:parquet 216819041 / 347883002 / -37.7% 🟢 398397004 / 458428074 / -13.1% 0.54 / 0.76 / -28.3%
tpch_q07/datafusion:parquet 694191606 / 989209197 / -29.8% 812668364 / 1107933707 / -26.7% 0.85 / 0.89 / -4.3%
tpch_q08/datafusion:parquet 880871250 / 1048749688 / -16.0% 1207738472 / 1233108947 / -2.1% 0.73 / 0.85 / -14.2%
tpch_q09/datafusion:parquet 963731154 / 1067022954 / -9.7% 1479400475 / 1409568744 / +5.0% 0.65 / 0.76 / -13.9%
tpch_q10/datafusion:parquet 1814381635 / 1988850598 / -8.8% 2080318319 / 3264599066 / -36.3% 🟢 0.87 / 0.61 / +43.2%
tpch_q11/datafusion:parquet 395339535 / 415908224 / -4.9% 594977350 / 708917124 / -16.1% 0.66 / 0.59 / +13.3%
tpch_q12/datafusion:parquet 434512116 / 431505989 / +0.7% 732023869 / 1436769846 / -49.1% 🟢 0.59 / 0.30 / +97.6%
tpch_q13/datafusion:parquet 608257777 / 460342829 / +32.1% 🔴 883918797 / 982743916 / -10.1% 0.69 / 0.47 / +46.9%
tpch_q14/datafusion:parquet 413175273 / 531716910 / -22.3% 667278598 / 723245561 / -7.7% 0.62 / 0.74 / -15.8%
tpch_q15/datafusion:parquet 721560008 / 734810434 / -1.8% 837056100 / 954117203 / -12.3% 0.86 / 0.77 / +11.9%
tpch_q16/datafusion:parquet 235449875 / 309184184 / -23.8% 485105356 / 516916634 / -6.2% 0.49 / 0.60 / -18.9%
tpch_q17/datafusion:parquet 745140128 / 865648106 / -13.9% 857309093 / 1021760230 / -16.1% 0.87 / 0.85 / +2.6%
tpch_q18/datafusion:parquet 927759993 / 1293824123 / -28.3% 1302719632 / 1460805758 / -10.8% 0.71 / 0.89 / -19.6%
tpch_q19/datafusion:parquet 501490498 / 562221458 / -10.8% 655511254 / 694453169 / -5.6% 0.77 / 0.81 / -5.5%
tpch_q20/datafusion:parquet 764127517 / 818683445 / -6.7% 1007406846 / 1048917288 / -4.0% 0.76 / 0.78 / -2.8%
tpch_q21/datafusion:parquet 1167890638 / 1034663078 / +12.9% 1111562811 / 1366263008 / -18.6% 1.05 / 0.76 / +38.7%
tpch_q22/datafusion:parquet 615586456 / 697465440 / -11.7% 894778194 / 1214064842 / -26.3% 0.69 / 0.57 / +19.8%
duckdb / vortex-compact / ns (0.977x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 885711363 / 937064829 / -5.5% 1155127876 / 2380819972 / -51.5% 🟢 0.77 / 0.39 / +94.8%
tpch_q02/duckdb:vortex-compact 446054440 / 543953425 / -18.0% 629229964 / 857588185 / -26.6% 0.71 / 0.63 / +11.8%
tpch_q03/duckdb:vortex-compact 1186717277 / 1249805153 / -5.0% 1298469881 / 1964349349 / -33.9% 🟢 0.91 / 0.64 / +43.6%
tpch_q04/duckdb:vortex-compact 668399668 / 954784929 / -30.0% 812355655 / 1825582934 / -55.5% 🟢 0.82 / 0.52 / +57.3%
tpch_q05/duckdb:vortex-compact 1156940527 / 1139286227 / +1.5% 1489307836 / 1794766161 / -17.0% 0.78 / 0.63 / +22.4%
tpch_q06/duckdb:vortex-compact 1111513081 / 1130006698 / -1.6% 1122269801 / 1131227413 / -0.8% 0.99 / 1.00 / -0.9%
tpch_q07/duckdb:vortex-compact 1427851260 / 1473073773 / -3.1% 1481443763 / 1590584812 / -6.9% 0.96 / 0.93 / +4.1%
tpch_q08/duckdb:vortex-compact 1548609697 / 1539651639 / +0.6% 1522327045 / 1727576937 / -11.9% 1.02 / 0.89 / +14.1%
tpch_q09/duckdb:vortex-compact 1628530222 / 1649945884 / -1.3% 1685986268 / 1897373840 / -11.1% 0.97 / 0.87 / +11.1%
tpch_q10/duckdb:vortex-compact 1507646319 / 1414440396 / +6.6% 1685917750 / 1824180269 / -7.6% 0.89 / 0.78 / +15.3%
tpch_q11/duckdb:vortex-compact 444123085 / 435297563 / +2.0% 622094996 / 658550263 / -5.5% 0.71 / 0.66 / +8.0%
tpch_q12/duckdb:vortex-compact 1989819599 / 2114276661 / -5.9% 2114902268 / 2363106610 / -10.5% 0.94 / 0.89 / +5.2%
tpch_q13/duckdb:vortex-compact 1274916676 / 1303139024 / -2.2% 1967914315 / 1786238581 / +10.2% 0.65 / 0.73 / -11.2%
tpch_q14/duckdb:vortex-compact 843966008 / 849344381 / -0.6% 848986625 / 942099820 / -9.9% 0.99 / 0.90 / +10.3%
tpch_q15/duckdb:vortex-compact 1181879497 / 1091019406 / +8.3% 1249233181 / 1156974258 / +8.0% 0.95 / 0.94 / +0.3%
tpch_q16/duckdb:vortex-compact 233122843 / 249636269 / -6.6% 255649246 / 250430716 / +2.1% 0.91 / 1.00 / -8.5%
tpch_q17/duckdb:vortex-compact 2480519377 / 1394880087 / +77.8% 🔴 2082724049 / 1383019806 / +50.6% 🔴 1.19 / 1.01 / +18.1%
tpch_q18/duckdb:vortex-compact 1294637925 / 1145259361 / +13.0% 1273883049 / 1202062270 / +6.0% 1.02 / 0.95 / +6.7%
tpch_q19/duckdb:vortex-compact 1119084575 / 1032741524 / +8.4% 1312726951 / 1231143496 / +6.6% 0.85 / 0.84 / +1.6%
tpch_q20/duckdb:vortex-compact 1490471701 / 2787898183 / -46.5% 🟢 1731684811 / 3433717703 / -49.6% 🟢 0.86 / 0.81 / +6.0%
tpch_q21/duckdb:vortex-compact 2339595801 / 2278229947 / +2.7% 2485470196 / 2425102486 / +2.5% 0.94 / 0.94 / +0.2%
tpch_q22/duckdb:vortex-compact 300659134 / 298697620 / +0.7% 429319737 / 501701065 / -14.4% 0.70 / 0.60 / +17.6%
duckdb / parquet / ns (0.973x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 391397562 / 520874436 / -24.9% 516854859 / 780474859 / -33.8% 🟢 0.76 / 0.67 / +13.5%
tpch_q02/duckdb:parquet 792531849 / 857698231 / -7.6% 1022326126 / 1571606758 / -35.0% 🟢 0.78 / 0.55 / +42.0%
tpch_q03/duckdb:parquet 1327974699 / 1111999273 / +19.4% 1281822620 / 2256809483 / -43.2% 🟢 1.04 / 0.49 / +110.3%
tpch_q04/duckdb:parquet 525210538 / 687790214 / -23.6% 711472306 / 945900614 / -24.8% 0.74 / 0.73 / +1.5%
tpch_q05/duckdb:parquet 1678784643 / 1370682471 / +22.5% 1088790447 / 1539621173 / -29.3% 1.54 / 0.89 / +73.2%
tpch_q06/duckdb:parquet 602339609 / 408050784 / +47.6% 🔴 526959932 / 465978539 / +13.1% 1.14 / 0.88 / +30.5%
tpch_q07/duckdb:parquet 1010624274 / 1283781887 / -21.3% 1317939729 / 1049682679 / +25.6% 0.77 / 1.22 / -37.3%
tpch_q08/duckdb:parquet 1373769331 / 1338811641 / +2.6% 1362223547 / 2181157411 / -37.5% 🟢 1.01 / 0.61 / +64.3%
tpch_q09/duckdb:parquet 1305908729 / 1324725826 / -1.4% 1564113415 / 1709793532 / -8.5% 0.83 / 0.77 / +7.8%
tpch_q10/duckdb:parquet 2266257160 / 2294789278 / -1.2% 3037372618 / 3074141637 / -1.2% 0.75 / 0.75 / -0.0%
tpch_q11/duckdb:parquet 509131885 / 498120019 / +2.2% 635101761 / 501748576 / +26.6% 0.80 / 0.99 / -19.3%
tpch_q12/duckdb:parquet 632296993 / 637228529 / -0.8% 956393587 / 1131326992 / -15.5% 0.66 / 0.56 / +17.4%
tpch_q13/duckdb:parquet 969796831 / 910661679 / +6.5% 1228640394 / 1623966896 / -24.3% 0.79 / 0.56 / +40.8%
tpch_q14/duckdb:parquet 751592402 / 718427522 / +4.6% 1122426730 / 835268272 / +34.4% 🔴 0.67 / 0.86 / -22.1%
tpch_q15/duckdb:parquet 440263749 / 569271162 / -22.7% 662513587 / 592863752 / +11.7% 0.66 / 0.96 / -30.8%
tpch_q16/duckdb:parquet 703775747 / 661595841 / +6.4% 657357280 / 828724705 / -20.7% 1.07 / 0.80 / +34.1%
tpch_q17/duckdb:parquet 634216593 / 735021747 / -13.7% 636468140 / 666268807 / -4.5% 1.00 / 1.10 / -9.7%
tpch_q18/duckdb:parquet 767642055 / 860064002 / -10.7% 980971084 / 1033722714 / -5.1% 0.78 / 0.83 / -5.9%
tpch_q19/duckdb:parquet 948134369 / 985106080 / -3.8% 894735817 / 888271715 / +0.7% 1.06 / 1.11 / -4.4%
tpch_q20/duckdb:parquet 1136085223 / 1239479628 / -8.3% 1480309162 / 1544574110 / -4.2% 0.77 / 0.80 / -4.4%
tpch_q21/duckdb:parquet 933807064 / 951738574 / -1.9% 1076336467 / 864851244 / +24.5% 0.87 / 1.10 / -21.2%
tpch_q22/duckdb:parquet 828313294 / 835622931 / -0.9% 988293900 / 1129249581 / -12.5% 0.84 / 0.74 / +13.3%

@github-actions

github-actions Bot commented Sep 11, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 1.008x ➖ · cold 0.987x ➖
Parquet (geomean): hot 1.015x ➖ · cold 1.013x ➖
Shifts: Parquet (control) +1.5% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52688655 / 52800138 / -0.2% 73204690 / 75567713 / -3.1% 0.72 / 0.70 / +3.0%
appian_q02/datafusion:vortex-compact 231885633 / 233939330 / -0.9% 268957120 / 266887623 / +0.8% 0.86 / 0.88 / -1.6%
appian_q03/datafusion:vortex-compact 147627184 / 150222271 / -1.7% 188288393 / 183689346 / +2.5% 0.78 / 0.82 / -4.1%
appian_q04/datafusion:vortex-compact 9895920107 / 9901820002 / -0.1% 9830307011 / 9814931855 / +0.2% 1.01 / 1.01 / -0.2%
appian_q05/datafusion:vortex-compact 140254497 / 137415159 / +2.1% 164068744 / 161576114 / +1.5% 0.85 / 0.85 / +0.5%
appian_q06/datafusion:vortex-compact 144865553 / 142652111 / +1.6% 166258220 / 163741833 / +1.5% 0.87 / 0.87 / +0.0%
appian_q07/datafusion:vortex-compact 165820503 / 164019016 / +1.1% 193913339 / 199421547 / -2.8% 0.86 / 0.82 / +4.0%
appian_q08/datafusion:vortex-compact 553430780 / 559046983 / -1.0% 584618703 / 586827600 / -0.4% 0.95 / 0.95 / -0.6%
datafusion / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72779586 / 72440940 / +0.5% 95169567 / 88547995 / +7.5% 0.76 / 0.82 / -6.5%
appian_q02/datafusion:parquet 300653183 / 302774199 / -0.7% 336641530 / 328014643 / +2.6% 0.89 / 0.92 / -3.2%
appian_q03/datafusion:parquet 188701143 / 185207947 / +1.9% 230787685 / 221644424 / +4.1% 0.82 / 0.84 / -2.2%
appian_q04/datafusion:parquet 9940040042 / 9906143563 / +0.3% 9916260069 / 9804537702 / +1.1% 1.00 / 1.01 / -0.8%
appian_q05/datafusion:parquet 196285136 / 191542619 / +2.5% 217023732 / 219250120 / -1.0% 0.90 / 0.87 / +3.5%
appian_q06/datafusion:parquet 168072051 / 166454608 / +1.0% 190203906 / 190147899 / +0.0% 0.88 / 0.88 / +0.9%
appian_q07/datafusion:parquet 207589298 / 205605565 / +1.0% 240854898 / 240402897 / +0.2% 0.86 / 0.86 / +0.8%
appian_q08/datafusion:parquet 671021417 / 665856344 / +0.8% 691642988 / 676434077 / +2.2% 0.97 / 0.98 / -1.4%
duckdb / vortex-compact / ns (1.015x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 93540450 / 90877406 / +2.9% 98970515 / 106264126 / -6.9% 0.95 / 0.86 / +10.5%
appian_q02/duckdb:vortex-compact 217091849 / 213154327 / +1.8% 222203547 / 220615338 / +0.7% 0.98 / 0.97 / +1.1%
appian_q03/duckdb:vortex-compact 122287578 / 122287288 / +0.0% 130232930 / 144459105 / -9.8% 0.94 / 0.85 / +10.9%
appian_q04/duckdb:vortex-compact 558595932 / 527431363 / +5.9% 562903555 / 568630030 / -1.0% 0.99 / 0.93 / +7.0%
appian_q05/duckdb:vortex-compact 133363436 / 134325921 / -0.7% 146204936 / 152651777 / -4.2% 0.91 / 0.88 / +3.7%
appian_q06/duckdb:vortex-compact 396138965 / 400382696 / -1.1% 398453654 / 386098098 / +3.2% 0.99 / 1.04 / -4.1%
appian_q07/duckdb:vortex-compact 139182137 / 136670012 / +1.8% 146652905 / 154070551 / -4.8% 0.95 / 0.89 / +7.0%
appian_q08/duckdb:vortex-compact 446090907 / 441089304 / +1.1% 464762215 / 454966456 / +2.2% 0.96 / 0.97 / -1.0%
duckdb / parquet / ns (1.021x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 99897897 / 99044510 / +0.9% 120364225 / 121600799 / -1.0% 0.83 / 0.81 / +1.9%
appian_q02/duckdb:parquet 199594021 / 198473636 / +0.6% 199976460 / 209704742 / -4.6% 1.00 / 0.95 / +5.5%
appian_q03/duckdb:parquet 126893441 / 126339262 / +0.4% 141780462 / 143510492 / -1.2% 0.89 / 0.88 / +1.7%
appian_q04/duckdb:parquet 466000033 / 427967665 / +8.9% 458265492 / 440679410 / +4.0% 1.02 / 0.97 / +4.7%
appian_q05/duckdb:parquet 141962816 / 142904875 / -0.7% 161431386 / 157065409 / +2.8% 0.88 / 0.91 / -3.3%
appian_q06/duckdb:parquet 278483023 / 259942832 / +7.1% 278475455 / 278666487 / -0.1% 1.00 / 0.93 / +7.2%
appian_q07/duckdb:parquet 154530059 / 154801954 / -0.2% 173778529 / 167116666 / +4.0% 0.89 / 0.93 / -4.0%
appian_q08/duckdb:parquet 379751838 / 379038132 / +0.2% 397137873 / 393402603 / +0.9% 0.96 / 0.96 / -0.8%
File Size Changes (8 files changed, +1.5% overall, 8↑ 0↓)
File Scale Format Base HEAD Change %
categoryview.vortex 1.0 vortex-compact 17.41 KB 103.65 KB +86.23 KB +495.2%
productview.vortex 1.0 vortex-compact 16.61 KB 94.62 KB +78.01 KB +469.7%
orderview.vortex 1.0 vortex-compact 31.01 MB 31.76 MB +762.62 KB +2.4%
customerview.vortex 1.0 vortex-compact 10.58 MB 10.80 MB +226.79 KB +2.1%
creditcardview.vortex 1.0 vortex-compact 32.19 MB 32.70 MB +528.32 KB +1.6%
addressview.vortex 1.0 vortex-compact 24.50 MB 24.81 MB +313.94 KB +1.3%
orderitemview.vortex 1.0 vortex-compact 155.96 MB 157.81 MB +1.85 MB +1.2%
taxrecordview.vortex 1.0 vortex-compact 17.32 MB 17.50 MB +181.65 KB +1.0%

Totals:

  • vortex-compact: 271.86 MB → 275.84 MB (+1.5%)

@github-actions

github-actions Bot commented Sep 11, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 0a5e328f vs base c93f5a9a

vortex / vortex-file-compressed / ns (0.991x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 868019538 / 887453354 / -2.2%
compress time/Bimbo 3890922856 / 3954480678 / -1.6%
compress time/CMSprovider 2886368557 / 3047335369 / -5.3%
compress time/Euro2016 308116699 / 319000175 / -3.4%
compress time/Food 307780795 / 315302037 / -2.4%
compress time/HashTags 552899026 / 570624905 / -3.1%
compress time/TPC-H l_comment canonical 775125141 / 788118432 / -1.6%
compress time/TPC-H l_comment chunked 776491713 / 786588743 / -1.3%
compress time/taxi 424906539 / 436098344 / -2.6%
compress time/wide table cols=100 chunks=1 rows=1000 7678073 / 7211104 / +6.5%
compress time/wide table cols=100 chunks=50 rows=1000 7528454 / 7182317 / +4.8%
compress time/wide table cols=1000 chunks=1 rows=1000 72487129 / 70306957 / +3.1%
compress time/wide table cols=1000 chunks=50 rows=1000 72993709 / 69498235 / +5.0%
compress time/wide table cols=10000 chunks=1 rows=1000 791739870 / 779953023 / +1.5%
compress time/wide table cols=10000 chunks=50 rows=1000 805148880 / 796592066 / +1.1%
decompress time/Arade 9191880 / 9449197 / -2.7%
decompress time/Bimbo 63101264 / 62859933 / +0.4%
decompress time/CMSprovider 26680868 / 27630725 / -3.4%
decompress time/Euro2016 7292102 / 7366804 / -1.0%
decompress time/Food 2857025 / 2909296 / -1.8%
decompress time/HashTags 58338943 / 59662589 / -2.2%
decompress time/TPC-H l_comment canonical 20452040 / 22090229 / -7.4%
decompress time/TPC-H l_comment chunked 20922106 / 21781105 / -3.9%
decompress time/taxi 8588274 / 8546323 / +0.5%
decompress time/wide table cols=100 chunks=1 rows=1000 2029911 / 2035509 / -0.3%
decompress time/wide table cols=100 chunks=50 rows=1000 2046290 / 2067873 / -1.0%
decompress time/wide table cols=1000 chunks=1 rows=1000 19629419 / 19830510 / -1.0%
decompress time/wide table cols=1000 chunks=50 rows=1000 19620070 / 19620058 / +0.0%
decompress time/wide table cols=10000 chunks=1 rows=1000 228581514 / 232546380 / -1.7%
decompress time/wide table cols=10000 chunks=50 rows=1000 233423565 / 229734892 / +1.6%
vortex / vortex-file-compressed / bytes (1.286x ❌, 0↑ 6↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 144601188 / 142210524 / +1.7%
vortex-file-compressed size/Bimbo 464267396 / 458475220 / +1.3%
vortex-file-compressed size/CMSprovider 423113500 / 420650636 / +0.6%
vortex-file-compressed size/Euro2016 164682756 / 164038260 / +0.4%
vortex-file-compressed size/Food 39147968 / 38946488 / +0.5%
vortex-file-compressed size/HashTags 192210036 / 190336420 / +1.0%
vortex-file-compressed size/TPC-H l_comment canonical 183397000 / 179845160 / +2.0%
vortex-file-compressed size/TPC-H l_comment chunked 183397000 / 179845160 / +2.0%
vortex-file-compressed size/taxi 51022516 / 50116916 / +1.8%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 1717432 / 932480 / +84.2% 🔴
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 1717432 / 932480 / +84.2% 🔴
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 17157832 / 9309680 / +84.3% 🔴
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 17157832 / 9309680 / +84.3% 🔴
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 171597832 / 93117680 / +84.3% 🔴
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 171597832 / 93117680 / +84.3% 🔴
vortex / vortex-file-compressed / ratio (1.081x ➖, 0↑ 6↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.386703317 / 0.394672077 / -2.0%
vortex:parquet-zstd ratio compress time/Bimbo 0.32929316 / 0.334187991 / -1.5%
vortex:parquet-zstd ratio compress time/CMSprovider 0.451783584 / 0.476565425 / -5.2%
vortex:parquet-zstd ratio compress time/Euro2016 0.286198634 / 0.294911996 / -3.0%
vortex:parquet-zstd ratio compress time/Food 0.416203607 / 0.425858844 / -2.3%
vortex:parquet-zstd ratio compress time/HashTags 0.302305008 / 0.311719011 / -3.0%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.294902639 / 0.299566965 / -1.6%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.294511571 / 0.298660757 / -1.4%
vortex:parquet-zstd ratio compress time/taxi 0.389027321 / 0.399524099 / -2.6%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.90458299 / 1.80704967 / +5.4%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.89199159 / 1.8130736 / +4.4%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.63528518 / 1.57159348 / +4.1%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.63726 / 1.55977213 / +5.0%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.6476685 / 1.69562819 / -2.8%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.74784687 / 1.71617903 / +1.8%
vortex:parquet-zstd ratio decompress time/Arade 0.0165278716 / 0.016924974 / -2.3%
vortex:parquet-zstd ratio decompress time/Bimbo 0.039370375 / 0.0391855889 / +0.5%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.019628597 / 0.0202346046 / -3.0%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0219070676 / 0.0221119232 / -0.9%
vortex:parquet-zstd ratio decompress time/Food 0.0167823244 / 0.017085331 / -1.8%
vortex:parquet-zstd ratio decompress time/HashTags 0.113386462 / 0.115654067 / -2.0%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.041154231 / 0.0443266004 / -7.2%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0422023937 / 0.0437252309 / -3.5%
vortex:parquet-zstd ratio decompress time/taxi 0.0395823263 / 0.0392803296 / +0.8%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.964669681 / 0.976966163 / -1.3%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.998709085 / 1.0012434 / -0.3%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.842929357 / 0.835195206 / +0.9%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.83445178 / 0.837090188 / -0.3%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.902940033 / 0.946305482 / -4.6%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.955986817 / 0.925315424 / +3.3%
vortex:parquet-zstd size/Arade 0.560438697 / 0.55117307 / +1.7%
vortex:parquet-zstd size/Bimbo 1.20740317 / 1.19233967 / +1.3%
vortex:parquet-zstd size/CMSprovider 1.12265076 / 1.11611602 / +0.6%
vortex:parquet-zstd size/Euro2016 1.33911229 / 1.33387159 / +0.4%
vortex:parquet-zstd size/Food 1.0965971 / 1.09095332 / +0.5%
vortex:parquet-zstd size/HashTags 1.43980154 / 1.42576671 / +1.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.15811468 / 1.13568553 / +2.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.15811468 / 1.13568553 / +2.0%
vortex:parquet-zstd size/taxi 0.922922597 / 0.906541619 / +1.8%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.84193976 / 1.00008151 / +84.2% 🔴
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.84193976 / 1.00008151 / +84.2% 🔴
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 1.84017853 / 0.99846375 / +84.3% 🔴
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 1.84017853 / 0.99846375 / +84.3% 🔴
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 1.84038851 / 0.998688074 / +84.3% 🔴
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 1.84038851 / 0.998688074 / +84.3% 🔴
vortex / parquet / ns (1.000x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2244665352 / 2248584094 / -0.2%
parquet_rs-zstd compress time/Bimbo 11815984442 / 11833102291 / -0.1%
parquet_rs-zstd compress time/CMSprovider 6388830087 / 6394369402 / -0.1%
parquet_rs-zstd compress time/Euro2016 1076583403 / 1081679210 / -0.5%
parquet_rs-zstd compress time/Food 739495741 / 740390957 / -0.1%
parquet_rs-zstd compress time/HashTags 1828944317 / 1830574604 / -0.1%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2628410322 / 2630858951 / -0.1%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2636540597 / 2633719778 / +0.1%
parquet_rs-zstd compress time/taxi 1092228017 / 1091544528 / +0.1%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 4031367 / 3990540 / +1.0%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 3979116 / 3961404 / +0.4%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44326904 / 44736096 / -0.9%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 44582845 / 44556659 / +0.1%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 480521337 / 459978803 / +4.5%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 460651843 / 464166063 / -0.8%
parquet_rs-zstd decompress time/Arade 556144203 / 558299056 / -0.4%
parquet_rs-zstd decompress time/Bimbo 1602760046 / 1604159455 / -0.1%
parquet_rs-zstd decompress time/CMSprovider 1359285537 / 1365518406 / -0.5%
parquet_rs-zstd decompress time/Euro2016 332865271 / 333159804 / -0.1%
parquet_rs-zstd decompress time/Food 170240125 / 170280342 / -0.0%
parquet_rs-zstd decompress time/HashTags 514514184 / 515871086 / -0.3%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 496960811 / 498351527 / -0.3%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 495756382 / 498135849 / -0.5%
parquet_rs-zstd decompress time/taxi 216972442 / 217572589 / -0.3%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2104255 / 2083500 / +1.0%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2048935 / 2065305 / -0.8%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23287146 / 23743563 / -1.9%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 23512527 / 23438404 / +0.3%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 253152486 / 245741343 / +3.0%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 244170276 / 248277383 / -1.7%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.968x ➖, 4↑ 0↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 99706165 / 99475687 / +0.2%
arrow-ipc compress time/Bimbo 621494036 / 623956525 / -0.4%
arrow-ipc compress time/CMSprovider 382036585 / 386188776 / -1.1%
arrow-ipc compress time/Euro2016 38352829 / 38741766 / -1.0%
arrow-ipc compress time/Food 33796001 / 34106616 / -0.9%
arrow-ipc compress time/HashTags 78816348 / 79327299 / -0.6%
arrow-ipc compress time/TPC-H l_comment canonical 498688976 / 499564273 / -0.2%
arrow-ipc compress time/TPC-H l_comment chunked 502882567 / 504337956 / -0.3%
arrow-ipc compress time/taxi 74993066 / 75356659 / -0.5%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 204811 / 205724 / -0.4%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 203772 / 205997 / -1.1%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2247366 / 2259631 / -0.5%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2221580 / 2256817 / -1.6%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25711272 / 25706180 / +0.0%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25678777 / 25897949 / -0.8%
arrow-ipc decompress time/Arade 140273527 / 181207329 / -22.6% 🟢
arrow-ipc decompress time/Bimbo 401201691 / 425273564 / -5.7%
arrow-ipc decompress time/CMSprovider 582521368 / 581684438 / +0.1%
arrow-ipc decompress time/Euro2016 64044655 / 74670549 / -14.2% 🟢
arrow-ipc decompress time/Food 48579002 / 58395550 / -16.8% 🟢
arrow-ipc decompress time/HashTags 119813165 / 142757625 / -16.1% 🟢
arrow-ipc decompress time/TPC-H l_comment canonical 531750008 / 534155650 / -0.5%
arrow-ipc decompress time/TPC-H l_comment chunked 542245859 / 534147498 / +1.5%
arrow-ipc decompress time/taxi 45329679 / 48883106 / -7.3%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 317836 / 323013 / -1.6%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 316152 / 321779 / -1.7%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3495568 / 3477704 / +0.5%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3487962 / 3410494 / +2.3%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 35416282 / 35230919 / +0.5%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 35194532 / 34880692 / +0.9%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 0a5e328f vs base c93f5a9a

vortex / vortex-file-compressed / ms (1.004x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 32.318553 / 32.166356 / +0.5%
read/clickbench/URL/shard-0/onpair-12 20.275087 / 20.072693 / +1.0%
read/tpch/l_comment/fsst 53.816869 / 53.549542 / +0.5%
read/tpch/l_comment/onpair-12 49.19041 / 49.364394 / -0.4%
write/clickbench/URL/shard-0/fsst 591.717616 / 594.297572 / -0.4%
write/clickbench/URL/shard-0/onpair-12 994.903942 / 986.236212 / +0.9%
write/tpch/l_comment/fsst 1994.88467 / 1994.48671 / +0.0%
write/tpch/l_comment/onpair-12 2220.24951 / 2200.02709 / +0.9%
vortex / vortex-file-compressed / % (1.017x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 47.638347 / 47.3999586 / +0.5%
size/clickbench/URL/shard-0/onpair-12 30.4612008 / 30.225605 / +0.8%
size/tpch/l_comment/fsst 31.298062 / 30.5819725 / +2.3%
size/tpch/l_comment/onpair-12 26.6875683 / 25.8644092 / +3.2%

@joseph-isaacs Claude

joseph-isaacs commented Sep 11, 2026

Copy link
Copy Markdown
Contributor Author

The three BENCHMARK FAILED comments above are EC2 spot interruptions, not a failure of this PR.

Each failed job ends with the same runner-provider error rather than any Vortex output:

##[error]AWS interrupted the EC2 Spot instance running this job.
RunsOn can retry it after the workflow run finishes.
  • all-compression-bench / bench / bench — instance i-083aa1e5bdb727232, us-east-1b, died at 2.89 min
  • all-sql-bench / sql / bench (tpch-s3-10) — instance i-0193df05ee1ec85f5, us-east-1a, died at 2.74 min
  • all-sql-bench / sql / bench (appian-nvme) — same window

All three died within six seconds of each other on different instances in two availability zones, which is a fleet-wide c8gd.metal-24xl spot reclamation, not anything in the diff. The polarsignals job survived on its own instance and produced clean results over the same code.

I'll re-run the failed jobs once the run finishes, as RunsOn's message instructs — they can't be retried while it is still in progress.

For context on what these runs are measuring: the last commit deliberately sets VORTEX_DIRECT_IO=1 and VORTEX_SEGMENT_PADDING=always on the benchmark jobs, so this run compares aligned writes read back through O_DIRECT against develop's buffered, packed baseline. That commit is an experiment and should be reverted before merging.

Generated by Claude Code

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +13.9%
Engines: DataFusion No clear signal (+2.4%, low confidence) · DuckDB Likely regression (+26.7%, medium confidence)
Vortex (geomean): hot 1.148x ❌ · cold 0.869x ✅
Parquet (geomean): hot 1.007x ➖ · cold 1.047x ➖
Shifts: Parquet (control) +0.7% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.024x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6929510 / 6726260 / +3.0% 20348132 / 20730642 / -1.8% 0.34 / 0.32 / +5.0%
fineweb_q01/datafusion:vortex-file-compressed 13022332 / 12477362 / +4.4% 47357122 / 49344110 / -4.0% 0.27 / 0.25 / +8.7%
fineweb_q02/datafusion:vortex-file-compressed 12889952 / 13335722 / -3.3% 49551006 / 52814813 / -6.2% 0.26 / 0.25 / +3.0%
fineweb_q03/datafusion:vortex-file-compressed 19662084 / 20163072 / -2.5% 105052800 / 99732774 / +5.3% 0.19 / 0.20 / -7.4%
fineweb_q04/datafusion:vortex-file-compressed 76945618 / 76535666 / +0.5% 163426887 / 150023268 / +8.9% 0.47 / 0.51 / -7.7%
fineweb_q05/datafusion:vortex-file-compressed 60805461 / 60735904 / +0.1% 142211353 / 140193857 / +1.4% 0.43 / 0.43 / -1.3%
fineweb_q06/datafusion:vortex-file-compressed 19434996 / 19660684 / -1.1% 106057374 / 102322651 / +3.6% 0.18 / 0.19 / -4.6%
fineweb_q07/datafusion:vortex-file-compressed 17822053 / 16065176 / +10.9% 🔴 104658558 / 97418508 / +7.4% 0.17 / 0.16 / +3.3%
fineweb_q08/datafusion:vortex-file-compressed 11836382 / 10690661 / +10.7% 🔴 39082111 / 44116003 / -11.4% 🟢 0.30 / 0.24 / +25.0%
datafusion / vortex-compact / ns (1.017x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 7294784 / 7032346 / +3.7% 21420539 / 19027861 / +12.6% 🔴 0.34 / 0.37 / -7.9%
fineweb_q01/datafusion:vortex-compact 44128157 / 44456314 / -0.7% 78029391 / 77815085 / +0.3% 0.57 / 0.57 / -1.0%
fineweb_q02/datafusion:vortex-compact 44116872 / 45018740 / -2.0% 78515568 / 80975552 / -3.0% 0.56 / 0.56 / +1.1%
fineweb_q03/datafusion:vortex-compact 166599459 / 169313186 / -1.6% 227979324 / 293109172 / -22.2% 🟢 0.73 / 0.58 / +26.5%
fineweb_q04/datafusion:vortex-compact 210357554 / 178237198 / +18.0% 🔴 250095607 / 264989296 / -5.6% 0.84 / 0.67 / +25.0%
fineweb_q05/datafusion:vortex-compact 168994376 / 154412434 / +9.4% 224098823 / 228756129 / -2.0% 0.75 / 0.68 / +11.7%
fineweb_q06/datafusion:vortex-compact 87864008 / 88319857 / -0.5% 168274592 / 161574433 / +4.1% 0.52 / 0.55 / -4.5%
fineweb_q07/datafusion:vortex-compact 88624752 / 89030688 / -0.5% 160224707 / 156669113 / +2.3% 0.55 / 0.57 / -2.7%
fineweb_q08/datafusion:vortex-compact 8630885 / 9426087 / -8.4% 41413703 / 37519399 / +10.4% 🔴 0.21 / 0.25 / -17.0%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9517110 / 9544301 / -0.3% 33259776 / 33442194 / -0.5% 0.29 / 0.29 / +0.3%
fineweb_q01/datafusion:parquet 74397836 / 75351553 / -1.3% 159473472 / 144869117 / +10.1% 🔴 0.47 / 0.52 / -10.3%
fineweb_q02/datafusion:parquet 76322483 / 76058232 / +0.3% 159764862 / 146598420 / +9.0% 0.48 / 0.52 / -7.9%
fineweb_q03/datafusion:parquet 75971898 / 73425153 / +3.5% 160103090 / 146861281 / +9.0% 0.47 / 0.50 / -5.1%
fineweb_q04/datafusion:parquet 83645118 / 83516917 / +0.2% 154586470 / 140507993 / +10.0% 🔴 0.54 / 0.59 / -9.0%
fineweb_q05/datafusion:parquet 81009870 / 82116467 / -1.3% 158359473 / 140777121 / +12.5% 🔴 0.51 / 0.58 / -12.3%
fineweb_q06/datafusion:parquet 74276952 / 76359124 / -2.7% 161495437 / 144635238 / +11.7% 🔴 0.46 / 0.53 / -12.9%
fineweb_q07/datafusion:parquet 73017207 / 73761139 / -1.0% 156594298 / 141449472 / +10.7% 🔴 0.47 / 0.52 / -10.6%
fineweb_q08/datafusion:parquet 73081706 / 73609070 / -0.7% 154768387 / 146703264 / +5.5% 0.47 / 0.50 / -5.9%
duckdb / vortex-file-compressed / ns (1.584x ❌, 0↑ 8↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2234742 / 1843530 / +21.2% 🔴 6301754 / 4713904 / +33.7% 🔴 0.35 / 0.39 / -9.3%
fineweb_q01/duckdb:vortex-file-compressed 23627420 / 24512481 / -3.6% 28947616 / 61694358 / -53.1% 🟢 0.82 / 0.40 / +105.4%
fineweb_q02/duckdb:vortex-file-compressed 25635532 / 21542216 / +19.0% 🔴 29237161 / 61543521 / -52.5% 🟢 0.88 / 0.35 / +150.5%
fineweb_q03/duckdb:vortex-file-compressed 91861868 / 29427934 / +212.2% 🔴 94569974 / 163121258 / -42.0% 🟢 0.97 / 0.18 / +438.4%
fineweb_q04/duckdb:vortex-file-compressed 107885770 / 76647157 / +40.8% 🔴 111690686 / 132955796 / -16.0% 🟢 0.97 / 0.58 / +67.6%
fineweb_q05/duckdb:vortex-file-compressed 102030442 / 59822845 / +70.6% 🔴 104136538 / 111951832 / -7.0% 0.98 / 0.53 / +83.4%
fineweb_q06/duckdb:vortex-file-compressed 84551448 / 51238184 / +65.0% 🔴 89797845 / 152664729 / -41.2% 🟢 0.94 / 0.34 / +180.5%
fineweb_q07/duckdb:vortex-file-compressed 91624334 / 29891385 / +206.5% 🔴 92826015 / 109712675 / -15.4% 🟢 0.99 / 0.27 / +262.3%
fineweb_q08/duckdb:vortex-file-compressed 7802102 / 6567940 / +18.8% 🔴 12258549 / 16320538 / -24.9% 🟢 0.64 / 0.40 / +58.2%
duckdb / vortex-compact / ns (1.052x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2516254 / 3034978 / -17.1% 🟢 5154230 / 8108161 / -36.4% 🟢 0.49 / 0.37 / +30.4%
fineweb_q01/duckdb:vortex-compact 54314984 / 45503742 / +19.4% 🔴 66367443 / 66057652 / +0.5% 0.82 / 0.69 / +18.8%
fineweb_q02/duckdb:vortex-compact 59484694 / 55654264 / +6.9% 59908889 / 100971662 / -40.7% 🟢 0.99 / 0.55 / +80.1%
fineweb_q03/duckdb:vortex-compact 189868252 / 188797640 / +0.6% 239307352 / 294231188 / -18.7% 🟢 0.79 / 0.64 / +23.6%
fineweb_q04/duckdb:vortex-compact 212286546 / 187538448 / +13.2% 🔴 240221986 / 242190267 / -0.8% 0.88 / 0.77 / +14.1%
fineweb_q05/duckdb:vortex-compact 207833727 / 183263616 / +13.4% 🔴 211319765 / 254335338 / -16.9% 🟢 0.98 / 0.72 / +36.5%
fineweb_q06/duckdb:vortex-compact 118348952 / 109272839 / +8.3% 135910249 / 199577668 / -31.9% 🟢 0.87 / 0.55 / +59.0%
fineweb_q07/duckdb:vortex-compact 119441116 / 114002595 / +4.8% 137970181 / 175705996 / -21.5% 🟢 0.87 / 0.65 / +33.4%
fineweb_q08/duckdb:vortex-compact 6088651 / 5988716 / +1.7% 13621057 / 13834458 / -1.5% 0.45 / 0.43 / +3.3%
duckdb / parquet / ns (1.018x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 22520288 / 21234978 / +6.1% 28071701 / 23299074 / +20.5% 🔴 0.80 / 0.91 / -12.0%
fineweb_q01/duckdb:parquet 45175122 / 44856516 / +0.7% 56084852 / 57631272 / -2.7% 0.81 / 0.78 / +3.5%
fineweb_q02/duckdb:parquet 44271062 / 43801900 / +1.1% 54090022 / 53089555 / +1.9% 0.82 / 0.83 / -0.8%
fineweb_q03/duckdb:parquet 95470106 / 94509843 / +1.0% 181074864 / 182842218 / -1.0% 0.53 / 0.52 / +2.0%
fineweb_q04/duckdb:parquet 151072064 / 151467950 / -0.3% 191125783 / 218822966 / -12.7% 🟢 0.79 / 0.69 / +14.2%
fineweb_q05/duckdb:parquet 143035394 / 142199992 / +0.6% 190945401 / 199949344 / -4.5% 0.75 / 0.71 / +5.3%
fineweb_q06/duckdb:parquet 71350864 / 71163871 / +0.3% 128005676 / 116652236 / +9.7% 0.56 / 0.61 / -8.6%
fineweb_q07/duckdb:parquet 72539640 / 71699721 / +1.2% 157205159 / 150191399 / +4.7% 0.46 / 0.48 / -3.3%
fineweb_q08/duckdb:parquet 25228807 / 23752949 / +6.2% 24149300 / 25331543 / -4.7% 1.04 / 0.94 / +11.4%
File Size Changes (2 files changed, +0.1% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-compact 1.23 GB 1.23 GB +795.93 KB +0.1%
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +838.02 KB +0.1%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (+0.1%)
  • vortex-file-compressed: 1.43 GB → 1.44 GB (+0.1%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.0%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+10.0%, medium confidence)
Vortex (geomean): hot 1.047x ➖ · cold 0.933x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 17123552 / 16841850 / +1.7% 51537003 / 47252405 / +9.1% 0.33 / 0.36 / -6.8%
tpch_q02/datafusion:vortex-file-compressed 17233767 / 17328078 / -0.5% 39896563 / 37791472 / +5.6% 0.43 / 0.46 / -5.8%
tpch_q03/datafusion:vortex-file-compressed 19195084 / 19085706 / +0.6% 53000645 / 53884209 / -1.6% 0.36 / 0.35 / +2.2%
tpch_q04/datafusion:vortex-file-compressed 10394998 / 10168212 / +2.2% 38992946 / 36113265 / +8.0% 0.27 / 0.28 / -5.3%
tpch_q05/datafusion:vortex-file-compressed 37127729 / 37053535 / +0.2% 65917911 / 67954784 / -3.0% 0.56 / 0.55 / +3.3%
tpch_q06/datafusion:vortex-file-compressed 6171058 / 6241549 / -1.1% 35898595 / 32949761 / +8.9% 0.17 / 0.19 / -9.3%
tpch_q07/datafusion:vortex-file-compressed 51228492 / 51841763 / -1.2% 81753322 / 86938492 / -6.0% 0.63 / 0.60 / +5.1%
tpch_q08/datafusion:vortex-file-compressed 51482508 / 51941492 / -0.9% 83997489 / 78674715 / +6.8% 0.61 / 0.66 / -7.2%
tpch_q09/datafusion:vortex-file-compressed 49529834 / 50442551 / -1.8% 79641837 / 80460431 / -1.0% 0.62 / 0.63 / -0.8%
tpch_q10/datafusion:vortex-file-compressed 17051674 / 17207510 / -0.9% 55251292 / 52354132 / +5.5% 0.31 / 0.33 / -6.1%
tpch_q11/datafusion:vortex-file-compressed 14984461 / 15107721 / -0.8% 37390463 / 34876545 / +7.2% 0.40 / 0.43 / -7.5%
tpch_q12/datafusion:vortex-file-compressed 22677250 / 22962389 / -1.2% 50083752 / 47747084 / +4.9% 0.45 / 0.48 / -5.8%
tpch_q13/datafusion:vortex-file-compressed 20137921 / 20102638 / +0.2% 43485480 / 44420634 / -2.1% 0.46 / 0.45 / +2.3%
tpch_q14/datafusion:vortex-file-compressed 15117538 / 15123941 / -0.0% 43305480 / 41738161 / +3.8% 0.35 / 0.36 / -3.7%
tpch_q15/datafusion:vortex-file-compressed 18911628 / 18997882 / -0.5% 51214227 / 47135376 / +8.7% 0.37 / 0.40 / -8.4%
tpch_q16/datafusion:vortex-file-compressed 18383209 / 18794504 / -2.2% 40270615 / 39562358 / +1.8% 0.46 / 0.48 / -3.9%
tpch_q17/datafusion:vortex-file-compressed 28310645 / 27992951 / +1.1% 61660276 / 59644834 / +3.4% 0.46 / 0.47 / -2.2%
tpch_q18/datafusion:vortex-file-compressed 36956781 / 36978363 / -0.1% 64119422 / 60945195 / +5.2% 0.58 / 0.61 / -5.0%
tpch_q19/datafusion:vortex-file-compressed 14380511 / 14168406 / +1.5% 45344704 / 41088187 / +10.4% 🔴 0.32 / 0.34 / -8.0%
tpch_q20/datafusion:vortex-file-compressed 20694830 / 21025182 / -1.6% 46788484 / 47297329 / -1.1% 0.44 / 0.44 / -0.5%
tpch_q21/datafusion:vortex-file-compressed 39654184 / 39108149 / +1.4% 67008820 / 69315508 / -3.3% 0.59 / 0.56 / +4.9%
tpch_q22/datafusion:vortex-file-compressed 10973679 / 11198895 / -2.0% 36634102 / 34800546 / +5.3% 0.30 / 0.32 / -6.9%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 17616872 / 18423433 / -4.4% 47815608 / 45218762 / +5.7% 0.37 / 0.41 / -9.6%
tpch_q02/datafusion:vortex-compact 19703217 / 19629800 / +0.4% 38142810 / 39484399 / -3.4% 0.52 / 0.50 / +3.9%
tpch_q03/datafusion:vortex-compact 20156565 / 20209567 / -0.3% 48356439 / 48488227 / -0.3% 0.42 / 0.42 / +0.0%
tpch_q04/datafusion:vortex-compact 11716714 / 11073055 / +5.8% 32301762 / 33303383 / -3.0% 0.36 / 0.33 / +9.1%
tpch_q05/datafusion:vortex-compact 37733810 / 38135824 / -1.1% 63707113 / 68196354 / -6.6% 0.59 / 0.56 / +5.9%
tpch_q06/datafusion:vortex-compact 6785760 / 6720728 / +1.0% 31473297 / 30269099 / +4.0% 0.22 / 0.22 / -2.9%
tpch_q07/datafusion:vortex-compact 52073015 / 52894918 / -1.6% 83440122 / 75737805 / +10.2% 🔴 0.62 / 0.70 / -10.6%
tpch_q08/datafusion:vortex-compact 53654898 / 52648741 / +1.9% 80085117 / 82894459 / -3.4% 0.67 / 0.64 / +5.5%
tpch_q09/datafusion:vortex-compact 50934793 / 50250571 / +1.4% 79260125 / 80010448 / -0.9% 0.64 / 0.63 / +2.3%
tpch_q10/datafusion:vortex-compact 18921939 / 19129225 / -1.1% 50740900 / 49844964 / +1.8% 0.37 / 0.38 / -2.8%
tpch_q11/datafusion:vortex-compact 16060370 / 16051756 / +0.1% 35629416 / 34351998 / +3.7% 0.45 / 0.47 / -3.5%
tpch_q12/datafusion:vortex-compact 24837843 / 24158464 / +2.8% 48205615 / 47220059 / +2.1% 0.52 / 0.51 / +0.7%
tpch_q13/datafusion:vortex-compact 21158315 / 21145410 / +0.1% 40732828 / 39500374 / +3.1% 0.52 / 0.54 / -3.0%
tpch_q14/datafusion:vortex-compact 16508957 / 16424033 / +0.5% 41135392 / 42489501 / -3.2% 0.40 / 0.39 / +3.8%
tpch_q15/datafusion:vortex-compact 19812959 / 19901155 / -0.4% 47487994 / 45390241 / +4.6% 0.42 / 0.44 / -4.8%
tpch_q16/datafusion:vortex-compact 18782332 / 18456257 / +1.8% 38616271 / 38727371 / -0.3% 0.49 / 0.48 / +2.1%
tpch_q17/datafusion:vortex-compact 29188958 / 29080440 / +0.4% 56607678 / 57917311 / -2.3% 0.52 / 0.50 / +2.7%
tpch_q18/datafusion:vortex-compact 38210634 / 38176385 / +0.1% 60791228 / 59331811 / +2.5% 0.63 / 0.64 / -2.3%
tpch_q19/datafusion:vortex-compact 18639183 / 18739971 / -0.5% 46823592 / 46793810 / +0.1% 0.40 / 0.40 / -0.6%
tpch_q20/datafusion:vortex-compact 21919082 / 22027246 / -0.5% 45999001 / 45496543 / +1.1% 0.48 / 0.48 / -1.6%
tpch_q21/datafusion:vortex-compact 41331197 / 42571507 / -2.9% 69108385 / 69425168 / -0.5% 0.60 / 0.61 / -2.5%
tpch_q22/datafusion:vortex-compact 11911524 / 11768009 / +1.2% 31604856 / 32012885 / -1.3% 0.38 / 0.37 / +2.5%
datafusion / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 66854054 / 67273283 / -0.6% 88830097 / 87687149 / +1.3% 0.75 / 0.77 / -1.9%
tpch_q02/datafusion:parquet 52460362 / 52855327 / -0.7% 73927745 / 75695520 / -2.3% 0.71 / 0.70 / +1.6%
tpch_q03/datafusion:parquet 71870871 / 72087763 / -0.3% 100884504 / 98657229 / +2.3% 0.71 / 0.73 / -2.5%
tpch_q04/datafusion:parquet 39579222 / 39886960 / -0.8% 63463289 / 62771870 / +1.1% 0.62 / 0.64 / -1.9%
tpch_q05/datafusion:parquet 88735846 / 87730361 / +1.1% 118198493 / 118148543 / +0.0% 0.75 / 0.74 / +1.1%
tpch_q06/datafusion:parquet 28038402 / 28121644 / -0.3% 50588130 / 50470712 / +0.2% 0.55 / 0.56 / -0.5%
tpch_q07/datafusion:parquet 94813621 / 94099283 / +0.8% 128700057 / 129233587 / -0.4% 0.74 / 0.73 / +1.2%
tpch_q08/datafusion:parquet 96451488 / 95836873 / +0.6% 130014315 / 126724510 / +2.6% 0.74 / 0.76 / -1.9%
tpch_q09/datafusion:parquet 113471726 / 114785812 / -1.1% 151832702 / 149035501 / +1.9% 0.75 / 0.77 / -3.0%
tpch_q10/datafusion:parquet 79153168 / 79867174 / -0.9% 113809594 / 114666339 / -0.7% 0.70 / 0.70 / -0.1%
tpch_q11/datafusion:parquet 39374029 / 39879865 / -1.3% 66422148 / 65340184 / +1.7% 0.59 / 0.61 / -2.9%
tpch_q12/datafusion:parquet 62257181 / 61896749 / +0.6% 90477938 / 91754425 / -1.4% 0.69 / 0.67 / +2.0%
tpch_q13/datafusion:parquet 158985884 / 159656590 / -0.4% 184647455 / 187131231 / -1.3% 0.86 / 0.85 / +0.9%
tpch_q14/datafusion:parquet 39922943 / 39770349 / +0.4% 67777812 / 68235685 / -0.7% 0.59 / 0.58 / +1.1%
tpch_q15/datafusion:parquet 46462320 / 46782957 / -0.7% 76472791 / 72955990 / +4.8% 0.61 / 0.64 / -5.3%
tpch_q16/datafusion:parquet 38322027 / 38660210 / -0.9% 61094628 / 60583614 / +0.8% 0.63 / 0.64 / -1.7%
tpch_q17/datafusion:parquet 116480365 / 116433638 / +0.0% 146173339 / 143728905 / +1.7% 0.80 / 0.81 / -1.6%
tpch_q18/datafusion:parquet 115205408 / 115819736 / -0.5% 141485893 / 142343727 / -0.6% 0.81 / 0.81 / +0.1%
tpch_q19/datafusion:parquet 50063294 / 49887562 / +0.4% 82468240 / 80538243 / +2.4% 0.61 / 0.62 / -2.0%
tpch_q20/datafusion:parquet 57861406 / 58344580 / -0.8% 84822289 / 89332677 / -5.0% 0.68 / 0.65 / +4.4%
tpch_q21/datafusion:parquet 98748219 / 99727762 / -1.0% 124022259 / 127385237 / -2.6% 0.80 / 0.78 / +1.7%
tpch_q22/datafusion:parquet 41961326 / 42098723 / -0.3% 64721765 / 62071003 / +4.3% 0.65 / 0.68 / -4.4%
duckdb / vortex-file-compressed / ns (1.104x ❌, 0↑ 13↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 12478579 / 11573337 / +7.8% 18826266 / 23524769 / -20.0% 🟢 0.66 / 0.49 / +34.7%
tpch_q02/duckdb:vortex-file-compressed 19198363 / 17731492 / +8.3% 24492153 / 28586514 / -14.3% 🟢 0.78 / 0.62 / +26.4%
tpch_q03/duckdb:vortex-file-compressed 20638407 / 18615732 / +10.9% 🔴 28798917 / 39532612 / -27.2% 🟢 0.72 / 0.47 / +52.2%
tpch_q04/duckdb:vortex-file-compressed 17897316 / 17648331 / +1.4% 25039665 / 31268806 / -19.9% 🟢 0.71 / 0.56 / +26.6%
tpch_q05/duckdb:vortex-file-compressed 24686245 / 22823748 / +8.2% 30070730 / 36846688 / -18.4% 🟢 0.82 / 0.62 / +32.5%
tpch_q06/duckdb:vortex-file-compressed 6895922 / 5721653 / +20.5% 🔴 12104225 / 14362119 / -15.7% 🟢 0.57 / 0.40 / +43.0%
tpch_q07/duckdb:vortex-file-compressed 23497561 / 21361920 / +10.0% 31428596 / 37568738 / -16.3% 🟢 0.75 / 0.57 / +31.5%
tpch_q08/duckdb:vortex-file-compressed 26686324 / 23801721 / +12.1% 🔴 33672986 / 43023990 / -21.7% 🟢 0.79 / 0.55 / +43.3%
tpch_q09/duckdb:vortex-file-compressed 33225146 / 29808259 / +11.5% 🔴 40298258 / 48248948 / -16.5% 🟢 0.82 / 0.62 / +33.5%
tpch_q10/duckdb:vortex-file-compressed 31656331 / 28602470 / +10.7% 🔴 40099306 / 46421819 / -13.6% 🟢 0.79 / 0.62 / +28.1%
tpch_q11/duckdb:vortex-file-compressed 9186424 / 8070549 / +13.8% 🔴 16603668 / 15161481 / +9.5% 0.55 / 0.53 / +3.9%
tpch_q12/duckdb:vortex-file-compressed 18874783 / 16479710 / +14.5% 🔴 24233801 / 32070174 / -24.4% 🟢 0.78 / 0.51 / +51.6%
tpch_q13/duckdb:vortex-file-compressed 23427452 / 22536280 / +4.0% 32077480 / 39229230 / -18.2% 🟢 0.73 / 0.57 / +27.1%
tpch_q14/duckdb:vortex-file-compressed 15438167 / 13247587 / +16.5% 🔴 21948066 / 25245757 / -13.1% 🟢 0.70 / 0.52 / +34.0%
tpch_q15/duckdb:vortex-file-compressed 11547512 / 9654349 / +19.6% 🔴 15343105 / 21940075 / -30.1% 🟢 0.75 / 0.44 / +71.0%
tpch_q16/duckdb:vortex-file-compressed 19314177 / 18524517 / +4.3% 22841337 / 24609896 / -7.2% 0.85 / 0.75 / +12.3%
tpch_q17/duckdb:vortex-file-compressed 17329937 / 14784392 / +17.2% 🔴 28154608 / 36085173 / -22.0% 🟢 0.62 / 0.41 / +50.2%
tpch_q18/duckdb:vortex-file-compressed 27582298 / 24948415 / +10.6% 🔴 36079737 / 37449344 / -3.7% 0.76 / 0.67 / +14.8%
tpch_q19/duckdb:vortex-file-compressed 25695472 / 23123625 / +11.1% 🔴 31243605 / 36506740 / -14.4% 🟢 0.82 / 0.63 / +29.8%
tpch_q20/duckdb:vortex-file-compressed 19990784 / 17574543 / +13.7% 🔴 28909696 / 34988695 / -17.4% 🟢 0.69 / 0.50 / +37.7%
tpch_q21/duckdb:vortex-file-compressed 69447326 / 66021399 / +5.2% 78537261 / 81080063 / -3.1% 0.88 / 0.81 / +8.6%
tpch_q22/duckdb:vortex-file-compressed 12633161 / 12588773 / +0.4% 21120887 / 22874248 / -7.7% 0.60 / 0.55 / +8.7%
duckdb / vortex-compact / ns (1.088x ➖, 0↑ 9↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 14013398 / 14667341 / -4.5% 18743134 / 23093313 / -18.8% 🟢 0.75 / 0.64 / +17.7%
tpch_q02/duckdb:vortex-compact 20926904 / 20158306 / +3.8% 28972265 / 30433534 / -4.8% 0.72 / 0.66 / +9.0%
tpch_q03/duckdb:vortex-compact 22360898 / 18995005 / +17.7% 🔴 29525579 / 38213070 / -22.7% 🟢 0.76 / 0.50 / +52.4%
tpch_q04/duckdb:vortex-compact 19654830 / 18350162 / +7.1% 27717828 / 30798001 / -10.0% 🟢 0.71 / 0.60 / +19.0%
tpch_q05/duckdb:vortex-compact 25745776 / 22430186 / +14.8% 🔴 34587775 / 38602737 / -10.4% 🟢 0.74 / 0.58 / +28.1%
tpch_q06/duckdb:vortex-compact 7462075 / 6301096 / +18.4% 🔴 12707355 / 16383171 / -22.4% 🟢 0.59 / 0.38 / +52.7%
tpch_q07/duckdb:vortex-compact 24747856 / 21743063 / +13.8% 🔴 33639357 / 40160075 / -16.2% 🟢 0.74 / 0.54 / +35.9%
tpch_q08/duckdb:vortex-compact 29059577 / 25890738 / +12.2% 🔴 34376397 / 42617172 / -19.3% 🟢 0.85 / 0.61 / +39.1%
tpch_q09/duckdb:vortex-compact 33275992 / 30614142 / +8.7% 43488687 / 44727732 / -2.8% 0.77 / 0.68 / +11.8%
tpch_q10/duckdb:vortex-compact 33005653 / 31242068 / +5.6% 38123584 / 50523901 / -24.5% 🟢 0.87 / 0.62 / +40.0%
tpch_q11/duckdb:vortex-compact 10092477 / 9393232 / +7.4% 15724950 / 17468025 / -10.0% 0.64 / 0.54 / +19.4%
tpch_q12/duckdb:vortex-compact 20378405 / 18662579 / +9.2% 28152424 / 31947651 / -11.9% 🟢 0.72 / 0.58 / +23.9%
tpch_q13/duckdb:vortex-compact 24646443 / 22748269 / +8.3% 39526612 / 47977915 / -17.6% 🟢 0.62 / 0.47 / +31.5%
tpch_q14/duckdb:vortex-compact 15802329 / 15025789 / +5.2% 22505972 / 26979843 / -16.6% 🟢 0.70 / 0.56 / +26.1%
tpch_q15/duckdb:vortex-compact 11905017 / 9865524 / +20.7% 🔴 17510382 / 22377310 / -21.7% 🟢 0.68 / 0.44 / +54.2%
tpch_q16/duckdb:vortex-compact 21182054 / 20454980 / +3.6% 25602281 / 27072902 / -5.4% 0.83 / 0.76 / +9.5%
tpch_q17/duckdb:vortex-compact 18787109 / 16535131 / +13.6% 🔴 31222979 / 32222958 / -3.1% 0.60 / 0.51 / +17.3%
tpch_q18/duckdb:vortex-compact 27988587 / 26848418 / +4.2% 35626373 / 41829069 / -14.8% 🟢 0.79 / 0.64 / +22.4%
tpch_q19/duckdb:vortex-compact 27416256 / 24628367 / +11.3% 🔴 32614478 / 35964077 / -9.3% 0.84 / 0.68 / +22.8%
tpch_q20/duckdb:vortex-compact 21259579 / 19124358 / +11.2% 🔴 32534096 / 37071327 / -12.2% 🟢 0.65 / 0.52 / +26.7%
tpch_q21/duckdb:vortex-compact 71263967 / 69106962 / +3.1% 84442920 / 86728344 / -2.6% 0.84 / 0.80 / +5.9%
tpch_q22/duckdb:vortex-compact 13116683 / 12864733 / +2.0% 22044803 / 25298390 / -12.9% 🟢 0.60 / 0.51 / +17.0%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60233841 / 60357845 / -0.2% 67017573 / 66718108 / +0.4% 0.90 / 0.90 / -0.7%
tpch_q02/duckdb:parquet 37626050 / 35530048 / +5.9% 42740876 / 43216727 / -1.1% 0.88 / 0.82 / +7.1%
tpch_q03/duckdb:parquet 61969984 / 62579421 / -1.0% 72888891 / 74093185 / -1.6% 0.85 / 0.84 / +0.7%
tpch_q04/duckdb:parquet 43497253 / 45748894 / -4.9% 52736901 / 53137188 / -0.8% 0.82 / 0.86 / -4.2%
tpch_q05/duckdb:parquet 61080451 / 61081593 / -0.0% 72842602 / 73721538 / -1.2% 0.84 / 0.83 / +1.2%
tpch_q06/duckdb:parquet 20288227 / 20298984 / -0.1% 25076480 / 24700480 / +1.5% 0.81 / 0.82 / -1.6%
tpch_q07/duckdb:parquet 60726837 / 61394501 / -1.1% 71917676 / 72481550 / -0.8% 0.84 / 0.85 / -0.3%
tpch_q08/duckdb:parquet 73685782 / 73836951 / -0.2% 87508985 / 87738454 / -0.3% 0.84 / 0.84 / +0.1%
tpch_q09/duckdb:parquet 114056041 / 115073006 / -0.9% 127278153 / 130308202 / -2.3% 0.90 / 0.88 / +1.5%
tpch_q10/duckdb:parquet 108199368 / 109092836 / -0.8% 123144807 / 125015639 / -1.5% 0.88 / 0.87 / +0.7%
tpch_q11/duckdb:parquet 19969615 / 20253054 / -1.4% 23745650 / 24355852 / -2.5% 0.84 / 0.83 / +1.1%
tpch_q12/duckdb:parquet 41456714 / 41623713 / -0.4% 49252083 / 49514412 / -0.5% 0.84 / 0.84 / +0.1%
tpch_q13/duckdb:parquet 238914881 / 239305747 / -0.2% 247983149 / 249047976 / -0.4% 0.96 / 0.96 / +0.3%
tpch_q14/duckdb:parquet 43691181 / 43976951 / -0.6% 51929331 / 52781165 / -1.6% 0.84 / 0.83 / +1.0%
tpch_q15/duckdb:parquet 25018742 / 25084238 / -0.3% 31638120 / 31691726 / -0.2% 0.79 / 0.79 / -0.1%
tpch_q16/duckdb:parquet 49966021 / 51562535 / -3.1% 57633666 / 58278660 / -1.1% 0.87 / 0.88 / -2.0%
tpch_q17/duckdb:parquet 47213435 / 44660314 / +5.7% 54277354 / 55063817 / -1.4% 0.87 / 0.81 / +7.2%
tpch_q18/duckdb:parquet 89742252 / 90738571 / -1.1% 100327841 / 101576475 / -1.2% 0.89 / 0.89 / +0.1%
tpch_q19/duckdb:parquet 61176911 / 61487376 / -0.5% 71723260 / 71753672 / -0.0% 0.85 / 0.86 / -0.5%
tpch_q20/duckdb:parquet 58727097 / 59136460 / -0.7% 71018212 / 71135126 / -0.2% 0.83 / 0.83 / -0.5%
tpch_q21/duckdb:parquet 136946868 / 137493886 / -0.4% 150993361 / 148648697 / +1.6% 0.91 / 0.92 / -1.9%
tpch_q22/duckdb:parquet 50631085 / 50787925 / -0.3% 58306754 / 61391221 / -5.0% 0.87 / 0.83 / +5.0%
File Size Changes (16 files changed, +1.9% overall, 16↑ 0↓)
File Scale Format Base HEAD Change %
region.vortex 1.0 vortex-compact 5.70 KB 28.42 KB +22.73 KB +399.0%
nation.vortex 1.0 vortex-compact 7.51 KB 37.17 KB +29.66 KB +394.8%
region.vortex 1.0 vortex-file-compressed 6.52 KB 28.72 KB +22.20 KB +340.8%
nation.vortex 1.0 vortex-file-compressed 10.54 KB 41.99 KB +31.45 KB +298.3%
supplier.vortex 1.0 vortex-compact 495.60 KB 548.97 KB +53.38 KB +10.8%
supplier.vortex 1.0 vortex-file-compressed 624.71 KB 672.37 KB +47.66 KB +7.6%
part.vortex 1.0 vortex-compact 3.55 MB 3.69 MB +139.17 KB +3.8%
part.vortex 1.0 vortex-file-compressed 5.39 MB 5.55 MB +159.95 KB +2.9%
customer.vortex 1.0 vortex-compact 7.41 MB 7.61 MB +209.99 KB +2.8%
customer.vortex 1.0 vortex-file-compressed 9.17 MB 9.39 MB +224.86 KB +2.4%
orders.vortex 1.0 vortex-compact 31.72 MB 32.38 MB +673.05 KB +2.1%
lineitem.vortex 1.0 vortex-file-compressed 171.51 MB 174.90 MB +3.39 MB +2.0%
lineitem.vortex 1.0 vortex-compact 126.00 MB 128.15 MB +2.14 MB +1.7%
orders.vortex 1.0 vortex-file-compressed 42.78 MB 43.38 MB +612.95 KB +1.4%
partsupp.vortex 1.0 vortex-compact 20.30 MB 20.56 MB +268.55 KB +1.3%
partsupp.vortex 1.0 vortex-file-compressed 24.95 MB 25.24 MB +296.98 KB +1.2%

Totals:

  • vortex-compact: 189.75 MB → 193.25 MB (+1.8%)
  • vortex-file-compressed: 254.70 MB → 259.45 MB (+1.9%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +14.0%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB Likely regression (+30.2%, environment too noisy confidence)
Vortex (geomean): hot 1.133x ❌ · cold 0.971x ➖
Parquet (geomean): hot 0.994x ➖ · cold 1.000x ➖
Shifts: Parquet (control) -0.6% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.994x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 173868746 / 203958554 / -14.8% 🟢 582053267 / 554859386 / +4.9% 0.30 / 0.37 / -18.7%
clickbench-sorted_q24/datafusion:vortex-file-compressed 11394960 / 10147694 / +12.3% 🔴 48975271 / 46221672 / +6.0% 0.23 / 0.22 / +6.0%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11254524 / 11226318 / +0.3% 45596179 / 45622714 / -0.1% 0.25 / 0.25 / +0.3%
clickbench-sorted_q36/datafusion:vortex-file-compressed 22951720 / 22664480 / +1.3% 69885661 / 65164433 / +7.2% 0.33 / 0.35 / -5.6%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18407424 / 17980650 / +2.4% 55601633 / 54844461 / +1.4% 0.33 / 0.33 / +1.0%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17586162 / 17900656 / -1.8% 58000486 / 55903347 / +3.8% 0.30 / 0.32 / -5.3%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40574302 / 40709808 / -0.3% 87512240 / 89086386 / -1.8% 0.46 / 0.46 / +1.5%
clickbench-sorted_q40/datafusion:vortex-file-compressed 13628244 / 13203188 / +3.2% 41657897 / 42315040 / -1.6% 0.33 / 0.31 / +4.8%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11832023 / 12772200 / -7.4% 40411278 / 39529482 / +2.2% 0.29 / 0.32 / -9.4%
clickbench-sorted_q42/datafusion:vortex-file-compressed 10094450 / 9952523 / +1.4% 34640770 / 34271295 / +1.1% 0.29 / 0.29 / +0.3%
datafusion / vortex-compact / ns (1.016x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 219310652 / 216074156 / +1.5% 412426388 / 429430708 / -4.0% 0.53 / 0.50 / +5.7%
clickbench-sorted_q24/datafusion:vortex-compact 23738381 / 23163317 / +2.5% 50144433 / 50917792 / -1.5% 0.47 / 0.45 / +4.1%
clickbench-sorted_q26/datafusion:vortex-compact 22863098 / 23427008 / -2.4% 50471672 / 49079527 / +2.8% 0.45 / 0.48 / -5.1%
clickbench-sorted_q36/datafusion:vortex-compact 25504683 / 24768156 / +3.0% 68580979 / 66909300 / +2.5% 0.37 / 0.37 / +0.5%
clickbench-sorted_q37/datafusion:vortex-compact 22287948 / 21445435 / +3.9% 61796468 / 65440405 / -5.6% 0.36 / 0.33 / +10.1%
clickbench-sorted_q38/datafusion:vortex-compact 21907216 / 20822332 / +5.2% 62882633 / 61433464 / +2.4% 0.35 / 0.34 / +2.8%
clickbench-sorted_q39/datafusion:vortex-compact 45310600 / 44742779 / +1.3% 83686798 / 82943710 / +0.9% 0.54 / 0.54 / +0.4%
clickbench-sorted_q40/datafusion:vortex-compact 15171174 / 15093750 / +0.5% 43772378 / 42882250 / +2.1% 0.35 / 0.35 / -1.5%
clickbench-sorted_q41/datafusion:vortex-compact 13949014 / 14467203 / -3.6% 40968732 / 43893742 / -6.7% 0.34 / 0.33 / +3.3%
clickbench-sorted_q42/datafusion:vortex-compact 11646932 / 11124072 / +4.7% 36533982 / 33782727 / +8.1% 0.32 / 0.33 / -3.2%
datafusion / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 757689500 / 754211802 / +0.5% 934464662 / 952663856 / -1.9% 0.81 / 0.79 / +2.4%
clickbench-sorted_q24/datafusion:parquet 8711486 / 8766182 / -0.6% 72354249 / 74567385 / -3.0% 0.12 / 0.12 / +2.4%
clickbench-sorted_q26/datafusion:parquet 9103539 / 9143628 / -0.4% 71195815 / 71331011 / -0.2% 0.13 / 0.13 / -0.2%
clickbench-sorted_q36/datafusion:parquet 94019994 / 93308853 / +0.8% 165239379 / 167252122 / -1.2% 0.57 / 0.56 / +2.0%
clickbench-sorted_q37/datafusion:parquet 64833260 / 64380406 / +0.7% 130331601 / 131474705 / -0.9% 0.50 / 0.49 / +1.6%
clickbench-sorted_q38/datafusion:parquet 88013358 / 86865668 / +1.3% 156485024 / 158637356 / -1.4% 0.56 / 0.55 / +2.7%
clickbench-sorted_q39/datafusion:parquet 159849003 / 159971916 / -0.1% 231843984 / 231745071 / +0.0% 0.69 / 0.69 / -0.1%
clickbench-sorted_q40/datafusion:parquet 44774121 / 44248474 / +1.2% 110110557 / 109678710 / +0.4% 0.41 / 0.40 / +0.8%
clickbench-sorted_q41/datafusion:parquet 42660972 / 41722788 / +2.2% 108193914 / 106879259 / +1.2% 0.39 / 0.39 / +1.0%
clickbench-sorted_q42/datafusion:parquet 26438514 / 25938578 / +1.9% 87986584 / 86425443 / +1.8% 0.30 / 0.30 / +0.1%
duckdb / vortex-file-compressed / ns (1.259x ❌, 0↑ 7↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 60640860 / 56678177 / +7.0% 79040122 / 88136408 / -10.3% 🟢 0.77 / 0.64 / +19.3%
clickbench-sorted_q24/duckdb:vortex-file-compressed 21506167 / 22203234 / -3.1% 28571195 / 28579992 / -0.0% 0.75 / 0.78 / -3.1%
clickbench-sorted_q26/duckdb:vortex-file-compressed 17489052 / 16327810 / +7.1% 28151514 / 25009332 / +12.6% 🔴 0.62 / 0.65 / -4.8%
clickbench-sorted_q36/duckdb:vortex-file-compressed 43782938 / 29935670 / +46.3% 🔴 60817857 / 59853994 / +1.6% 0.72 / 0.50 / +43.9%
clickbench-sorted_q37/duckdb:vortex-file-compressed 37642575 / 23555410 / +59.8% 🔴 47567658 / 53310453 / -10.8% 🟢 0.79 / 0.44 / +79.1%
clickbench-sorted_q38/duckdb:vortex-file-compressed 39206488 / 26417602 / +48.4% 🔴 52356164 / 57435907 / -8.8% 0.75 / 0.46 / +62.8%
clickbench-sorted_q39/duckdb:vortex-file-compressed 66173706 / 48175516 / +37.4% 🔴 76767602 / 92820980 / -17.3% 🟢 0.86 / 0.52 / +66.1%
clickbench-sorted_q40/duckdb:vortex-file-compressed 19428988 / 15710556 / +23.7% 🔴 33277430 / 35554250 / -6.4% 0.58 / 0.44 / +32.1%
clickbench-sorted_q41/duckdb:vortex-file-compressed 19393106 / 15856792 / +22.3% 🔴 33310816 / 38156276 / -12.7% 🟢 0.58 / 0.42 / +40.1%
clickbench-sorted_q42/duckdb:vortex-file-compressed 17617078 / 14102984 / +24.9% 🔴 33935121 / 31205734 / +8.7% 0.52 / 0.45 / +14.9%
duckdb / vortex-compact / ns (1.295x ❌, 0↑ 9↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 69810168 / 65614158 / +6.4% 85665583 / 92489108 / -7.4% 0.81 / 0.71 / +14.9%
clickbench-sorted_q24/duckdb:vortex-compact 25581830 / 22659856 / +12.9% 🔴 33139250 / 32579825 / +1.7% 0.77 / 0.70 / +11.0%
clickbench-sorted_q26/duckdb:vortex-compact 18726960 / 15409460 / +21.5% 🔴 25917081 / 32988210 / -21.4% 🟢 0.72 / 0.47 / +54.7%
clickbench-sorted_q36/duckdb:vortex-compact 55048164 / 35997109 / +52.9% 🔴 68438368 / 71951366 / -4.9% 0.80 / 0.50 / +60.8%
clickbench-sorted_q37/duckdb:vortex-compact 47847953 / 30703165 / +55.8% 🔴 57576466 / 69267609 / -16.9% 🟢 0.83 / 0.44 / +87.5%
clickbench-sorted_q38/duckdb:vortex-compact 50822898 / 32757278 / +55.1% 🔴 61458144 / 66530096 / -7.6% 0.83 / 0.49 / +68.0%
clickbench-sorted_q39/duckdb:vortex-compact 83462141 / 61336080 / +36.1% 🔴 93764952 / 96696895 / -3.0% 0.89 / 0.63 / +40.3%
clickbench-sorted_q40/duckdb:vortex-compact 21583330 / 17948590 / +20.3% 🔴 36075946 / 39854716 / -9.5% 0.60 / 0.45 / +32.8%
clickbench-sorted_q41/duckdb:vortex-compact 23498730 / 19285862 / +21.8% 🔴 39555804 / 43087655 / -8.2% 0.59 / 0.45 / +32.7%
clickbench-sorted_q42/duckdb:vortex-compact 18519518 / 15040000 / +23.1% 🔴 33365739 / 35728320 / -6.6% 0.56 / 0.42 / +31.9%
duckdb / parquet / ns (0.980x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 123149460 / 123574631 / -0.3% 143823561 / 152980403 / -6.0% 0.86 / 0.81 / +6.0%
clickbench-sorted_q24/duckdb:parquet 17429240 / 17170432 / +1.5% 25623456 / 31553056 / -18.8% 🟢 0.68 / 0.54 / +25.0%
clickbench-sorted_q26/duckdb:parquet 12406009 / 14940070 / -17.0% 🟢 29551029 / 23618781 / +25.1% 🔴 0.42 / 0.63 / -33.6%
clickbench-sorted_q36/duckdb:parquet 43534064 / 42032726 / +3.6% 60760134 / 60107224 / +1.1% 0.72 / 0.70 / +2.5%
clickbench-sorted_q37/duckdb:parquet 31031307 / 31008083 / +0.1% 49318012 / 45614583 / +8.1% 0.63 / 0.68 / -7.4%
clickbench-sorted_q38/duckdb:parquet 38177434 / 40603616 / -6.0% 54945868 / 55031645 / -0.2% 0.69 / 0.74 / -5.8%
clickbench-sorted_q39/duckdb:parquet 70707044 / 73674813 / -4.0% 86484755 / 86274078 / +0.2% 0.82 / 0.85 / -4.3%
clickbench-sorted_q40/duckdb:parquet 16440398 / 18467324 / -11.0% 🟢 36090334 / 38898370 / -7.2% 0.46 / 0.47 / -4.0%
clickbench-sorted_q41/duckdb:parquet 16631682 / 15837202 / +5.0% 38887859 / 35684318 / +9.0% 0.43 / 0.44 / -3.6%
clickbench-sorted_q42/duckdb:parquet 12105914 / 10838226 / +11.7% 🔴 22506259 / 22476682 / +0.1% 0.54 / 0.48 / +11.5%
File Size Changes (200 files changed, +1.5% overall, 200↑ 0↓)
File Scale Format Base HEAD Change %
hits_080.vortex 1.0 vortex-compact 94.66 MB 98.83 MB +4.17 MB +4.4%
hits_000.vortex 1.0 vortex-compact 97.88 MB 100.60 MB +2.72 MB +2.8%
hits_089.vortex 1.0 vortex-compact 97.67 MB 100.38 MB +2.71 MB +2.8%
hits_026.vortex 1.0 vortex-compact 97.28 MB 99.94 MB +2.66 MB +2.7%
hits_012.vortex 1.0 vortex-compact 138.70 MB 142.36 MB +3.66 MB +2.6%
hits_041.vortex 1.0 vortex-compact 97.13 MB 99.68 MB +2.56 MB +2.6%
hits_069.vortex 1.0 vortex-compact 99.57 MB 102.07 MB +2.50 MB +2.5%
hits_043.vortex 1.0 vortex-compact 94.45 MB 96.73 MB +2.28 MB +2.4%
hits_046.vortex 1.0 vortex-compact 74.85 MB 76.57 MB +1.72 MB +2.3%
hits_009.vortex 1.0 vortex-compact 75.16 MB 76.89 MB +1.73 MB +2.3%
hits_083.vortex 1.0 vortex-compact 109.96 MB 112.40 MB +2.44 MB +2.2%
hits_072.vortex 1.0 vortex-compact 75.64 MB 77.29 MB +1.65 MB +2.2%
hits_031.vortex 1.0 vortex-compact 111.14 MB 113.55 MB +2.41 MB +2.2%
hits_020.vortex 1.0 vortex-compact 111.64 MB 114.03 MB +2.39 MB +2.1%
hits_035.vortex 1.0 vortex-compact 75.98 MB 77.60 MB +1.62 MB +2.1%
hits_094.vortex 1.0 vortex-compact 110.71 MB 113.07 MB +2.36 MB +2.1%
hits_068.vortex 1.0 vortex-compact 111.94 MB 114.30 MB +2.37 MB +2.1%
hits_099.vortex 1.0 vortex-compact 132.99 MB 135.80 MB +2.81 MB +2.1%
hits_052.vortex 1.0 vortex-compact 98.06 MB 100.08 MB +2.02 MB +2.1%
hits_021.vortex 1.0 vortex-compact 110.38 MB 112.64 MB +2.26 MB +2.1%
hits_057.vortex 1.0 vortex-compact 111.41 MB 113.68 MB +2.27 MB +2.0%
hits_019.vortex 1.0 vortex-compact 106.08 MB 108.22 MB +2.15 MB +2.0%
hits_005.vortex 1.0 vortex-compact 115.84 MB 118.17 MB +2.33 MB +2.0%
hits_082.vortex 1.0 vortex-compact 105.64 MB 107.77 MB +2.12 MB +2.0%
hits_061.vortex 1.0 vortex-compact 123.42 MB 125.90 MB +2.48 MB +2.0%
hits_049.vortex 1.0 vortex-compact 139.39 MB 142.19 MB +2.79 MB +2.0%
hits_056.vortex 1.0 vortex-compact 100.72 MB 102.73 MB +2.01 MB +2.0%
hits_028.vortex 1.0 vortex-compact 115.19 MB 117.47 MB +2.28 MB +2.0%
hits_010.vortex 1.0 vortex-file-compressed 168.91 MB 172.21 MB +3.30 MB +2.0%
hits_016.vortex 1.0 vortex-compact 127.31 MB 129.80 MB +2.49 MB +2.0%
hits_008.vortex 1.0 vortex-compact 105.70 MB 107.76 MB +2.06 MB +1.9%
hits_070.vortex 1.0 vortex-file-compressed 199.61 MB 203.45 MB +3.85 MB +1.9%
hits_040.vortex 1.0 vortex-compact 109.98 MB 112.10 MB +2.12 MB +1.9%
hits_017.vortex 1.0 vortex-compact 111.72 MB 113.87 MB +2.15 MB +1.9%
hits_084.vortex 1.0 vortex-compact 110.56 MB 112.68 MB +2.12 MB +1.9%
hits_065.vortex 1.0 vortex-compact 123.95 MB 126.33 MB +2.38 MB +1.9%
hits_071.vortex 1.0 vortex-compact 105.57 MB 107.59 MB +2.02 MB +1.9%
hits_014.vortex 1.0 vortex-compact 133.73 MB 136.28 MB +2.55 MB +1.9%
hits_091.vortex 1.0 vortex-compact 111.92 MB 114.05 MB +2.13 MB +1.9%
hits_054.vortex 1.0 vortex-compact 111.64 MB 113.76 MB +2.12 MB +1.9%
hits_063.vortex 1.0 vortex-compact 98.15 MB 100.01 MB +1.85 MB +1.9%
hits_042.vortex 1.0 vortex-file-compressed 201.28 MB 205.07 MB +3.80 MB +1.9%
hits_037.vortex 1.0 vortex-compact 132.18 MB 134.67 MB +2.49 MB +1.9%
hits_067.vortex 1.0 vortex-compact 99.30 MB 101.17 MB +1.87 MB +1.9%
hits_039.vortex 1.0 vortex-compact 123.81 MB 126.13 MB +2.32 MB +1.9%
hits_036.vortex 1.0 vortex-compact 133.23 MB 135.71 MB +2.48 MB +1.9%
hits_003.vortex 1.0 vortex-compact 104.58 MB 106.51 MB +1.93 MB +1.8%
hits_093.vortex 1.0 vortex-compact 98.92 MB 100.74 MB +1.82 MB +1.8%
hits_095.vortex 1.0 vortex-compact 110.63 MB 112.66 MB +2.03 MB +1.8%
hits_015.vortex 1.0 vortex-compact 97.34 MB 99.11 MB +1.78 MB +1.8%
hits_047.vortex 1.0 vortex-compact 110.46 MB 112.46 MB +2.00 MB +1.8%
hits_058.vortex 1.0 vortex-compact 111.06 MB 113.06 MB +2.00 MB +1.8%
hits_001.vortex 1.0 vortex-compact 138.76 MB 141.25 MB +2.49 MB +1.8%
hits_087.vortex 1.0 vortex-compact 125.12 MB 127.36 MB +2.24 MB +1.8%
hits_079.vortex 1.0 vortex-compact 127.92 MB 130.21 MB +2.29 MB +1.8%
hits_006.vortex 1.0 vortex-file-compressed 126.55 MB 128.81 MB +2.26 MB +1.8%
hits_027.vortex 1.0 vortex-compact 137.94 MB 140.40 MB +2.46 MB +1.8%
hits_043.vortex 1.0 vortex-file-compressed 126.68 MB 128.91 MB +2.23 MB +1.8%
hits_004.vortex 1.0 vortex-compact 97.31 MB 99.02 MB +1.71 MB +1.8%
hits_024.vortex 1.0 vortex-compact 124.60 MB 126.78 MB +2.19 MB +1.8%
hits_053.vortex 1.0 vortex-compact 138.24 MB 140.66 MB +2.42 MB +1.7%
hits_045.vortex 1.0 vortex-compact 105.71 MB 107.55 MB +1.84 MB +1.7%
hits_032.vortex 1.0 vortex-compact 110.61 MB 112.53 MB +1.92 MB +1.7%
hits_097.vortex 1.0 vortex-compact 141.03 MB 143.47 MB +2.44 MB +1.7%
hits_042.vortex 1.0 vortex-compact 136.24 MB 138.59 MB +2.35 MB +1.7%
hits_086.vortex 1.0 vortex-compact 139.68 MB 142.08 MB +2.40 MB +1.7%
hits_064.vortex 1.0 vortex-compact 138.86 MB 141.21 MB +2.35 MB +1.7%
hits_080.vortex 1.0 vortex-file-compressed 127.07 MB 129.21 MB +2.13 MB +1.7%
hits_075.vortex 1.0 vortex-compact 137.85 MB 140.16 MB +2.31 MB +1.7%
hits_007.vortex 1.0 vortex-compact 153.54 MB 156.10 MB +2.57 MB +1.7%
hits_067.vortex 1.0 vortex-file-compressed 130.72 MB 132.89 MB +2.17 MB +1.7%
hits_019.vortex 1.0 vortex-file-compressed 139.98 MB 142.30 MB +2.32 MB +1.7%
hits_051.vortex 1.0 vortex-compact 133.92 MB 136.13 MB +2.20 MB +1.6%
hits_046.vortex 1.0 vortex-file-compressed 100.77 MB 102.42 MB +1.65 MB +1.6%
hits_041.vortex 1.0 vortex-file-compressed 130.20 MB 132.34 MB +2.13 MB +1.6%
hits_006.vortex 1.0 vortex-compact 96.34 MB 97.92 MB +1.57 MB +1.6%
hits_072.vortex 1.0 vortex-file-compressed 101.86 MB 103.50 MB +1.65 MB +1.6%
hits_059.vortex 1.0 vortex-compact 152.65 MB 155.11 MB +2.46 MB +1.6%
hits_066.vortex 1.0 vortex-file-compressed 162.95 MB 165.57 MB +2.62 MB +1.6%
hits_089.vortex 1.0 vortex-file-compressed 130.58 MB 132.67 MB +2.10 MB +1.6%
hits_022.vortex 1.0 vortex-compact 153.00 MB 155.45 MB +2.45 MB +1.6%
hits_045.vortex 1.0 vortex-file-compressed 139.88 MB 142.11 MB +2.22 MB +1.6%
hits_087.vortex 1.0 vortex-file-compressed 161.53 MB 164.09 MB +2.56 MB +1.6%
hits_056.vortex 1.0 vortex-file-compressed 134.95 MB 137.06 MB +2.12 MB +1.6%
hits_038.vortex 1.0 vortex-file-compressed 189.58 MB 192.51 MB +2.93 MB +1.5%
hits_074.vortex 1.0 vortex-compact 153.00 MB 155.36 MB +2.35 MB +1.5%
hits_010.vortex 1.0 vortex-compact 123.40 MB 125.30 MB +1.90 MB +1.5%
hits_090.vortex 1.0 vortex-compact 141.29 MB 143.46 MB +2.17 MB +1.5%
hits_076.vortex 1.0 vortex-compact 124.95 MB 126.86 MB +1.91 MB +1.5%
hits_052.vortex 1.0 vortex-file-compressed 129.97 MB 131.95 MB +1.97 MB +1.5%
hits_066.vortex 1.0 vortex-compact 117.64 MB 119.42 MB +1.79 MB +1.5%
hits_078.vortex 1.0 vortex-file-compressed 130.27 MB 132.25 MB +1.97 MB +1.5%
hits_035.vortex 1.0 vortex-file-compressed 102.29 MB 103.84 MB +1.55 MB +1.5%
hits_073.vortex 1.0 vortex-compact 134.17 MB 136.20 MB +2.03 MB +1.5%
hits_000.vortex 1.0 vortex-file-compressed 130.63 MB 132.61 MB +1.98 MB +1.5%
hits_088.vortex 1.0 vortex-compact 134.09 MB 136.10 MB +2.01 MB +1.5%
hits_063.vortex 1.0 vortex-file-compressed 130.77 MB 132.73 MB +1.96 MB +1.5%
hits_082.vortex 1.0 vortex-file-compressed 139.30 MB 141.39 MB +2.09 MB +1.5%
hits_098.vortex 1.0 vortex-compact 103.82 MB 105.37 MB +1.55 MB +1.5%
hits_030.vortex 1.0 vortex-file-compressed 131.09 MB 133.04 MB +1.95 MB +1.5%
hits_044.vortex 1.0 vortex-compact 153.75 MB 156.03 MB +2.29 MB +1.5%
hits_093.vortex 1.0 vortex-file-compressed 130.90 MB 132.85 MB +1.95 MB +1.5%
hits_004.vortex 1.0 vortex-file-compressed 130.59 MB 132.53 MB +1.94 MB +1.5%
hits_029.vortex 1.0 vortex-compact 153.49 MB 155.76 MB +2.27 MB +1.5%
hits_025.vortex 1.0 vortex-compact 133.44 MB 135.40 MB +1.97 MB +1.5%
hits_065.vortex 1.0 vortex-file-compressed 161.87 MB 164.25 MB +2.38 MB +1.5%
hits_062.vortex 1.0 vortex-compact 132.57 MB 134.51 MB +1.93 MB +1.5%
hits_081.vortex 1.0 vortex-compact 153.69 MB 155.93 MB +2.23 MB +1.5%
hits_096.vortex 1.0 vortex-compact 153.21 MB 155.44 MB +2.22 MB +1.5%
hits_005.vortex 1.0 vortex-file-compressed 167.08 MB 169.50 MB +2.41 MB +1.4%
hits_085.vortex 1.0 vortex-compact 153.30 MB 155.51 MB +2.21 MB +1.4%
hits_016.vortex 1.0 vortex-file-compressed 179.65 MB 182.24 MB +2.59 MB +1.4%
hits_049.vortex 1.0 vortex-file-compressed 191.01 MB 193.74 MB +2.73 MB +1.4%
hits_026.vortex 1.0 vortex-file-compressed 130.42 MB 132.29 MB +1.86 MB +1.4%
hits_003.vortex 1.0 vortex-file-compressed 136.61 MB 138.56 MB +1.95 MB +1.4%
hits_092.vortex 1.0 vortex-compact 153.31 MB 155.48 MB +2.17 MB +1.4%
hits_002.vortex 1.0 vortex-file-compressed 161.61 MB 163.90 MB +2.29 MB +1.4%
hits_071.vortex 1.0 vortex-file-compressed 139.39 MB 141.35 MB +1.97 MB +1.4%
hits_084.vortex 1.0 vortex-file-compressed 153.95 MB 156.11 MB +2.16 MB +1.4%
hits_009.vortex 1.0 vortex-file-compressed 101.18 MB 102.60 MB +1.42 MB +1.4%
hits_033.vortex 1.0 vortex-compact 152.85 MB 154.99 MB +2.14 MB +1.4%
hits_020.vortex 1.0 vortex-file-compressed 159.92 MB 162.15 MB +2.23 MB +1.4%
hits_024.vortex 1.0 vortex-file-compressed 161.05 MB 163.29 MB +2.24 MB +1.4%
hits_053.vortex 1.0 vortex-file-compressed 189.47 MB 192.10 MB +2.64 MB +1.4%
hits_015.vortex 1.0 vortex-file-compressed 130.28 MB 132.09 MB +1.81 MB +1.4%
hits_098.vortex 1.0 vortex-file-compressed 137.74 MB 139.66 MB +1.91 MB +1.4%
hits_012.vortex 1.0 vortex-file-compressed 190.39 MB 193.03 MB +2.64 MB +1.4%
hits_091.vortex 1.0 vortex-file-compressed 147.34 MB 149.37 MB +2.03 MB +1.4%
hits_064.vortex 1.0 vortex-file-compressed 190.61 MB 193.22 MB +2.61 MB +1.4%
hits_028.vortex 1.0 vortex-file-compressed 152.14 MB 154.22 MB +2.08 MB +1.4%
hits_077.vortex 1.0 vortex-compact 134.41 MB 136.24 MB +1.84 MB +1.4%
hits_068.vortex 1.0 vortex-file-compressed 160.26 MB 162.45 MB +2.19 MB +1.4%
hits_047.vortex 1.0 vortex-file-compressed 153.83 MB 155.91 MB +2.08 MB +1.4%
hits_057.vortex 1.0 vortex-file-compressed 159.74 MB 161.90 MB +2.16 MB +1.4%
hits_001.vortex 1.0 vortex-file-compressed 188.75 MB 191.30 MB +2.55 MB +1.4%
hits_086.vortex 1.0 vortex-file-compressed 191.77 MB 194.35 MB +2.58 MB +1.3%
hits_018.vortex 1.0 vortex-compact 153.76 MB 155.83 MB +2.06 MB +1.3%
hits_017.vortex 1.0 vortex-file-compressed 147.19 MB 149.16 MB +1.97 MB +1.3%
hits_013.vortex 1.0 vortex-file-compressed 161.75 MB 163.91 MB +2.16 MB +1.3%
hits_055.vortex 1.0 vortex-compact 153.37 MB 155.41 MB +2.04 MB +1.3%
hits_075.vortex 1.0 vortex-file-compressed 189.10 MB 191.61 MB +2.51 MB +1.3%
hits_078.vortex 1.0 vortex-compact 98.00 MB 99.30 MB +1.30 MB +1.3%
hits_027.vortex 1.0 vortex-file-compressed 189.55 MB 192.06 MB +2.51 MB +1.3%
hits_060.vortex 1.0 vortex-file-compressed 192.73 MB 195.28 MB +2.55 MB +1.3%
hits_011.vortex 1.0 vortex-compact 152.97 MB 154.98 MB +2.01 MB +1.3%
hits_060.vortex 1.0 vortex-compact 140.92 MB 142.77 MB +1.85 MB +1.3%
hits_054.vortex 1.0 vortex-file-compressed 147.27 MB 149.21 MB +1.93 MB +1.3%
hits_023.vortex 1.0 vortex-compact 142.50 MB 144.37 MB +1.86 MB +1.3%
hits_039.vortex 1.0 vortex-file-compressed 161.76 MB 163.87 MB +2.11 MB +1.3%
hits_023.vortex 1.0 vortex-file-compressed 194.82 MB 197.34 MB +2.53 MB +1.3%
hits_037.vortex 1.0 vortex-file-compressed 178.08 MB 180.38 MB +2.31 MB +1.3%
hits_076.vortex 1.0 vortex-file-compressed 161.66 MB 163.75 MB +2.09 MB +1.3%
hits_096.vortex 1.0 vortex-file-compressed 200.22 MB 202.80 MB +2.58 MB +1.3%
hits_069.vortex 1.0 vortex-file-compressed 143.07 MB 144.90 MB +1.84 MB +1.3%
hits_083.vortex 1.0 vortex-file-compressed 156.32 MB 158.32 MB +2.01 MB +1.3%
hits_061.vortex 1.0 vortex-file-compressed 161.58 MB 163.64 MB +2.06 MB +1.3%
hits_058.vortex 1.0 vortex-file-compressed 154.49 MB 156.44 MB +1.95 MB +1.3%
hits_090.vortex 1.0 vortex-file-compressed 192.35 MB 194.77 MB +2.42 MB +1.3%
hits_050.vortex 1.0 vortex-file-compressed 161.68 MB 163.68 MB +2.00 MB +1.2%
hits_059.vortex 1.0 vortex-file-compressed 200.09 MB 202.56 MB +2.47 MB +1.2%
hits_011.vortex 1.0 vortex-file-compressed 200.06 MB 202.53 MB +2.47 MB +1.2%
hits_034.vortex 1.0 vortex-file-compressed 182.01 MB 184.25 MB +2.23 MB +1.2%
hits_095.vortex 1.0 vortex-file-compressed 153.90 MB 155.78 MB +1.89 MB +1.2%
hits_079.vortex 1.0 vortex-file-compressed 181.01 MB 183.23 MB +2.22 MB +1.2%
hits_032.vortex 1.0 vortex-file-compressed 154.15 MB 156.02 MB +1.87 MB +1.2%
hits_034.vortex 1.0 vortex-compact 133.15 MB 134.76 MB +1.61 MB +1.2%
hits_029.vortex 1.0 vortex-file-compressed 200.96 MB 203.38 MB +2.42 MB +1.2%
hits_077.vortex 1.0 vortex-file-compressed 172.91 MB 174.96 MB +2.05 MB +1.2%
hits_070.vortex 1.0 vortex-compact 153.49 MB 155.31 MB +1.82 MB +1.2%
hits_094.vortex 1.0 vortex-file-compressed 158.73 MB 160.59 MB +1.86 MB +1.2%
hits_051.vortex 1.0 vortex-file-compressed 172.87 MB 174.89 MB +2.02 MB +1.2%
hits_088.vortex 1.0 vortex-file-compressed 172.65 MB 174.66 MB +2.01 MB +1.2%
hits_048.vortex 1.0 vortex-file-compressed 200.55 MB 202.88 MB +2.33 MB +1.2%
hits_022.vortex 1.0 vortex-file-compressed 200.26 MB 202.59 MB +2.32 MB +1.2%
hits_085.vortex 1.0 vortex-file-compressed 200.84 MB 203.17 MB +2.33 MB +1.2%
hits_073.vortex 1.0 vortex-file-compressed 173.05 MB 175.04 MB +1.99 MB +1.2%
hits_018.vortex 1.0 vortex-file-compressed 200.79 MB 203.09 MB +2.30 MB +1.1%
hits_062.vortex 1.0 vortex-file-compressed 171.23 MB 173.17 MB +1.94 MB +1.1%
hits_025.vortex 1.0 vortex-file-compressed 172.39 MB 174.33 MB +1.95 MB +1.1%
hits_021.vortex 1.0 vortex-file-compressed 154.03 MB 155.77 MB +1.74 MB +1.1%
hits_081.vortex 1.0 vortex-file-compressed 201.11 MB 203.37 MB +2.26 MB +1.1%
hits_099.vortex 1.0 vortex-file-compressed 171.77 MB 173.70 MB +1.92 MB +1.1%
hits_030.vortex 1.0 vortex-compact 98.70 MB 99.80 MB +1.10 MB +1.1%
hits_074.vortex 1.0 vortex-file-compressed 200.24 MB 202.47 MB +2.23 MB +1.1%
hits_097.vortex 1.0 vortex-file-compressed 193.03 MB 195.18 MB +2.14 MB +1.1%
hits_033.vortex 1.0 vortex-file-compressed 201.09 MB 203.28 MB +2.18 MB +1.1%
hits_048.vortex 1.0 vortex-compact 153.30 MB 154.96 MB +1.65 MB +1.1%
hits_014.vortex 1.0 vortex-file-compressed 172.71 MB 174.57 MB +1.86 MB +1.1%
hits_092.vortex 1.0 vortex-file-compressed 199.30 MB 201.40 MB +2.10 MB +1.1%
hits_038.vortex 1.0 vortex-compact 139.28 MB 140.73 MB +1.45 MB +1.0%
hits_031.vortex 1.0 vortex-file-compressed 159.66 MB 161.27 MB +1.61 MB +1.0%
hits_040.vortex 1.0 vortex-file-compressed 144.56 MB 145.93 MB +1.36 MB +0.9%
hits_002.vortex 1.0 vortex-compact 124.90 MB 126.02 MB +1.12 MB +0.9%
hits_008.vortex 1.0 vortex-file-compressed 140.30 MB 141.48 MB +1.18 MB +0.8%
hits_013.vortex 1.0 vortex-compact 125.26 MB 126.31 MB +1.05 MB +0.8%
hits_036.vortex 1.0 vortex-file-compressed 172.53 MB 173.94 MB +1.41 MB +0.8%
hits_050.vortex 1.0 vortex-compact 125.04 MB 125.83 MB +810.98 KB +0.6%
hits_007.vortex 1.0 vortex-file-compressed 201.32 MB 202.11 MB +808.24 KB +0.4%
hits_055.vortex 1.0 vortex-file-compressed 200.71 MB 201.46 MB +769.46 KB +0.4%
hits_044.vortex 1.0 vortex-file-compressed 201.40 MB 201.76 MB +364.69 KB +0.2%

Totals:

  • vortex-compact: 11.91 GB → 12.12 GB (+1.8%)
  • vortex-file-compressed: 15.96 GB → 16.17 GB (+1.3%)

@codspeed-hq

codspeed-hq Bot commented Sep 11, 2026

Copy link
Copy Markdown

Merging this PR will improve performance by 16.78%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
✅ 2238 untouched benchmarks
⏩ 176 skipped benchmarks1
🗄️ 1 archived benchmark run2

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ WallTime deferred_i64_avx512[PerRowPerRow] 11.6 µs 9.9 µs +16.78%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.

Comparing claude/direct-io-reads-perf-3b5kk2 (0a5e328) with develop (2dffb68)

Open in CodSpeed

Footnotes

  1. 176 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. 1 benchmark was run, but is now archived. If it was deleted in another branch, consider rebasing to remove it from the report. Instead if it was added back, click here to restore it. ↩

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +24.1%
Engines: DataFusion No clear signal (+30.3%, environment too noisy confidence) · DuckDB No clear signal (+18.3%, environment too noisy confidence)
Vortex (geomean): hot 1.074x ➖ · cold 1.010x ➖
Parquet (geomean): hot 0.865x ➖ · cold 0.881x ➖
Shifts: Parquet (control) -13.5% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.213x ➖, 0↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 56564557 / 38914313 / +45.4% 🔴 109863054 / 152403481 / -27.9% 0.51 / 0.26 / +101.6%
fineweb_q01/datafusion:vortex-file-compressed 549545350 / 459094487 / +19.7% 867325510 / 798450003 / +8.6% 0.63 / 0.57 / +10.2%
fineweb_q02/datafusion:vortex-file-compressed 389386147 / 426358332 / -8.7% 569916741 / 703905879 / -19.0% 0.68 / 0.61 / +12.8%
fineweb_q03/datafusion:vortex-file-compressed 493305511 / 589472863 / -16.3% 738239051 / 1114579491 / -33.8% 🟢 0.67 / 0.53 / +26.3%
fineweb_q04/datafusion:vortex-file-compressed 630636448 / 440066464 / +43.3% 🔴 597907093 / 485247749 / +23.2% 1.05 / 0.91 / +16.3%
fineweb_q05/datafusion:vortex-file-compressed 785660684 / 422920108 / +85.8% 🔴 1207090324 / 571255162 / +111.3% 🔴 0.65 / 0.74 / -12.1%
fineweb_q06/datafusion:vortex-file-compressed 1059383996 / 782061036 / +35.5% 🔴 1396380090 / 703963456 / +98.4% 🔴 0.76 / 1.11 / -31.7%
fineweb_q07/datafusion:vortex-file-compressed 517935952 / 441507766 / +17.3% 528287750 / 450552343 / +17.3% 0.98 / 0.98 / +0.0%
fineweb_q08/datafusion:vortex-file-compressed 176138080 / 174052698 / +1.2% 213334999 / 173185809 / +23.2% 0.83 / 1.01 / -17.8%
datafusion / vortex-compact / ns (1.021x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 54609984 / 64592282 / -15.5% 129402219 / 125592844 / +3.0% 0.42 / 0.51 / -17.9%
fineweb_q01/datafusion:vortex-compact 402867789 / 408861030 / -1.5% 679215892 / 1247744211 / -45.6% 🟢 0.59 / 0.33 / +81.0%
fineweb_q02/datafusion:vortex-compact 359846404 / 391183342 / -8.0% 486733996 / 514267035 / -5.4% 0.74 / 0.76 / -2.8%
fineweb_q03/datafusion:vortex-compact 540689768 / 578706144 / -6.6% 673158592 / 1864891277 / -63.9% 🟢 0.80 / 0.31 / +158.8%
fineweb_q04/datafusion:vortex-compact 548247536 / 775467346 / -29.3% 662312422 / 626195360 / +5.8% 0.83 / 1.24 / -33.2%
fineweb_q05/datafusion:vortex-compact 561478365 / 456737370 / +22.9% 616857153 / 530722941 / +16.2% 0.91 / 0.86 / +5.8%
fineweb_q06/datafusion:vortex-compact 615375847 / 687740232 / -10.5% 757123190 / 652057471 / +16.1% 0.81 / 1.05 / -22.9%
fineweb_q07/datafusion:vortex-compact 509239975 / 516078708 / -1.3% 445954179 / 505619308 / -11.8% 1.14 / 1.02 / +11.9%
fineweb_q08/datafusion:vortex-compact 416603920 / 189262741 / +120.1% 🔴 254234631 / 358294202 / -29.0% 1.64 / 0.53 / +210.2%
datafusion / parquet / ns (0.854x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 428625262 / 529981865 / -19.1% 783578413 / 817110277 / -4.1% 0.55 / 0.65 / -15.7%
fineweb_q01/datafusion:parquet 720726351 / 913711911 / -21.1% 627203150 / 982843522 / -36.2% 🟢 1.15 / 0.93 / +23.6%
fineweb_q02/datafusion:parquet 737798996 / 728136556 / +1.3% 709418040 / 676084464 / +4.9% 1.04 / 1.08 / -3.4%
fineweb_q03/datafusion:parquet 715507196 / 696965431 / +2.7% 611610754 / 769078982 / -20.5% 1.17 / 0.91 / +29.1%
fineweb_q04/datafusion:parquet 772653058 / 871757850 / -11.4% 881102386 / 977175943 / -9.8% 0.88 / 0.89 / -1.7%
fineweb_q05/datafusion:parquet 734033915 / 801929898 / -8.5% 950133721 / 1080908085 / -12.1% 0.77 / 0.74 / +4.1%
fineweb_q06/datafusion:parquet 702076844 / 908834815 / -22.7% 718584860 / 925763581 / -22.4% 0.98 / 0.98 / -0.5%
fineweb_q07/datafusion:parquet 801172967 / 782261684 / +2.4% 859850130 / 720282244 / +19.4% 0.93 / 1.09 / -14.2%
fineweb_q08/datafusion:parquet 752198518 / 1320745330 / -43.0% 🟢 628015318 / 1136774029 / -44.8% 🟢 1.20 / 1.16 / +3.1%
duckdb / vortex-file-compressed / ns (1.049x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 67736782 / 66944936 / +1.2% 70285512 / 49895204 / +40.9% 🔴 0.96 / 1.34 / -28.2%
fineweb_q01/duckdb:vortex-file-compressed 512871604 / 541803921 / -5.3% 709784002 / 510048743 / +39.2% 🔴 0.72 / 1.06 / -32.0%
fineweb_q02/duckdb:vortex-file-compressed 909905242 / 581749338 / +56.4% 🔴 786443835 / 603252039 / +30.4% 🔴 1.16 / 0.96 / +20.0%
fineweb_q03/duckdb:vortex-file-compressed 1004720812 / 1011700680 / -0.7% 1050786560 / 1277659540 / -17.8% 0.96 / 0.79 / +20.8%
fineweb_q04/duckdb:vortex-file-compressed 1042926372 / 1009015396 / +3.4% 994196311 / 1049413497 / -5.3% 1.05 / 0.96 / +9.1%
fineweb_q05/duckdb:vortex-file-compressed 910499524 / 966120876 / -5.8% 1062011703 / 1051437764 / +1.0% 0.86 / 0.92 / -6.7%
fineweb_q06/duckdb:vortex-file-compressed 1408080686 / 1224723750 / +15.0% 1379287241 / 1319876834 / +4.5% 1.02 / 0.93 / +10.0%
fineweb_q07/duckdb:vortex-file-compressed 987903372 / 960234368 / +2.9% 1087601513 / 1073092903 / +1.4% 0.91 / 0.89 / +1.5%
fineweb_q08/duckdb:vortex-file-compressed 411416988 / 458647687 / -10.3% 504207787 / 488998339 / +3.1% 0.82 / 0.94 / -13.0%
duckdb / vortex-compact / ns (1.024x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 73594806 / 67765461 / +8.6% 103595315 / 70797508 / +46.3% 🔴 0.71 / 0.96 / -25.8%
fineweb_q01/duckdb:vortex-compact 380403609 / 454471877 / -16.3% 445888582 / 564164885 / -21.0% 0.85 / 0.81 / +5.9%
fineweb_q02/duckdb:vortex-compact 682984936 / 592117845 / +15.3% 610733614 / 607379218 / +0.6% 1.12 / 0.97 / +14.7%
fineweb_q03/duckdb:vortex-compact 1073690397 / 1172211820 / -8.4% 1173804446 / 1344717891 / -12.7% 0.91 / 0.87 / +4.9%
fineweb_q04/duckdb:vortex-compact 1174131266 / 1103208730 / +6.4% 1391371699 / 967765736 / +43.8% 🔴 0.84 / 1.14 / -26.0%
fineweb_q05/duckdb:vortex-compact 1020936104 / 918497998 / +11.2% 1153791483 / 1259957351 / -8.4% 0.88 / 0.73 / +21.4%
fineweb_q06/duckdb:vortex-compact 1306622152 / 1071944462 / +21.9% 1348213292 / 1125878564 / +19.7% 0.97 / 0.95 / +1.8%
fineweb_q07/duckdb:vortex-compact 916854090 / 946040122 / -3.1% 962674210 / 984192378 / -2.2% 0.95 / 0.96 / -0.9%
fineweb_q08/duckdb:vortex-compact 368303708 / 398824289 / -7.7% 418919546 / 549022030 / -23.7% 0.88 / 0.73 / +21.0%
duckdb / parquet / ns (0.876x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 462753538 / 576099376 / -19.7% 559216122 / 608468113 / -8.1% 0.83 / 0.95 / -12.6%
fineweb_q01/duckdb:parquet 648240541 / 750902218 / -13.7% 615183324 / 556962300 / +10.5% 1.05 / 1.35 / -21.8%
fineweb_q02/duckdb:parquet 652460776 / 800351004 / -18.5% 800902385 / 808663761 / -1.0% 0.81 / 0.99 / -17.7%
fineweb_q03/duckdb:parquet 1447510052 / 1796044053 / -19.4% 1637035367 / 2736761639 / -40.2% 🟢 0.88 / 0.66 / +34.7%
fineweb_q04/duckdb:parquet 801391754 / 906622280 / -11.6% 758704650 / 838284831 / -9.5% 1.06 / 1.08 / -2.3%
fineweb_q05/duckdb:parquet 849849559 / 1044954971 / -18.7% 863790573 / 965805490 / -10.6% 0.98 / 1.08 / -9.1%
fineweb_q06/duckdb:parquet 1773181558 / 1895843542 / -6.5% 1706058451 / 1903220002 / -10.4% 1.04 / 1.00 / +4.3%
fineweb_q07/duckdb:parquet 1110261364 / 1297573868 / -14.4% 1243042416 / 1318274423 / -5.7% 0.89 / 0.98 / -9.3%
fineweb_q08/duckdb:parquet 611732302 / 525283968 / +16.5% 689318673 / 576259175 / +19.6% 0.89 / 0.91 / -2.6%

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.998x ➖ · cold 0.966x ➖
Parquet (geomean): hot 0.994x ➖ · cold 0.995x ➖
Shifts: Parquet (control) -0.6% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
duckdb / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9065034 / 9012477 / +0.6% 9512725 / 9549241 / -0.4% 0.95 / 0.94 / +1.0%
statpopgen_q01/duckdb:vortex-file-compressed 10325958 / 10464460 / -1.3% 12552582 / 14184123 / -11.5% 🟢 0.82 / 0.74 / +11.5%
statpopgen_q02/duckdb:vortex-file-compressed 300166064 / 302343554 / -0.7% 323106957 / 324605630 / -0.5% 0.93 / 0.93 / -0.3%
statpopgen_q03/duckdb:vortex-file-compressed 815057553 / 803926859 / +1.4% 822290333 / 811488352 / +1.3% 0.99 / 0.99 / +0.1%
statpopgen_q04/duckdb:vortex-file-compressed 817798438 / 815771302 / +0.2% 829355974 / 822327907 / +0.9% 0.99 / 0.99 / -0.6%
statpopgen_q05/duckdb:vortex-file-compressed 318032710 / 316331324 / +0.5% 329782484 / 353941531 / -6.8% 0.96 / 0.89 / +7.9%
statpopgen_q06/duckdb:vortex-file-compressed 1130499700 / 1140266942 / -0.9% 1149827769 / 1138324130 / +1.0% 0.98 / 1.00 / -1.8%
statpopgen_q07/duckdb:vortex-file-compressed 128910753 / 130443968 / -1.2% 139614640 / 149497675 / -6.6% 0.92 / 0.87 / +5.8%
statpopgen_q08/duckdb:vortex-file-compressed 142088496 / 145748242 / -2.5% 163928960 / 207781627 / -21.1% 🟢 0.87 / 0.70 / +23.6%
statpopgen_q09/duckdb:vortex-file-compressed 608576666 / 610605088 / -0.3% 624953500 / 621901233 / +0.5% 0.97 / 0.98 / -0.8%
statpopgen_q10/duckdb:vortex-file-compressed 1917201796 / 1927296567 / -0.5% 1905156234 / 1906473108 / -0.1% 1.01 / 1.01 / -0.5%
duckdb / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 8979294 / 9044018 / -0.7% 9383080 / 9554749 / -1.8% 0.96 / 0.95 / +1.1%
statpopgen_q01/duckdb:vortex-compact 10260968 / 10281126 / -0.2% 12545584 / 14279111 / -12.1% 🟢 0.82 / 0.72 / +13.6%
statpopgen_q02/duckdb:vortex-compact 389762038 / 392708380 / -0.8% 402906773 / 413893853 / -2.7% 0.97 / 0.95 / +2.0%
statpopgen_q03/duckdb:vortex-compact 911402373 / 907105456 / +0.5% 912259097 / 922198363 / -1.1% 1.00 / 0.98 / +1.6%
statpopgen_q04/duckdb:vortex-compact 907409846 / 905945164 / +0.2% 912789902 / 926695322 / -1.5% 0.99 / 0.98 / +1.7%
statpopgen_q05/duckdb:vortex-compact 437434062 / 436246416 / +0.3% 445394953 / 448255842 / -0.6% 0.98 / 0.97 / +0.9%
statpopgen_q06/duckdb:vortex-compact 1182157288 / 1180092459 / +0.2% 1175149034 / 1184310323 / -0.8% 1.01 / 1.00 / +1.0%
statpopgen_q07/duckdb:vortex-compact 331877289 / 331522118 / +0.1% 336356483 / 350757352 / -4.1% 0.99 / 0.95 / +4.4%
statpopgen_q08/duckdb:vortex-compact 354264169 / 351585740 / +0.8% 359031025 / 371316185 / -3.3% 0.99 / 0.95 / +4.2%
statpopgen_q09/duckdb:vortex-compact 719382008 / 721881442 / -0.3% 731406223 / 728312776 / +0.4% 0.98 / 0.99 / -0.8%
statpopgen_q10/duckdb:vortex-compact 2029568648 / 2039931518 / -0.5% 1984403351 / 2014521364 / -1.5% 1.02 / 1.01 / +1.0%
duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 248530766 / 247147169 / +0.6% 247487177 / 247774976 / -0.1% 1.00 / 1.00 / +0.7%
statpopgen_q01/duckdb:parquet 305176608 / 305886086 / -0.2% 307219757 / 307534833 / -0.1% 0.99 / 0.99 / -0.1%
statpopgen_q02/duckdb:parquet 582612080 / 562821850 / +3.5% 587239740 / 587763925 / -0.1% 0.99 / 0.96 / +3.6%
statpopgen_q03/duckdb:parquet 832010067 / 867536667 / -4.1% 857684178 / 850826871 / +0.8% 0.97 / 1.02 / -4.9%
statpopgen_q04/duckdb:parquet 869072272 / 896348225 / -3.0% 857709857 / 883953996 / -3.0% 1.01 / 1.01 / -0.1%
statpopgen_q05/duckdb:parquet 566503491 / 565923325 / +0.1% 587890641 / 556930036 / +5.6% 0.96 / 1.02 / -5.2%
statpopgen_q06/duckdb:parquet 706006085 / 723393928 / -2.4% 718528291 / 762538601 / -5.8% 0.98 / 0.95 / +3.6%
statpopgen_q07/duckdb:parquet 618574263 / 617188774 / +0.2% 689232040 / 712014640 / -3.2% 0.90 / 0.87 / +3.5%
statpopgen_q08/duckdb:parquet 625283464 / 620562042 / +0.8% 712193680 / 715393665 / -0.4% 0.88 / 0.87 / +1.2%
statpopgen_q09/duckdb:parquet 780526870 / 785833538 / -0.7% 814534350 / 811310746 / +0.4% 0.96 / 0.97 / -1.1%
statpopgen_q10/duckdb:parquet 1438316382 / 1462335237 / -1.6% 1319119531 / 1313137120 / +0.5% 1.09 / 1.11 / -2.1%
File Size Changes (2 files changed, +0.7% overall, 2↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-compact 960.58 MB 969.54 MB +8.96 MB +0.9%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.80 GB 1.81 GB +9.49 MB +0.5%

Totals:

  • vortex-compact: 960.84 MB → 969.80 MB (+0.9%)
  • vortex-file-compressed: 1.80 GB → 1.81 GB (+0.5%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +5.5%
Engines: DataFusion No clear signal (+2.0%, low confidence) · DuckDB No clear signal (+9.1%, low confidence)
Vortex (geomean): hot 1.044x ➖ · cold 0.940x ➖
Parquet (geomean): hot 0.990x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1263923 / 1205786 / +4.8% 21480085 / 20883544 / +2.9% 0.06 / 0.06 / +1.9%
clickbench_q01/datafusion:vortex-file-compressed 5788118 / 5842518 / -0.9% 33755016 / 34356884 / -1.8% 0.17 / 0.17 / +0.8%
clickbench_q02/datafusion:vortex-file-compressed 10585598 / 10057895 / +5.2% 37909172 / 40500980 / -6.4% 0.28 / 0.25 / +12.4%
clickbench_q03/datafusion:vortex-file-compressed 11751955 / 12277718 / -4.3% 54837484 / 54367362 / +0.9% 0.21 / 0.23 / -5.1%
clickbench_q04/datafusion:vortex-file-compressed 57317549 / 54914094 / +4.4% 92865994 / 91520904 / +1.5% 0.62 / 0.60 / +2.9%
clickbench_q05/datafusion:vortex-file-compressed 75977064 / 74070010 / +2.6% 117345505 / 114776753 / +2.2% 0.65 / 0.65 / +0.3%
clickbench_q06/datafusion:vortex-file-compressed 1246130 / 1240946 / +0.4% 20914488 / 21268139 / -1.7% 0.06 / 0.06 / +2.1%
clickbench_q07/datafusion:vortex-file-compressed 9784768 / 9872777 / -0.9% 33615975 / 34058418 / -1.3% 0.29 / 0.29 / +0.4%
clickbench_q08/datafusion:vortex-file-compressed 74446262 / 77042766 / -3.4% 112907318 / 118714513 / -4.9% 0.66 / 0.65 / +1.6%
clickbench_q09/datafusion:vortex-file-compressed 171289722 / 170639886 / +0.4% 205967881 / 211844607 / -2.8% 0.83 / 0.81 / +3.2%
clickbench_q10/datafusion:vortex-file-compressed 23699334 / 23658820 / +0.2% 67357842 / 70229666 / -4.1% 0.35 / 0.34 / +4.4%
clickbench_q11/datafusion:vortex-file-compressed 26691158 / 27240367 / -2.0% 69112770 / 71503062 / -3.3% 0.39 / 0.38 / +1.4%
clickbench_q12/datafusion:vortex-file-compressed 72823668 / 71100051 / +2.4% 119817592 / 117298486 / +2.1% 0.61 / 0.61 / +0.3%
clickbench_q13/datafusion:vortex-file-compressed 121798696 / 116959460 / +4.1% 173816849 / 177942492 / -2.3% 0.70 / 0.66 / +6.6%
clickbench_q14/datafusion:vortex-file-compressed 73661931 / 76078914 / -3.2% 116455998 / 121993543 / -4.5% 0.63 / 0.62 / +1.4%
clickbench_q15/datafusion:vortex-file-compressed 60080421 / 61979438 / -3.1% 95445781 / 97068748 / -1.7% 0.63 / 0.64 / -1.4%
clickbench_q16/datafusion:vortex-file-compressed 149043742 / 148601215 / +0.3% 195620455 / 207003213 / -5.5% 0.76 / 0.72 / +6.1%
clickbench_q17/datafusion:vortex-file-compressed 146259347 / 149744412 / -2.3% 210313793 / 212164108 / -0.9% 0.70 / 0.71 / -1.5%
clickbench_q18/datafusion:vortex-file-compressed 295391370 / 295804232 / -0.1% 352331621 / 377704273 / -6.7% 0.84 / 0.78 / +7.1%
clickbench_q19/datafusion:vortex-file-compressed 7908962 / 7857701 / +0.7% 46102477 / 49499902 / -6.9% 0.17 / 0.16 / +8.1%
clickbench_q20/datafusion:vortex-file-compressed 62258870 / 61684815 / +0.9% 225804464 / 229367445 / -1.6% 0.28 / 0.27 / +2.5%
clickbench_q21/datafusion:vortex-file-compressed 91672099 / 88146335 / +4.0% 265235262 / 270901992 / -2.1% 0.35 / 0.33 / +6.2%
clickbench_q22/datafusion:vortex-file-compressed 104116206 / 102205630 / +1.9% 346604904 / 347277514 / -0.2% 0.30 / 0.29 / +2.1%
clickbench_q23/datafusion:vortex-file-compressed 207452955 / 211021468 / -1.7% 529267758 / 508084248 / +4.2% 0.39 / 0.42 / -5.6%
clickbench_q24/datafusion:vortex-file-compressed 16130614 / 16067936 / +0.4% 65231547 / 67527760 / -3.4% 0.25 / 0.24 / +3.9%
clickbench_q25/datafusion:vortex-file-compressed 17780734 / 17528214 / +1.4% 57989505 / 56856538 / +2.0% 0.31 / 0.31 / -0.5%
clickbench_q26/datafusion:vortex-file-compressed 16751337 / 17279652 / -3.1% 69479002 / 65693393 / +5.8% 0.24 / 0.26 / -8.3%
clickbench_q27/datafusion:vortex-file-compressed 98742254 / 96990851 / +1.8% 241302508 / 242840828 / -0.6% 0.41 / 0.40 / +2.5%
clickbench_q28/datafusion:vortex-file-compressed 566752697 / 571705001 / -0.9% 623717162 / 613310872 / +1.7% 0.91 / 0.93 / -2.5%
clickbench_q29/datafusion:vortex-file-compressed 22563088 / 22510956 / +0.2% 53109311 / 50397494 / +5.4% 0.42 / 0.45 / -4.9%
clickbench_q30/datafusion:vortex-file-compressed 60166118 / 63168538 / -4.8% 106906811 / 105416564 / +1.4% 0.56 / 0.60 / -6.1%
clickbench_q31/datafusion:vortex-file-compressed 72408829 / 71259405 / +1.6% 153501265 / 154984479 / -1.0% 0.47 / 0.46 / +2.6%
clickbench_q32/datafusion:vortex-file-compressed 299585334 / 307167956 / -2.5% 375781229 / 383713194 / -2.1% 0.80 / 0.80 / -0.4%
clickbench_q33/datafusion:vortex-file-compressed 329891757 / 325330120 / +1.4% 410325161 / 429637869 / -4.5% 0.80 / 0.76 / +6.2%
clickbench_q34/datafusion:vortex-file-compressed 328134894 / 329050201 / -0.3% 416594831 / 434299372 / -4.1% 0.79 / 0.76 / +4.0%
clickbench_q35/datafusion:vortex-file-compressed 57098120 / 55751219 / +2.4% 87018414 / 91573128 / -5.0% 0.66 / 0.61 / +7.8%
clickbench_q36/datafusion:vortex-file-compressed 37121192 / 37537554 / -1.1% 65404435 / 68735827 / -4.8% 0.57 / 0.55 / +3.9%
clickbench_q37/datafusion:vortex-file-compressed 21786044 / 21707569 / +0.4% 48780040 / 48522739 / +0.5% 0.45 / 0.45 / -0.2%
clickbench_q38/datafusion:vortex-file-compressed 11722126 / 11842752 / -1.0% 38637747 / 40462250 / -4.5% 0.30 / 0.29 / +3.7%
clickbench_q39/datafusion:vortex-file-compressed 77982418 / 77970286 / +0.0% 110176068 / 111893693 / -1.5% 0.71 / 0.70 / +1.6%
clickbench_q40/datafusion:vortex-file-compressed 11129774 / 10870766 / +2.4% 36657358 / 39525926 / -7.3% 0.30 / 0.28 / +10.4%
clickbench_q41/datafusion:vortex-file-compressed 10679314 / 10968894 / -2.6% 37810129 / 38911125 / -2.8% 0.28 / 0.28 / +0.2%
clickbench_q42/datafusion:vortex-file-compressed 11137799 / 11090516 / +0.4% 35931272 / 36463167 / -1.5% 0.31 / 0.30 / +1.9%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1231656 / 1218520 / +1.1% 20693234 / 20514158 / +0.9% 0.06 / 0.06 / +0.2%
clickbench_q01/datafusion:vortex-compact 7258635 / 7165106 / +1.3% 34439566 / 33721537 / +2.1% 0.21 / 0.21 / -0.8%
clickbench_q02/datafusion:vortex-compact 19785886 / 20331238 / -2.7% 43576681 / 46167168 / -5.6% 0.45 / 0.44 / +3.1%
clickbench_q03/datafusion:vortex-compact 13465998 / 13749716 / -2.1% 40304699 / 40006177 / +0.7% 0.33 / 0.34 / -2.8%
clickbench_q04/datafusion:vortex-compact 55527215 / 58271328 / -4.7% 89595668 / 90474686 / -1.0% 0.62 / 0.64 / -3.8%
clickbench_q05/datafusion:vortex-compact 87102782 / 88179400 / -1.2% 117843326 / 120380879 / -2.1% 0.74 / 0.73 / +0.9%
clickbench_q06/datafusion:vortex-compact 1244977 / 1243699 / +0.1% 20404053 / 20308876 / +0.5% 0.06 / 0.06 / -0.4%
clickbench_q07/datafusion:vortex-compact 12370651 / 12345266 / +0.2% 34269486 / 35047069 / -2.2% 0.36 / 0.35 / +2.5%
clickbench_q08/datafusion:vortex-compact 85187867 / 86809626 / -1.9% 117987222 / 115175431 / +2.4% 0.72 / 0.75 / -4.2%
clickbench_q09/datafusion:vortex-compact 190791024 / 189147963 / +0.9% 219749017 / 219031848 / +0.3% 0.87 / 0.86 / +0.5%
clickbench_q10/datafusion:vortex-compact 44446058 / 43740248 / +1.6% 71651241 / 70755791 / +1.3% 0.62 / 0.62 / +0.3%
clickbench_q11/datafusion:vortex-compact 55527513 / 55451336 / +0.1% 82304115 / 81688167 / +0.8% 0.67 / 0.68 / -0.6%
clickbench_q12/datafusion:vortex-compact 86829614 / 84591020 / +2.6% 126241042 / 125685309 / +0.4% 0.69 / 0.67 / +2.2%
clickbench_q13/datafusion:vortex-compact 137356820 / 137679052 / -0.2% 182588239 / 185515865 / -1.6% 0.75 / 0.74 / +1.4%
clickbench_q14/datafusion:vortex-compact 91159261 / 89503722 / +1.8% 133570859 / 127810711 / +4.5% 0.68 / 0.70 / -2.5%
clickbench_q15/datafusion:vortex-compact 65231120 / 63106820 / +3.4% 93723832 / 93296663 / +0.5% 0.70 / 0.68 / +2.9%
clickbench_q16/datafusion:vortex-compact 168662894 / 166935431 / +1.0% 209132231 / 207537712 / +0.8% 0.81 / 0.80 / +0.3%
clickbench_q17/datafusion:vortex-compact 165522532 / 165218004 / +0.2% 215818334 / 218277652 / -1.1% 0.77 / 0.76 / +1.3%
clickbench_q18/datafusion:vortex-compact 306216946 / 311983194 / -1.8% 364063565 / 376529261 / -3.3% 0.84 / 0.83 / +1.5%
clickbench_q19/datafusion:vortex-compact 11557267 / 10240091 / +12.9% 🔴 39468254 / 40765474 / -3.2% 0.29 / 0.25 / +16.6%
clickbench_q20/datafusion:vortex-compact 73061430 / 73849008 / -1.1% 198150286 / 195570840 / +1.3% 0.37 / 0.38 / -2.4%
clickbench_q21/datafusion:vortex-compact 118721844 / 119338953 / -0.5% 228951437 / 228175561 / +0.3% 0.52 / 0.52 / -0.9%
clickbench_q22/datafusion:vortex-compact 186773190 / 187745750 / -0.5% 275863595 / 272009463 / +1.4% 0.68 / 0.69 / -1.9%
clickbench_q23/datafusion:vortex-compact 557642501 / 603419602 / -7.6% 737564058 / 690187990 / +6.9% 0.76 / 0.87 / -13.5%
clickbench_q24/datafusion:vortex-compact 28384410 / 27739246 / +2.3% 61632623 / 62375122 / -1.2% 0.46 / 0.44 / +3.6%
clickbench_q25/datafusion:vortex-compact 35732656 / 36633690 / -2.5% 66965484 / 68142215 / -1.7% 0.53 / 0.54 / -0.7%
clickbench_q26/datafusion:vortex-compact 30459216 / 29477586 / +3.3% 61852983 / 62423690 / -0.9% 0.49 / 0.47 / +4.3%
clickbench_q27/datafusion:vortex-compact 104050921 / 102538024 / +1.5% 211517822 / 206536341 / +2.4% 0.49 / 0.50 / -0.9%
clickbench_q28/datafusion:vortex-compact 594672426 / 581891513 / +2.2% 633765426 / 640639327 / -1.1% 0.94 / 0.91 / +3.3%
clickbench_q29/datafusion:vortex-compact 30150290 / 30584710 / -1.4% 54037369 / 55592113 / -2.8% 0.56 / 0.55 / +1.4%
clickbench_q30/datafusion:vortex-compact 94944092 / 93517934 / +1.5% 132807254 / 133565056 / -0.6% 0.71 / 0.70 / +2.1%
clickbench_q31/datafusion:vortex-compact 101440352 / 100198448 / +1.2% 156760577 / 157371175 / -0.4% 0.65 / 0.64 / +1.6%
clickbench_q32/datafusion:vortex-compact 304445388 / 306776931 / -0.8% 369979628 / 381824134 / -3.1% 0.82 / 0.80 / +2.4%
clickbench_q33/datafusion:vortex-compact 344738020 / 339447450 / +1.6% 413054177 / 438305512 / -5.8% 0.83 / 0.77 / +7.8%
clickbench_q34/datafusion:vortex-compact 340940102 / 344275490 / -1.0% 406465901 / 422494708 / -3.8% 0.84 / 0.81 / +2.9%
clickbench_q35/datafusion:vortex-compact 63249650 / 64051915 / -1.3% 89570649 / 90187011 / -0.7% 0.71 / 0.71 / -0.6%
clickbench_q36/datafusion:vortex-compact 38298028 / 38223459 / +0.2% 65146223 / 67349861 / -3.3% 0.59 / 0.57 / +3.6%
clickbench_q37/datafusion:vortex-compact 22309976 / 22667656 / -1.6% 46750243 / 48127682 / -2.9% 0.48 / 0.47 / +1.3%
clickbench_q38/datafusion:vortex-compact 12418766 / 12755558 / -2.6% 40869332 / 41833543 / -2.3% 0.30 / 0.30 / -0.3%
clickbench_q39/datafusion:vortex-compact 78716210 / 79181504 / -0.6% 109552068 / 112035141 / -2.2% 0.72 / 0.71 / +1.7%
clickbench_q40/datafusion:vortex-compact 12329365 / 12329351 / +0.0% 36355580 / 38186503 / -4.8% 0.34 / 0.32 / +5.0%
clickbench_q41/datafusion:vortex-compact 13259116 / 12682689 / +4.5% 35811884 / 37980252 / -5.7% 0.37 / 0.33 / +10.9%
clickbench_q42/datafusion:vortex-compact 11340783 / 11075602 / +2.4% 34495515 / 37052657 / -6.9% 0.33 / 0.30 / +10.0%
datafusion / parquet / ns (0.982x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1283512 / 1248666 / +2.8% 50929760 / 50674550 / +0.5% 0.03 / 0.02 / +2.3%
clickbench_q01/datafusion:parquet 16356454 / 16261794 / +0.6% 74897649 / 71148607 / +5.3% 0.22 / 0.23 / -4.5%
clickbench_q02/datafusion:parquet 19269822 / 18762621 / +2.7% 84265127 / 83030696 / +1.5% 0.23 / 0.23 / +1.2%
clickbench_q03/datafusion:parquet 17504901 / 17195102 / +1.8% 83603033 / 81411249 / +2.7% 0.21 / 0.21 / -0.9%
clickbench_q04/datafusion:parquet 61871490 / 63354337 / -2.3% 130338991 / 129119589 / +0.9% 0.47 / 0.49 / -3.3%
clickbench_q05/datafusion:parquet 87809126 / 88844260 / -1.2% 160682093 / 160327899 / +0.2% 0.55 / 0.55 / -1.4%
clickbench_q06/datafusion:parquet 1296800 / 1240214 / +4.6% 50438640 / 49710136 / +1.5% 0.03 / 0.02 / +3.1%
clickbench_q07/datafusion:parquet 16574241 / 16890980 / -1.9% 68852243 / 67962034 / +1.3% 0.24 / 0.25 / -3.1%
clickbench_q08/datafusion:parquet 86222982 / 85061250 / +1.4% 162595116 / 163012411 / -0.3% 0.53 / 0.52 / +1.6%
clickbench_q09/datafusion:parquet 188127962 / 189203609 / -0.6% 268614300 / 270632685 / -0.7% 0.70 / 0.70 / +0.2%
clickbench_q10/datafusion:parquet 36100082 / 36601414 / -1.4% 102591261 / 102731359 / -0.1% 0.35 / 0.36 / -1.2%
clickbench_q11/datafusion:parquet 42721560 / 42820304 / -0.2% 113566778 / 112329735 / +1.1% 0.38 / 0.38 / -1.3%
clickbench_q12/datafusion:parquet 93189068 / 95946685 / -2.9% 162274944 / 164878211 / -1.6% 0.57 / 0.58 / -1.3%
clickbench_q13/datafusion:parquet 145946742 / 147449550 / -1.0% 225377590 / 232667652 / -3.1% 0.65 / 0.63 / +2.2%
clickbench_q14/datafusion:parquet 99370052 / 101570327 / -2.2% 174682593 / 176212981 / -0.9% 0.57 / 0.58 / -1.3%
clickbench_q15/datafusion:parquet 69014860 / 71215126 / -3.1% 131597905 / 132957062 / -1.0% 0.52 / 0.54 / -2.1%
clickbench_q16/datafusion:parquet 154202248 / 155956499 / -1.1% 234233247 / 241651347 / -3.1% 0.66 / 0.65 / +2.0%
clickbench_q17/datafusion:parquet 153559739 / 156850529 / -2.1% 233061140 / 241796412 / -3.6% 0.66 / 0.65 / +1.6%
clickbench_q18/datafusion:parquet 311699054 / 316711610 / -1.6% 408330356 / 421464415 / -3.1% 0.76 / 0.75 / +1.6%
clickbench_q19/datafusion:parquet 19891900 / 18651205 / +6.7% 79858849 / 77599466 / +2.9% 0.25 / 0.24 / +3.6%
clickbench_q20/datafusion:parquet 168423418 / 181282567 / -7.1% 296581316 / 296948476 / -0.1% 0.57 / 0.61 / -7.0%
clickbench_q21/datafusion:parquet 163816670 / 174007663 / -5.9% 310799414 / 316344166 / -1.8% 0.53 / 0.55 / -4.2%
clickbench_q22/datafusion:parquet 246994732 / 259863082 / -5.0% 450044709 / 458777006 / -1.9% 0.55 / 0.57 / -3.1%
clickbench_q23/datafusion:parquet 955285728 / 1121270496 / -14.8% 🟢 1203619393 / 1271960961 / -5.4% 0.79 / 0.88 / -10.0%
clickbench_q24/datafusion:parquet 30079864 / 29908004 / +0.6% 91486510 / 90973777 / +0.6% 0.33 / 0.33 / +0.0%
clickbench_q25/datafusion:parquet 35729046 / 37356178 / -4.4% 106050419 / 104951637 / +1.0% 0.34 / 0.36 / -5.3%
clickbench_q26/datafusion:parquet 30928210 / 30298266 / +2.1% 95133550 / 94990767 / +0.2% 0.33 / 0.32 / +1.9%
clickbench_q27/datafusion:parquet 180702610 / 194471708 / -7.1% 292424702 / 303642736 / -3.7% 0.62 / 0.64 / -3.5%
clickbench_q28/datafusion:parquet 616445220 / 626889826 / -1.7% 700640975 / 714969361 / -2.0% 0.88 / 0.88 / +0.3%
clickbench_q29/datafusion:parquet 29040244 / 28855514 / +0.6% 93294509 / 92735185 / +0.6% 0.31 / 0.31 / +0.0%
clickbench_q30/datafusion:parquet 87815025 / 91374237 / -3.9% 175400284 / 175352107 / +0.0% 0.50 / 0.52 / -3.9%
clickbench_q31/datafusion:parquet 100696172 / 103920149 / -3.1% 196758550 / 201411255 / -2.3% 0.51 / 0.52 / -0.8%
clickbench_q32/datafusion:parquet 311493162 / 333823982 / -6.7% 416065652 / 433890883 / -4.1% 0.75 / 0.77 / -2.7%
clickbench_q33/datafusion:parquet 369257226 / 384234452 / -3.9% 456177940 / 481163445 / -5.2% 0.81 / 0.80 / +1.4%
clickbench_q34/datafusion:parquet 371322414 / 383579387 / -3.2% 458828329 / 479141684 / -4.2% 0.81 / 0.80 / +1.1%
clickbench_q35/datafusion:parquet 63503600 / 64999929 / -2.3% 129598300 / 124009260 / +4.5% 0.49 / 0.52 / -6.5%
clickbench_q36/datafusion:parquet 72901336 / 73238122 / -0.5% 133391622 / 139145527 / -4.1% 0.55 / 0.53 / +3.8%
clickbench_q37/datafusion:parquet 35298457 / 35337692 / -0.1% 91730569 / 92525371 / -0.9% 0.38 / 0.38 / +0.8%
clickbench_q38/datafusion:parquet 46840910 / 47774183 / -2.0% 110596806 / 110068026 / +0.5% 0.42 / 0.43 / -2.4%
clickbench_q39/datafusion:parquet 143083648 / 143495754 / -0.3% 209251026 / 213701963 / -2.1% 0.68 / 0.67 / +1.8%
clickbench_q40/datafusion:parquet 19836096 / 20319687 / -2.4% 76281481 / 78728787 / -3.1% 0.26 / 0.26 / +0.8%
clickbench_q41/datafusion:parquet 18601378 / 18592491 / +0.0% 75949592 / 76860792 / -1.2% 0.24 / 0.24 / +1.2%
clickbench_q42/datafusion:parquet 19174256 / 19336308 / -0.8% 73973124 / 74945510 / -1.3% 0.26 / 0.26 / +0.5%
duckdb / vortex-file-compressed / ns (1.093x ➖, 2↑ 16↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1535797 / 1555660 / -1.3% 26286035 / 26610999 / -1.2% 0.06 / 0.06 / -0.1%
clickbench_q01/duckdb:vortex-file-compressed 15606794 / 11781086 / +32.5% 🔴 28786011 / 28832902 / -0.2% 0.54 / 0.41 / +32.7%
clickbench_q02/duckdb:vortex-file-compressed 14202345 / 13836074 / +2.6% 31772639 / 36131089 / -12.1% 🟢 0.45 / 0.38 / +16.7%
clickbench_q03/duckdb:vortex-file-compressed 24442950 / 17140524 / +42.6% 🔴 36998087 / 53468402 / -30.8% 🟢 0.66 / 0.32 / +106.1%
clickbench_q04/duckdb:vortex-file-compressed 76719242 / 77080077 / -0.5% 96443851 / 104764827 / -7.9% 0.80 / 0.74 / +8.1%
clickbench_q05/duckdb:vortex-file-compressed 70493932 / 69369968 / +1.6% 87330055 / 98497477 / -11.3% 🟢 0.81 / 0.70 / +14.6%
clickbench_q06/duckdb:vortex-file-compressed 1832016 / 2050057 / -10.6% 🟢 26195763 / 28556723 / -8.3% 0.07 / 0.07 / -2.6%
clickbench_q07/duckdb:vortex-file-compressed 16397712 / 14163454 / +15.8% 🔴 31323403 / 32663221 / -4.1% 0.52 / 0.43 / +20.7%
clickbench_q08/duckdb:vortex-file-compressed 91462915 / 83843124 / +9.1% 108230550 / 133020092 / -18.6% 🟢 0.85 / 0.63 / +34.1%
clickbench_q09/duckdb:vortex-file-compressed 115679672 / 107725871 / +7.4% 136419903 / 150064254 / -9.1% 0.85 / 0.72 / +18.1%
clickbench_q10/duckdb:vortex-file-compressed 40536576 / 34233652 / +18.4% 🔴 57406964 / 71593935 / -19.8% 🟢 0.71 / 0.48 / +47.7%
clickbench_q11/duckdb:vortex-file-compressed 45416605 / 35341393 / +28.5% 🔴 61668260 / 77723859 / -20.7% 🟢 0.74 / 0.45 / +62.0%
clickbench_q12/duckdb:vortex-file-compressed 74518906 / 74770450 / -0.3% 94121373 / 104373673 / -9.8% 0.79 / 0.72 / +10.5%
clickbench_q13/duckdb:vortex-file-compressed 147750786 / 142453523 / +3.7% 160427467 / 181443736 / -11.6% 🟢 0.92 / 0.79 / +17.3%
clickbench_q14/duckdb:vortex-file-compressed 81146437 / 80848595 / +0.4% 98167397 / 107241481 / -8.5% 0.83 / 0.75 / +9.6%
clickbench_q15/duckdb:vortex-file-compressed 99039902 / 93632290 / +5.8% 118564887 / 130965227 / -9.5% 0.84 / 0.71 / +16.8%
clickbench_q16/duckdb:vortex-file-compressed 168397436 / 165086103 / +2.0% 187027683 / 212027800 / -11.8% 🟢 0.90 / 0.78 / +15.6%
clickbench_q17/duckdb:vortex-file-compressed 176259123 / 168316407 / +4.7% 191765596 / 212915965 / -9.9% 0.92 / 0.79 / +16.3%
clickbench_q18/duckdb:vortex-file-compressed 336385696 / 321957444 / +4.5% 349292815 / 379013620 / -7.8% 0.96 / 0.85 / +13.4%
clickbench_q19/duckdb:vortex-file-compressed 20216550 / 16469936 / +22.7% 🔴 33374082 / 41085999 / -18.8% 🟢 0.61 / 0.40 / +51.1%
clickbench_q20/duckdb:vortex-file-compressed 141130086 / 111091562 / +27.0% 🔴 154446032 / 191326909 / -19.3% 🟢 0.91 / 0.58 / +57.4%
clickbench_q21/duckdb:vortex-file-compressed 212260438 / 161411504 / +31.5% 🔴 228508873 / 306668783 / -25.5% 🟢 0.93 / 0.53 / +76.5%
clickbench_q22/duckdb:vortex-file-compressed 319538490 / 243102506 / +31.4% 🔴 330727869 / 473518056 / -30.2% 🟢 0.97 / 0.51 / +88.2%
clickbench_q23/duckdb:vortex-file-compressed 83091256 / 57912988 / +43.5% 🔴 99091201 / 106188703 / -6.7% 0.84 / 0.55 / +53.8%
clickbench_q24/duckdb:vortex-file-compressed 28770412 / 26464748 / +8.7% 44390115 / 49261544 / -9.9% 0.65 / 0.54 / +20.6%
clickbench_q25/duckdb:vortex-file-compressed 31220418 / 32604929 / -4.2% 46023901 / 54143239 / -15.0% 🟢 0.68 / 0.60 / +12.6%
clickbench_q26/duckdb:vortex-file-compressed 22273522 / 20767506 / +7.3% 35572874 / 40737224 / -12.7% 🟢 0.63 / 0.51 / +22.8%
clickbench_q27/duckdb:vortex-file-compressed 179782285 / 145419334 / +23.6% 🔴 201825560 / 252360295 / -20.0% 🟢 0.89 / 0.58 / +54.6%
clickbench_q28/duckdb:vortex-file-compressed 593537358 / 835607383 / -29.0% 🟢 633319758 / 679116000 / -6.7% 0.94 / 1.23 / -23.8%
clickbench_q29/duckdb:vortex-file-compressed 18771444 / 18452732 / +1.7% 34892311 / 40940911 / -14.8% 🟢 0.54 / 0.45 / +19.4%
clickbench_q30/duckdb:vortex-file-compressed 80337662 / 66155557 / +21.4% 🔴 96833009 / 116403278 / -16.8% 🟢 0.83 / 0.57 / +46.0%
clickbench_q31/duckdb:vortex-file-compressed 155883368 / 127292754 / +22.5% 🔴 177327684 / 208706847 / -15.0% 🟢 0.88 / 0.61 / +44.1%
clickbench_q32/duckdb:vortex-file-compressed 444154280 / 445166432 / -0.2% 470791805 / 495199203 / -4.9% 0.94 / 0.90 / +4.9%
clickbench_q33/duckdb:vortex-file-compressed 402160288 / 385800970 / +4.2% 428189279 / 499735089 / -14.3% 🟢 0.94 / 0.77 / +21.7%
clickbench_q34/duckdb:vortex-file-compressed 416717736 / 419334437 / -0.6% 450680989 / 551039433 / -18.2% 🟢 0.92 / 0.76 / +21.5%
clickbench_q35/duckdb:vortex-file-compressed 108626948 / 102418915 / +6.1% 127560467 / 145629829 / -12.4% 🟢 0.85 / 0.70 / +21.1%
clickbench_q36/duckdb:vortex-file-compressed 18593907 / 16406492 / +13.3% 🔴 31695833 / 33727523 / -6.0% 0.59 / 0.49 / +20.6%
clickbench_q37/duckdb:vortex-file-compressed 12894586 / 12172136 / +5.9% 27247998 / 28478850 / -4.3% 0.47 / 0.43 / +10.7%
clickbench_q38/duckdb:vortex-file-compressed 14669996 / 13966158 / +5.0% 27665743 / 28868971 / -4.2% 0.53 / 0.48 / +9.6%
clickbench_q39/duckdb:vortex-file-compressed 24673980 / 24545774 / +0.5% 40295530 / 43063175 / -6.4% 0.61 / 0.57 / +7.4%
clickbench_q40/duckdb:vortex-file-compressed 12652649 / 10820871 / +16.9% 🔴 27956652 / 27873084 / +0.3% 0.45 / 0.39 / +16.6%
clickbench_q41/duckdb:vortex-file-compressed 12724762 / 12830578 / -0.8% 25334292 / 28261988 / -10.4% 🟢 0.50 / 0.45 / +10.6%
clickbench_q42/duckdb:vortex-file-compressed 13687456 / 12307592 / +11.2% 🔴 30639723 / 27507131 / +11.4% 🔴 0.45 / 0.45 / -0.2%
duckdb / vortex-compact / ns (1.084x ➖, 1↑ 18↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1561006 / 1624142 / -3.9% 28167126 / 23788879 / +18.4% 🔴 0.06 / 0.07 / -18.8%
clickbench_q01/duckdb:vortex-compact 12632684 / 14611340 / -13.5% 🟢 27160897 / 28737551 / -5.5% 0.47 / 0.51 / -8.5%
clickbench_q02/duckdb:vortex-compact 25313091 / 20342177 / +24.4% 🔴 41931936 / 42481998 / -1.3% 0.60 / 0.48 / +26.1%
clickbench_q03/duckdb:vortex-compact 23952578 / 20958997 / +14.3% 🔴 38056811 / 54359716 / -30.0% 🟢 0.63 / 0.39 / +63.2%
clickbench_q04/duckdb:vortex-compact 77698756 / 72302596 / +7.5% 87187725 / 107210276 / -18.7% 🟢 0.89 / 0.67 / +32.1%
clickbench_q05/duckdb:vortex-compact 81236069 / 75487450 / +7.6% 94181846 / 98174917 / -4.1% 0.86 / 0.77 / +12.2%
clickbench_q06/duckdb:vortex-compact 1786374 / 1975292 / -9.6% 27621580 / 28414301 / -2.8% 0.06 / 0.07 / -7.0%
clickbench_q07/duckdb:vortex-compact 15632516 / 14724766 / +6.2% 33834385 / 31373286 / +7.8% 0.46 / 0.47 / -1.6%
clickbench_q08/duckdb:vortex-compact 102901998 / 96022259 / +7.2% 119719803 / 134522619 / -11.0% 🟢 0.86 / 0.71 / +20.4%
clickbench_q09/duckdb:vortex-compact 149837906 / 142531730 / +5.1% 164014711 / 179314897 / -8.5% 0.91 / 0.79 / +14.9%
clickbench_q10/duckdb:vortex-compact 61324784 / 52368664 / +17.1% 🔴 79358740 / 89720452 / -11.5% 🟢 0.77 / 0.58 / +32.4%
clickbench_q11/duckdb:vortex-compact 75007420 / 67319914 / +11.4% 🔴 93564462 / 105745354 / -11.5% 🟢 0.80 / 0.64 / +25.9%
clickbench_q12/duckdb:vortex-compact 95050535 / 91058630 / +4.4% 120894307 / 122276367 / -1.1% 0.79 / 0.74 / +5.6%
clickbench_q13/duckdb:vortex-compact 183070490 / 163663890 / +11.9% 🔴 192184908 / 212104600 / -9.4% 0.95 / 0.77 / +23.5%
clickbench_q14/duckdb:vortex-compact 107898412 / 97007480 / +11.2% 🔴 126710499 / 131946165 / -4.0% 0.85 / 0.74 / +15.8%
clickbench_q15/duckdb:vortex-compact 103633248 / 96349476 / +7.6% 123950774 / 135882541 / -8.8% 0.84 / 0.71 / +17.9%
clickbench_q16/duckdb:vortex-compact 189422343 / 180450493 / +5.0% 198637879 / 221549460 / -10.3% 🟢 0.95 / 0.81 / +17.1%
clickbench_q17/duckdb:vortex-compact 188949928 / 182144784 / +3.7% 225905318 / 242501932 / -6.8% 0.84 / 0.75 / +11.4%
clickbench_q18/duckdb:vortex-compact 358996899 / 347221068 / +3.4% 357103928 / 389180143 / -8.2% 1.01 / 0.89 / +12.7%
clickbench_q19/duckdb:vortex-compact 18536624 / 16629261 / +11.5% 🔴 34020182 / 39935291 / -14.8% 🟢 0.54 / 0.42 / +30.9%
clickbench_q20/duckdb:vortex-compact 133486508 / 111637470 / +19.6% 🔴 151551367 / 182133382 / -16.8% 🟢 0.88 / 0.61 / +43.7%
clickbench_q21/duckdb:vortex-compact 234554032 / 180599658 / +29.9% 🔴 253462876 / 327718011 / -22.7% 🟢 0.93 / 0.55 / +67.9%
clickbench_q22/duckdb:vortex-compact 430919764 / 355788996 / +21.1% 🔴 430205502 / 565709205 / -24.0% 🟢 1.00 / 0.63 / +59.3%
clickbench_q23/duckdb:vortex-compact 112802634 / 92353930 / +22.1% 🔴 124666017 / 123748622 / +0.7% 0.90 / 0.75 / +21.2%
clickbench_q24/duckdb:vortex-compact 35785874 / 32261884 / +10.9% 🔴 42646252 / 48347550 / -11.8% 🟢 0.84 / 0.67 / +25.8%
clickbench_q25/duckdb:vortex-compact 54730620 / 47447020 / +15.4% 🔴 70794335 / 75521580 / -6.3% 0.77 / 0.63 / +23.1%
clickbench_q26/duckdb:vortex-compact 26983922 / 23931724 / +12.8% 🔴 37302875 / 40327768 / -7.5% 0.72 / 0.59 / +21.9%
clickbench_q27/duckdb:vortex-compact 237502279 / 194363813 / +22.2% 🔴 243838655 / 322009569 / -24.3% 🟢 0.97 / 0.60 / +61.4%
clickbench_q28/duckdb:vortex-compact 613941345 / 600215280 / +2.3% 630361652 / 683199128 / -7.7% 0.97 / 0.88 / +10.9%
clickbench_q29/duckdb:vortex-compact 27246290 / 23469530 / +16.1% 🔴 43862647 / 45491424 / -3.6% 0.62 / 0.52 / +20.4%
clickbench_q30/duckdb:vortex-compact 128282204 / 112331456 / +14.2% 🔴 144767570 / 158527705 / -8.7% 0.89 / 0.71 / +25.1%
clickbench_q31/duckdb:vortex-compact 198964050 / 174169635 / +14.2% 🔴 221083331 / 252709846 / -12.5% 🟢 0.90 / 0.69 / +30.6%
clickbench_q32/duckdb:vortex-compact 454458316 / 479328178 / -5.2% 509604800 / 528017463 / -3.5% 0.89 / 0.91 / -1.8%
clickbench_q33/duckdb:vortex-compact 411866694 / 404644044 / +1.8% 421644080 / 511009693 / -17.5% 🟢 0.98 / 0.79 / +23.4%
clickbench_q34/duckdb:vortex-compact 419155102 / 413275762 / +1.4% 446431727 / 528416266 / -15.5% 🟢 0.94 / 0.78 / +20.0%
clickbench_q35/duckdb:vortex-compact 110788422 / 109895418 / +0.8% 134732360 / 140403090 / -4.0% 0.82 / 0.78 / +5.1%
clickbench_q36/duckdb:vortex-compact 18101129 / 18443364 / -1.9% 29740234 / 32427851 / -8.3% 0.61 / 0.57 / +7.0%
clickbench_q37/duckdb:vortex-compact 15978594 / 14783627 / +8.1% 29550609 / 31346342 / -5.7% 0.54 / 0.47 / +14.7%
clickbench_q38/duckdb:vortex-compact 14797234 / 13562504 / +9.1% 29734318 / 28911154 / +2.8% 0.50 / 0.47 / +6.1%
clickbench_q39/duckdb:vortex-compact 27421734 / 26262972 / +4.4% 40544126 / 41778694 / -3.0% 0.68 / 0.63 / +7.6%
clickbench_q40/duckdb:vortex-compact 14083368 / 13103070 / +7.5% 28023410 / 31759007 / -11.8% 🟢 0.50 / 0.41 / +21.8%
clickbench_q41/duckdb:vortex-compact 16062903 / 14943380 / +7.5% 28464009 / 30350475 / -6.2% 0.56 / 0.49 / +14.6%
clickbench_q42/duckdb:vortex-compact 13471062 / 12388085 / +8.7% 27279567 / 28867129 / -5.5% 0.49 / 0.43 / +15.1%
duckdb / parquet / ns (0.998x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8917876 / 8188704 / +8.9% 25784768 / 25978629 / -0.7% 0.35 / 0.32 / +9.7%
clickbench_q01/duckdb:parquet 9500740 / 9901200 / -4.0% 20000632 / 22215098 / -10.0% 0.48 / 0.45 / +6.6%
clickbench_q02/duckdb:parquet 15749046 / 15495019 / +1.6% 33258937 / 35855076 / -7.2% 0.47 / 0.43 / +9.6%
clickbench_q03/duckdb:parquet 16668342 / 16017134 / +4.1% 54855966 / 55503757 / -1.2% 0.30 / 0.29 / +5.3%
clickbench_q04/duckdb:parquet 69418144 / 72294106 / -4.0% 93216620 / 103405382 / -9.9% 0.74 / 0.70 / +6.5%
clickbench_q05/duckdb:parquet 83937734 / 80965278 / +3.7% 116704809 / 125353809 / -6.9% 0.72 / 0.65 / +11.4%
clickbench_q06/duckdb:parquet 15662515 / 14773186 / +6.0% 23513813 / 23800327 / -1.2% 0.67 / 0.62 / +7.3%
clickbench_q07/duckdb:parquet 11171001 / 13256286 / -15.7% 🟢 22407584 / 25126959 / -10.8% 🟢 0.50 / 0.53 / -5.5%
clickbench_q08/duckdb:parquet 83970224 / 85591179 / -1.9% 134261286 / 131058726 / +2.4% 0.63 / 0.65 / -4.2%
clickbench_q09/duckdb:parquet 125486382 / 114570831 / +9.5% 156718602 / 161664641 / -3.1% 0.80 / 0.71 / +13.0%
clickbench_q10/duckdb:parquet 33174752 / 33618728 / -1.3% 68578699 / 70864710 / -3.2% 0.48 / 0.47 / +2.0%
clickbench_q11/duckdb:parquet 36521092 / 36150668 / +1.0% 79302920 / 77841601 / +1.9% 0.46 / 0.46 / -0.8%
clickbench_q12/duckdb:parquet 92904098 / 95129340 / -2.3% 140760521 / 129562608 / +8.6% 0.66 / 0.73 / -10.1%
clickbench_q13/duckdb:parquet 150082864 / 144599352 / +3.8% 210094896 / 211392462 / -0.6% 0.71 / 0.68 / +4.4%
clickbench_q14/duckdb:parquet 96741007 / 100808935 / -4.0% 146164321 / 144919177 / +0.9% 0.66 / 0.70 / -4.9%
clickbench_q15/duckdb:parquet 92742734 / 92959255 / -0.2% 118896734 / 121633756 / -2.3% 0.78 / 0.76 / +2.1%
clickbench_q16/duckdb:parquet 168933114 / 171936248 / -1.7% 227581078 / 242210282 / -6.0% 0.74 / 0.71 / +4.6%
clickbench_q17/duckdb:parquet 175081965 / 183724055 / -4.7% 233113129 / 232945903 / +0.1% 0.75 / 0.79 / -4.8%
clickbench_q18/duckdb:parquet 332234978 / 315987706 / +5.1% 404099141 / 406534129 / -0.6% 0.82 / 0.78 / +5.8%
clickbench_q19/duckdb:parquet 13099654 / 13225112 / -0.9% 42002950 / 41753034 / +0.6% 0.31 / 0.32 / -1.5%
clickbench_q20/duckdb:parquet 134247031 / 131089836 / +2.4% 244812074 / 250381531 / -2.2% 0.55 / 0.52 / +4.7%
clickbench_q21/duckdb:parquet 181942530 / 182542027 / -0.3% 320128524 / 324653048 / -1.4% 0.57 / 0.56 / +1.1%
clickbench_q22/duckdb:parquet 244499992 / 245135811 / -0.3% 424917646 / 411306695 / +3.3% 0.58 / 0.60 / -3.5%
clickbench_q23/duckdb:parquet 146214698 / 145770542 / +0.3% 180094120 / 166706922 / +8.0% 0.81 / 0.87 / -7.2%
clickbench_q24/duckdb:parquet 44920293 / 43180490 / +4.0% 63052755 / 63327310 / -0.4% 0.71 / 0.68 / +4.5%
clickbench_q25/duckdb:parquet 39825608 / 40270625 / -1.1% 93243699 / 91397272 / +2.0% 0.43 / 0.44 / -3.1%
clickbench_q26/duckdb:parquet 29623775 / 30946298 / -4.3% 47157393 / 47644733 / -1.0% 0.63 / 0.65 / -3.3%
clickbench_q27/duckdb:parquet 149484248 / 148859846 / +0.4% 258693216 / 258566970 / +0.0% 0.58 / 0.58 / +0.4%
clickbench_q28/duckdb:parquet 898908448 / 904229444 / -0.6% 1047527644 / 1013536632 / +3.4% 0.86 / 0.89 / -3.8%
clickbench_q29/duckdb:parquet 17461788 / 17283162 / +1.0% 33122071 / 34486894 / -4.0% 0.53 / 0.50 / +5.2%
clickbench_q30/duckdb:parquet 90008767 / 93892706 / -4.1% 173297569 / 172337175 / +0.6% 0.52 / 0.54 / -4.7%
clickbench_q31/duckdb:parquet 150669569 / 148288425 / +1.6% 263820420 / 265553721 / -0.7% 0.57 / 0.56 / +2.3%
clickbench_q32/duckdb:parquet 459723200 / 450951973 / +1.9% 511692035 / 508105948 / +0.7% 0.90 / 0.89 / +1.2%
clickbench_q33/duckdb:parquet 458911946 / 472101960 / -2.8% 479420424 / 478063670 / +0.3% 0.96 / 0.99 / -3.1%
clickbench_q34/duckdb:parquet 447543354 / 450578300 / -0.7% 489836151 / 522061345 / -6.2% 0.91 / 0.86 / +5.9%
clickbench_q35/duckdb:parquet 100370040 / 102129014 / -1.7% 121774100 / 120247467 / +1.3% 0.82 / 0.85 / -3.0%
clickbench_q36/duckdb:parquet 31025929 / 31581072 / -1.8% 40495728 / 40732371 / -0.6% 0.77 / 0.78 / -1.2%
clickbench_q37/duckdb:parquet 22955323 / 23091040 / -0.6% 32096392 / 32936273 / -2.6% 0.72 / 0.70 / +2.0%
clickbench_q38/duckdb:parquet 23795202 / 24368718 / -2.4% 33478779 / 33606655 / -0.4% 0.71 / 0.73 / -2.0%
clickbench_q39/duckdb:parquet 56381416 / 56813448 / -0.8% 67000153 / 68932993 / -2.8% 0.84 / 0.82 / +2.1%
clickbench_q40/duckdb:parquet 12866728 / 13314852 / -3.4% 22103676 / 22181755 / -0.4% 0.58 / 0.60 / -3.0%
clickbench_q41/duckdb:parquet 13976481 / 13047572 / +7.1% 22357899 / 23638357 / -5.4% 0.63 / 0.55 / +13.3%
clickbench_q42/duckdb:parquet 14411005 / 14777680 / -2.5% 24626890 / 24237447 / +1.6% 0.59 / 0.61 / -4.0%
File Size Changes (200 files changed, +2.5% overall, 200↑ 0↓)
File Scale Format Base HEAD Change %
hits_48.vortex 1.0 vortex-compact 17.83 MB 19.94 MB +2.12 MB +11.9%
hits_47.vortex 1.0 vortex-compact 18.19 MB 20.23 MB +2.04 MB +11.2%
hits_48.vortex 1.0 vortex-file-compressed 28.75 MB 30.85 MB +2.11 MB +7.3%
hits_33.vortex 1.0 vortex-compact 35.91 MB 38.03 MB +2.11 MB +5.9%
hits_29.vortex 1.0 vortex-compact 36.66 MB 38.59 MB +1.93 MB +5.3%
hits_32.vortex 1.0 vortex-compact 44.57 MB 46.74 MB +2.17 MB +4.9%
hits_75.vortex 1.0 vortex-compact 45.11 MB 47.30 MB +2.18 MB +4.8%
hits_20.vortex 1.0 vortex-compact 38.33 MB 40.19 MB +1.85 MB +4.8%
hits_47.vortex 1.0 vortex-file-compressed 41.95 MB 43.94 MB +2.00 MB +4.8%
hits_19.vortex 1.0 vortex-compact 49.57 MB 51.87 MB +2.30 MB +4.6%
hits_24.vortex 1.0 vortex-compact 45.03 MB 47.11 MB +2.08 MB +4.6%
hits_49.vortex 1.0 vortex-compact 50.97 MB 53.30 MB +2.32 MB +4.6%
hits_23.vortex 1.0 vortex-compact 46.04 MB 48.13 MB +2.09 MB +4.5%
hits_10.vortex 1.0 vortex-compact 49.46 MB 51.69 MB +2.23 MB +4.5%
hits_36.vortex 1.0 vortex-compact 49.20 MB 51.40 MB +2.20 MB +4.5%
hits_66.vortex 1.0 vortex-compact 53.47 MB 55.86 MB +2.39 MB +4.5%
hits_15.vortex 1.0 vortex-compact 48.37 MB 50.52 MB +2.14 MB +4.4%
hits_22.vortex 1.0 vortex-compact 46.14 MB 48.17 MB +2.03 MB +4.4%
hits_86.vortex 1.0 vortex-compact 49.09 MB 51.25 MB +2.16 MB +4.4%
hits_63.vortex 1.0 vortex-compact 46.10 MB 48.09 MB +1.99 MB +4.3%
hits_16.vortex 1.0 vortex-compact 49.44 MB 51.57 MB +2.13 MB +4.3%
hits_11.vortex 1.0 vortex-compact 55.95 MB 58.30 MB +2.35 MB +4.2%
hits_46.vortex 1.0 vortex-compact 42.24 MB 44.01 MB +1.77 MB +4.2%
hits_83.vortex 1.0 vortex-compact 53.49 MB 55.68 MB +2.19 MB +4.1%
hits_17.vortex 1.0 vortex-compact 58.77 MB 61.16 MB +2.39 MB +4.1%
hits_72.vortex 1.0 vortex-compact 52.64 MB 54.78 MB +2.14 MB +4.1%
hits_31.vortex 1.0 vortex-compact 55.75 MB 57.99 MB +2.24 MB +4.0%
hits_85.vortex 1.0 vortex-compact 52.84 MB 54.95 MB +2.11 MB +4.0%
hits_53.vortex 1.0 vortex-compact 60.02 MB 62.40 MB +2.38 MB +4.0%
hits_27.vortex 1.0 vortex-compact 69.88 MB 72.58 MB +2.70 MB +3.9%
hits_95.vortex 1.0 vortex-compact 58.10 MB 60.35 MB +2.24 MB +3.9%
hits_93.vortex 1.0 vortex-compact 59.70 MB 61.96 MB +2.27 MB +3.8%
hits_39.vortex 1.0 vortex-compact 50.02 MB 51.88 MB +1.87 MB +3.7%
hits_61.vortex 1.0 vortex-compact 57.67 MB 59.80 MB +2.13 MB +3.7%
hits_21.vortex 1.0 vortex-compact 51.92 MB 53.84 MB +1.92 MB +3.7%
hits_28.vortex 1.0 vortex-compact 70.84 MB 73.46 MB +2.61 MB +3.7%
hits_26.vortex 1.0 vortex-compact 71.97 MB 74.58 MB +2.61 MB +3.6%
hits_30.vortex 1.0 vortex-compact 58.56 MB 60.68 MB +2.12 MB +3.6%
hits_33.vortex 1.0 vortex-file-compressed 58.81 MB 60.93 MB +2.13 MB +3.6%
hits_8.vortex 1.0 vortex-compact 63.37 MB 65.64 MB +2.27 MB +3.6%
hits_68.vortex 1.0 vortex-compact 76.63 MB 79.36 MB +2.73 MB +3.6%
hits_6.vortex 1.0 vortex-compact 63.55 MB 65.81 MB +2.26 MB +3.6%
hits_34.vortex 1.0 vortex-compact 58.22 MB 60.28 MB +2.05 MB +3.5%
hits_18.vortex 1.0 vortex-compact 64.80 MB 67.09 MB +2.28 MB +3.5%
hits_5.vortex 1.0 vortex-compact 63.30 MB 65.53 MB +2.22 MB +3.5%
hits_37.vortex 1.0 vortex-compact 54.28 MB 56.19 MB +1.91 MB +3.5%
hits_58.vortex 1.0 vortex-compact 61.22 MB 63.36 MB +2.15 MB +3.5%
hits_59.vortex 1.0 vortex-compact 66.63 MB 68.95 MB +2.32 MB +3.5%
hits_4.vortex 1.0 vortex-compact 71.93 MB 74.43 MB +2.50 MB +3.5%
hits_7.vortex 1.0 vortex-compact 64.16 MB 66.39 MB +2.23 MB +3.5%
hits_88.vortex 1.0 vortex-compact 73.50 MB 76.02 MB +2.52 MB +3.4%
hits_98.vortex 1.0 vortex-compact 72.92 MB 75.41 MB +2.49 MB +3.4%
hits_97.vortex 1.0 vortex-compact 69.35 MB 71.72 MB +2.36 MB +3.4%
hits_54.vortex 1.0 vortex-compact 117.47 MB 121.47 MB +4.00 MB +3.4%
hits_35.vortex 1.0 vortex-compact 75.31 MB 77.83 MB +2.53 MB +3.4%
hits_75.vortex 1.0 vortex-file-compressed 64.66 MB 66.82 MB +2.16 MB +3.3%
hits_0.vortex 1.0 vortex-compact 58.86 MB 60.83 MB +1.97 MB +3.3%
hits_79.vortex 1.0 vortex-compact 86.11 MB 88.98 MB +2.87 MB +3.3%
hits_74.vortex 1.0 vortex-compact 71.84 MB 74.24 MB +2.39 MB +3.3%
hits_81.vortex 1.0 vortex-compact 65.93 MB 68.10 MB +2.17 MB +3.3%
hits_38.vortex 1.0 vortex-compact 63.36 MB 65.44 MB +2.08 MB +3.3%
hits_73.vortex 1.0 vortex-compact 70.83 MB 73.14 MB +2.30 MB +3.3%
hits_52.vortex 1.0 vortex-compact 65.05 MB 67.16 MB +2.12 MB +3.3%
hits_64.vortex 1.0 vortex-compact 54.05 MB 55.80 MB +1.74 MB +3.2%
hits_25.vortex 1.0 vortex-compact 73.49 MB 75.85 MB +2.36 MB +3.2%
hits_78.vortex 1.0 vortex-compact 97.77 MB 100.91 MB +3.14 MB +3.2%
hits_76.vortex 1.0 vortex-compact 77.04 MB 79.52 MB +2.47 MB +3.2%
hits_69.vortex 1.0 vortex-compact 80.96 MB 83.55 MB +2.59 MB +3.2%
hits_70.vortex 1.0 vortex-compact 61.82 MB 63.79 MB +1.97 MB +3.2%
hits_40.vortex 1.0 vortex-compact 77.31 MB 79.77 MB +2.45 MB +3.2%
hits_9.vortex 1.0 vortex-compact 66.29 MB 68.39 MB +2.10 MB +3.2%
hits_84.vortex 1.0 vortex-compact 74.15 MB 76.49 MB +2.33 MB +3.1%
hits_10.vortex 1.0 vortex-file-compressed 72.07 MB 74.33 MB +2.25 MB +3.1%
hits_91.vortex 1.0 vortex-compact 61.20 MB 63.11 MB +1.91 MB +3.1%
hits_49.vortex 1.0 vortex-file-compressed 78.38 MB 80.82 MB +2.44 MB +3.1%
hits_32.vortex 1.0 vortex-file-compressed 68.72 MB 70.85 MB +2.13 MB +3.1%
hits_36.vortex 1.0 vortex-file-compressed 70.03 MB 72.19 MB +2.16 MB +3.1%
hits_71.vortex 1.0 vortex-compact 69.87 MB 72.03 MB +2.15 MB +3.1%
hits_99.vortex 1.0 vortex-compact 77.61 MB 80.00 MB +2.39 MB +3.1%
hits_29.vortex 1.0 vortex-file-compressed 61.81 MB 63.71 MB +1.90 MB +3.1%
hits_90.vortex 1.0 vortex-compact 82.09 MB 84.60 MB +2.51 MB +3.1%
hits_45.vortex 1.0 vortex-compact 75.78 MB 78.09 MB +2.31 MB +3.0%
hits_86.vortex 1.0 vortex-file-compressed 71.03 MB 73.19 MB +2.16 MB +3.0%
hits_3.vortex 1.0 vortex-compact 94.83 MB 97.69 MB +2.87 MB +3.0%
hits_56.vortex 1.0 vortex-compact 78.62 MB 81.00 MB +2.37 MB +3.0%
hits_89.vortex 1.0 vortex-compact 114.03 MB 117.44 MB +3.42 MB +3.0%
hits_82.vortex 1.0 vortex-compact 67.33 MB 69.31 MB +1.98 MB +2.9%
hits_67.vortex 1.0 vortex-compact 113.95 MB 117.28 MB +3.33 MB +2.9%
hits_20.vortex 1.0 vortex-file-compressed 64.29 MB 66.16 MB +1.87 MB +2.9%
hits_13.vortex 1.0 vortex-compact 68.69 MB 70.66 MB +1.97 MB +2.9%
hits_24.vortex 1.0 vortex-file-compressed 76.74 MB 78.92 MB +2.18 MB +2.8%
hits_96.vortex 1.0 vortex-compact 91.69 MB 94.29 MB +2.60 MB +2.8%
hits_63.vortex 1.0 vortex-file-compressed 71.20 MB 73.19 MB +1.99 MB +2.8%
hits_23.vortex 1.0 vortex-file-compressed 77.21 MB 79.36 MB +2.15 MB +2.8%
hits_53.vortex 1.0 vortex-file-compressed 88.39 MB 90.84 MB +2.45 MB +2.8%
hits_94.vortex 1.0 vortex-compact 90.58 MB 93.09 MB +2.50 MB +2.8%
hits_19.vortex 1.0 vortex-file-compressed 76.46 MB 78.57 MB +2.11 MB +2.8%
hits_60.vortex 1.0 vortex-compact 64.85 MB 66.63 MB +1.78 MB +2.7%
hits_22.vortex 1.0 vortex-file-compressed 77.65 MB 79.79 MB +2.13 MB +2.7%
hits_16.vortex 1.0 vortex-file-compressed 80.65 MB 82.86 MB +2.21 MB +2.7%
hits_62.vortex 1.0 vortex-compact 74.85 MB 76.90 MB +2.05 MB +2.7%
hits_12.vortex 1.0 vortex-compact 69.49 MB 71.39 MB +1.90 MB +2.7%
hits_80.vortex 1.0 vortex-compact 68.63 MB 70.50 MB +1.87 MB +2.7%
hits_11.vortex 1.0 vortex-file-compressed 83.69 MB 85.96 MB +2.27 MB +2.7%
hits_50.vortex 1.0 vortex-compact 113.70 MB 116.76 MB +3.06 MB +2.7%
hits_1.vortex 1.0 vortex-compact 90.69 MB 93.11 MB +2.41 MB +2.7%
hits_92.vortex 1.0 vortex-compact 94.39 MB 96.89 MB +2.50 MB +2.7%
hits_55.vortex 1.0 vortex-compact 92.52 MB 94.95 MB +2.43 MB +2.6%
hits_51.vortex 1.0 vortex-compact 168.31 MB 172.67 MB +4.37 MB +2.6%
hits_14.vortex 1.0 vortex-compact 74.51 MB 76.44 MB +1.93 MB +2.6%
hits_66.vortex 1.0 vortex-file-compressed 93.24 MB 95.64 MB +2.40 MB +2.6%
hits_77.vortex 1.0 vortex-compact 118.46 MB 121.49 MB +3.03 MB +2.6%
hits_87.vortex 1.0 vortex-compact 118.83 MB 121.83 MB +3.00 MB +2.5%
hits_17.vortex 1.0 vortex-file-compressed 91.91 MB 94.20 MB +2.29 MB +2.5%
hits_46.vortex 1.0 vortex-file-compressed 71.32 MB 73.10 MB +1.78 MB +2.5%
hits_72.vortex 1.0 vortex-file-compressed 88.41 MB 90.55 MB +2.14 MB +2.4%
hits_31.vortex 1.0 vortex-file-compressed 92.30 MB 94.53 MB +2.23 MB +2.4%
hits_93.vortex 1.0 vortex-file-compressed 95.37 MB 97.63 MB +2.27 MB +2.4%
hits_44.vortex 1.0 vortex-compact 132.85 MB 136.01 MB +3.15 MB +2.4%
hits_26.vortex 1.0 vortex-file-compressed 111.64 MB 114.28 MB +2.65 MB +2.4%
hits_15.vortex 1.0 vortex-file-compressed 91.20 MB 93.35 MB +2.15 MB +2.4%
hits_30.vortex 1.0 vortex-file-compressed 90.48 MB 92.59 MB +2.11 MB +2.3%
hits_83.vortex 1.0 vortex-file-compressed 93.53 MB 95.69 MB +2.16 MB +2.3%
hits_88.vortex 1.0 vortex-file-compressed 113.91 MB 116.54 MB +2.63 MB +2.3%
hits_57.vortex 1.0 vortex-compact 83.69 MB 85.60 MB +1.91 MB +2.3%
hits_6.vortex 1.0 vortex-file-compressed 94.80 MB 96.94 MB +2.14 MB +2.3%
hits_2.vortex 1.0 vortex-compact 129.16 MB 132.07 MB +2.92 MB +2.3%
hits_8.vortex 1.0 vortex-file-compressed 94.66 MB 96.79 MB +2.13 MB +2.3%
hits_7.vortex 1.0 vortex-file-compressed 95.45 MB 97.59 MB +2.14 MB +2.2%
hits_5.vortex 1.0 vortex-file-compressed 94.31 MB 96.42 MB +2.11 MB +2.2%
hits_39.vortex 1.0 vortex-file-compressed 81.95 MB 83.76 MB +1.82 MB +2.2%
hits_0.vortex 1.0 vortex-file-compressed 91.02 MB 93.03 MB +2.01 MB +2.2%
hits_4.vortex 1.0 vortex-file-compressed 111.55 MB 114.02 MB +2.47 MB +2.2%
hits_76.vortex 1.0 vortex-file-compressed 117.15 MB 119.74 MB +2.59 MB +2.2%
hits_85.vortex 1.0 vortex-file-compressed 95.04 MB 97.14 MB +2.10 MB +2.2%
hits_95.vortex 1.0 vortex-file-compressed 100.59 MB 102.80 MB +2.21 MB +2.2%
hits_58.vortex 1.0 vortex-file-compressed 92.40 MB 94.43 MB +2.03 MB +2.2%
hits_37.vortex 1.0 vortex-file-compressed 89.21 MB 91.16 MB +1.95 MB +2.2%
hits_59.vortex 1.0 vortex-file-compressed 105.52 MB 107.83 MB +2.31 MB +2.2%
hits_65.vortex 1.0 vortex-compact 129.36 MB 132.19 MB +2.82 MB +2.2%
hits_27.vortex 1.0 vortex-file-compressed 122.41 MB 125.08 MB +2.67 MB +2.2%
hits_35.vortex 1.0 vortex-file-compressed 119.39 MB 121.97 MB +2.58 MB +2.2%
hits_68.vortex 1.0 vortex-file-compressed 127.52 MB 130.27 MB +2.75 MB +2.2%
hits_28.vortex 1.0 vortex-file-compressed 120.47 MB 123.05 MB +2.59 MB +2.1%
hits_42.vortex 1.0 vortex-compact 164.50 MB 168.01 MB +3.51 MB +2.1%
hits_97.vortex 1.0 vortex-file-compressed 111.46 MB 113.83 MB +2.38 MB +2.1%
hits_40.vortex 1.0 vortex-file-compressed 119.93 MB 122.48 MB +2.55 MB +2.1%
hits_41.vortex 1.0 vortex-compact 166.03 MB 169.56 MB +3.53 MB +2.1%
hits_43.vortex 1.0 vortex-compact 169.18 MB 172.78 MB +3.59 MB +2.1%
hits_25.vortex 1.0 vortex-file-compressed 117.26 MB 119.73 MB +2.47 MB +2.1%
hits_79.vortex 1.0 vortex-file-compressed 148.70 MB 151.83 MB +3.13 MB +2.1%
hits_69.vortex 1.0 vortex-file-compressed 125.83 MB 128.47 MB +2.64 MB +2.1%
hits_18.vortex 1.0 vortex-file-compressed 109.80 MB 112.09 MB +2.29 MB +2.1%
hits_73.vortex 1.0 vortex-file-compressed 113.32 MB 115.67 MB +2.36 MB +2.1%
hits_52.vortex 1.0 vortex-file-compressed 107.27 MB 109.46 MB +2.19 MB +2.0%
hits_3.vortex 1.0 vortex-file-compressed 147.09 MB 150.06 MB +2.98 MB +2.0%
hits_64.vortex 1.0 vortex-file-compressed 83.40 MB 85.09 MB +1.69 MB +2.0%
hits_61.vortex 1.0 vortex-file-compressed 103.90 MB 105.99 MB +2.09 MB +2.0%
hits_21.vortex 1.0 vortex-file-compressed 96.10 MB 98.03 MB +1.93 MB +2.0%
hits_84.vortex 1.0 vortex-file-compressed 120.82 MB 123.24 MB +2.41 MB +2.0%
hits_98.vortex 1.0 vortex-file-compressed 121.51 MB 123.93 MB +2.42 MB +2.0%
hits_74.vortex 1.0 vortex-file-compressed 122.65 MB 125.08 MB +2.44 MB +2.0%
hits_9.vortex 1.0 vortex-file-compressed 101.79 MB 103.81 MB +2.02 MB +2.0%
hits_90.vortex 1.0 vortex-file-compressed 145.83 MB 148.72 MB +2.89 MB +2.0%
hits_34.vortex 1.0 vortex-file-compressed 100.90 MB 102.89 MB +1.99 MB +2.0%
hits_81.vortex 1.0 vortex-file-compressed 103.74 MB 105.78 MB +2.04 MB +2.0%
hits_38.vortex 1.0 vortex-file-compressed 102.71 MB 104.74 MB +2.02 MB +2.0%
hits_13.vortex 1.0 vortex-file-compressed 100.73 MB 102.71 MB +1.98 MB +2.0%
hits_70.vortex 1.0 vortex-file-compressed 96.77 MB 98.66 MB +1.89 MB +1.9%
hits_71.vortex 1.0 vortex-file-compressed 106.13 MB 108.20 MB +2.07 MB +1.9%
hits_45.vortex 1.0 vortex-file-compressed 122.90 MB 125.26 MB +2.36 MB +1.9%
hits_54.vortex 1.0 vortex-file-compressed 225.88 MB 230.20 MB +4.32 MB +1.9%
hits_82.vortex 1.0 vortex-file-compressed 102.22 MB 104.17 MB +1.95 MB +1.9%
hits_91.vortex 1.0 vortex-file-compressed 102.21 MB 104.15 MB +1.93 MB +1.9%
hits_78.vortex 1.0 vortex-file-compressed 167.44 MB 170.57 MB +3.13 MB +1.9%
hits_96.vortex 1.0 vortex-file-compressed 142.30 MB 144.93 MB +2.62 MB +1.8%
hits_55.vortex 1.0 vortex-file-compressed 173.90 MB 177.09 MB +3.20 MB +1.8%
hits_99.vortex 1.0 vortex-file-compressed 127.94 MB 130.28 MB +2.34 MB +1.8%
hits_77.vortex 1.0 vortex-file-compressed 172.87 MB 176.03 MB +3.16 MB +1.8%
hits_1.vortex 1.0 vortex-file-compressed 143.29 MB 145.88 MB +2.59 MB +1.8%
hits_12.vortex 1.0 vortex-file-compressed 103.73 MB 105.58 MB +1.86 MB +1.8%
hits_89.vortex 1.0 vortex-file-compressed 188.22 MB 191.57 MB +3.35 MB +1.8%
hits_80.vortex 1.0 vortex-file-compressed 108.37 MB 110.28 MB +1.91 MB +1.8%
hits_56.vortex 1.0 vortex-file-compressed 126.92 MB 129.14 MB +2.22 MB +1.7%
hits_87.vortex 1.0 vortex-file-compressed 176.84 MB 179.93 MB +3.09 MB +1.7%
hits_94.vortex 1.0 vortex-file-compressed 143.98 MB 146.48 MB +2.50 MB +1.7%
hits_44.vortex 1.0 vortex-file-compressed 191.26 MB 194.54 MB +3.28 MB +1.7%
hits_67.vortex 1.0 vortex-file-compressed 188.24 MB 191.41 MB +3.18 MB +1.7%
hits_14.vortex 1.0 vortex-file-compressed 113.62 MB 115.53 MB +1.91 MB +1.7%
hits_43.vortex 1.0 vortex-file-compressed 232.11 MB 235.98 MB +3.86 MB +1.7%
hits_65.vortex 1.0 vortex-file-compressed 185.87 MB 188.96 MB +3.09 MB +1.7%
hits_41.vortex 1.0 vortex-file-compressed 228.73 MB 232.52 MB +3.79 MB +1.7%
hits_62.vortex 1.0 vortex-file-compressed 122.23 MB 124.26 MB +2.03 MB +1.7%
hits_42.vortex 1.0 vortex-file-compressed 227.69 MB 231.45 MB +3.75 MB +1.6%
hits_92.vortex 1.0 vortex-file-compressed 153.24 MB 155.74 MB +2.50 MB +1.6%
hits_2.vortex 1.0 vortex-file-compressed 191.95 MB 195.02 MB +3.07 MB +1.6%
hits_60.vortex 1.0 vortex-file-compressed 108.73 MB 110.47 MB +1.74 MB +1.6%
hits_50.vortex 1.0 vortex-file-compressed 183.47 MB 186.37 MB +2.90 MB +1.6%
hits_51.vortex 1.0 vortex-file-compressed 282.30 MB 286.56 MB +4.25 MB +1.5%
hits_57.vortex 1.0 vortex-file-compressed 131.86 MB 133.84 MB +1.98 MB +1.5%

Totals:

  • vortex-compact: 7.10 GB → 7.33 GB (+3.3%)
  • vortex-file-compressed: 11.31 GB → 11.54 GB (+2.1%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.0%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+8.0%, low confidence)
Vortex (geomean): hot 1.039x ➖ · cold 0.857x ✅
Parquet (geomean): hot 1.000x ➖ · cold 0.989x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 93482410 / 90718299 / +3.0% 168471880 / 161920161 / +4.0% 0.55 / 0.56 / -1.0%
tpch_q02/datafusion:vortex-file-compressed 65355385 / 65106392 / +0.4% 95637874 / 93735096 / +2.0% 0.68 / 0.69 / -1.6%
tpch_q03/datafusion:vortex-file-compressed 65706125 / 65510838 / +0.3% 118907250 / 122072875 / -2.6% 0.55 / 0.54 / +3.0%
tpch_q04/datafusion:vortex-file-compressed 34773010 / 35419851 / -1.8% 81678441 / 82498686 / -1.0% 0.43 / 0.43 / -0.8%
tpch_q05/datafusion:vortex-file-compressed 118248662 / 120181046 / -1.6% 181654167 / 180443811 / +0.7% 0.65 / 0.67 / -2.3%
tpch_q06/datafusion:vortex-file-compressed 14733643 / 14889095 / -1.0% 72076973 / 71495537 / +0.8% 0.20 / 0.21 / -1.8%
tpch_q07/datafusion:vortex-file-compressed 140911719 / 134914143 / +4.4% 187588284 / 188757102 / -0.6% 0.75 / 0.71 / +5.1%
tpch_q08/datafusion:vortex-file-compressed 144084588 / 143590799 / +0.3% 210152699 / 205655383 / +2.2% 0.69 / 0.70 / -1.8%
tpch_q09/datafusion:vortex-file-compressed 190108412 / 190875316 / -0.4% 263098304 / 263505741 / -0.2% 0.72 / 0.72 / -0.2%
tpch_q10/datafusion:vortex-file-compressed 74791106 / 74236083 / +0.7% 137056017 / 137496474 / -0.3% 0.55 / 0.54 / +1.1%
tpch_q11/datafusion:vortex-file-compressed 42971617 / 43276214 / -0.7% 68109407 / 67129567 / +1.5% 0.63 / 0.64 / -2.1%
tpch_q12/datafusion:vortex-file-compressed 44312659 / 43428903 / +2.0% 91233410 / 98999395 / -7.8% 0.49 / 0.44 / +10.7%
tpch_q13/datafusion:vortex-file-compressed 46504827 / 46959961 / -1.0% 79955613 / 80001769 / -0.1% 0.58 / 0.59 / -0.9%
tpch_q14/datafusion:vortex-file-compressed 25819534 / 25972460 / -0.6% 95712063 / 97595825 / -1.9% 0.27 / 0.27 / +1.4%
tpch_q15/datafusion:vortex-file-compressed 37503376 / 37241288 / +0.7% 102629659 / 101658759 / +1.0% 0.37 / 0.37 / -0.2%
tpch_q16/datafusion:vortex-file-compressed 37480225 / 37262096 / +0.6% 67314006 / 65082240 / +3.4% 0.56 / 0.57 / -2.7%
tpch_q17/datafusion:vortex-file-compressed 176491563 / 178369927 / -1.1% 224038553 / 231964611 / -3.4% 0.79 / 0.77 / +2.4%
tpch_q18/datafusion:vortex-file-compressed 206121546 / 205858784 / +0.1% 264198016 / 259896298 / +1.7% 0.78 / 0.79 / -1.5%
tpch_q19/datafusion:vortex-file-compressed 39378145 / 38939016 / +1.1% 98696631 / 92521024 / +6.7% 0.40 / 0.42 / -5.2%
tpch_q20/datafusion:vortex-file-compressed 62984545 / 63132078 / -0.2% 120141305 / 123321682 / -2.6% 0.52 / 0.51 / +2.4%
tpch_q21/datafusion:vortex-file-compressed 185127664 / 182309751 / +1.5% 236031990 / 232119520 / +1.7% 0.78 / 0.79 / -0.1%
tpch_q22/datafusion:vortex-file-compressed 25868763 / 25899078 / -0.1% 52474529 / 54581185 / -3.9% 0.49 / 0.47 / +3.9%
datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 96752901 / 97060611 / -0.3% 155471891 / 154909681 / +0.4% 0.62 / 0.63 / -0.7%
tpch_q02/datafusion:vortex-compact 66354293 / 65405144 / +1.5% 93178466 / 93396582 / -0.2% 0.71 / 0.70 / +1.7%
tpch_q03/datafusion:vortex-compact 67357697 / 67066223 / +0.4% 109241322 / 109735955 / -0.5% 0.62 / 0.61 / +0.9%
tpch_q04/datafusion:vortex-compact 41826620 / 41789575 / +0.1% 82563067 / 82522632 / +0.0% 0.51 / 0.51 / +0.0%
tpch_q05/datafusion:vortex-compact 120809499 / 118762005 / +1.7% 168958337 / 181374305 / -6.8% 0.72 / 0.65 / +9.2%
tpch_q06/datafusion:vortex-compact 18204072 / 18378566 / -0.9% 61981778 / 65298690 / -5.1% 0.29 / 0.28 / +4.4%
tpch_q07/datafusion:vortex-compact 141662087 / 142891448 / -0.9% 183184687 / 184683668 / -0.8% 0.77 / 0.77 / -0.0%
tpch_q08/datafusion:vortex-compact 147639002 / 146672213 / +0.7% 194031705 / 202261098 / -4.1% 0.76 / 0.73 / +4.9%
tpch_q09/datafusion:vortex-compact 193625538 / 193389534 / +0.1% 249726665 / 247034529 / +1.1% 0.78 / 0.78 / -1.0%
tpch_q10/datafusion:vortex-compact 79960238 / 78750615 / +1.5% 137974702 / 124545156 / +10.8% 🔴 0.58 / 0.63 / -8.3%
tpch_q11/datafusion:vortex-compact 43740268 / 43826937 / -0.2% 67298864 / 64470941 / +4.4% 0.65 / 0.68 / -4.4%
tpch_q12/datafusion:vortex-compact 57832916 / 57993415 / -0.3% 91317655 / 95909282 / -4.8% 0.63 / 0.60 / +4.7%
tpch_q13/datafusion:vortex-compact 53746182 / 55065646 / -2.4% 80086806 / 78648239 / +1.8% 0.67 / 0.70 / -4.1%
tpch_q14/datafusion:vortex-compact 28054345 / 27745169 / +1.1% 94678462 / 99776492 / -5.1% 0.30 / 0.28 / +6.6%
tpch_q15/datafusion:vortex-compact 44588396 / 45456025 / -1.9% 101925607 / 103092070 / -1.1% 0.44 / 0.44 / -0.8%
tpch_q16/datafusion:vortex-compact 40972880 / 40384702 / +1.5% 65567157 / 68466681 / -4.2% 0.62 / 0.59 / +5.9%
tpch_q17/datafusion:vortex-compact 178860832 / 174149976 / +2.7% 221628623 / 214997469 / +3.1% 0.81 / 0.81 / -0.4%
tpch_q18/datafusion:vortex-compact 202005108 / 205743264 / -1.8% 250919451 / 258593281 / -3.0% 0.81 / 0.80 / +1.2%
tpch_q19/datafusion:vortex-compact 62341161 / 62715924 / -0.6% 110304957 / 114848020 / -4.0% 0.57 / 0.55 / +3.5%
tpch_q20/datafusion:vortex-compact 65151290 / 66101860 / -1.4% 115070019 / 119448629 / -3.7% 0.57 / 0.55 / +2.3%
tpch_q21/datafusion:vortex-compact 190804044 / 189686137 / +0.6% 242318781 / 244988028 / -1.1% 0.79 / 0.77 / +1.7%
tpch_q22/datafusion:vortex-compact 26456073 / 26958000 / -1.9% 53673921 / 54751199 / -2.0% 0.49 / 0.49 / +0.1%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83378542 / 82985004 / +0.5% 131355334 / 135056995 / -2.7% 0.63 / 0.61 / +3.3%
tpch_q02/datafusion:parquet 134901267 / 134226775 / +0.5% 161512214 / 165287949 / -2.3% 0.84 / 0.81 / +2.9%
tpch_q03/datafusion:parquet 124248536 / 124672909 / -0.3% 187095431 / 199745541 / -6.3% 0.66 / 0.62 / +6.4%
tpch_q04/datafusion:parquet 52860279 / 53154295 / -0.6% 99771151 / 108607013 / -8.1% 0.53 / 0.49 / +8.3%
tpch_q05/datafusion:parquet 165123058 / 164101362 / +0.6% 229571155 / 242393288 / -5.3% 0.72 / 0.68 / +6.2%
tpch_q06/datafusion:parquet 32288061 / 32031872 / +0.8% 80851503 / 87089467 / -7.2% 0.40 / 0.37 / +8.6%
tpch_q07/datafusion:parquet 214131088 / 216098084 / -0.9% 277336916 / 299942092 / -7.5% 0.77 / 0.72 / +7.2%
tpch_q08/datafusion:parquet 210993613 / 209680280 / +0.6% 290824717 / 298917893 / -2.7% 0.73 / 0.70 / +3.4%
tpch_q09/datafusion:parquet 283063007 / 284343266 / -0.5% 367157707 / 370705911 / -1.0% 0.77 / 0.77 / +0.5%
tpch_q10/datafusion:parquet 302448195 / 306143316 / -1.2% 366913643 / 367040139 / -0.0% 0.82 / 0.83 / -1.2%
tpch_q11/datafusion:parquet 96945782 / 96301472 / +0.7% 117540634 / 121896745 / -3.6% 0.82 / 0.79 / +4.4%
tpch_q12/datafusion:parquet 78496764 / 78260334 / +0.3% 128748917 / 129915649 / -0.9% 0.61 / 0.60 / +1.2%
tpch_q13/datafusion:parquet 194302065 / 194122123 / +0.1% 226833567 / 228269594 / -0.6% 0.86 / 0.85 / +0.7%
tpch_q14/datafusion:parquet 74380760 / 73826800 / +0.8% 173045424 / 177775534 / -2.7% 0.43 / 0.42 / +3.5%
tpch_q15/datafusion:parquet 76424918 / 76428249 / -0.0% 137136510 / 137900768 / -0.6% 0.56 / 0.55 / +0.6%
tpch_q16/datafusion:parquet 84336305 / 83914067 / +0.5% 108927145 / 108592822 / +0.3% 0.77 / 0.77 / +0.2%
tpch_q17/datafusion:parquet 203245439 / 203042405 / +0.1% 260973302 / 265689386 / -1.8% 0.78 / 0.76 / +1.9%
tpch_q18/datafusion:parquet 263702399 / 263878401 / -0.1% 307574412 / 317435077 / -3.1% 0.86 / 0.83 / +3.1%
tpch_q19/datafusion:parquet 97738710 / 97761598 / -0.0% 173179274 / 175242736 / -1.2% 0.56 / 0.56 / +1.2%
tpch_q20/datafusion:parquet 151900013 / 152990226 / -0.7% 213024633 / 216879922 / -1.8% 0.71 / 0.71 / +1.1%
tpch_q21/datafusion:parquet 226368216 / 226277529 / +0.0% 309025334 / 312189724 / -1.0% 0.73 / 0.72 / +1.1%
tpch_q22/datafusion:parquet 161017431 / 161622830 / -0.4% 183186525 / 185133592 / -1.1% 0.88 / 0.87 / +0.7%
duckdb / vortex-file-compressed / ns (1.084x ➖, 1↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 55140129 / 55555531 / -0.7% 62743580 / 110216789 / -43.1% 🟢 0.88 / 0.50 / +74.3%
tpch_q02/duckdb:vortex-file-compressed 34877535 / 32541791 / +7.2% 40934082 / 46441633 / -11.9% 🟢 0.85 / 0.70 / +21.6%
tpch_q03/duckdb:vortex-file-compressed 62382498 / 57300905 / +8.9% 70370327 / 103922372 / -32.3% 🟢 0.89 / 0.55 / +60.8%
tpch_q04/duckdb:vortex-file-compressed 82400869 / 80706043 / +2.1% 91487463 / 116271519 / -21.3% 🟢 0.90 / 0.69 / +29.8%
tpch_q05/duckdb:vortex-file-compressed 68254755 / 66426992 / +2.8% 75029926 / 124059387 / -39.5% 🟢 0.91 / 0.54 / +69.9%
tpch_q06/duckdb:vortex-file-compressed 30825191 / 21795436 / +41.4% 🔴 36646568 / 61665915 / -40.6% 🟢 0.84 / 0.35 / +138.0%
tpch_q07/duckdb:vortex-file-compressed 67287035 / 59799599 / +12.5% 🔴 81893193 / 128109764 / -36.1% 🟢 0.82 / 0.47 / +76.0%
tpch_q08/duckdb:vortex-file-compressed 93036312 / 88621589 / +5.0% 107433167 / 149114244 / -28.0% 🟢 0.87 / 0.59 / +45.7%
tpch_q09/duckdb:vortex-file-compressed 178260808 / 172707325 / +3.2% 193897877 / 230597946 / -15.9% 🟢 0.92 / 0.75 / +22.8%
tpch_q10/duckdb:vortex-file-compressed 118910773 / 111454986 / +6.7% 126448499 / 188228145 / -32.8% 🟢 0.94 / 0.59 / +58.8%
tpch_q11/duckdb:vortex-file-compressed 19199109 / 16543436 / +16.1% 🔴 27880205 / 31429871 / -11.3% 🟢 0.69 / 0.53 / +30.8%
tpch_q12/duckdb:vortex-file-compressed 74270157 / 58914507 / +26.1% 🔴 80826415 / 109356280 / -26.1% 🟢 0.92 / 0.54 / +70.6%
tpch_q13/duckdb:vortex-file-compressed 95298704 / 89883101 / +6.0% 110806443 / 142695989 / -22.3% 🟢 0.86 / 0.63 / +36.5%
tpch_q14/duckdb:vortex-file-compressed 40582793 / 31098922 / +30.5% 🔴 46358966 / 78400101 / -40.9% 🟢 0.88 / 0.40 / +120.7%
tpch_q15/duckdb:vortex-file-compressed 41164094 / 38112225 / +8.0% 48825805 / 82844673 / -41.1% 🟢 0.84 / 0.46 / +83.3%
tpch_q16/duckdb:vortex-file-compressed 43521332 / 41864444 / +4.0% 51691356 / 54253314 / -4.7% 0.84 / 0.77 / +9.1%
tpch_q17/duckdb:vortex-file-compressed 60950755 / 77493508 / -21.3% 🟢 68430385 / 157552557 / -56.6% 🟢 0.89 / 0.49 / +81.1%
tpch_q18/duckdb:vortex-file-compressed 134240263 / 127192319 / +5.5% 128774557 / 153154817 / -15.9% 🟢 1.04 / 0.83 / +25.5%
tpch_q19/duckdb:vortex-file-compressed 54859646 / 46838937 / +17.1% 🔴 60720856 / 103959645 / -41.6% 🟢 0.90 / 0.45 / +100.5%
tpch_q20/duckdb:vortex-file-compressed 66242148 / 60650184 / +9.2% 76786196 / 111249578 / -31.0% 🟢 0.86 / 0.55 / +58.2%
tpch_q21/duckdb:vortex-file-compressed 249544815 / 239591296 / +4.2% 256259558 / 280748163 / -8.7% 0.97 / 0.85 / +14.1%
tpch_q22/duckdb:vortex-file-compressed 41285787 / 39651137 / +4.1% 51451314 / 58488190 / -12.0% 🟢 0.80 / 0.68 / +18.4%
duckdb / vortex-compact / ns (1.073x ➖, 0↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 70278583 / 69763407 / +0.7% 75273761 / 102078555 / -26.3% 🟢 0.93 / 0.68 / +36.6%
tpch_q02/duckdb:vortex-compact 36979940 / 35467591 / +4.3% 47723707 / 51544532 / -7.4% 0.77 / 0.69 / +12.6%
tpch_q03/duckdb:vortex-compact 67238850 / 62797964 / +7.1% 75627421 / 101122412 / -25.2% 🟢 0.89 / 0.62 / +43.2%
tpch_q04/duckdb:vortex-compact 94508948 / 88498922 / +6.8% 104219611 / 116507376 / -10.5% 🟢 0.91 / 0.76 / +19.4%
tpch_q05/duckdb:vortex-compact 73745678 / 71039489 / +3.8% 81865106 / 118753685 / -31.1% 🟢 0.90 / 0.60 / +50.6%
tpch_q06/duckdb:vortex-compact 30961027 / 24889827 / +24.4% 🔴 35599507 / 58210433 / -38.8% 🟢 0.87 / 0.43 / +103.4%
tpch_q07/duckdb:vortex-compact 79023813 / 71600075 / +10.4% 🔴 89724698 / 129062907 / -30.5% 🟢 0.88 / 0.55 / +58.8%
tpch_q08/duckdb:vortex-compact 99136650 / 89663182 / +10.6% 🔴 106066437 / 144157371 / -26.4% 🟢 0.93 / 0.62 / +50.3%
tpch_q09/duckdb:vortex-compact 184088803 / 173205477 / +6.3% 199160462 / 238226043 / -16.4% 🟢 0.92 / 0.73 / +27.1%
tpch_q10/duckdb:vortex-compact 131833008 / 126411615 / +4.3% 133922001 / 182577166 / -26.6% 🟢 0.98 / 0.69 / +42.2%
tpch_q11/duckdb:vortex-compact 20155155 / 19090258 / +5.6% 31489421 / 36345490 / -13.4% 🟢 0.64 / 0.53 / +21.9%
tpch_q12/duckdb:vortex-compact 81496574 / 70649690 / +15.4% 🔴 96421467 / 104119215 / -7.4% 0.85 / 0.68 / +24.6%
tpch_q13/duckdb:vortex-compact 103640355 / 100597399 / +3.0% 114706926 / 140218777 / -18.2% 🟢 0.90 / 0.72 / +25.9%
tpch_q14/duckdb:vortex-compact 41562347 / 34283535 / +21.2% 🔴 49361956 / 70368970 / -29.9% 🟢 0.84 / 0.49 / +72.8%
tpch_q15/duckdb:vortex-compact 46691582 / 44990280 / +3.8% 56928186 / 93558853 / -39.2% 🟢 0.82 / 0.48 / +70.6%
tpch_q16/duckdb:vortex-compact 45087552 / 44150952 / +2.1% 54088167 / 59347307 / -8.9% 0.83 / 0.74 / +12.1%
tpch_q17/duckdb:vortex-compact 62146960 / 59976812 / +3.6% 70957444 / 115300443 / -38.5% 🟢 0.88 / 0.52 / +68.4%
tpch_q18/duckdb:vortex-compact 148151471 / 144241447 / +2.7% 135613918 / 160371601 / -15.4% 🟢 1.09 / 0.90 / +21.5%
tpch_q19/duckdb:vortex-compact 57124606 / 48908239 / +16.8% 🔴 69163692 / 91444496 / -24.4% 🟢 0.83 / 0.53 / +54.4%
tpch_q20/duckdb:vortex-compact 72647027 / 69234969 / +4.9% 83898212 / 119750548 / -29.9% 🟢 0.87 / 0.58 / +49.8%
tpch_q21/duckdb:vortex-compact 280976391 / 262933198 / +6.9% 279060623 / 293311934 / -4.9% 1.01 / 0.90 / +12.3%
tpch_q22/duckdb:vortex-compact 42438091 / 42147182 / +0.7% 48626003 / 57055182 / -14.8% 🟢 0.87 / 0.74 / +18.1%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 71061694 / 70842519 / +0.3% 102257402 / 90442707 / +13.1% 🔴 0.69 / 0.78 / -11.3%
tpch_q02/duckdb:parquet 71398262 / 71805208 / -0.6% 82995931 / 82425569 / +0.7% 0.86 / 0.87 / -1.3%
tpch_q03/duckdb:parquet 115443311 / 117211364 / -1.5% 150595407 / 151144056 / -0.4% 0.77 / 0.78 / -1.1%
tpch_q04/duckdb:parquet 75563961 / 75583302 / -0.0% 108064892 / 98854880 / +9.3% 0.70 / 0.76 / -8.5%
tpch_q05/duckdb:parquet 126471880 / 131258202 / -3.6% 166455507 / 174179281 / -4.4% 0.76 / 0.75 / +0.8%
tpch_q06/duckdb:parquet 35130087 / 34993895 / +0.4% 52234622 / 49773568 / +4.9% 0.67 / 0.70 / -4.3%
tpch_q07/duckdb:parquet 91107673 / 90463516 / +0.7% 132349791 / 131778689 / +0.4% 0.69 / 0.69 / +0.3%
tpch_q08/duckdb:parquet 145058064 / 144548339 / +0.4% 200421314 / 191928354 / +4.4% 0.72 / 0.75 / -3.9%
tpch_q09/duckdb:parquet 222322894 / 223503870 / -0.5% 285066336 / 269442082 / +5.8% 0.78 / 0.83 / -6.0%
tpch_q10/duckdb:parquet 473023584 / 472703459 / +0.1% 513970689 / 509586595 / +0.9% 0.92 / 0.93 / -0.8%
tpch_q11/duckdb:parquet 31104385 / 30851557 / +0.8% 37494855 / 38068350 / -1.5% 0.83 / 0.81 / +2.4%
tpch_q12/duckdb:parquet 76543838 / 76544310 / -0.0% 93091472 / 92985642 / +0.1% 0.82 / 0.82 / -0.1%
tpch_q13/duckdb:parquet 319199193 / 316481914 / +0.9% 330906029 / 332974494 / -0.6% 0.96 / 0.95 / +1.5%
tpch_q14/duckdb:parquet 103753356 / 104990086 / -1.2% 137552409 / 134425576 / +2.3% 0.75 / 0.78 / -3.4%
tpch_q15/duckdb:parquet 45332517 / 44791188 / +1.2% 68985159 / 85275809 / -19.1% 🟢 0.66 / 0.53 / +25.1%
tpch_q16/duckdb:parquet 114783500 / 115629668 / -0.7% 124788539 / 124365082 / +0.3% 0.92 / 0.93 / -1.1%
tpch_q17/duckdb:parquet 74942876 / 73968208 / +1.3% 104904233 / 104627359 / +0.3% 0.71 / 0.71 / +1.1%
tpch_q18/duckdb:parquet 204956868 / 208416812 / -1.7% 178745912 / 175877923 / +1.6% 1.15 / 1.19 / -3.2%
tpch_q19/duckdb:parquet 163962152 / 163166706 / +0.5% 195062651 / 193530513 / +0.8% 0.84 / 0.84 / -0.3%
tpch_q20/duckdb:parquet 129019272 / 129447889 / -0.3% 165142013 / 173231992 / -4.7% 0.78 / 0.75 / +4.6%
tpch_q21/duckdb:parquet 273606691 / 271829325 / +0.7% 291815057 / 285154253 / +2.3% 0.94 / 0.95 / -1.6%
tpch_q22/duckdb:parquet 263812649 / 262805581 / +0.4% 275676649 / 275519672 / +0.1% 0.96 / 0.95 / +0.3%
File Size Changes (16 files changed, +1.8% overall, 16↑ 0↓)
File Scale Format Base HEAD Change %
region.vortex 10.0 vortex-compact 5.70 KB 28.42 KB +22.73 KB +399.0%
nation.vortex 10.0 vortex-compact 7.51 KB 37.17 KB +29.66 KB +394.8%
region.vortex 10.0 vortex-file-compressed 6.52 KB 28.72 KB +22.20 KB +340.8%
nation.vortex 10.0 vortex-file-compressed 10.54 KB 41.99 KB +31.45 KB +298.3%
supplier.vortex 10.0 vortex-compact 4.73 MB 4.88 MB +157.94 KB +3.3%
orders.vortex 10.0 vortex-compact 344.29 MB 354.68 MB +10.39 MB +3.0%
supplier.vortex 10.0 vortex-file-compressed 5.92 MB 6.07 MB +150.41 KB +2.5%
part.vortex 10.0 vortex-compact 35.90 MB 36.74 MB +861.20 KB +2.3%
customer.vortex 10.0 vortex-compact 74.00 MB 75.71 MB +1.71 MB +2.3%
part.vortex 10.0 vortex-file-compressed 53.83 MB 55.00 MB +1.17 MB +2.2%
lineitem.vortex 10.0 vortex-file-compressed 1.71 GB 1.74 GB +33.00 MB +1.9%
customer.vortex 10.0 vortex-file-compressed 91.33 MB 93.00 MB +1.67 MB +1.8%
orders.vortex 10.0 vortex-file-compressed 491.43 MB 500.31 MB +8.88 MB +1.8%
lineitem.vortex 10.0 vortex-compact 1.28 GB 1.30 GB +21.26 MB +1.6%
partsupp.vortex 10.0 vortex-compact 203.65 MB 206.13 MB +2.48 MB +1.2%
partsupp.vortex 10.0 vortex-file-compressed 251.87 MB 254.59 MB +2.72 MB +1.1%

Totals:

  • vortex-compact: 1.92 GB → 1.96 GB (+1.9%)
  • vortex-file-compressed: 2.59 GB → 2.63 GB (+1.8%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.1%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+8.5%, low confidence)
Vortex (geomean): hot 1.038x ➖ · cold 0.951x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.993x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 23987819 / 24209545 / -0.9% 41856544 / 44493131 / -5.9% 0.57 / 0.54 / +5.3%
tpcds_q02/datafusion:vortex-file-compressed 46526592 / 45551338 / +2.1% 64160343 / 63567695 / +0.9% 0.73 / 0.72 / +1.2%
tpcds_q03/datafusion:vortex-file-compressed 11139276 / 11854732 / -6.0% 29685138 / 29298469 / +1.3% 0.38 / 0.40 / -7.3%
tpcds_q04/datafusion:vortex-file-compressed 113606162 / 114245680 / -0.6% 141415022 / 140890938 / +0.4% 0.80 / 0.81 / -0.9%
tpcds_q05/datafusion:vortex-file-compressed 60624513 / 60187488 / +0.7% 79362633 / 82383525 / -3.7% 0.76 / 0.73 / +4.6%
tpcds_q06/datafusion:vortex-file-compressed 24475898 / 23721332 / +3.2% 44908928 / 47656367 / -5.8% 0.55 / 0.50 / +9.5%
tpcds_q07/datafusion:vortex-file-compressed 32458778 / 32430537 / +0.1% 53770685 / 56373994 / -4.6% 0.60 / 0.58 / +4.9%
tpcds_q08/datafusion:vortex-file-compressed 25226956 / 25450420 / -0.9% 43398908 / 46814117 / -7.3% 0.58 / 0.54 / +6.9%
tpcds_q09/datafusion:vortex-file-compressed 17264186 / 19217823 / -10.2% 🟢 36244008 / 34826524 / +4.1% 0.48 / 0.55 / -13.7%
tpcds_q10/datafusion:vortex-file-compressed 27292527 / 29692906 / -8.1% 46985818 / 51723362 / -9.2% 0.58 / 0.57 / +1.2%
tpcds_q11/datafusion:vortex-file-compressed 63333423 / 63186827 / +0.2% 87524493 / 87943666 / -0.5% 0.72 / 0.72 / +0.7%
tpcds_q12/datafusion:vortex-file-compressed 16182780 / 16406628 / -1.4% 31424707 / 32625161 / -3.7% 0.51 / 0.50 / +2.4%
tpcds_q13/datafusion:vortex-file-compressed 34963248 / 35495760 / -1.5% 55330021 / 57011671 / -2.9% 0.63 / 0.62 / +1.5%
tpcds_q14/datafusion:vortex-file-compressed 95460224 / 91388534 / +4.5% 122136695 / 119650544 / +2.1% 0.78 / 0.76 / +2.3%
tpcds_q15/datafusion:vortex-file-compressed 23544497 / 23912982 / -1.5% 43666823 / 45317113 / -3.6% 0.54 / 0.53 / +2.2%
tpcds_q16/datafusion:vortex-file-compressed 20474252 / 20787212 / -1.5% 41121807 / 43498455 / -5.5% 0.50 / 0.48 / +4.2%
tpcds_q17/datafusion:vortex-file-compressed 53146645 / 61329098 / -13.3% 🟢 83023530 / 78699433 / +5.5% 0.64 / 0.78 / -17.9%
tpcds_q18/datafusion:vortex-file-compressed 67263224 / 68540143 / -1.9% 91576153 / 94401300 / -3.0% 0.73 / 0.73 / +1.2%
tpcds_q19/datafusion:vortex-file-compressed 17605816 / 18246804 / -3.5% 40161598 / 41306019 / -2.8% 0.44 / 0.44 / -0.8%
tpcds_q20/datafusion:vortex-file-compressed 17714122 / 17511053 / +1.2% 33100303 / 35435793 / -6.6% 0.54 / 0.49 / +8.3%
tpcds_q21/datafusion:vortex-file-compressed 16595570 / 17176112 / -3.4% 39140369 / 40849805 / -4.2% 0.42 / 0.42 / +0.8%
tpcds_q22/datafusion:vortex-file-compressed 49041684 / 49718227 / -1.4% 70229990 / 72443522 / -3.1% 0.70 / 0.69 / +1.7%
tpcds_q23/datafusion:vortex-file-compressed 73247992 / 73297570 / -0.1% 97472209 / 99365227 / -1.9% 0.75 / 0.74 / +1.9%
tpcds_q24/datafusion:vortex-file-compressed 70862943 / 70991760 / -0.2% 96672958 / 95356119 / +1.4% 0.73 / 0.74 / -1.5%
tpcds_q25/datafusion:vortex-file-compressed 54526104 / 52428004 / +4.0% 76018626 / 85672153 / -11.3% 🟢 0.72 / 0.61 / +17.2%
tpcds_q26/datafusion:vortex-file-compressed 29800340 / 30193362 / -1.3% 47740314 / 51478030 / -7.3% 0.62 / 0.59 / +6.4%
tpcds_q27/datafusion:vortex-file-compressed 66219944 / 66013373 / +0.3% 86101158 / 88686756 / -2.9% 0.77 / 0.74 / +3.3%
tpcds_q28/datafusion:vortex-file-compressed 18225668 / 18956134 / -3.9% 36598344 / 36939006 / -0.9% 0.50 / 0.51 / -3.0%
tpcds_q29/datafusion:vortex-file-compressed 59552011 / 53694536 / +10.9% 🔴 82074821 / 74675106 / +9.9% 0.73 / 0.72 / +0.9%
tpcds_q30/datafusion:vortex-file-compressed 27762348 / 27305402 / +1.7% 45016317 / 45179172 / -0.4% 0.62 / 0.60 / +2.0%
tpcds_q31/datafusion:vortex-file-compressed 61089072 / 65145012 / -6.2% 82488858 / 94955879 / -13.1% 🟢 0.74 / 0.69 / +7.9%
tpcds_q32/datafusion:vortex-file-compressed 14089778 / 13570556 / +3.8% 31796089 / 30433477 / +4.5% 0.44 / 0.45 / -0.6%
tpcds_q33/datafusion:vortex-file-compressed 26956689 / 26739354 / +0.8% 50718059 / 49963685 / +1.5% 0.53 / 0.54 / -0.7%
tpcds_q34/datafusion:vortex-file-compressed 18193610 / 18576946 / -2.1% 36203403 / 38995162 / -7.2% 0.50 / 0.48 / +5.5%
tpcds_q35/datafusion:vortex-file-compressed 33985204 / 35844588 / -5.2% 55089590 / 59565058 / -7.5% 0.62 / 0.60 / +2.5%
tpcds_q36/datafusion:vortex-file-compressed 49869039 / 48371832 / +3.1% 71827262 / 75743852 / -5.2% 0.69 / 0.64 / +8.7%
tpcds_q37/datafusion:vortex-file-compressed 13334064 / 13173512 / +1.2% 33776120 / 38281435 / -11.8% 🟢 0.39 / 0.34 / +14.7%
tpcds_q38/datafusion:vortex-file-compressed 28333248 / 30644097 / -7.5% 47702055 / 53748926 / -11.3% 🟢 0.59 / 0.57 / +4.2%
tpcds_q39/datafusion:vortex-file-compressed 65032383 / 64887354 / +0.2% 87856057 / 91586869 / -4.1% 0.74 / 0.71 / +4.5%
tpcds_q40/datafusion:vortex-file-compressed 25156184 / 25814617 / -2.6% 45593556 / 45950344 / -0.8% 0.55 / 0.56 / -1.8%
tpcds_q41/datafusion:vortex-file-compressed 16695415 / 16598124 / +0.6% 30796288 / 31129827 / -1.1% 0.54 / 0.53 / +1.7%
tpcds_q42/datafusion:vortex-file-compressed 10849814 / 11374309 / -4.6% 27581766 / 26926960 / +2.4% 0.39 / 0.42 / -6.9%
tpcds_q43/datafusion:vortex-file-compressed 12840644 / 13383700 / -4.1% 28798923 / 34403070 / -16.3% 🟢 0.45 / 0.39 / +14.6%
tpcds_q44/datafusion:vortex-file-compressed 26464246 / 26989066 / -1.9% 49589800 / 50725769 / -2.2% 0.53 / 0.53 / +0.3%
tpcds_q45/datafusion:vortex-file-compressed 27077462 / 27962898 / -3.2% 45627074 / 48784651 / -6.5% 0.59 / 0.57 / +3.5%
tpcds_q46/datafusion:vortex-file-compressed 24006180 / 24775440 / -3.1% 45135602 / 48277343 / -6.5% 0.53 / 0.51 / +3.6%
tpcds_q47/datafusion:vortex-file-compressed 78016170 / 78525543 / -0.6% 102963994 / 107199684 / -4.0% 0.76 / 0.73 / +3.4%
tpcds_q48/datafusion:vortex-file-compressed 31810646 / 31590750 / +0.7% 52936953 / 54264055 / -2.4% 0.60 / 0.58 / +3.2%
tpcds_q49/datafusion:vortex-file-compressed 61086408 / 59714518 / +2.3% 82467125 / 85744971 / -3.8% 0.74 / 0.70 / +6.4%
tpcds_q50/datafusion:vortex-file-compressed 35648046 / 34141712 / +4.4% 56023187 / 55681588 / +0.6% 0.64 / 0.61 / +3.8%
tpcds_q51/datafusion:vortex-file-compressed 60672705 / 60959043 / -0.5% 84578094 / 85430330 / -1.0% 0.72 / 0.71 / +0.5%
tpcds_q52/datafusion:vortex-file-compressed 11255116 / 11723278 / -4.0% 28513680 / 27973863 / +1.9% 0.39 / 0.42 / -5.8%
tpcds_q53/datafusion:vortex-file-compressed 17770883 / 18812716 / -5.5% 37867742 / 38972024 / -2.8% 0.47 / 0.48 / -2.8%
tpcds_q54/datafusion:vortex-file-compressed 34594400 / 34011909 / +1.7% 59318152 / 59861406 / -0.9% 0.58 / 0.57 / +2.6%
tpcds_q55/datafusion:vortex-file-compressed 10821283 / 11413189 / -5.2% 27137647 / 26945480 / +0.7% 0.40 / 0.42 / -5.9%
tpcds_q56/datafusion:vortex-file-compressed 26941673 / 26686058 / +1.0% 47870534 / 50026308 / -4.3% 0.56 / 0.53 / +5.5%
tpcds_q57/datafusion:vortex-file-compressed 71963350 / 73812887 / -2.5% 91588016 / 98848490 / -7.3% 0.79 / 0.75 / +5.2%
tpcds_q58/datafusion:vortex-file-compressed 41053250 / 40609592 / +1.1% 64762750 / 67175031 / -3.6% 0.63 / 0.60 / +4.9%
tpcds_q59/datafusion:vortex-file-compressed 32551547 / 32203426 / +1.1% 53742653 / 52800744 / +1.8% 0.61 / 0.61 / -0.7%
tpcds_q60/datafusion:vortex-file-compressed 26417304 / 26507256 / -0.3% 48555897 / 49928489 / -2.7% 0.54 / 0.53 / +2.5%
tpcds_q61/datafusion:vortex-file-compressed 25193260 / 24195840 / +4.1% 48174249 / 50119451 / -3.9% 0.52 / 0.48 / +8.3%
tpcds_q62/datafusion:vortex-file-compressed 17108848 / 17229598 / -0.7% 33665146 / 36716501 / -8.3% 0.51 / 0.47 / +8.3%
tpcds_q63/datafusion:vortex-file-compressed 18146519 / 18534167 / -2.1% 37617329 / 38245302 / -1.6% 0.48 / 0.48 / -0.5%
tpcds_q64/datafusion:vortex-file-compressed 341725390 / 329339718 / +3.8% 368265417 / 356767521 / +3.2% 0.93 / 0.92 / +0.5%
tpcds_q65/datafusion:vortex-file-compressed 75313474 / 75783855 / -0.6% 93418913 / 97247728 / -3.9% 0.81 / 0.78 / +3.5%
tpcds_q66/datafusion:vortex-file-compressed 52893860 / 52776656 / +0.2% 73241847 / 76379668 / -4.1% 0.72 / 0.69 / +4.5%
tpcds_q67/datafusion:vortex-file-compressed 55550874 / 56506143 / -1.7% 82363942 / 84887185 / -3.0% 0.67 / 0.67 / +1.3%
tpcds_q68/datafusion:vortex-file-compressed 23838170 / 24321702 / -2.0% 46608827 / 48195692 / -3.3% 0.51 / 0.50 / +1.3%
tpcds_q69/datafusion:vortex-file-compressed 27387022 / 28307381 / -3.3% 48238467 / 50842483 / -5.1% 0.57 / 0.56 / +2.0%
tpcds_q70/datafusion:vortex-file-compressed 71130877 / 71914044 / -1.1% 90220257 / 96193633 / -6.2% 0.79 / 0.75 / +5.5%
tpcds_q71/datafusion:vortex-file-compressed 18831294 / 18853803 / -0.1% 38711741 / 41037157 / -5.7% 0.49 / 0.46 / +5.9%
tpcds_q72/datafusion:vortex-file-compressed 458775506 / 463929504 / -1.1% 498179849 / 507997879 / -1.9% 0.92 / 0.91 / +0.8%
tpcds_q73/datafusion:vortex-file-compressed 16877929 / 17497196 / -3.5% 36466253 / 38393239 / -5.0% 0.46 / 0.46 / +1.6%
tpcds_q74/datafusion:vortex-file-compressed 47211590 / 45741640 / +3.2% 70086712 / 70925213 / -1.2% 0.67 / 0.64 / +4.4%
tpcds_q75/datafusion:vortex-file-compressed 133614625 / 131527228 / +1.6% 156598349 / 163844236 / -4.4% 0.85 / 0.80 / +6.3%
tpcds_q76/datafusion:vortex-file-compressed 50773972 / 43257954 / +17.4% 🔴 67648229 / 66453008 / +1.8% 0.75 / 0.65 / +15.3%
tpcds_q77/datafusion:vortex-file-compressed 37286866 / 34360453 / +8.5% 57949854 / 59787018 / -3.1% 0.64 / 0.57 / +12.0%
tpcds_q78/datafusion:vortex-file-compressed 79475376 / 79618750 / -0.2% 109114925 / 110640920 / -1.4% 0.73 / 0.72 / +1.2%
tpcds_q79/datafusion:vortex-file-compressed 20685132 / 22162926 / -6.7% 39420746 / 42678830 / -7.6% 0.52 / 0.52 / +1.0%
tpcds_q80/datafusion:vortex-file-compressed 78327110 / 77767990 / +0.7% 105384783 / 112302035 / -6.2% 0.74 / 0.69 / +7.3%
tpcds_q81/datafusion:vortex-file-compressed 28198946 / 28133097 / +0.2% 45975007 / 45945146 / +0.1% 0.61 / 0.61 / +0.2%
tpcds_q82/datafusion:vortex-file-compressed 14131736 / 13209876 / +7.0% 36951344 / 36385630 / +1.6% 0.38 / 0.36 / +5.3%
tpcds_q83/datafusion:vortex-file-compressed 37496176 / 36369596 / +3.1% 58581606 / 57787929 / +1.4% 0.64 / 0.63 / +1.7%
tpcds_q84/datafusion:vortex-file-compressed 12406321 / 12030092 / +3.1% 28094677 / 29508149 / -4.8% 0.44 / 0.41 / +8.3%
tpcds_q85/datafusion:vortex-file-compressed 60421070 / 60371630 / +0.1% 86918508 / 84495024 / +2.9% 0.70 / 0.71 / -2.7%
tpcds_q86/datafusion:vortex-file-compressed 15937769 / 16422308 / -3.0% 30505134 / 33121460 / -7.9% 0.52 / 0.50 / +5.4%
tpcds_q87/datafusion:vortex-file-compressed 28093472 / 30095466 / -6.7% 46846595 / 53002818 / -11.6% 🟢 0.60 / 0.57 / +5.6%
tpcds_q88/datafusion:vortex-file-compressed 34749634 / 34474280 / +0.8% 61053818 / 60817379 / +0.4% 0.57 / 0.57 / +0.4%
tpcds_q89/datafusion:vortex-file-compressed 20707545 / 20846144 / -0.7% 39568703 / 42042067 / -5.9% 0.52 / 0.50 / +5.5%
tpcds_q90/datafusion:vortex-file-compressed 10491236 / 10579896 / -0.8% 26767155 / 27009219 / -0.9% 0.39 / 0.39 / +0.1%
tpcds_q91/datafusion:vortex-file-compressed 16861768 / 16615224 / +1.5% 36413188 / 38358818 / -5.1% 0.46 / 0.43 / +6.9%
tpcds_q92/datafusion:vortex-file-compressed 14074781 / 13948810 / +0.9% 31701745 / 31855868 / -0.5% 0.44 / 0.44 / +1.4%
tpcds_q93/datafusion:vortex-file-compressed 23996657 / 23838968 / +0.7% 44010191 / 46049852 / -4.4% 0.55 / 0.52 / +5.3%
tpcds_q94/datafusion:vortex-file-compressed 19597254 / 20316402 / -3.5% 38343879 / 40550707 / -5.4% 0.51 / 0.50 / +2.0%
tpcds_q95/datafusion:vortex-file-compressed 44908594 / 46654052 / -3.7% 65828997 / 69093550 / -4.7% 0.68 / 0.68 / +1.0%
tpcds_q96/datafusion:vortex-file-compressed 9586854 / 9663888 / -0.8% 25703183 / 25818562 / -0.4% 0.37 / 0.37 / -0.4%
tpcds_q97/datafusion:vortex-file-compressed 21442699 / 21306582 / +0.6% 43133873 / 43759469 / -1.4% 0.50 / 0.49 / +2.1%
tpcds_q98/datafusion:vortex-file-compressed 16705054 / 17106440 / -2.3% 35832865 / 37287051 / -3.9% 0.47 / 0.46 / +1.6%
tpcds_q99/datafusion:vortex-file-compressed 19622642 / 19698649 / -0.4% 35950301 / 38072133 / -5.6% 0.55 / 0.52 / +5.5%
datafusion / vortex-compact / ns (0.992x ➖, 4↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 26006054 / 25847061 / +0.6% 43342908 / 45951592 / -5.7% 0.60 / 0.56 / +6.7%
tpcds_q02/datafusion:vortex-compact 47866157 / 48421820 / -1.1% 66333099 / 68168703 / -2.7% 0.72 / 0.71 / +1.6%
tpcds_q03/datafusion:vortex-compact 13220054 / 12806770 / +3.2% 30227056 / 32635054 / -7.4% 0.44 / 0.39 / +11.5%
tpcds_q04/datafusion:vortex-compact 123222384 / 121451010 / +1.5% 146814368 / 158523435 / -7.4% 0.84 / 0.77 / +9.6%
tpcds_q05/datafusion:vortex-compact 61527684 / 62462968 / -1.5% 81248571 / 83574189 / -2.8% 0.76 / 0.75 / +1.3%
tpcds_q06/datafusion:vortex-compact 24915356 / 25739960 / -3.2% 47783573 / 47893348 / -0.2% 0.52 / 0.54 / -3.0%
tpcds_q07/datafusion:vortex-compact 33934782 / 34260386 / -1.0% 57375191 / 58743985 / -2.3% 0.59 / 0.58 / +1.4%
tpcds_q08/datafusion:vortex-compact 30580094 / 29919128 / +2.2% 51775082 / 49328743 / +5.0% 0.59 / 0.61 / -2.6%
tpcds_q09/datafusion:vortex-compact 21585158 / 21957310 / -1.7% 40501275 / 40180516 / +0.8% 0.53 / 0.55 / -2.5%
tpcds_q10/datafusion:vortex-compact 37208978 / 37610208 / -1.1% 61980492 / 60153007 / +3.0% 0.60 / 0.63 / -4.0%
tpcds_q11/datafusion:vortex-compact 69035229 / 68607668 / +0.6% 88300700 / 95659428 / -7.7% 0.78 / 0.72 / +9.0%
tpcds_q12/datafusion:vortex-compact 16949119 / 20864904 / -18.8% 🟢 32924331 / 39704966 / -17.1% 🟢 0.51 / 0.53 / -2.0%
tpcds_q13/datafusion:vortex-compact 61329202 / 60717974 / +1.0% 78599623 / 90912276 / -13.5% 🟢 0.78 / 0.67 / +16.8%
tpcds_q14/datafusion:vortex-compact 93323058 / 95387368 / -2.2% 125826327 / 123315557 / +2.0% 0.74 / 0.77 / -4.1%
tpcds_q15/datafusion:vortex-compact 26678304 / 28136835 / -5.2% 46938162 / 47356163 / -0.9% 0.57 / 0.59 / -4.3%
tpcds_q16/datafusion:vortex-compact 23802818 / 23885446 / -0.3% 43878066 / 45048605 / -2.6% 0.54 / 0.53 / +2.3%
tpcds_q17/datafusion:vortex-compact 67297815 / 60915038 / +10.5% 🔴 81252638 / 82370648 / -1.4% 0.83 / 0.74 / +12.0%
tpcds_q18/datafusion:vortex-compact 69862040 / 68886582 / +1.4% 92683355 / 96042052 / -3.5% 0.75 / 0.72 / +5.1%
tpcds_q19/datafusion:vortex-compact 21827551 / 22631540 / -3.6% 43188694 / 41672400 / +3.6% 0.51 / 0.54 / -6.9%
tpcds_q20/datafusion:vortex-compact 18103472 / 22061768 / -17.9% 🟢 34357413 / 41495654 / -17.2% 🟢 0.53 / 0.53 / -0.9%
tpcds_q21/datafusion:vortex-compact 17155944 / 18113812 / -5.3% 39399649 / 43138800 / -8.7% 0.44 / 0.42 / +3.7%
tpcds_q22/datafusion:vortex-compact 49513050 / 49822808 / -0.6% 71059677 / 73790878 / -3.7% 0.70 / 0.68 / +3.2%
tpcds_q23/datafusion:vortex-compact 77778239 / 77601330 / +0.2% 101410184 / 102979822 / -1.5% 0.77 / 0.75 / +1.8%
tpcds_q24/datafusion:vortex-compact 77612798 / 77711650 / -0.1% 97967534 / 102370756 / -4.3% 0.79 / 0.76 / +4.4%
tpcds_q25/datafusion:vortex-compact 63654856 / 55804121 / +14.1% 🔴 79638575 / 81635113 / -2.4% 0.80 / 0.68 / +16.9%
tpcds_q26/datafusion:vortex-compact 32385117 / 33394533 / -3.0% 51794060 / 51443620 / +0.7% 0.63 / 0.65 / -3.7%
tpcds_q27/datafusion:vortex-compact 67494466 / 63979262 / +5.5% 86934033 / 93149357 / -6.7% 0.78 / 0.69 / +13.0%
tpcds_q28/datafusion:vortex-compact 28086274 / 27687149 / +1.4% 51328410 / 50221109 / +2.2% 0.55 / 0.55 / -0.7%
tpcds_q29/datafusion:vortex-compact 64475488 / 62926912 / +2.5% 90118724 / 86104283 / +4.7% 0.72 / 0.73 / -2.1%
tpcds_q30/datafusion:vortex-compact 30161599 / 30224040 / -0.2% 47731429 / 49644050 / -3.9% 0.63 / 0.61 / +3.8%
tpcds_q31/datafusion:vortex-compact 77834837 / 79249961 / -1.8% 101399574 / 104171198 / -2.7% 0.77 / 0.76 / +0.9%
tpcds_q32/datafusion:vortex-compact 15319149 / 16204287 / -5.5% 33248052 / 34719519 / -4.2% 0.46 / 0.47 / -1.3%
tpcds_q33/datafusion:vortex-compact 28984695 / 29168044 / -0.6% 53118673 / 49327104 / +7.7% 0.55 / 0.59 / -7.7%
tpcds_q34/datafusion:vortex-compact 21698266 / 23084256 / -6.0% 39964046 / 44410192 / -10.0% 🟢 0.54 / 0.52 / +4.5%
tpcds_q35/datafusion:vortex-compact 41869700 / 42277139 / -1.0% 65816009 / 67001072 / -1.8% 0.64 / 0.63 / +0.8%
tpcds_q36/datafusion:vortex-compact 52885988 / 51554938 / +2.6% 76976774 / 77482113 / -0.7% 0.69 / 0.67 / +3.3%
tpcds_q37/datafusion:vortex-compact 15849822 / 16002820 / -1.0% 39062257 / 39192532 / -0.3% 0.41 / 0.41 / -0.6%
tpcds_q38/datafusion:vortex-compact 34575719 / 34071045 / +1.5% 54673405 / 58758240 / -7.0% 0.63 / 0.58 / +9.1%
tpcds_q39/datafusion:vortex-compact 66335948 / 65477464 / +1.3% 88627493 / 88368383 / +0.3% 0.75 / 0.74 / +1.0%
tpcds_q40/datafusion:vortex-compact 27392434 / 27988866 / -2.1% 46113171 / 52180527 / -11.6% 🟢 0.59 / 0.54 / +10.7%
tpcds_q41/datafusion:vortex-compact 17499343 / 18914344 / -7.5% 31345504 / 33708858 / -7.0% 0.56 / 0.56 / -0.5%
tpcds_q42/datafusion:vortex-compact 12775365 / 13037724 / -2.0% 29210912 / 32506748 / -10.1% 🟢 0.44 / 0.40 / +9.0%
tpcds_q43/datafusion:vortex-compact 15818344 / 16211266 / -2.4% 34022925 / 34729553 / -2.0% 0.46 / 0.47 / -0.4%
tpcds_q44/datafusion:vortex-compact 33249600 / 31102529 / +6.9% 56310438 / 54345355 / +3.6% 0.59 / 0.57 / +3.2%
tpcds_q45/datafusion:vortex-compact 30427320 / 31141502 / -2.3% 49767723 / 50852863 / -2.1% 0.61 / 0.61 / -0.2%
tpcds_q46/datafusion:vortex-compact 28154188 / 27940356 / +0.8% 49818180 / 50644634 / -1.6% 0.57 / 0.55 / +2.4%
tpcds_q47/datafusion:vortex-compact 86390553 / 87527522 / -1.3% 114165169 / 117130924 / -2.5% 0.76 / 0.75 / +1.3%
tpcds_q48/datafusion:vortex-compact 52047009 / 51484601 / +1.1% 68443597 / 69676038 / -1.8% 0.76 / 0.74 / +2.9%
tpcds_q49/datafusion:vortex-compact 64431312 / 67748596 / -4.9% 88019791 / 90226182 / -2.4% 0.73 / 0.75 / -2.5%
tpcds_q50/datafusion:vortex-compact 36716556 / 37062606 / -0.9% 56484194 / 57858592 / -2.4% 0.65 / 0.64 / +1.5%
tpcds_q51/datafusion:vortex-compact 62797126 / 62470158 / +0.5% 84869537 / 84867660 / +0.0% 0.74 / 0.74 / +0.5%
tpcds_q52/datafusion:vortex-compact 13488660 / 12875685 / +4.8% 29105973 / 32163376 / -9.5% 0.46 / 0.40 / +15.8%
tpcds_q53/datafusion:vortex-compact 21777832 / 21809695 / -0.1% 41249081 / 43087061 / -4.3% 0.53 / 0.51 / +4.3%
tpcds_q54/datafusion:vortex-compact 37476498 / 39185623 / -4.4% 60868427 / 64775750 / -6.0% 0.62 / 0.60 / +1.8%
tpcds_q55/datafusion:vortex-compact 12542254 / 12766572 / -1.8% 29279860 / 31359850 / -6.6% 0.43 / 0.41 / +5.2%
tpcds_q56/datafusion:vortex-compact 29140333 / 29168234 / -0.1% 49734097 / 51981430 / -4.3% 0.59 / 0.56 / +4.4%
tpcds_q57/datafusion:vortex-compact 77878111 / 81188812 / -4.1% 102740086 / 106157370 / -3.2% 0.76 / 0.76 / -0.9%
tpcds_q58/datafusion:vortex-compact 43825288 / 47539902 / -7.8% 67995312 / 72339722 / -6.0% 0.64 / 0.66 / -1.9%
tpcds_q59/datafusion:vortex-compact 38507790 / 39191598 / -1.7% 57800445 / 59006718 / -2.0% 0.67 / 0.66 / +0.3%
tpcds_q60/datafusion:vortex-compact 28522610 / 28082206 / +1.6% 51729232 / 52203366 / -0.9% 0.55 / 0.54 / +2.5%
tpcds_q61/datafusion:vortex-compact 28120870 / 27235683 / +3.3% 52153088 / 48994220 / +6.4% 0.54 / 0.56 / -3.0%
tpcds_q62/datafusion:vortex-compact 17678568 / 18142532 / -2.6% 36302980 / 36388396 / -0.2% 0.49 / 0.50 / -2.3%
tpcds_q63/datafusion:vortex-compact 21715086 / 21590052 / +0.6% 40632820 / 42839430 / -5.2% 0.53 / 0.50 / +6.0%
tpcds_q64/datafusion:vortex-compact 449051774 / 451718034 / -0.6% 467405390 / 457109762 / +2.3% 0.96 / 0.99 / -2.8%
tpcds_q65/datafusion:vortex-compact 80300776 / 81278832 / -1.2% 98239750 / 101785805 / -3.5% 0.82 / 0.80 / +2.4%
tpcds_q66/datafusion:vortex-compact 54569786 / 55091460 / -0.9% 78880509 / 78774548 / +0.1% 0.69 / 0.70 / -1.1%
tpcds_q67/datafusion:vortex-compact 58543678 / 59584584 / -1.7% 86826220 / 90455780 / -4.0% 0.67 / 0.66 / +2.4%
tpcds_q68/datafusion:vortex-compact 32354770 / 28593706 / +13.2% 🔴 54658834 / 50415641 / +8.4% 0.59 / 0.57 / +4.4%
tpcds_q69/datafusion:vortex-compact 36554738 / 36735275 / -0.5% 58351708 / 59093815 / -1.3% 0.63 / 0.62 / +0.8%
tpcds_q70/datafusion:vortex-compact 73686612 / 75893215 / -2.9% 95312888 / 97157390 / -1.9% 0.77 / 0.78 / -1.0%
tpcds_q71/datafusion:vortex-compact 20842608 / 20365184 / +2.3% 41187679 / 43849042 / -6.1% 0.51 / 0.46 / +9.0%
tpcds_q72/datafusion:vortex-compact 467506057 / 454555715 / +2.8% 476650125 / 510426472 / -6.6% 0.98 / 0.89 / +10.1%
tpcds_q73/datafusion:vortex-compact 20213974 / 19731228 / +2.4% 43604829 / 40738140 / +7.0% 0.46 / 0.48 / -4.3%
tpcds_q74/datafusion:vortex-compact 49510890 / 51321584 / -3.5% 76302710 / 73366509 / +4.0% 0.65 / 0.70 / -7.2%
tpcds_q75/datafusion:vortex-compact 136702028 / 137379045 / -0.5% 162533522 / 171366292 / -5.2% 0.84 / 0.80 / +4.9%
tpcds_q76/datafusion:vortex-compact 42183161 / 42837152 / -1.5% 63024486 / 60981994 / +3.3% 0.67 / 0.70 / -4.7%
tpcds_q77/datafusion:vortex-compact 38991328 / 37619168 / +3.6% 60008322 / 64733096 / -7.3% 0.65 / 0.58 / +11.8%
tpcds_q78/datafusion:vortex-compact 86746533 / 86303460 / +0.5% 115268654 / 117020546 / -1.5% 0.75 / 0.74 / +2.0%
tpcds_q79/datafusion:vortex-compact 24775908 / 30013532 / -17.5% 🟢 51090202 / 44998728 / +13.5% 🔴 0.48 / 0.67 / -27.3%
tpcds_q80/datafusion:vortex-compact 79862295 / 79199438 / +0.8% 108950605 / 109584373 / -0.6% 0.73 / 0.72 / +1.4%
tpcds_q81/datafusion:vortex-compact 29781438 / 29885982 / -0.3% 46252171 / 48592274 / -4.8% 0.64 / 0.62 / +4.7%
tpcds_q82/datafusion:vortex-compact 16042798 / 16172809 / -0.8% 39386518 / 39391619 / -0.0% 0.41 / 0.41 / -0.8%
tpcds_q83/datafusion:vortex-compact 37101596 / 37181148 / -0.2% 57575778 / 59748235 / -3.6% 0.64 / 0.62 / +3.6%
tpcds_q84/datafusion:vortex-compact 13003838 / 13756324 / -5.5% 28423536 / 30097194 / -5.6% 0.46 / 0.46 / +0.1%
tpcds_q85/datafusion:vortex-compact 111864748 / 108574433 / +3.0% 137385993 / 134707421 / +2.0% 0.81 / 0.81 / +1.0%
tpcds_q86/datafusion:vortex-compact 16730050 / 17000860 / -1.6% 34094454 / 35659312 / -4.4% 0.49 / 0.48 / +2.9%
tpcds_q87/datafusion:vortex-compact 33351003 / 32307966 / +3.2% 54210342 / 57969364 / -6.5% 0.62 / 0.56 / +10.4%
tpcds_q88/datafusion:vortex-compact 41889576 / 41658815 / +0.6% 72805233 / 70474018 / +3.3% 0.58 / 0.59 / -2.7%
tpcds_q89/datafusion:vortex-compact 24581228 / 25374506 / -3.1% 43664852 / 46846550 / -6.8% 0.56 / 0.54 / +3.9%
tpcds_q90/datafusion:vortex-compact 11542510 / 11826490 / -2.4% 27561398 / 28119874 / -2.0% 0.42 / 0.42 / -0.4%
tpcds_q91/datafusion:vortex-compact 26418746 / 27511352 / -4.0% 47258820 / 47409440 / -0.3% 0.56 / 0.58 / -3.7%
tpcds_q92/datafusion:vortex-compact 15758054 / 15874000 / -0.7% 31081808 / 33948192 / -8.4% 0.51 / 0.47 / +8.4%
tpcds_q93/datafusion:vortex-compact 26173160 / 24753238 / +5.7% 43908150 / 47850496 / -8.2% 0.60 / 0.52 / +15.2%
tpcds_q94/datafusion:vortex-compact 21781761 / 22329019 / -2.5% 43199515 / 42782198 / +1.0% 0.50 / 0.52 / -3.4%
tpcds_q95/datafusion:vortex-compact 49577792 / 50259422 / -1.4% 72221801 / 73707461 / -2.0% 0.69 / 0.68 / +0.7%
tpcds_q96/datafusion:vortex-compact 12859742 / 10206070 / +26.0% 🔴 27483359 / 26399703 / +4.1% 0.47 / 0.39 / +21.0%
tpcds_q97/datafusion:vortex-compact 24048522 / 24293034 / -1.0% 44426997 / 45845556 / -3.1% 0.54 / 0.53 / +2.2%
tpcds_q98/datafusion:vortex-compact 18488689 / 22074703 / -16.2% 🟢 37725598 / 43047960 / -12.4% 🟢 0.49 / 0.51 / -4.4%
tpcds_q99/datafusion:vortex-compact 21010050 / 20892357 / +0.6% 40030125 / 40345069 / -0.8% 0.52 / 0.52 / +1.4%
datafusion / parquet / ns (0.994x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 28711798 / 29846593 / -3.8% 48527457 / 46020232 / +5.4% 0.59 / 0.65 / -8.8%
tpcds_q02/datafusion:parquet 45257626 / 45625254 / -0.8% 61779068 / 62295826 / -0.8% 0.73 / 0.73 / +0.0%
tpcds_q03/datafusion:parquet 18812359 / 19273647 / -2.4% 34013828 / 32896864 / +3.4% 0.55 / 0.59 / -5.6%
tpcds_q04/datafusion:parquet 194683489 / 196168412 / -0.8% 224571991 / 226993878 / -1.1% 0.87 / 0.86 / +0.3%
tpcds_q05/datafusion:parquet 70934070 / 71586808 / -0.9% 95077827 / 91903016 / +3.5% 0.75 / 0.78 / -4.2%
tpcds_q06/datafusion:parquet 34581374 / 35747908 / -3.3% 51636703 / 56247731 / -8.2% 0.67 / 0.64 / +5.4%
tpcds_q07/datafusion:parquet 45683769 / 46691948 / -2.2% 66445382 / 72983013 / -9.0% 0.69 / 0.64 / +7.5%
tpcds_q08/datafusion:parquet 39041272 / 39770866 / -1.8% 53155504 / 56826924 / -6.5% 0.73 / 0.70 / +4.9%
tpcds_q09/datafusion:parquet 29663622 / 33125552 / -10.5% 🟢 43561981 / 42918511 / +1.5% 0.68 / 0.77 / -11.8%
tpcds_q10/datafusion:parquet 50335992 / 50233250 / +0.2% 67746073 / 62691370 / +8.1% 0.74 / 0.80 / -7.3%
tpcds_q11/datafusion:parquet 93175304 / 94782382 / -1.7% 115530431 / 118287865 / -2.3% 0.81 / 0.80 / +0.7%
tpcds_q12/datafusion:parquet 24460842 / 24672304 / -0.9% 36194428 / 38280172 / -5.4% 0.68 / 0.64 / +4.9%
tpcds_q13/datafusion:parquet 44749308 / 45533153 / -1.7% 67114532 / 69616323 / -3.6% 0.67 / 0.65 / +1.9%
tpcds_q14/datafusion:parquet 136762168 / 137902304 / -0.8% 156628367 / 156174025 / +0.3% 0.87 / 0.88 / -1.1%
tpcds_q15/datafusion:parquet 30501062 / 31884794 / -4.3% 50448559 / 50736861 / -0.6% 0.60 / 0.63 / -3.8%
tpcds_q16/datafusion:parquet 36413356 / 36788681 / -1.0% 56502628 / 57420057 / -1.6% 0.64 / 0.64 / +0.6%
tpcds_q17/datafusion:parquet 74728648 / 75639592 / -1.2% 101169715 / 107233952 / -5.7% 0.74 / 0.71 / +4.7%
tpcds_q18/datafusion:parquet 57846179 / 59596884 / -2.9% 81336818 / 79095017 / +2.8% 0.71 / 0.75 / -5.6%
tpcds_q19/datafusion:parquet 32368392 / 32959238 / -1.8% 50370386 / 49188629 / +2.4% 0.64 / 0.67 / -4.1%
tpcds_q20/datafusion:parquet 25211768 / 25324751 / -0.4% 37610582 / 39923016 / -5.8% 0.67 / 0.63 / +5.7%
tpcds_q21/datafusion:parquet 20466988 / 20383787 / +0.4% 32350496 / 35287627 / -8.3% 0.63 / 0.58 / +9.5%
tpcds_q22/datafusion:parquet 77374926 / 77616322 / -0.3% 91863092 / 93142133 / -1.4% 0.84 / 0.83 / +1.1%
tpcds_q23/datafusion:parquet 113879320 / 116990994 / -2.7% 132895208 / 138080407 / -3.8% 0.86 / 0.85 / +1.1%
tpcds_q24/datafusion:parquet 89872936 / 93396004 / -3.8% 116425274 / 120393377 / -3.3% 0.77 / 0.78 / -0.5%
tpcds_q25/datafusion:parquet 74674784 / 75687110 / -1.3% 100030892 / 106267475 / -5.9% 0.75 / 0.71 / +4.8%
tpcds_q26/datafusion:parquet 42600188 / 42770909 / -0.4% 60882968 / 60807504 / +0.1% 0.70 / 0.70 / -0.5%
tpcds_q27/datafusion:parquet 79891629 / 78338060 / +2.0% 105476909 / 108675046 / -2.9% 0.76 / 0.72 / +5.1%
tpcds_q28/datafusion:parquet 26913816 / 26904520 / +0.0% 44913070 / 46882587 / -4.2% 0.60 / 0.57 / +4.4%
tpcds_q29/datafusion:parquet 75143426 / 76745932 / -2.1% 101368785 / 106123849 / -4.5% 0.74 / 0.72 / +2.5%
tpcds_q30/datafusion:parquet 46409882 / 46043924 / +0.8% 65886414 / 68730656 / -4.1% 0.70 / 0.67 / +5.1%
tpcds_q31/datafusion:parquet 91630820 / 89855576 / +2.0% 110907311 / 109673120 / +1.1% 0.83 / 0.82 / +0.8%
tpcds_q32/datafusion:parquet 25648656 / 25888316 / -0.9% 42340470 / 42014572 / +0.8% 0.61 / 0.62 / -1.7%
tpcds_q33/datafusion:parquet 39162545 / 40284584 / -2.8% 54437085 / 57926783 / -6.0% 0.72 / 0.70 / +3.4%
tpcds_q34/datafusion:parquet 23614686 / 23847806 / -1.0% 39059476 / 39526141 / -1.2% 0.60 / 0.60 / +0.2%
tpcds_q35/datafusion:parquet 54339065 / 54618561 / -0.5% 71296972 / 72795686 / -2.1% 0.76 / 0.75 / +1.6%
tpcds_q36/datafusion:parquet 50900292 / 50905620 / -0.0% 77262516 / 74377829 / +3.9% 0.66 / 0.68 / -3.7%
tpcds_q37/datafusion:parquet 26295952 / 26076095 / +0.8% 40681273 / 42414528 / -4.1% 0.65 / 0.61 / +5.1%
tpcds_q38/datafusion:parquet 44988670 / 44779390 / +0.5% 63080734 / 63406614 / -0.5% 0.71 / 0.71 / +1.0%
tpcds_q39/datafusion:parquet 72121694 / 71815856 / +0.4% 90960938 / 93681914 / -2.9% 0.79 / 0.77 / +3.4%
tpcds_q40/datafusion:parquet 28065328 / 29539680 / -5.0% 49529592 / 50962939 / -2.8% 0.57 / 0.58 / -2.2%
tpcds_q41/datafusion:parquet 20413256 / 20009051 / +2.0% 33485193 / 34955364 / -4.2% 0.61 / 0.57 / +6.5%
tpcds_q42/datafusion:parquet 18244068 / 17826889 / +2.3% 33608824 / 31389641 / +7.1% 0.54 / 0.57 / -4.4%
tpcds_q43/datafusion:parquet 19855640 / 19542640 / +1.6% 34080265 / 34531394 / -1.3% 0.58 / 0.57 / +2.9%
tpcds_q44/datafusion:parquet 33661428 / 32412757 / +3.9% 51399459 / 53088869 / -3.2% 0.65 / 0.61 / +7.3%
tpcds_q45/datafusion:parquet 38751442 / 38250872 / +1.3% 53084061 / 56295125 / -5.7% 0.73 / 0.68 / +7.4%
tpcds_q46/datafusion:parquet 29167704 / 29909678 / -2.5% 51133082 / 52441427 / -2.5% 0.57 / 0.57 / +0.0%
tpcds_q47/datafusion:parquet 99051328 / 98790790 / +0.3% 123374171 / 125332012 / -1.6% 0.80 / 0.79 / +1.9%
tpcds_q48/datafusion:parquet 40493214 / 42630614 / -5.0% 60841396 / 62885752 / -3.3% 0.67 / 0.68 / -1.8%
tpcds_q49/datafusion:parquet 74863712 / 73996938 / +1.2% 97017824 / 102416942 / -5.3% 0.77 / 0.72 / +6.8%
tpcds_q50/datafusion:parquet 47595546 / 48052640 / -1.0% 72076805 / 70627300 / +2.1% 0.66 / 0.68 / -2.9%
tpcds_q51/datafusion:parquet 71325970 / 71805103 / -0.7% 87251871 / 92620134 / -5.8% 0.82 / 0.78 / +5.4%
tpcds_q52/datafusion:parquet 18870896 / 18677049 / +1.0% 32983194 / 32114649 / +2.7% 0.57 / 0.58 / -1.6%
tpcds_q53/datafusion:parquet 22967074 / 21732446 / +5.7% 41414501 / 42177049 / -1.8% 0.55 / 0.52 / +7.6%
tpcds_q54/datafusion:parquet 55394614 / 54132809 / +2.3% 77388347 / 78969314 / -2.0% 0.72 / 0.69 / +4.4%
tpcds_q55/datafusion:parquet 18016589 / 18281062 / -1.4% 32529504 / 32048045 / +1.5% 0.55 / 0.57 / -2.9%
tpcds_q56/datafusion:parquet 45285438 / 45759942 / -1.0% 62595589 / 61406418 / +1.9% 0.72 / 0.75 / -2.9%
tpcds_q57/datafusion:parquet 100626536 / 100968331 / -0.3% 119280312 / 120146685 / -0.7% 0.84 / 0.84 / +0.4%
tpcds_q58/datafusion:parquet 64047672 / 64731798 / -1.1% 82893929 / 83586135 / -0.8% 0.77 / 0.77 / -0.2%
tpcds_q59/datafusion:parquet 47785233 / 45525105 / +5.0% 62217133 / 66921330 / -7.0% 0.77 / 0.68 / +12.9%
tpcds_q60/datafusion:parquet 44997108 / 45327546 / -0.7% 60661022 / 62706944 / -3.3% 0.74 / 0.72 / +2.6%
tpcds_q61/datafusion:parquet 36923562 / 37615214 / -1.8% 61218585 / 60012479 / +2.0% 0.60 / 0.63 / -3.8%
tpcds_q62/datafusion:parquet 24845289 / 24930858 / -0.3% 38520031 / 40856289 / -5.7% 0.64 / 0.61 / +5.7%
tpcds_q63/datafusion:parquet 21914146 / 21815516 / +0.5% 40254541 / 41618576 / -3.3% 0.54 / 0.52 / +3.9%
tpcds_q64/datafusion:parquet 210034078 / 205051758 / +2.4% 235371219 / 239594689 / -1.8% 0.89 / 0.86 / +4.3%
tpcds_q65/datafusion:parquet 37400210 / 38669758 / -3.3% 58063900 / 58762198 / -1.2% 0.64 / 0.66 / -2.1%
tpcds_q66/datafusion:parquet 61148404 / 61455426 / -0.5% 79372015 / 81827346 / -3.0% 0.77 / 0.75 / +2.6%
tpcds_q67/datafusion:parquet 69756920 / 71872432 / -2.9% 95929575 / 98651560 / -2.8% 0.73 / 0.73 / -0.2%
tpcds_q68/datafusion:parquet 28798012 / 29658280 / -2.9% 50173056 / 50953882 / -1.5% 0.57 / 0.58 / -1.4%
tpcds_q69/datafusion:parquet 49596813 / 50695970 / -2.2% 68784432 / 64047383 / +7.4% 0.72 / 0.79 / -8.9%
tpcds_q70/datafusion:parquet 36595800 / 36896737 / -0.8% 48735596 / 58303043 / -16.4% 🟢 0.75 / 0.63 / +18.7%
tpcds_q71/datafusion:parquet 27341816 / 28275400 / -3.3% 43346603 / 44420173 / -2.4% 0.63 / 0.64 / -0.9%
tpcds_q72/datafusion:parquet 553305222 / 549309171 / +0.7% 589061864 / 586303764 / +0.5% 0.94 / 0.94 / +0.3%
tpcds_q73/datafusion:parquet 23065294 / 23147376 / -0.4% 37962050 / 39144801 / -3.0% 0.61 / 0.59 / +2.7%
tpcds_q74/datafusion:parquet 67751341 / 68898929 / -1.7% 87836189 / 89628751 / -2.0% 0.77 / 0.77 / +0.3%
tpcds_q75/datafusion:parquet 149132393 / 146351637 / +1.9% 171948753 / 176616694 / -2.6% 0.87 / 0.83 / +4.7%
tpcds_q76/datafusion:parquet 54938694 / 53797080 / +2.1% 71205931 / 70853471 / +0.5% 0.77 / 0.76 / +1.6%
tpcds_q77/datafusion:parquet 54194920 / 56408311 / -3.9% 72773224 / 75182013 / -3.2% 0.74 / 0.75 / -0.7%
tpcds_q78/datafusion:parquet 90100834 / 89321760 / +0.9% 120076871 / 123362389 / -2.7% 0.75 / 0.72 / +3.6%
tpcds_q79/datafusion:parquet 26332083 / 25947408 / +1.5% 45223637 / 46598159 / -2.9% 0.58 / 0.56 / +4.6%
tpcds_q80/datafusion:parquet 79503232 / 80167490 / -0.8% 111889270 / 114080679 / -1.9% 0.71 / 0.70 / +1.1%
tpcds_q81/datafusion:parquet 41801572 / 42388637 / -1.4% 61884536 / 61943530 / -0.1% 0.68 / 0.68 / -1.3%
tpcds_q82/datafusion:parquet 26409944 / 26601935 / -0.7% 40962757 / 42302343 / -3.2% 0.64 / 0.63 / +2.5%
tpcds_q83/datafusion:parquet 57099006 / 56841896 / +0.5% 75439380 / 76776455 / -1.7% 0.76 / 0.74 / +2.2%
tpcds_q84/datafusion:parquet 29889628 / 31320690 / -4.6% 46164170 / 46003455 / +0.3% 0.65 / 0.68 / -4.9%
tpcds_q85/datafusion:parquet 82612794 / 82481460 / +0.2% 105537390 / 107615661 / -1.9% 0.78 / 0.77 / +2.1%
tpcds_q86/datafusion:parquet 20454914 / 20517204 / -0.3% 34953079 / 36255234 / -3.6% 0.59 / 0.57 / +3.4%
tpcds_q87/datafusion:parquet 46489919 / 45833168 / +1.4% 61512234 / 67467137 / -8.8% 0.76 / 0.68 / +11.3%
tpcds_q88/datafusion:parquet 49144306 / 48170367 / +2.0% 61204361 / 57365463 / +6.7% 0.80 / 0.84 / -4.4%
tpcds_q89/datafusion:parquet 25451458 / 25890070 / -1.7% 43200837 / 44515327 / -3.0% 0.59 / 0.58 / +1.3%
tpcds_q90/datafusion:parquet 19500398 / 19042084 / +2.4% 32407523 / 33153148 / -2.2% 0.60 / 0.57 / +4.8%
tpcds_q91/datafusion:parquet 37129510 / 37644044 / -1.4% 51923520 / 55662770 / -6.7% 0.72 / 0.68 / +5.7%
tpcds_q92/datafusion:parquet 25969155 / 25735606 / +0.9% 41861963 / 41822047 / +0.1% 0.62 / 0.62 / +0.8%
tpcds_q93/datafusion:parquet 26131051 / 27267882 / -4.2% 50124026 / 49222862 / +1.8% 0.52 / 0.55 / -5.9%
tpcds_q94/datafusion:parquet 34394549 / 34401071 / -0.0% 49547478 / 50811669 / -2.5% 0.69 / 0.68 / +2.5%
tpcds_q95/datafusion:parquet 65554626 / 62559637 / +4.8% 80219847 / 83392885 / -3.8% 0.82 / 0.75 / +8.9%
tpcds_q96/datafusion:parquet 16658969 / 16712070 / -0.3% 29888669 / 31299059 / -4.5% 0.56 / 0.53 / +4.4%
tpcds_q97/datafusion:parquet 35767718 / 35276555 / +1.4% 53592011 / 54050435 / -0.8% 0.67 / 0.65 / +2.3%
tpcds_q98/datafusion:parquet 24945141 / 25130371 / -0.7% 38670911 / 40887914 / -5.4% 0.65 / 0.61 / +5.0%
tpcds_q99/datafusion:parquet 29297608 / 29490492 / -0.7% 42062962 / 43520926 / -3.4% 0.70 / 0.68 / +2.8%
duckdb / vortex-file-compressed / ns (1.102x ❌, 1↑ 50↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 16533669 / 15284880 / +8.2% 22178083 / 23627707 / -6.1% 0.75 / 0.65 / +15.2%
tpcds_q02/duckdb:vortex-file-compressed 17142971 / 15190563 / +12.9% 🔴 19577332 / 23343220 / -16.1% 🟢 0.88 / 0.65 / +34.6%
tpcds_q03/duckdb:vortex-file-compressed 13971036 / 12513962 / +11.6% 🔴 21193685 / 23887840 / -11.3% 🟢 0.66 / 0.52 / +25.8%
tpcds_q04/duckdb:vortex-file-compressed 52810313 / 50246609 / +5.1% 59894448 / 63113110 / -5.1% 0.88 / 0.80 / +10.8%
tpcds_q05/duckdb:vortex-file-compressed 21111984 / 19507920 / +8.2% 27207936 / 28253135 / -3.7% 0.78 / 0.69 / +12.4%
tpcds_q06/duckdb:vortex-file-compressed 29530964 / 26880026 / +9.9% 39130324 / 43883967 / -10.8% 🟢 0.75 / 0.61 / +23.2%
tpcds_q07/duckdb:vortex-file-compressed 18209572 / 16045900 / +13.5% 🔴 27614138 / 32068742 / -13.9% 🟢 0.66 / 0.50 / +31.8%
tpcds_q08/duckdb:vortex-file-compressed 20761191 / 19461940 / +6.7% 25252946 / 28044803 / -10.0% 0.82 / 0.69 / +18.5%
tpcds_q09/duckdb:vortex-file-compressed 12704128 / 10356468 / +22.7% 🔴 19447013 / 18046047 / +7.8% 0.65 / 0.57 / +13.8%
tpcds_q10/duckdb:vortex-file-compressed 30792314 / 27623936 / +11.5% 🔴 39098905 / 42714860 / -8.5% 0.79 / 0.65 / +21.8%
tpcds_q11/duckdb:vortex-file-compressed 42354155 / 40150728 / +5.5% 48866737 / 54867277 / -10.9% 🟢 0.87 / 0.73 / +18.4%
tpcds_q12/duckdb:vortex-file-compressed 11607281 / 10171470 / +14.1% 🔴 14369176 / 21421773 / -32.9% 🟢 0.81 / 0.47 / +70.1%
tpcds_q13/duckdb:vortex-file-compressed 23258617 / 21944388 / +6.0% 28859524 / 36263691 / -20.4% 🟢 0.81 / 0.61 / +33.2%
tpcds_q14/duckdb:vortex-file-compressed 63367730 / 61219424 / +3.5% 73938831 / 70750486 / +4.5% 0.86 / 0.87 / -1.0%
tpcds_q15/duckdb:vortex-file-compressed 22643474 / 20835645 / +8.7% 24988890 / 25308661 / -1.3% 0.91 / 0.82 / +10.1%
tpcds_q16/duckdb:vortex-file-compressed 20339062 / 17760004 / +14.5% 🔴 26942872 / 32629332 / -17.4% 🟢 0.75 / 0.54 / +38.7%
tpcds_q17/duckdb:vortex-file-compressed 33335116 / 30328749 / +9.9% 39021653 / 45764309 / -14.7% 🟢 0.85 / 0.66 / +28.9%
tpcds_q18/duckdb:vortex-file-compressed 30890678 / 28295922 / +9.2% 36333617 / 39217059 / -7.4% 0.85 / 0.72 / +17.8%
tpcds_q19/duckdb:vortex-file-compressed 26195814 / 23866096 / +9.8% 33547667 / 34966562 / -4.1% 0.78 / 0.68 / +14.4%
tpcds_q20/duckdb:vortex-file-compressed 11886354 / 10703145 / +11.1% 🔴 14361032 / 15399798 / -6.7% 0.83 / 0.70 / +19.1%
tpcds_q21/duckdb:vortex-file-compressed 10721666 / 9876061 / +8.6% 19408827 / 18098491 / +7.2% 0.55 / 0.55 / +1.2%
tpcds_q22/duckdb:vortex-file-compressed 30312747 / 29833482 / +1.6% 37067909 / 40210972 / -7.8% 0.82 / 0.74 / +10.2%
tpcds_q23/duckdb:vortex-file-compressed 40767291 / 36601222 / +11.4% 🔴 47106103 / 47599047 / -1.0% 0.87 / 0.77 / +12.5%
tpcds_q24/duckdb:vortex-file-compressed 30980314 / 28119339 / +10.2% 🔴 36865785 / 40140649 / -8.2% 0.84 / 0.70 / +20.0%
tpcds_q25/duckdb:vortex-file-compressed 29575718 / 25647444 / +15.3% 🔴 35593260 / 41091163 / -13.4% 🟢 0.83 / 0.62 / +33.1%
tpcds_q26/duckdb:vortex-file-compressed 15670860 / 13667576 / +14.7% 🔴 20937631 / 19777649 / +5.9% 0.75 / 0.69 / +8.3%
tpcds_q27/duckdb:vortex-file-compressed 20348727 / 17518005 / +16.2% 🔴 27413285 / 31803045 / -13.8% 🟢 0.74 / 0.55 / +34.8%
tpcds_q28/duckdb:vortex-file-compressed 9060536 / 7776540 / +16.5% 🔴 11832034 / 12975429 / -8.8% 0.77 / 0.60 / +27.8%
tpcds_q29/duckdb:vortex-file-compressed 32482068 / 28919674 / +12.3% 🔴 37455020 / 45086305 / -16.9% 🟢 0.87 / 0.64 / +35.2%
tpcds_q30/duckdb:vortex-file-compressed 20933326 / 19579508 / +6.9% 26427135 / 28913848 / -8.6% 0.79 / 0.68 / +17.0%
tpcds_q31/duckdb:vortex-file-compressed 20341762 / 19264032 / +5.6% 26076127 / 27101547 / -3.8% 0.78 / 0.71 / +9.7%
tpcds_q32/duckdb:vortex-file-compressed 12136530 / 9959145 / +21.9% 🔴 16748551 / 20169220 / -17.0% 🟢 0.72 / 0.49 / +46.8%
tpcds_q33/duckdb:vortex-file-compressed 19392554 / 17349052 / +11.8% 🔴 26402331 / 29177286 / -9.5% 0.73 / 0.59 / +23.5%
tpcds_q34/duckdb:vortex-file-compressed 16231801 / 15377156 / +5.6% 21973699 / 24307496 / -9.6% 0.74 / 0.63 / +16.8%
tpcds_q35/duckdb:vortex-file-compressed 49461418 / 46014606 / +7.5% 59315765 / 60757011 / -2.4% 0.83 / 0.76 / +10.1%
tpcds_q36/duckdb:vortex-file-compressed 17154252 / 14858093 / +15.5% 🔴 23628925 / 29422165 / -19.7% 🟢 0.73 / 0.50 / +43.8%
tpcds_q37/duckdb:vortex-file-compressed 15367634 / 13887972 / +10.7% 🔴 21641856 / 23334512 / -7.3% 0.71 / 0.60 / +19.3%
tpcds_q38/duckdb:vortex-file-compressed 23491654 / 22382348 / +5.0% 28814015 / 30398941 / -5.2% 0.82 / 0.74 / +10.7%
tpcds_q39/duckdb:vortex-file-compressed 19895288 / 18364480 / +8.3% 25875646 / 30665331 / -15.6% 🟢 0.77 / 0.60 / +28.4%
tpcds_q40/duckdb:vortex-file-compressed 14429021 / 13411468 / +7.6% 17821329 / 19222888 / -7.3% 0.81 / 0.70 / +16.0%
tpcds_q41/duckdb:vortex-file-compressed 6879773 / 6617007 / +4.0% 8997407 / 10131919 / -11.2% 🟢 0.76 / 0.65 / +17.1%
tpcds_q42/duckdb:vortex-file-compressed 9919392 / 8469154 / +17.1% 🔴 17142204 / 17958329 / -4.5% 0.58 / 0.47 / +22.7%
tpcds_q43/duckdb:vortex-file-compressed 11489815 / 10234168 / +12.3% 🔴 15965515 / 18099603 / -11.8% 🟢 0.72 / 0.57 / +27.3%
tpcds_q44/duckdb:vortex-file-compressed 16017534 / 13803986 / +16.0% 🔴 24192269 / 23352728 / +3.6% 0.66 / 0.59 / +12.0%
tpcds_q45/duckdb:vortex-file-compressed 24111570 / 22399580 / +7.6% 27202255 / 30071502 / -9.5% 0.89 / 0.74 / +19.0%
tpcds_q46/duckdb:vortex-file-compressed 20551007 / 18521214 / +11.0% 🔴 25953506 / 29415961 / -11.8% 🟢 0.79 / 0.63 / +25.8%
tpcds_q47/duckdb:vortex-file-compressed 32702772 / 30983854 / +5.5% 39484516 / 44050042 / -10.4% 🟢 0.83 / 0.70 / +17.8%
tpcds_q48/duckdb:vortex-file-compressed 22842252 / 19674957 / +16.1% 🔴 29134750 / 32609013 / -10.7% 🟢 0.78 / 0.60 / +29.9%
tpcds_q49/duckdb:vortex-file-compressed 19245876 / 16859476 / +14.2% 🔴 24958462 / 29785863 / -16.2% 🟢 0.77 / 0.57 / +36.2%
tpcds_q50/duckdb:vortex-file-compressed 19971722 / 16917463 / +18.1% 🔴 25070220 / 29023573 / -13.6% 🟢 0.80 / 0.58 / +36.7%
tpcds_q51/duckdb:vortex-file-compressed 54717587 / 64933288 / -15.7% 🟢 94017784 / 60983319 / +54.2% 🔴 0.58 / 1.06 / -45.3%
tpcds_q52/duckdb:vortex-file-compressed 10415331 / 8508166 / +22.4% 🔴 15215337 / 18005207 / -15.5% 🟢 0.68 / 0.47 / +44.9%
tpcds_q53/duckdb:vortex-file-compressed 17337414 / 14531259 / +19.3% 🔴 24040995 / 24984186 / -3.8% 0.72 / 0.58 / +24.0%
tpcds_q54/duckdb:vortex-file-compressed 22822339 / 20243797 / +12.7% 🔴 28978655 / 30043273 / -3.5% 0.79 / 0.67 / +16.9%
tpcds_q55/duckdb:vortex-file-compressed 11265538 / 8347115 / +35.0% 🔴 14392855 / 18420923 / -21.9% 🟢 0.78 / 0.45 / +72.7%
tpcds_q56/duckdb:vortex-file-compressed 19367338 / 17177692 / +12.7% 🔴 28807718 / 28918705 / -0.4% 0.67 / 0.59 / +13.2%
tpcds_q57/duckdb:vortex-file-compressed 26085714 / 26744502 / -2.5% 31771552 / 31520074 / +0.8% 0.82 / 0.85 / -3.2%
tpcds_q58/duckdb:vortex-file-compressed 20487460 / 18460114 / +11.0% 🔴 30811262 / 30650564 / +0.5% 0.66 / 0.60 / +10.4%
tpcds_q59/duckdb:vortex-file-compressed 19481826 / 18955488 / +2.8% 23656481 / 25571913 / -7.5% 0.82 / 0.74 / +11.1%
tpcds_q60/duckdb:vortex-file-compressed 19994748 / 17880724 / +11.8% 🔴 26059037 / 31146649 / -16.3% 🟢 0.77 / 0.57 / +33.7%
tpcds_q61/duckdb:vortex-file-compressed 22524386 / 19937746 / +13.0% 🔴 27521492 / 33563712 / -18.0% 🟢 0.82 / 0.59 / +37.8%
tpcds_q62/duckdb:vortex-file-compressed 11551369 / 11832466 / -2.4% 14713723 / 17755275 / -17.1% 🟢 0.79 / 0.67 / +17.8%
tpcds_q63/duckdb:vortex-file-compressed 15828498 / 13734132 / +15.2% 🔴 20473418 / 24072310 / -15.0% 🟢 0.77 / 0.57 / +35.5%
tpcds_q64/duckdb:vortex-file-compressed 69879976 / 62649974 / +11.5% 🔴 75734860 / 78474938 / -3.5% 0.92 / 0.80 / +15.6%
tpcds_q65/duckdb:vortex-file-compressed 15028788 / 13707912 / +9.6% 22261884 / 22504574 / -1.1% 0.68 / 0.61 / +10.8%
tpcds_q66/duckdb:vortex-file-compressed 23377554 / 21473406 / +8.9% 28388492 / 32954612 / -13.9% 🟢 0.82 / 0.65 / +26.4%
tpcds_q67/duckdb:vortex-file-compressed 69580352 / 65173367 / +6.8% 79824550 / 81615332 / -2.2% 0.87 / 0.80 / +9.2%
tpcds_q68/duckdb:vortex-file-compressed 19826278 / 18277758 / +8.5% 25324364 / 28175961 / -10.1% 🟢 0.78 / 0.65 / +20.7%
tpcds_q69/duckdb:vortex-file-compressed 32421893 / 28726705 / +12.9% 🔴 39737546 / 42876140 / -7.3% 0.82 / 0.67 / +21.8%
tpcds_q70/duckdb:vortex-file-compressed 21442858 / 18729678 / +14.5% 🔴 29598123 / 31862751 / -7.1% 0.72 / 0.59 / +23.2%
tpcds_q71/duckdb:vortex-file-compressed 14838136 / 12661834 / +17.2% 🔴 20556246 / 23676377 / -13.2% 🟢 0.72 / 0.53 / +35.0%
tpcds_q72/duckdb:vortex-file-compressed 64761699 / 61679881 / +5.0% 69957187 / 80279126 / -12.9% 🟢 0.93 / 0.77 / +20.5%
tpcds_q73/duckdb:vortex-file-compressed 15676530 / 14690200 / +6.7% 19199224 / 20164445 / -4.8% 0.82 / 0.73 / +12.1%
tpcds_q74/duckdb:vortex-file-compressed 29346798 / 27183421 / +8.0% 34469519 / 36403494 / -5.3% 0.85 / 0.75 / +14.0%
tpcds_q75/duckdb:vortex-file-compressed 30751654 / 28643819 / +7.4% 40233940 / 45597335 / -11.8% 🟢 0.76 / 0.63 / +21.7%
tpcds_q76/duckdb:vortex-file-compressed 14239512 / 12824042 / +11.0% 🔴 21136921 / 24299101 / -13.0% 🟢 0.67 / 0.53 / +27.6%
tpcds_q77/duckdb:vortex-file-compressed 18684729 / 16016758 / +16.7% 🔴 21763432 / 24690151 / -11.9% 🟢 0.86 / 0.65 / +32.3%
tpcds_q78/duckdb:vortex-file-compressed 38586185 / 37586808 / +2.7% 43901937 / 46316024 / -5.2% 0.88 / 0.81 / +8.3%
tpcds_q79/duckdb:vortex-file-compressed 17002192 / 14656468 / +16.0% 🔴 26043685 / 24820597 / +4.9% 0.65 / 0.59 / +10.6%
tpcds_q80/duckdb:vortex-file-compressed 30528872 / 28036052 / +8.9% 38144894 / 42321480 / -9.9% 0.80 / 0.66 / +20.8%
tpcds_q81/duckdb:vortex-file-compressed 24036378 / 22359486 / +7.5% 29180809 / 30680098 / -4.9% 0.82 / 0.73 / +13.0%
tpcds_q82/duckdb:vortex-file-compressed 34329304 / 32556034 / +5.4% 40376985 / 39752091 / +1.6% 0.85 / 0.82 / +3.8%
tpcds_q83/duckdb:vortex-file-compressed 20307315 / 18742225 / +8.4% 24100382 / 24573727 / -1.9% 0.84 / 0.76 / +10.5%
tpcds_q84/duckdb:vortex-file-compressed 15345182 / 12742933 / +20.4% 🔴 19708818 / 23010314 / -14.3% 🟢 0.78 / 0.55 / +40.6%
tpcds_q85/duckdb:vortex-file-compressed 34153406 / 31505152 / +8.4% 40138760 / 41461509 / -3.2% 0.85 / 0.76 / +12.0%
tpcds_q86/duckdb:vortex-file-compressed 11785762 / 10788680 / +9.2% 16208135 / 17546160 / -7.6% 0.73 / 0.61 / +18.3%
tpcds_q87/duckdb:vortex-file-compressed 25142490 / 24131230 / +4.2% 30299063 / 30107442 / +0.6% 0.83 / 0.80 / +3.5%
tpcds_q88/duckdb:vortex-file-compressed 37622544 / 32481819 / +15.8% 🔴 46597118 / 45859246 / +1.6% 0.81 / 0.71 / +14.0%
tpcds_q89/duckdb:vortex-file-compressed 15833198 / 14055656 / +12.6% 🔴 20237931 / 24721581 / -18.1% 🟢 0.78 / 0.57 / +37.6%
tpcds_q90/duckdb:vortex-file-compressed 8727518 / 7659454 / +13.9% 🔴 14845079 / 15479961 / -4.1% 0.59 / 0.49 / +18.8%
tpcds_q91/duckdb:vortex-file-compressed 17659176 / 15605009 / +13.2% 🔴 20462611 / 24041785 / -14.9% 🟢 0.86 / 0.65 / +33.0%
tpcds_q92/duckdb:vortex-file-compressed 15359915 / 13265162 / +15.8% 🔴 21545537 / 22525279 / -4.3% 0.71 / 0.59 / +21.1%
tpcds_q93/duckdb:vortex-file-compressed 17825298 / 17251864 / +3.3% 22402944 / 24436782 / -8.3% 0.80 / 0.71 / +12.7%
tpcds_q94/duckdb:vortex-file-compressed 18857752 / 17666823 / +6.7% 26051124 / 28813503 / -9.6% 0.72 / 0.61 / +18.1%
tpcds_q95/duckdb:vortex-file-compressed 74109750 / 71736714 / +3.3% 79675589 / 85826591 / -7.2% 0.93 / 0.84 / +11.3%
tpcds_q96/duckdb:vortex-file-compressed 9205092 / 7606576 / +21.0% 🔴 13811638 / 17670168 / -21.8% 🟢 0.67 / 0.43 / +54.8%
tpcds_q97/duckdb:vortex-file-compressed 23424395 / 22513732 / +4.0% 28061099 / 29063888 / -3.5% 0.83 / 0.77 / +7.8%
tpcds_q98/duckdb:vortex-file-compressed 14941923 / 14794104 / +1.0% 23884181 / 23341699 / +2.3% 0.63 / 0.63 / -1.3%
tpcds_q99/duckdb:vortex-file-compressed 15087394 / 13623054 / +10.7% 🔴 18364092 / 19384928 / -5.3% 0.82 / 0.70 / +16.9%
duckdb / vortex-compact / ns (1.070x ➖, 0↑ 15↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17829883 / 16369750 / +8.9% 23285769 / 24815392 / -6.2% 0.77 / 0.66 / +16.1%
tpcds_q02/duckdb:vortex-compact 17247740 / 16580339 / +4.0% 20506190 / 23202141 / -11.6% 🟢 0.84 / 0.71 / +17.7%
tpcds_q03/duckdb:vortex-compact 23202020 / 22316301 / +4.0% 30182344 / 30750841 / -1.8% 0.77 / 0.73 / +5.9%
tpcds_q04/duckdb:vortex-compact 55742580 / 55556578 / +0.3% 66040982 / 67660601 / -2.4% 0.84 / 0.82 / +2.8%
tpcds_q05/duckdb:vortex-compact 26869673 / 22547808 / +19.2% 🔴 30864477 / 32849701 / -6.0% 0.87 / 0.69 / +26.8%
tpcds_q06/duckdb:vortex-compact 34652063 / 32403836 / +6.9% 45301192 / 44707847 / +1.3% 0.76 / 0.72 / +5.5%
tpcds_q07/duckdb:vortex-compact 30557420 / 28249055 / +8.2% 34451513 / 38548201 / -10.6% 🟢 0.89 / 0.73 / +21.0%
tpcds_q08/duckdb:vortex-compact 50948054 / 49503013 / +2.9% 58033352 / 57987317 / +0.1% 0.88 / 0.85 / +2.8%
tpcds_q09/duckdb:vortex-compact 14550470 / 13088366 / +11.2% 🔴 19011006 / 20255663 / -6.1% 0.77 / 0.65 / +18.4%
tpcds_q10/duckdb:vortex-compact 48277059 / 45476239 / +6.2% 56466879 / 67120749 / -15.9% 🟢 0.85 / 0.68 / +26.2%
tpcds_q11/duckdb:vortex-compact 46927272 / 45292618 / +3.6% 53471211 / 58297560 / -8.3% 0.88 / 0.78 / +13.0%
tpcds_q12/duckdb:vortex-compact 14449058 / 13561264 / +6.5% 17789894 / 20196629 / -11.9% 🟢 0.81 / 0.67 / +21.0%
tpcds_q13/duckdb:vortex-compact 38563784 / 37617626 / +2.5% 46797467 / 49963680 / -6.3% 0.82 / 0.75 / +9.5%
tpcds_q14/duckdb:vortex-compact 70569922 / 67574868 / +4.4% 79503459 / 83241792 / -4.5% 0.89 / 0.81 / +9.3%
tpcds_q15/duckdb:vortex-compact 27191756 / 26450583 / +2.8% 31359331 / 32480373 / -3.5% 0.87 / 0.81 / +6.5%
tpcds_q16/duckdb:vortex-compact 26518732 / 25229970 / +5.1% 32449826 / 37077468 / -12.5% 🟢 0.82 / 0.68 / +20.1%
tpcds_q17/duckdb:vortex-compact 49226254 / 45116099 / +9.1% 55042258 / 57275102 / -3.9% 0.89 / 0.79 / +13.5%
tpcds_q18/duckdb:vortex-compact 38275281 / 37324354 / +2.5% 42603765 / 45197674 / -5.7% 0.90 / 0.83 / +8.8%
tpcds_q19/duckdb:vortex-compact 37838113 / 35797276 / +5.7% 43514009 / 44035414 / -1.2% 0.87 / 0.81 / +7.0%
tpcds_q20/duckdb:vortex-compact 15528950 / 14059656 / +10.5% 🔴 19114868 / 20059475 / -4.7% 0.81 / 0.70 / +15.9%
tpcds_q21/duckdb:vortex-compact 11728358 / 11389792 / +3.0% 17630557 / 18843385 / -6.4% 0.67 / 0.60 / +10.1%
tpcds_q22/duckdb:vortex-compact 31769405 / 30239667 / +5.1% 39908182 / 43466368 / -8.2% 0.80 / 0.70 / +14.4%
tpcds_q23/duckdb:vortex-compact 53051932 / 43250880 / +22.7% 🔴 55284616 / 55712041 / -0.8% 0.96 / 0.78 / +23.6%
tpcds_q24/duckdb:vortex-compact 41539958 / 40298646 / +3.1% 46409264 / 49623726 / -6.5% 0.90 / 0.81 / +10.2%
tpcds_q25/duckdb:vortex-compact 45901097 / 43503126 / +5.5% 50680691 / 54426117 / -6.9% 0.91 / 0.80 / +13.3%
tpcds_q26/duckdb:vortex-compact 27244406 / 25183713 / +8.2% 30960098 / 32678147 / -5.3% 0.88 / 0.77 / +14.2%
tpcds_q27/duckdb:vortex-compact 38695036 / 34243806 / +13.0% 🔴 38149008 / 48984812 / -22.1% 🟢 1.01 / 0.70 / +45.1%
tpcds_q28/duckdb:vortex-compact 13387853 / 12460782 / +7.4% 15799973 / 16885958 / -6.4% 0.85 / 0.74 / +14.8%
tpcds_q29/duckdb:vortex-compact 47843104 / 44367738 / +7.8% 53536530 / 57868180 / -7.5% 0.89 / 0.77 / +16.6%
tpcds_q30/duckdb:vortex-compact 23727202 / 22594562 / +5.0% 29125618 / 30548635 / -4.7% 0.81 / 0.74 / +10.1%
tpcds_q31/duckdb:vortex-compact 24509638 / 23917496 / +2.5% 29998294 / 31492955 / -4.7% 0.82 / 0.76 / +7.6%
tpcds_q32/duckdb:vortex-compact 16248368 / 15624302 / +4.0% 20915407 / 20809096 / +0.5% 0.78 / 0.75 / +3.5%
tpcds_q33/duckdb:vortex-compact 24965692 / 24119986 / +3.5% 30816785 / 35742487 / -13.8% 🟢 0.81 / 0.67 / +20.1%
tpcds_q34/duckdb:vortex-compact 23500581 / 22390500 / +5.0% 29152847 / 29860866 / -2.4% 0.81 / 0.75 / +7.5%
tpcds_q35/duckdb:vortex-compact 64823041 / 61874526 / +4.8% 71450741 / 75146335 / -4.9% 0.91 / 0.82 / +10.2%
tpcds_q36/duckdb:vortex-compact 23153498 / 22342407 / +3.6% 31982365 / 39535116 / -19.1% 🟢 0.72 / 0.57 / +28.1%
tpcds_q37/duckdb:vortex-compact 16847598 / 15614482 / +7.9% 26157091 / 24602090 / +6.3% 0.64 / 0.63 / +1.5%
tpcds_q38/duckdb:vortex-compact 27250036 / 26590398 / +2.5% 33416471 / 36094595 / -7.4% 0.82 / 0.74 / +10.7%
tpcds_q39/duckdb:vortex-compact 20731960 / 19436791 / +6.7% 26493659 / 27651708 / -4.2% 0.78 / 0.70 / +11.3%
tpcds_q40/duckdb:vortex-compact 17391505 / 16124118 / +7.9% 21844204 / 22164330 / -1.4% 0.80 / 0.73 / +9.4%
tpcds_q41/duckdb:vortex-compact 7975888 / 7739064 / +3.1% 12384284 / 11421758 / +8.4% 0.64 / 0.68 / -4.9%
tpcds_q42/duckdb:vortex-compact 13121572 / 11836234 / +10.9% 🔴 23750720 / 24871182 / -4.5% 0.55 / 0.48 / +16.1%
tpcds_q43/duckdb:vortex-compact 20996019 / 16637960 / +26.2% 🔴 28991481 / 27175569 / +6.7% 0.72 / 0.61 / +18.3%
tpcds_q44/duckdb:vortex-compact 22381268 / 20508671 / +9.1% 28062879 / 29262939 / -4.1% 0.80 / 0.70 / +13.8%
tpcds_q45/duckdb:vortex-compact 28686424 / 27636409 / +3.8% 31516831 / 34293406 / -8.1% 0.91 / 0.81 / +12.9%
tpcds_q46/duckdb:vortex-compact 30667374 / 29558072 / +3.8% 35307488 / 39041187 / -9.6% 0.87 / 0.76 / +14.7%
tpcds_q47/duckdb:vortex-compact 37405952 / 36229910 / +3.2% 42890556 / 45266647 / -5.2% 0.87 / 0.80 / +9.0%
tpcds_q48/duckdb:vortex-compact 35287565 / 33521122 / +5.3% 45016567 / 46078073 / -2.3% 0.78 / 0.73 / +7.8%
tpcds_q49/duckdb:vortex-compact 28310798 / 23316542 / +21.4% 🔴 30349873 / 43875563 / -30.8% 🟢 0.93 / 0.53 / +75.5%
tpcds_q50/duckdb:vortex-compact 29368249 / 27903992 / +5.2% 33996210 / 37036742 / -8.2% 0.86 / 0.75 / +14.7%
tpcds_q51/duckdb:vortex-compact 54860346 / 53139590 / +3.2% 91734315 / 61294257 / +49.7% 🔴 0.60 / 0.87 / -31.0%
tpcds_q52/duckdb:vortex-compact 13244697 / 11909316 / +11.2% 🔴 20537507 / 23780933 / -13.6% 🟢 0.64 / 0.50 / +28.8%
tpcds_q53/duckdb:vortex-compact 23334042 / 21508319 / +8.5% 28049192 / 30297476 / -7.4% 0.83 / 0.71 / +17.2%
tpcds_q54/duckdb:vortex-compact 28705778 / 26493018 / +8.4% 37773208 / 37175867 / +1.6% 0.76 / 0.71 / +6.6%
tpcds_q55/duckdb:vortex-compact 15474926 / 11783906 / +31.3% 🔴 17354708 / 23378549 / -25.8% 🟢 0.89 / 0.50 / +76.9%
tpcds_q56/duckdb:vortex-compact 26669977 / 23659026 / +12.7% 🔴 30267665 / 34640840 / -12.6% 🟢 0.88 / 0.68 / +29.0%
tpcds_q57/duckdb:vortex-compact 29229853 / 27816474 / +5.1% 35384819 / 36459243 / -2.9% 0.83 / 0.76 / +8.3%
tpcds_q58/duckdb:vortex-compact 23101066 / 22829472 / +1.2% 31702744 / 34956338 / -9.3% 0.73 / 0.65 / +11.6%
tpcds_q59/duckdb:vortex-compact 28175346 / 23471868 / +20.0% 🔴 28315495 / 29752467 / -4.8% 1.00 / 0.79 / +26.1%
tpcds_q60/duckdb:vortex-compact 25757870 / 24496604 / +5.1% 31526228 / 39730033 / -20.6% 🟢 0.82 / 0.62 / +32.5%
tpcds_q61/duckdb:vortex-compact 35145662 / 34299418 / +2.5% 44956185 / 45618565 / -1.5% 0.78 / 0.75 / +4.0%
tpcds_q62/duckdb:vortex-compact 12693513 / 11762698 / +7.9% 16636007 / 17889136 / -7.0% 0.76 / 0.66 / +16.0%
tpcds_q63/duckdb:vortex-compact 22185614 / 20871291 / +6.3% 26659320 / 28983248 / -8.0% 0.83 / 0.72 / +15.6%
tpcds_q64/duckdb:vortex-compact 90211593 / 86148949 / +4.7% 99516586 / 100976937 / -1.4% 0.91 / 0.85 / +6.3%
tpcds_q65/duckdb:vortex-compact 19752313 / 18365707 / +7.5% 27243904 / 28071073 / -2.9% 0.73 / 0.65 / +10.8%
tpcds_q66/duckdb:vortex-compact 28339434 / 25758148 / +10.0% 🔴 38193918 / 39120395 / -2.4% 0.74 / 0.66 / +12.7%
tpcds_q67/duckdb:vortex-compact 73769218 / 70728064 / +4.3% 81321177 / 85412969 / -4.8% 0.91 / 0.83 / +9.5%
tpcds_q68/duckdb:vortex-compact 31207302 / 29237142 / +6.7% 37885364 / 40063961 / -5.4% 0.82 / 0.73 / +12.9%
tpcds_q69/duckdb:vortex-compact 49489770 / 47610686 / +3.9% 55745804 / 58301712 / -4.4% 0.89 / 0.82 / +8.7%
tpcds_q70/duckdb:vortex-compact 34408499 / 31298426 / +9.9% 40889824 / 41389069 / -1.2% 0.84 / 0.76 / +11.3%
tpcds_q71/duckdb:vortex-compact 20403321 / 19278324 / +5.8% 29111396 / 30554483 / -4.7% 0.70 / 0.63 / +11.1%
tpcds_q72/duckdb:vortex-compact 71701551 / 70066934 / +2.3% 78527297 / 83627441 / -6.1% 0.91 / 0.84 / +9.0%
tpcds_q73/duckdb:vortex-compact 22952652 / 21731503 / +5.6% 28741251 / 29492244 / -2.5% 0.80 / 0.74 / +8.4%
tpcds_q74/duckdb:vortex-compact 33524572 / 32039862 / +4.6% 38958206 / 41083032 / -5.2% 0.86 / 0.78 / +10.3%
tpcds_q75/duckdb:vortex-compact 35570010 / 33902676 / +4.9% 42352050 / 46096888 / -8.1% 0.84 / 0.74 / +14.2%
tpcds_q76/duckdb:vortex-compact 20608567 / 16183138 / +27.3% 🔴 28290224 / 30516314 / -7.3% 0.73 / 0.53 / +37.4%
tpcds_q77/duckdb:vortex-compact 25609586 / 23654162 / +8.3% 31111471 / 31817358 / -2.2% 0.82 / 0.74 / +10.7%
tpcds_q78/duckdb:vortex-compact 43854976 / 42654026 / +2.8% 48895690 / 51182973 / -4.5% 0.90 / 0.83 / +7.6%
tpcds_q79/duckdb:vortex-compact 39573002 / 37981746 / +4.2% 43356671 / 62575122 / -30.7% 🟢 0.91 / 0.61 / +50.4%
tpcds_q80/duckdb:vortex-compact 39516045 / 36393418 / +8.6% 46192056 / 48444070 / -4.6% 0.86 / 0.75 / +13.9%
tpcds_q81/duckdb:vortex-compact 26228420 / 24390154 / +7.5% 30877629 / 32832428 / -6.0% 0.85 / 0.74 / +14.3%
tpcds_q82/duckdb:vortex-compact 37267182 / 35533818 / +4.9% 42981956 / 42852238 / +0.3% 0.87 / 0.83 / +4.6%
tpcds_q83/duckdb:vortex-compact 30572812 / 28378524 / +7.7% 34380078 / 32113563 / +7.1% 0.89 / 0.88 / +0.6%
tpcds_q84/duckdb:vortex-compact 18328032 / 15103359 / +21.4% 🔴 21340072 / 23574279 / -9.5% 0.86 / 0.64 / +34.1%
tpcds_q85/duckdb:vortex-compact 43921826 / 42011352 / +4.5% 49534782 / 51510234 / -3.8% 0.89 / 0.82 / +8.7%
tpcds_q86/duckdb:vortex-compact 12848444 / 12492364 / +2.9% 16446889 / 18823586 / -12.6% 🟢 0.78 / 0.66 / +17.7%
tpcds_q87/duckdb:vortex-compact 29237202 / 28749832 / +1.7% 34349539 / 36842375 / -6.8% 0.85 / 0.78 / +9.1%
tpcds_q88/duckdb:vortex-compact 73640156 / 67573438 / +9.0% 83907704 / 78735670 / +6.6% 0.88 / 0.86 / +2.3%
tpcds_q89/duckdb:vortex-compact 22014458 / 20974839 / +5.0% 30087633 / 31419256 / -4.2% 0.73 / 0.67 / +9.6%
tpcds_q90/duckdb:vortex-compact 12703046 / 11869118 / +7.0% 19979673 / 16064936 / +24.4% 🔴 0.64 / 0.74 / -13.9%
tpcds_q91/duckdb:vortex-compact 35214732 / 33154032 / +6.2% 39855627 / 40722614 / -2.1% 0.88 / 0.81 / +8.5%
tpcds_q92/duckdb:vortex-compact 22097660 / 20789349 / +6.3% 27052456 / 27592247 / -2.0% 0.82 / 0.75 / +8.4%
tpcds_q93/duckdb:vortex-compact 19579236 / 18575360 / +5.4% 24894383 / 26712494 / -6.8% 0.79 / 0.70 / +13.1%
tpcds_q94/duckdb:vortex-compact 23915220 / 22276236 / +7.4% 29426741 / 32506122 / -9.5% 0.81 / 0.69 / +18.6%
tpcds_q95/duckdb:vortex-compact 78354809 / 78344498 / +0.0% 89831875 / 84877825 / +5.8% 0.87 / 0.92 / -5.5%
tpcds_q96/duckdb:vortex-compact 18404732 / 17211488 / +6.9% 22557191 / 24101734 / -6.4% 0.82 / 0.71 / +14.3%
tpcds_q97/duckdb:vortex-compact 26696227 / 26003982 / +2.7% 35351103 / 32773920 / +7.9% 0.76 / 0.79 / -4.8%
tpcds_q98/duckdb:vortex-compact 19367351 / 18378596 / +5.4% 25256510 / 29144067 / -13.3% 🟢 0.77 / 0.63 / +21.6%
tpcds_q99/duckdb:vortex-compact 18139762 / 17002282 / +6.7% 21797773 / 22061752 / -1.2% 0.83 / 0.77 / +8.0%
duckdb / parquet / ns (1.001x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 25197149 / 24892216 / +1.2% 33869382 / 32003518 / +5.8% 0.74 / 0.78 / -4.4%
tpcds_q02/duckdb:parquet 18493522 / 15399586 / +20.1% 🔴 26198779 / 20478454 / +27.9% 🔴 0.71 / 0.75 / -6.1%
tpcds_q03/duckdb:parquet 8861038 / 8726826 / +1.5% 15139502 / 15895487 / -4.8% 0.59 / 0.55 / +6.6%
tpcds_q04/duckdb:parquet 128645243 / 127435346 / +0.9% 136715612 / 131795077 / +3.7% 0.94 / 0.97 / -2.7%
tpcds_q05/duckdb:parquet 21911578 / 21380982 / +2.5% 25763769 / 25922677 / -0.6% 0.85 / 0.82 / +3.1%
tpcds_q06/duckdb:parquet 27142101 / 26746958 / +1.5% 37123393 / 37099351 / +0.1% 0.73 / 0.72 / +1.4%
tpcds_q07/duckdb:parquet 15457094 / 15262952 / +1.3% 23440078 / 26055830 / -10.0% 🟢 0.66 / 0.59 / +12.6%
tpcds_q08/duckdb:parquet 28804389 / 25668402 / +12.2% 🔴 36078686 / 33460274 / +7.8% 0.80 / 0.77 / +4.1%
tpcds_q09/duckdb:parquet 18848828 / 18845854 / +0.0% 22568708 / 21894456 / +3.1% 0.84 / 0.86 / -3.0%
tpcds_q10/duckdb:parquet 27685232 / 27719191 / -0.1% 37933319 / 37759053 / +0.5% 0.73 / 0.73 / -0.6%
tpcds_q11/duckdb:parquet 71910124 / 71181890 / +1.0% 77927874 / 78994763 / -1.4% 0.92 / 0.90 / +2.4%
tpcds_q12/duckdb:parquet 12664310 / 12707596 / -0.3% 17699943 / 17359903 / +2.0% 0.72 / 0.73 / -2.3%
tpcds_q13/duckdb:parquet 24013070 / 23941733 / +0.3% 31752003 / 39333773 / -19.3% 🟢 0.76 / 0.61 / +24.2%
tpcds_q14/duckdb:parquet 61835765 / 60703586 / +1.9% 68804227 / 71191830 / -3.4% 0.90 / 0.85 / +5.4%
tpcds_q15/duckdb:parquet 24788061 / 24957040 / -0.7% 30686051 / 30795553 / -0.4% 0.81 / 0.81 / -0.3%
tpcds_q16/duckdb:parquet 20112288 / 20098979 / +0.1% 28986301 / 27921995 / +3.8% 0.69 / 0.72 / -3.6%
tpcds_q17/duckdb:parquet 32677558 / 32134993 / +1.7% 40619549 / 40574349 / +0.1% 0.80 / 0.79 / +1.6%
tpcds_q18/duckdb:parquet 39902258 / 39615626 / +0.7% 49693140 / 50202551 / -1.0% 0.80 / 0.79 / +1.8%
tpcds_q19/duckdb:parquet 24472798 / 25865102 / -5.4% 32473742 / 35497537 / -8.5% 0.75 / 0.73 / +3.4%
tpcds_q20/duckdb:parquet 13828124 / 13566776 / +1.9% 18590313 / 17815772 / +4.3% 0.74 / 0.76 / -2.3%
tpcds_q21/duckdb:parquet 9606721 / 9605931 / +0.0% 12954560 / 12908643 / +0.4% 0.74 / 0.74 / -0.3%
tpcds_q22/duckdb:parquet 36039071 / 34915558 / +3.2% 51188828 / 38836985 / +31.8% 🔴 0.70 / 0.90 / -21.7%
tpcds_q23/duckdb:parquet 40813538 / 40603944 / +0.5% 50127230 / 47593344 / +5.3% 0.81 / 0.85 / -4.6%
tpcds_q24/duckdb:parquet 33680035 / 33279720 / +1.2% 44294331 / 44350900 / -0.1% 0.76 / 0.75 / +1.3%
tpcds_q25/duckdb:parquet 30471324 / 30070326 / +1.3% 40261069 / 39578300 / +1.7% 0.76 / 0.76 / -0.4%
tpcds_q26/duckdb:parquet 31556461 / 31546068 / +0.0% 38756555 / 40615886 / -4.6% 0.81 / 0.78 / +4.8%
tpcds_q27/duckdb:parquet 31932366 / 32128526 / -0.6% 42159465 / 43726866 / -3.6% 0.76 / 0.73 / +3.1%
tpcds_q28/duckdb:parquet 17365701 / 17040462 / +1.9% 20625504 / 21599707 / -4.5% 0.84 / 0.79 / +6.7%
tpcds_q29/duckdb:parquet 30830286 / 30751530 / +0.3% 39861731 / 38745407 / +2.9% 0.77 / 0.79 / -2.6%
tpcds_q30/duckdb:parquet 32349084 / 33798509 / -4.3% 42304247 / 45035165 / -6.1% 0.76 / 0.75 / +1.9%
tpcds_q31/duckdb:parquet 20418016 / 21630488 / -5.6% 26062437 / 27668929 / -5.8% 0.78 / 0.78 / +0.2%
tpcds_q32/duckdb:parquet 11355462 / 11159186 / +1.8% 17571796 / 17475535 / +0.6% 0.65 / 0.64 / +1.2%
tpcds_q33/duckdb:parquet 16287023 / 15919042 / +2.3% 23119563 / 22825372 / +1.3% 0.70 / 0.70 / +1.0%
tpcds_q34/duckdb:parquet 16006856 / 16740047 / -4.4% 22497300 / 22436545 / +0.3% 0.71 / 0.75 / -4.6%
tpcds_q35/duckdb:parquet 47258666 / 47851832 / -1.2% 58172219 / 55866415 / +4.1% 0.81 / 0.86 / -5.2%
tpcds_q36/duckdb:parquet 15175008 / 15014140 / +1.1% 23560205 / 23150041 / +1.8% 0.64 / 0.65 / -0.7%
tpcds_q37/duckdb:parquet 12692624 / 13482123 / -5.9% 18943997 / 16508163 / +14.8% 🔴 0.67 / 0.82 / -18.0%
tpcds_q38/duckdb:parquet 26500002 / 26522598 / -0.1% 30808188 / 29483436 / +4.5% 0.86 / 0.90 / -4.4%
tpcds_q39/duckdb:parquet 24763290 / 24707215 / +0.2% 30007485 / 31686852 / -5.3% 0.83 / 0.78 / +5.8%
tpcds_q40/duckdb:parquet 16030310 / 15944883 / +0.5% 21792782 / 21125904 / +3.2% 0.74 / 0.75 / -2.5%
tpcds_q41/duckdb:parquet 9497672 / 10268143 / -7.5% 15970915 / 15808281 / +1.0% 0.59 / 0.65 / -8.4%
tpcds_q42/duckdb:parquet 8398175 / 8410119 / -0.1% 14781737 / 14619960 / +1.1% 0.57 / 0.58 / -1.2%
tpcds_q43/duckdb:parquet 10718448 / 10601022 / +1.1% 15985844 / 15355861 / +4.1% 0.67 / 0.69 / -2.9%
tpcds_q44/duckdb:parquet 16289428 / 16245904 / +0.3% 22583257 / 22368359 / +1.0% 0.72 / 0.73 / -0.7%
tpcds_q45/duckdb:parquet 23220456 / 23304017 / -0.4% 30071109 / 29859992 / +0.7% 0.77 / 0.78 / -1.1%
tpcds_q46/duckdb:parquet 36267239 / 36266682 / +0.0% 44241156 / 45473146 / -2.7% 0.82 / 0.80 / +2.8%
tpcds_q47/duckdb:parquet 31496858 / 32891756 / -4.2% 37398387 / 37248154 / +0.4% 0.84 / 0.88 / -4.6%
tpcds_q48/duckdb:parquet 21305144 / 21310342 / -0.0% 29256750 / 28214310 / +3.7% 0.73 / 0.76 / -3.6%
tpcds_q49/duckdb:parquet 18925880 / 18923718 / +0.0% 29332893 / 28708591 / +2.2% 0.65 / 0.66 / -2.1%
tpcds_q50/duckdb:parquet 17717075 / 18710498 / -5.3% 25148487 / 29925203 / -16.0% 🟢 0.70 / 0.63 / +12.7%
tpcds_q51/duckdb:parquet 54738784 / 53400597 / +2.5% 60989363 / 63254263 / -3.6% 0.90 / 0.84 / +6.3%
tpcds_q52/duckdb:parquet 8686914 / 8603280 / +1.0% 15385322 / 15217944 / +1.1% 0.56 / 0.57 / -0.1%
tpcds_q53/duckdb:parquet 11671366 / 11388516 / +2.5% 17246675 / 17011084 / +1.4% 0.68 / 0.67 / +1.1%
tpcds_q54/duckdb:parquet 20581280 / 20597508 / -0.1% 37673724 / 30236890 / +24.6% 🔴 0.55 / 0.68 / -19.8%
tpcds_q55/duckdb:parquet 8686284 / 8610430 / +0.9% 15364843 / 15119000 / +1.6% 0.57 / 0.57 / -0.7%
tpcds_q56/duckdb:parquet 16287064 / 16249792 / +0.2% 24198845 / 23586322 / +2.6% 0.67 / 0.69 / -2.3%
tpcds_q57/duckdb:parquet 29292060 / 28918634 / +1.3% 37626815 / 34396235 / +9.4% 0.78 / 0.84 / -7.4%
tpcds_q58/duckdb:parquet 18249468 / 18315076 / -0.4% 27052613 / 25929345 / +4.3% 0.67 / 0.71 / -4.5%
tpcds_q59/duckdb:parquet 20104006 / 20016616 / +0.4% 25525083 / 25833903 / -1.2% 0.79 / 0.77 / +1.7%
tpcds_q60/duckdb:parquet 16969672 / 17214026 / -1.4% 23725497 / 24319888 / -2.4% 0.72 / 0.71 / +1.1%
tpcds_q61/duckdb:parquet 21563519 / 21701258 / -0.6% 31070882 / 29371714 / +5.8% 0.69 / 0.74 / -6.1%
tpcds_q62/duckdb:parquet 10903659 / 10825700 / +0.7% 14819764 / 14610787 / +1.4% 0.74 / 0.74 / -0.7%
tpcds_q63/duckdb:parquet 11004881 / 11036888 / -0.3% 16522650 / 16480242 / +0.3% 0.67 / 0.67 / -0.5%
tpcds_q64/duckdb:parquet 55303932 / 52858096 / +4.6% 67451901 / 70192901 / -3.9% 0.82 / 0.75 / +8.9%
tpcds_q65/duckdb:parquet 14776790 / 15821623 / -6.6% 21423380 / 21080130 / +1.6% 0.69 / 0.75 / -8.1%
tpcds_q66/duckdb:parquet 24979466 / 24786574 / +0.8% 34567236 / 30940761 / +11.7% 🔴 0.72 / 0.80 / -9.8%
tpcds_q67/duckdb:parquet 77912616 / 77742174 / +0.2% 85192250 / 88196782 / -3.4% 0.91 / 0.88 / +3.8%
tpcds_q68/duckdb:parquet 29144515 / 29344296 / -0.7% 40891857 / 42745994 / -4.3% 0.71 / 0.69 / +3.8%
tpcds_q69/duckdb:parquet 28942238 / 28549396 / +1.4% 38752016 / 40482778 / -4.3% 0.75 / 0.71 / +5.9%
tpcds_q70/duckdb:parquet 16344589 / 16284184 / +0.4% 24854233 / 23211368 / +7.1% 0.66 / 0.70 / -6.3%
tpcds_q71/duckdb:parquet 14854758 / 14835429 / +0.1% 21015042 / 27973316 / -24.9% 🟢 0.71 / 0.53 / +33.3%
tpcds_q72/duckdb:parquet 82273408 / 81713904 / +0.7% 99310641 / 87471517 / +13.5% 🔴 0.83 / 0.93 / -11.3%
tpcds_q73/duckdb:parquet 13487204 / 13312422 / +1.3% 19765271 / 19774141 / -0.0% 0.68 / 0.67 / +1.4%
tpcds_q74/duckdb:parquet 99308857 / 99068760 / +0.2% 109089647 / 106359606 / +2.6% 0.91 / 0.93 / -2.3%
tpcds_q75/duckdb:parquet 40360990 / 40559942 / -0.5% 51409508 / 50522731 / +1.8% 0.79 / 0.80 / -2.2%
tpcds_q76/duckdb:parquet 13630318 / 13965362 / -2.4% 21116424 / 20567409 / +2.7% 0.65 / 0.68 / -4.9%
tpcds_q77/duckdb:parquet 17149922 / 16731664 / +2.5% 25460634 / 26026600 / -2.2% 0.67 / 0.64 / +4.8%
tpcds_q78/duckdb:parquet 48630530 / 48303170 / +0.7% 54107461 / 54714371 / -1.1% 0.90 / 0.88 / +1.8%
tpcds_q79/duckdb:parquet 20558634 / 20507531 / +0.2% 29034558 / 29039482 / -0.0% 0.71 / 0.71 / +0.3%
tpcds_q80/duckdb:parquet 31533456 / 31454994 / +0.2% 41177542 / 40217150 / +2.4% 0.77 / 0.78 / -2.1%
tpcds_q81/duckdb:parquet 29956604 / 29910051 / +0.2% 38756579 / 40090064 / -3.3% 0.77 / 0.75 / +3.6%
tpcds_q82/duckdb:parquet 13040248 / 13799418 / -5.5% 18606182 / 19865711 / -6.3% 0.70 / 0.69 / +0.9%
tpcds_q83/duckdb:parquet 15914822 / 15631995 / +1.8% 21548153 / 20563794 / +4.8% 0.74 / 0.76 / -2.8%
tpcds_q84/duckdb:parquet 17439406 / 18406704 / -5.3% 23156374 / 23503714 / -1.5% 0.75 / 0.78 / -3.8%
tpcds_q85/duckdb:parquet 34894002 / 34558891 / +1.0% 48155414 / 45323347 / +6.2% 0.72 / 0.76 / -5.0%
tpcds_q86/duckdb:parquet 11112040 / 13526972 / -17.9% 🟢 15841832 / 17727848 / -10.6% 🟢 0.70 / 0.76 / -8.1%
tpcds_q87/duckdb:parquet 28317613 / 28272938 / +0.2% 32668667 / 32032555 / +2.0% 0.87 / 0.88 / -1.8%
tpcds_q88/duckdb:parquet 28614550 / 27691900 / +3.3% 38007006 / 32822185 / +15.8% 🔴 0.75 / 0.84 / -10.8%
tpcds_q89/duckdb:parquet 12846799 / 12940780 / -0.7% 21783283 / 18260692 / +19.3% 🔴 0.59 / 0.71 / -16.8%
tpcds_q90/duckdb:parquet 7103415 / 6935350 / +2.4% 11385340 / 11196587 / +1.7% 0.62 / 0.62 / +0.7%
tpcds_q91/duckdb:parquet 21038484 / 20796389 / +1.2% 28992862 / 29024150 / -0.1% 0.73 / 0.72 / +1.3%
tpcds_q92/duckdb:parquet 11609370 / 11347676 / +2.3% 19015008 / 17684358 / +7.5% 0.61 / 0.64 / -4.9%
tpcds_q93/duckdb:parquet 21501028 / 21386518 / +0.5% 29781219 / 28960152 / +2.8% 0.72 / 0.74 / -2.2%
tpcds_q94/duckdb:parquet 16049754 / 15928124 / +0.8% 25007012 / 28435358 / -12.1% 🟢 0.64 / 0.56 / +14.6%
tpcds_q95/duckdb:parquet 90325776 / 89788770 / +0.6% 99401816 / 97927599 / +1.5% 0.91 / 0.92 / -0.9%
tpcds_q96/duckdb:parquet 6946338 / 6929343 / +0.2% 10873358 / 10815650 / +0.5% 0.64 / 0.64 / -0.3%
tpcds_q97/duckdb:parquet 26766501 / 25732818 / +4.0% 32110631 / 34130479 / -5.9% 0.83 / 0.75 / +10.6%
tpcds_q98/duckdb:parquet 15092256 / 14984405 / +0.7% 22135121 / 22450049 / -1.4% 0.68 / 0.67 / +2.2%
tpcds_q99/duckdb:parquet 17386580 / 17311944 / +0.4% 21592420 / 21342992 / +1.2% 0.81 / 0.81 / -0.7%
File Size Changes (48 files changed, +2.4% overall, 48↑ 0↓)
File Scale Format Base HEAD Change %
call_center.vortex 1.0 vortex-compact 46.10 KB 304.62 KB +258.52 KB +560.8%
store.vortex 1.0 vortex-compact 41.98 KB 265.84 KB +223.85 KB +533.2%
call_center.vortex 1.0 vortex-file-compressed 52.39 KB 323.46 KB +271.07 KB +517.4%
household_demographics.vortex 1.0 vortex-compact 9.72 KB 58.59 KB +48.87 KB +502.8%
web_site.vortex 1.0 vortex-compact 41.19 KB 248.11 KB +206.91 KB +502.3%
warehouse.vortex 1.0 vortex-compact 21.71 KB 125.89 KB +104.18 KB +479.9%
store.vortex 1.0 vortex-file-compressed 47.99 KB 276.20 KB +228.20 KB +475.5%
web_page.vortex 1.0 vortex-compact 23.91 KB 134.48 KB +110.56 KB +462.3%
ship_mode.vortex 1.0 vortex-compact 10.56 KB 59.11 KB +48.55 KB +459.8%
income_band.vortex 1.0 vortex-compact 5.14 KB 28.21 KB +23.07 KB +449.1%
warehouse.vortex 1.0 vortex-file-compressed 23.66 KB 126.78 KB +103.12 KB +435.8%
income_band.vortex 1.0 vortex-file-compressed 5.35 KB 28.25 KB +22.90 KB +428.2%
web_page.vortex 1.0 vortex-file-compressed 29.44 KB 152.38 KB +122.95 KB +417.6%
web_site.vortex 1.0 vortex-file-compressed 53.72 KB 272.32 KB +218.59 KB +406.9%
reason.vortex 1.0 vortex-compact 5.79 KB 28.32 KB +22.53 KB +388.9%
ship_mode.vortex 1.0 vortex-file-compressed 13.14 KB 64.14 KB +51.00 KB +388.2%
promotion.vortex 1.0 vortex-compact 50.96 KB 220.98 KB +170.02 KB +333.6%
household_demographics.vortex 1.0 vortex-file-compressed 16.20 KB 62.85 KB +46.65 KB +287.9%
reason.vortex 1.0 vortex-file-compressed 7.49 KB 28.77 KB +21.28 KB +284.2%
promotion.vortex 1.0 vortex-file-compressed 59.94 KB 230.20 KB +170.27 KB +284.1%
date_dim.vortex 1.0 vortex-compact 138.67 KB 377.39 KB +238.73 KB +172.2%
customer_demographics.vortex 1.0 vortex-compact 422.17 KB 837.79 KB +415.62 KB +98.4%
time_dim.vortex 1.0 vortex-compact 95.23 KB 185.16 KB +89.94 KB +94.4%
date_dim.vortex 1.0 vortex-file-compressed 910.61 KB 1.11 MB +227.20 KB +24.9%
catalog_page.vortex 1.0 vortex-compact 361.33 KB 436.82 KB +75.49 KB +20.9%
time_dim.vortex 1.0 vortex-file-compressed 441.29 KB 529.19 KB +87.90 KB +19.9%
customer_address.vortex 1.0 vortex-compact 638.19 KB 746.63 KB +108.45 KB +17.0%
customer_demographics.vortex 1.0 vortex-file-compressed 1.48 MB 1.73 MB +257.37 KB +17.0%
item.vortex 1.0 vortex-compact 998.46 KB 1.12 MB +152.61 KB +15.3%
catalog_page.vortex 1.0 vortex-file-compressed 585.52 KB 659.41 KB +73.90 KB +12.6%
customer_address.vortex 1.0 vortex-file-compressed 883.09 KB 984.41 KB +101.31 KB +11.5%
item.vortex 1.0 vortex-file-compressed 1.69 MB 1.84 MB +148.97 KB +8.6%
inventory.vortex 1.0 vortex-compact 16.06 MB 16.96 MB +917.80 KB +5.6%
web_returns.vortex 1.0 vortex-compact 2.99 MB 3.13 MB +143.99 KB +4.7%
web_returns.vortex 1.0 vortex-file-compressed 3.48 MB 3.62 MB +148.70 KB +4.2%
customer.vortex 1.0 vortex-compact 3.29 MB 3.42 MB +132.77 KB +3.9%
customer.vortex 1.0 vortex-file-compressed 4.29 MB 4.42 MB +136.72 KB +3.1%
inventory.vortex 1.0 vortex-file-compressed 36.63 MB 37.76 MB +1.13 MB +3.1%
catalog_returns.vortex 1.0 vortex-compact 6.03 MB 6.22 MB +184.88 KB +3.0%
catalog_returns.vortex 1.0 vortex-file-compressed 7.30 MB 7.51 MB +208.84 KB +2.8%
store_returns.vortex 1.0 vortex-compact 9.36 MB 9.52 MB +172.01 KB +1.8%
store_returns.vortex 1.0 vortex-file-compressed 11.12 MB 11.31 MB +193.44 KB +1.7%
web_sales.vortex 1.0 vortex-compact 29.43 MB 29.83 MB +412.59 KB +1.4%
web_sales.vortex 1.0 vortex-file-compressed 33.63 MB 34.02 MB +400.55 KB +1.2%
store_sales.vortex 1.0 vortex-compact 78.09 MB 78.94 MB +870.36 KB +1.1%
catalog_sales.vortex 1.0 vortex-file-compressed 69.36 MB 70.10 MB +766.44 KB +1.1%
catalog_sales.vortex 1.0 vortex-compact 59.44 MB 60.06 MB +626.30 KB +1.0%
store_sales.vortex 1.0 vortex-file-compressed 100.64 MB 101.37 MB +750.41 KB +0.7%

Totals:

  • vortex-compact: 207.81 MB → 213.43 MB (+2.7%)
  • vortex-file-compressed: 272.94 MB → 278.72 MB (+2.1%)

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -5.7%
Engines: DataFusion No clear signal (-5.4%, environment too noisy confidence) · DuckDB No clear signal (-6.0%, environment too noisy confidence)
Vortex (geomean): hot 0.922x ➖ · cold 0.927x ➖
Parquet (geomean): hot 0.977x ➖ · cold 0.927x ➖
Shifts: Parquet (control) -2.3% · Median polish -6.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.992x ➖, 3↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 230231269 / 212495404 / +8.3% 723571988 / 912126946 / -20.7% 0.32 / 0.23 / +36.6%
tpch_q02/datafusion:vortex-file-compressed 373734380 / 329761572 / +13.3% 662891176 / 649541700 / +2.1% 0.56 / 0.51 / +11.1%
tpch_q03/datafusion:vortex-file-compressed 350355374 / 381705259 / -8.2% 1045362554 / 1088939418 / -4.0% 0.34 / 0.35 / -4.4%
tpch_q04/datafusion:vortex-file-compressed 206567281 / 353322571 / -41.5% 🟢 508702320 / 529286015 / -3.9% 0.41 / 0.67 / -39.2%
tpch_q05/datafusion:vortex-file-compressed 383468452 / 423833929 / -9.5% 741011259 / 800711864 / -7.5% 0.52 / 0.53 / -2.2%
tpch_q06/datafusion:vortex-file-compressed 247616576 / 250258941 / -1.1% 391635307 / 500533749 / -21.8% 0.63 / 0.50 / +26.5%
tpch_q07/datafusion:vortex-file-compressed 403107197 / 376675474 / +7.0% 555606792 / 624919536 / -11.1% 0.73 / 0.60 / +20.4%
tpch_q08/datafusion:vortex-file-compressed 455156521 / 534616340 / -14.9% 639936428 / 608401986 / +5.2% 0.71 / 0.88 / -19.1%
tpch_q09/datafusion:vortex-file-compressed 818506026 / 458808694 / +78.4% 🔴 668337003 / 455973798 / +46.6% 🔴 1.22 / 1.01 / +21.7%
tpch_q10/datafusion:vortex-file-compressed 354144952 / 392851870 / -9.9% 519348488 / 588125858 / -11.7% 0.68 / 0.67 / +2.1%
tpch_q11/datafusion:vortex-file-compressed 404685248 / 265885417 / +52.2% 🔴 447111320 / 395433557 / +13.1% 0.91 / 0.67 / +34.6%
tpch_q12/datafusion:vortex-file-compressed 315245137 / 528284189 / -40.3% 🟢 451416749 / 716254598 / -37.0% 🟢 0.70 / 0.74 / -5.3%
tpch_q13/datafusion:vortex-file-compressed 187466447 / 158904654 / +18.0% 451626298 / 415349017 / +8.7% 0.42 / 0.38 / +8.5%
tpch_q14/datafusion:vortex-file-compressed 165295299 / 239950497 / -31.1% 🟢 318276607 / 332141698 / -4.2% 0.52 / 0.72 / -28.1%
tpch_q15/datafusion:vortex-file-compressed 342041758 / 313847765 / +9.0% 488732075 / 472455278 / +3.4% 0.70 / 0.66 / +5.4%
tpch_q16/datafusion:vortex-file-compressed 171508860 / 157261978 / +9.1% 327251716 / 293813506 / +11.4% 0.52 / 0.54 / -2.1%
tpch_q17/datafusion:vortex-file-compressed 466423565 / 341197056 / +36.7% 🔴 510557333 / 429489552 / +18.9% 0.91 / 0.79 / +15.0%
tpch_q18/datafusion:vortex-file-compressed 319391296 / 270082764 / +18.3% 450276196 / 420898783 / +7.0% 0.71 / 0.64 / +10.5%
tpch_q19/datafusion:vortex-file-compressed 380077680 / 456715140 / -16.8% 456671102 / 492213752 / -7.2% 0.83 / 0.93 / -10.3%
tpch_q20/datafusion:vortex-file-compressed 307893572 / 282574450 / +9.0% 764303953 / 435458262 / +75.5% 🔴 0.40 / 0.65 / -37.9%
tpch_q21/datafusion:vortex-file-compressed 423637137 / 571225163 / -25.8% 649775230 / 824560315 / -21.2% 0.65 / 0.69 / -5.9%
tpch_q22/datafusion:vortex-file-compressed 189760260 / 188218990 / +0.8% 322401555 / 321225366 / +0.4% 0.59 / 0.59 / +0.5%
datafusion / vortex-compact / ns (0.922x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 226230576 / 260315962 / -13.1% 637598640 / 810033291 / -21.3% 0.35 / 0.32 / +10.4%
tpch_q02/datafusion:vortex-compact 318453267 / 318957773 / -0.2% 650610859 / 717138638 / -9.3% 0.49 / 0.44 / +10.1%
tpch_q03/datafusion:vortex-compact 344297060 / 402865459 / -14.5% 828952696 / 921781255 / -10.1% 0.42 / 0.44 / -5.0%
tpch_q04/datafusion:vortex-compact 274935081 / 217390455 / +26.5% 356222023 / 481104113 / -26.0% 0.77 / 0.45 / +70.8%
tpch_q05/datafusion:vortex-compact 375175259 / 414396696 / -9.5% 515304042 / 547241107 / -5.8% 0.73 / 0.76 / -3.9%
tpch_q06/datafusion:vortex-compact 273281639 / 280286588 / -2.5% 437307956 / 439365995 / -0.5% 0.62 / 0.64 / -2.0%
tpch_q07/datafusion:vortex-compact 352965069 / 406265291 / -13.1% 550211535 / 488238410 / +12.7% 0.64 / 0.83 / -22.9%
tpch_q08/datafusion:vortex-compact 399654078 / 410224929 / -2.6% 637207442 / 629323492 / +1.3% 0.63 / 0.65 / -3.8%
tpch_q09/datafusion:vortex-compact 424071889 / 663957640 / -36.1% 🟢 439121258 / 1268145420 / -65.4% 🟢 0.97 / 0.52 / +84.5%
tpch_q10/datafusion:vortex-compact 320702618 / 414919916 / -22.7% 580109716 / 494058866 / +17.4% 0.55 / 0.84 / -34.2%
tpch_q11/datafusion:vortex-compact 308713315 / 300304065 / +2.8% 432176506 / 422037147 / +2.4% 0.71 / 0.71 / +0.4%
tpch_q12/datafusion:vortex-compact 317608648 / 358540023 / -11.4% 551757189 / 590325445 / -6.5% 0.58 / 0.61 / -5.2%
tpch_q13/datafusion:vortex-compact 101839798 / 131884301 / -22.8% 377843953 / 418528288 / -9.7% 0.27 / 0.32 / -14.5%
tpch_q14/datafusion:vortex-compact 161242082 / 183302949 / -12.0% 314083367 / 320682078 / -2.1% 0.51 / 0.57 / -10.2%
tpch_q15/datafusion:vortex-compact 302003232 / 351359993 / -14.0% 452889156 / 520532573 / -13.0% 0.67 / 0.68 / -1.2%
tpch_q16/datafusion:vortex-compact 146772997 / 142419505 / +3.1% 294152007 / 280472054 / +4.9% 0.50 / 0.51 / -1.7%
tpch_q17/datafusion:vortex-compact 447704073 / 351218636 / +27.5% 643220503 / 579282050 / +11.0% 0.70 / 0.61 / +14.8%
tpch_q18/datafusion:vortex-compact 244167561 / 249005871 / -1.9% 433110603 / 524158987 / -17.4% 0.56 / 0.48 / +18.7%
tpch_q19/datafusion:vortex-compact 388095971 / 456356805 / -15.0% 575045422 / 566152477 / +1.6% 0.67 / 0.81 / -16.3%
tpch_q20/datafusion:vortex-compact 260555695 / 311032633 / -16.2% 404734990 / 440814737 / -8.2% 0.64 / 0.71 / -8.8%
tpch_q21/datafusion:vortex-compact 501966447 / 476677575 / +5.3% 578414096 / 603230629 / -4.1% 0.87 / 0.79 / +9.8%
tpch_q22/datafusion:vortex-compact 180400105 / 190608234 / -5.4% 301189081 / 388636379 / -22.5% 0.60 / 0.49 / +22.1%
datafusion / parquet / ns (1.010x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 169392791 / 165898051 / +2.1% 471062757 / 548305944 / -14.1% 0.36 / 0.30 / +18.8%
tpch_q02/datafusion:parquet 253844594 / 305939681 / -17.0% 555565920 / 522837246 / +6.3% 0.46 / 0.59 / -21.9%
tpch_q03/datafusion:parquet 271866185 / 275962896 / -1.5% 759161451 / 744614676 / +2.0% 0.36 / 0.37 / -3.4%
tpch_q04/datafusion:parquet 133281738 / 164512906 / -19.0% 336024328 / 545844825 / -38.4% 🟢 0.40 / 0.30 / +31.6%
tpch_q05/datafusion:parquet 337631779 / 321614415 / +5.0% 468480929 / 515027020 / -9.0% 0.72 / 0.62 / +15.4%
tpch_q06/datafusion:parquet 128579569 / 132984475 / -3.3% 254806724 / 275628266 / -7.6% 0.50 / 0.48 / +4.6%
tpch_q07/datafusion:parquet 345174243 / 385492998 / -10.5% 527001605 / 543715897 / -3.1% 0.65 / 0.71 / -7.6%
tpch_q08/datafusion:parquet 403116939 / 420067618 / -4.0% 506500823 / 616234116 / -17.8% 0.80 / 0.68 / +16.8%
tpch_q09/datafusion:parquet 477234825 / 449952282 / +6.1% 776999331 / 562390399 / +38.2% 🔴 0.61 / 0.80 / -23.2%
tpch_q10/datafusion:parquet 382531449 / 369485600 / +3.5% 500822563 / 498000247 / +0.6% 0.76 / 0.74 / +2.9%
tpch_q11/datafusion:parquet 264157698 / 258472057 / +2.2% 407993487 / 442370111 / -7.8% 0.65 / 0.58 / +10.8%
tpch_q12/datafusion:parquet 293167759 / 189121813 / +55.0% 🔴 565956028 / 530961161 / +6.6% 0.52 / 0.36 / +45.4%
tpch_q13/datafusion:parquet 397759797 / 397936895 / -0.0% 531588435 / 583740302 / -8.9% 0.75 / 0.68 / +9.8%
tpch_q14/datafusion:parquet 159016884 / 160644279 / -1.0% 263085365 / 375994834 / -30.0% 🟢 0.60 / 0.43 / +41.5%
tpch_q15/datafusion:parquet 264982551 / 261740407 / +1.2% 408147462 / 462459131 / -11.7% 0.65 / 0.57 / +14.7%
tpch_q16/datafusion:parquet 102257949 / 108529039 / -5.8% 266677485 / 256471208 / +4.0% 0.38 / 0.42 / -9.4%
tpch_q17/datafusion:parquet 285920376 / 291988228 / -2.1% 405804281 / 430670965 / -5.8% 0.70 / 0.68 / +3.9%
tpch_q18/datafusion:parquet 412474513 / 406440887 / +1.5% 552711387 / 563818281 / -2.0% 0.75 / 0.72 / +3.5%
tpch_q19/datafusion:parquet 160075031 / 152184768 / +5.2% 360458105 / 287431304 / +25.4% 0.44 / 0.53 / -16.1%
tpch_q20/datafusion:parquet 239159348 / 279836185 / -14.5% 389396379 / 441966909 / -11.9% 0.61 / 0.63 / -3.0%
tpch_q21/datafusion:parquet 441849588 / 341769157 / +29.3% 506436992 / 654701592 / -22.6% 0.87 / 0.52 / +67.1%
tpch_q22/datafusion:parquet 173695665 / 154550679 / +12.4% 377193584 / 303312510 / +24.4% 0.46 / 0.51 / -9.6%
duckdb / vortex-file-compressed / ns (0.845x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 202157685 / 232124014 / -12.9% 247589377 / 346937658 / -28.6% 0.82 / 0.67 / +22.0%
tpch_q02/duckdb:vortex-file-compressed 368268002 / 402701759 / -8.6% 463840764 / 404297971 / +14.7% 0.79 / 1.00 / -20.3%
tpch_q03/duckdb:vortex-file-compressed 427789215 / 515177037 / -17.0% 455563688 / 784788858 / -42.0% 🟢 0.94 / 0.66 / +43.0%
tpch_q04/duckdb:vortex-file-compressed 299200615 / 399758894 / -25.2% 303876423 / 303155511 / +0.2% 0.98 / 1.32 / -25.3%
tpch_q05/duckdb:vortex-file-compressed 400614974 / 856420881 / -53.2% 🟢 444117087 / 617227298 / -28.0% 0.90 / 1.39 / -35.0%
tpch_q06/duckdb:vortex-file-compressed 266369753 / 297513617 / -10.5% 285014336 / 274731682 / +3.7% 0.93 / 1.08 / -13.7%
tpch_q07/duckdb:vortex-file-compressed 468712704 / 492705118 / -4.9% 522156825 / 541883231 / -3.6% 0.90 / 0.91 / -1.3%
tpch_q08/duckdb:vortex-file-compressed 545725237 / 666858296 / -18.2% 555030932 / 749955713 / -26.0% 0.98 / 0.89 / +10.6%
tpch_q09/duckdb:vortex-file-compressed 457416842 / 513928366 / -11.0% 464691916 / 568214713 / -18.2% 0.98 / 0.90 / +8.8%
tpch_q10/duckdb:vortex-file-compressed 444100322 / 496933929 / -10.6% 514850718 / 546767925 / -5.8% 0.86 / 0.91 / -5.1%
tpch_q11/duckdb:vortex-file-compressed 141739692 / 139720710 / +1.4% 164684851 / 207719811 / -20.7% 0.86 / 0.67 / +28.0%
tpch_q12/duckdb:vortex-file-compressed 394117459 / 648345851 / -39.2% 🟢 446656770 / 576992356 / -22.6% 0.88 / 1.12 / -21.5%
tpch_q13/duckdb:vortex-file-compressed 324780212 / 438960295 / -26.0% 414084344 / 428422769 / -3.3% 0.78 / 1.02 / -23.4%
tpch_q14/duckdb:vortex-file-compressed 224068470 / 255652658 / -12.4% 260900414 / 272616264 / -4.3% 0.86 / 0.94 / -8.4%
tpch_q15/duckdb:vortex-file-compressed 148951775 / 189090993 / -21.2% 183759012 / 250473164 / -26.6% 0.81 / 0.75 / +7.4%
tpch_q16/duckdb:vortex-file-compressed 209846264 / 174547463 / +20.2% 252175667 / 238114532 / +5.9% 0.83 / 0.73 / +13.5%
tpch_q17/duckdb:vortex-file-compressed 374432709 / 398503772 / -6.0% 404608660 / 429059537 / -5.7% 0.93 / 0.93 / -0.4%
tpch_q18/duckdb:vortex-file-compressed 327459718 / 464086519 / -29.4% 363880331 / 504851020 / -27.9% 0.90 / 0.92 / -2.1%
tpch_q19/duckdb:vortex-file-compressed 326586059 / 319192745 / +2.3% 343693968 / 348050799 / -1.3% 0.95 / 0.92 / +3.6%
tpch_q20/duckdb:vortex-file-compressed 373976683 / 393306059 / -4.9% 421182823 / 411405952 / +2.4% 0.89 / 0.96 / -7.1%
tpch_q21/duckdb:vortex-file-compressed 626953136 / 716463367 / -12.5% 815707757 / 790013682 / +3.3% 0.77 / 0.91 / -15.2%
tpch_q22/duckdb:vortex-file-compressed 122131508 / 134885337 / -9.5% 168668587 / 130946415 / +28.8% 0.72 / 1.03 / -29.7%
duckdb / vortex-compact / ns (0.933x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 210997933 / 202071117 / +4.4% 411471879 / 424328020 / -3.0% 0.51 / 0.48 / +7.7%
tpch_q02/duckdb:vortex-compact 417936631 / 357087082 / +17.0% 482458857 / 567903309 / -15.0% 0.87 / 0.63 / +37.8%
tpch_q03/duckdb:vortex-compact 400224168 / 413412338 / -3.2% 555759045 / 605113653 / -8.2% 0.72 / 0.68 / +5.4%
tpch_q04/duckdb:vortex-compact 249652819 / 303759372 / -17.8% 378662222 / 513899327 / -26.3% 0.66 / 0.59 / +11.5%
tpch_q05/duckdb:vortex-compact 433582861 / 465669778 / -6.9% 482069361 / 438676865 / +9.9% 0.90 / 1.06 / -15.3%
tpch_q06/duckdb:vortex-compact 274167545 / 292363566 / -6.2% 333938078 / 282502958 / +18.2% 0.82 / 1.03 / -20.7%
tpch_q07/duckdb:vortex-compact 394495780 / 443900065 / -11.1% 477760307 / 493277835 / -3.1% 0.83 / 0.90 / -8.2%
tpch_q08/duckdb:vortex-compact 490510357 / 561157149 / -12.6% 565691885 / 546543394 / +3.5% 0.87 / 1.03 / -15.5%
tpch_q09/duckdb:vortex-compact 431306245 / 509827363 / -15.4% 452476697 / 526804990 / -14.1% 0.95 / 0.97 / -1.5%
tpch_q10/duckdb:vortex-compact 432894799 / 466466667 / -7.2% 425819180 / 776985053 / -45.2% 🟢 1.02 / 0.60 / +69.3%
tpch_q11/duckdb:vortex-compact 131710994 / 137234465 / -4.0% 146630219 / 153133939 / -4.2% 0.90 / 0.90 / +0.2%
tpch_q12/duckdb:vortex-compact 433552082 / 545693067 / -20.6% 436084463 / 523457593 / -16.7% 0.99 / 1.04 / -4.6%
tpch_q13/duckdb:vortex-compact 381437503 / 230960391 / +65.2% 🔴 471009993 / 301046170 / +56.5% 🔴 0.81 / 0.77 / +5.6%
tpch_q14/duckdb:vortex-compact 223858868 / 242206407 / -7.6% 263086112 / 308551261 / -14.7% 0.85 / 0.78 / +8.4%
tpch_q15/duckdb:vortex-compact 173386127 / 206479006 / -16.0% 195420413 / 214233056 / -8.8% 0.89 / 0.96 / -7.9%
tpch_q16/duckdb:vortex-compact 178557658 / 174004147 / +2.6% 190611654 / 200006343 / -4.7% 0.94 / 0.87 / +7.7%
tpch_q17/duckdb:vortex-compact 364951338 / 401502520 / -9.1% 419922675 / 466031932 / -9.9% 0.87 / 0.86 / +0.9%
tpch_q18/duckdb:vortex-compact 262321757 / 310436315 / -15.5% 301634499 / 332680882 / -9.3% 0.87 / 0.93 / -6.8%
tpch_q19/duckdb:vortex-compact 330046967 / 437080733 / -24.5% 370165631 / 345789848 / +7.0% 0.89 / 1.26 / -29.5%
tpch_q20/duckdb:vortex-compact 343258957 / 364460304 / -5.8% 398892117 / 423391061 / -5.8% 0.86 / 0.86 / -0.0%
tpch_q21/duckdb:vortex-compact 519741271 / 693487082 / -25.1% 558209888 / 764202628 / -27.0% 0.93 / 0.91 / +2.6%
tpch_q22/duckdb:vortex-compact 111433662 / 108358155 / +2.8% 128280479 / 139191639 / -7.8% 0.87 / 0.78 / +11.6%
duckdb / parquet / ns (0.945x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 289734349 / 344941437 / -16.0% 317393751 / 320265021 / -0.9% 0.91 / 1.08 / -15.2%
tpch_q02/duckdb:parquet 619152014 / 654682727 / -5.4% 618938082 / 733454300 / -15.6% 1.00 / 0.89 / +12.1%
tpch_q03/duckdb:parquet 732653911 / 723972392 / +1.2% 832710560 / 1297299087 / -35.8% 🟢 0.88 / 0.56 / +57.7%
tpch_q04/duckdb:parquet 461404363 / 496175221 / -7.0% 458310853 / 512886329 / -10.6% 1.01 / 0.97 / +4.1%
tpch_q05/duckdb:parquet 936006779 / 1027529072 / -8.9% 859748619 / 1107983499 / -22.4% 1.09 / 0.93 / +17.4%
tpch_q06/duckdb:parquet 286219509 / 306555085 / -6.6% 295700359 / 363582457 / -18.7% 0.97 / 0.84 / +14.8%
tpch_q07/duckdb:parquet 877189692 / 1003962975 / -12.6% 833265966 / 998462609 / -16.5% 1.05 / 1.01 / +4.7%
tpch_q08/duckdb:parquet 1068006676 / 1012923219 / +5.4% 996367454 / 1102791371 / -9.7% 1.07 / 0.92 / +16.7%
tpch_q09/duckdb:parquet 991442217 / 1091185309 / -9.1% 1127980885 / 978344359 / +15.3% 0.88 / 1.12 / -21.2%
tpch_q10/duckdb:parquet 934531640 / 980605105 / -4.7% 964808560 / 1017561510 / -5.2% 0.97 / 0.96 / +0.5%
tpch_q11/duckdb:parquet 432236394 / 424153349 / +1.9% 373070045 / 589605628 / -36.7% 🟢 1.16 / 0.72 / +61.1%
tpch_q12/duckdb:parquet 550591838 / 536870845 / +2.6% 679180396 / 666733990 / +1.9% 0.81 / 0.81 / +0.7%
tpch_q13/duckdb:parquet 788667964 / 770696008 / +2.3% 924002439 / 936662022 / -1.4% 0.85 / 0.82 / +3.7%
tpch_q14/duckdb:parquet 469444920 / 546435974 / -14.1% 495311321 / 668121779 / -25.9% 0.95 / 0.82 / +15.9%
tpch_q15/duckdb:parquet 380821755 / 525618307 / -27.5% 361730838 / 331828246 / +9.0% 1.05 / 1.58 / -33.5%
tpch_q16/duckdb:parquet 485607995 / 477624322 / +1.7% 519840333 / 470422882 / +10.5% 0.93 / 1.02 / -8.0%
tpch_q17/duckdb:parquet 466795960 / 452906248 / +3.1% 529716395 / 435268133 / +21.7% 0.88 / 1.04 / -15.3%
tpch_q18/duckdb:parquet 599393677 / 698670045 / -14.2% 733604946 / 599644157 / +22.3% 0.82 / 1.17 / -29.9%
tpch_q19/duckdb:parquet 572603485 / 552354905 / +3.7% 636995277 / 677334843 / -6.0% 0.90 / 0.82 / +10.2%
tpch_q20/duckdb:parquet 799137286 / 860949261 / -7.2% 788969380 / 1167285367 / -32.4% 🟢 1.01 / 0.74 / +37.3%
tpch_q21/duckdb:parquet 683727818 / 715282074 / -4.4% 687991624 / 807227773 / -14.8% 0.99 / 0.89 / +12.2%
tpch_q22/duckdb:parquet 409578356 / 397359298 / +3.1% 445460579 / 422630633 / +5.4% 0.92 / 0.94 / -2.2%

@github-actions

github-actions Bot commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 0a5e328f vs base c93f5a9a
Verdict: Likely regression (high confidence)
Attributed Vortex impact: +424.8%
Engines: random-access Likely regression (+424.8%, high confidence)
Vortex (geomean): hot 5.174x ❌
Parquet (geomean): hot 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish +135.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
vortex / arrow-ipc / ns (0.888x ✅, 4↑ 0↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 71538 / 74138 / -3.5%
random-access/arrow-tokio-local-disk-footer 164016 / 166792 / -1.7%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 1319894 / 2502246 / -47.3% 🟢
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 1965070 / 2097099 / -6.3%
random-access/feature-vectors/uniform/arrow-tokio-local-disk 32159043 / 54090475 / -40.5% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 31923157 / 32201747 / -0.9%
random-access/nested-lists/correlated/arrow-tokio-local-disk 56744 / 62489 / -9.2%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 102068 / 109694 / -7.0%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1118636 / 1128498 / -0.9%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1148548 / 1241735 / -7.5%
random-access/nested-structs/correlated/arrow-tokio-local-disk 51789 / 56989 / -9.1%
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 89659 / 98180 / -8.7%
random-access/nested-structs/uniform/arrow-tokio-local-disk 841993 / 954305 / -11.8% 🟢
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 929779 / 1001935 / -7.2%
random-access/taxi/correlated/arrow-tokio-local-disk 123577 / 123709 / -0.1%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 218875 / 223929 / -2.3%
random-access/taxi/uniform/arrow-tokio-local-disk 2578314 / 2898817 / -11.1% 🟢
random-access/taxi/uniform/arrow-tokio-local-disk-footer 2827359 / 3042527 / -7.1%
random-access / vortex-file-compressed / ns (5.174x ❌, 0↑ 18↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 4099111 / 246051 / +1566.0% 🔴
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1856963 / 1245389 / +49.1% 🔴
random-access/feature-vectors/uniform/vortex-tokio-local-disk 7885647 / 1460723 / +439.8% 🔴
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 7961113 / 2712027 / +193.5% 🔴
random-access/nested-lists/correlated/vortex-tokio-local-disk 4626304 / 228962 / +1920.6% 🔴
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 867124 / 390856 / +121.9% 🔴
random-access/nested-lists/uniform/vortex-tokio-local-disk 5707851 / 750444 / +660.6% 🔴
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 6101177 / 982525 / +521.0% 🔴
random-access/nested-structs/correlated/vortex-tokio-local-disk 4722993 / 276552 / +1607.8% 🔴
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 1415994 / 525403 / +169.5% 🔴
random-access/nested-structs/uniform/vortex-tokio-local-disk 5548713 / 633029 / +776.5% 🔴
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 5954115 / 935500 / +536.5% 🔴
random-access/taxi/correlated/vortex-tokio-local-disk 6356553 / 685794 / +826.9% 🔴
random-access/taxi/correlated/vortex-tokio-local-disk-footer 3038706 / 1441517 / +110.8% 🔴
random-access/taxi/uniform/vortex-tokio-local-disk 8394628 / 2626503 / +219.6% 🔴
random-access/taxi/uniform/vortex-tokio-local-disk-footer 10063127 / 3864560 / +160.4% 🔴
random-access/vortex-tokio-local-disk 5404178 / 455963 / +1085.2% 🔴
random-access/vortex-tokio-local-disk-footer 1883344 / 1098276 / +71.5% 🔴
random-access / parquet / ns (0.986x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 103480580993 / 103855780644 / -0.4%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 103691337256 / 103864529848 / -0.2%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 103971487500 / 109841839881 / -5.3%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 104070556426 / 103858934719 / +0.2%
random-access/nested-lists/correlated/parquet-tokio-local-disk 131045458 / 132934703 / -1.4%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 131024879 / 131984566 / -0.7%
random-access/nested-lists/uniform/parquet-tokio-local-disk 130493993 / 133490005 / -2.2%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 130551571 / 133690341 / -2.3%
random-access/nested-structs/correlated/parquet-tokio-local-disk 7474334 / 7219715 / +3.5%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 7810658 / 8325871 / -6.2%
random-access/nested-structs/uniform/parquet-tokio-local-disk 7762193 / 7451982 / +4.2%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 7731860 / 7825121 / -1.2%
random-access/parquet-tokio-local-disk 117982355 / 123223410 / -4.3%
random-access/parquet-tokio-local-disk-footer 118137030 / 118945783 / -0.7%
random-access/taxi/correlated/parquet-tokio-local-disk 177076434 / 184368428 / -4.0%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 177321247 / 178420187 / -0.6%
random-access/taxi/uniform/parquet-tokio-local-disk 187560047 / 192123540 / -2.4%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 187136862 / 188053360 / -0.5%
random-access / lance / ns (0.987x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 282882 / 284073 / -0.4%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1239044 / 1268759 / -2.3%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1034096 / 1023262 / +1.1%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1996595 / 2021912 / -1.3%
random-access/lance-tokio-local-disk 514403 / 525814 / -2.2%
random-access/lance-tokio-local-disk-footer 1395248 / 1410340 / -1.1%
random-access/nested-lists/correlated/lance-tokio-local-disk 154457 / 156724 / -1.4%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 705390 / 713436 / -1.1%
random-access/nested-lists/uniform/lance-tokio-local-disk 849059 / 883182 / -3.9%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1410842 / 1408773 / +0.1%
random-access/nested-structs/correlated/lance-tokio-local-disk 266488 / 276261 / -3.5%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 637113 / 637723 / -0.1%
random-access/nested-structs/uniform/lance-tokio-local-disk 2339673 / 2361781 / -0.9%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2688376 / 2817947 / -4.6%
random-access/taxi/correlated/lance-tokio-local-disk 743151 / 737380 / +0.8%
random-access/taxi/correlated/lance-tokio-local-disk-footer 1943704 / 1948907 / -0.3%
random-access/taxi/uniform/lance-tokio-local-disk 8080017 / 8129926 / -0.6%
random-access/taxi/uniform/lance-tokio-local-disk-footer 8913855 / 9006521 / -1.0%

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

changelog/performance A performance improvement

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@joseph-isaacs