Skip to content

Group related conjuncts back together in the scan filter - #9877

Draft
joseph-isaacs wants to merge 3 commits into
developfrom
claude/conjunct-grouping-scan-builder-8sjfly
Draft

joseph-isaacs wants to merge 3 commits into
developfrom
claude/conjunct-grouping-scan-builder-8sjfly

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Sep 14, 2026

Copy link
Copy Markdown
Contributor

Summary

FilterExpr splits a filter on AND so each conjunct can be reordered and short-circuited on its own selectivity. That costs a separate decode of a column every time two conjuncts read it.

This regroups the conjuncts after splitting, trading scheduling granularity for a single pass over the columns a group shares.

Changes

vortex-layout/src/scan/filter.rs gains a ConjunctGrouping, selected at runtime by VORTEX_CONJUNCT_GROUPING:

value rule
shared (default) merge conjuncts sharing any field path, transitively via union-find, so a > 5 AND a < b AND b = 2 becomes one group
same merge only conjuncts whose referenced field paths are equal
none previous behaviour

Grouping is by connected component, and both the groups and their members keep the original conjunct order. FilterExpr::new becomes fallible, since the field-path analysis can error; RepeatedScan::execute propagates that.

Which queries this actually affects

Expression::optimize_recursive already runs find_between, which folds every same-column literal range (</<= paired with >/>=) into a single Between before the scan sees the filter. So the textbook a > 5 AND a < 10 case is handled upstream, and same finds nothing to group anywhere in TPC-H. It is kept as a selectable option to make that distinction explicit and measurable.

What survives for shared is TPC-H q12, whose lineitem filter reaches the scan as:

l_shipmode IN (MAIL, SHIP)
l_receiptdate > l_commitdate     ┐
l_shipdate    < l_commitdate     ├─ chained via l_commitdate → l_receiptdate
Between(l_receiptdate, …)        ┘

The three date conjuncts chain into one group: 4 conjuncts down to 2. (q19's part-side merges 2→1, but part is small enough that it does not show.)

Benchmark results

Full action/bench-all run on this commit. q12 is the query with anything to group, and it improves on every Vortex target, on both engines, at both NVMe scale factors, while the Parquet controls stay flat — Parquet does not go through the Vortex scan filter, so a real effect should show exactly this asymmetry.

q12 hot, PR vs base:

target SF=1 NVMe SF=10 NVMe
datafusion:vortex-file-compressed −7.7% −12.8% 🟢
datafusion:vortex-compact −5.7% −5.2%
duckdb:vortex-file-compressed −13.2% 🟢 −21.0% 🟢
duckdb:vortex-compact −0.9% −8.3%
datafusion:parquet (control) −0.3% +0.6%
duckdb:parquet (control) −0.5% +2.1%

The effect grows with scale factor, as expected: the larger the row count, the more the duplicated per-conjunct column decode costs. The S3 variants show the same direction and larger magnitudes, but those suites are flagged environment too noisy, so they are directional only.

No regressions. All fourteen benchmark suites report No clear signal, with Vortex geomeans at or slightly below 1.0 — including TPC-H SF=1/SF=10, TPC-DS, ClickBench (plain and sorted), FineWeb, Appian, PolarSignals, StatPopGen, random-access, string and compression. Scattered ±5-18% movements on non-q12 queries fall on queries where the grouping provably cannot act, and run in both directions; that is the noise the runner's low-confidence verdict reflects.

Local measurement, and why it needed care

A sequential A/B sweep is worthless on a small box: the same none configuration measured 1.76x faster from position 3 than position 1, purely on page-cache warming, and a none-vs-none control showed ±27% per-query swings. Measuring by round-robin interleaving with none, so drift is common-mode, q12 came out faster in 8/8 rounds (median ratio 0.852) and again in 7/8 on an independent re-check (median 0.911, pooled min 0.850). The CI run above is the clean confirmation.

Testing

  • cargo clippy -p vortex-layout --all-targets --all-features -- -D warnings — clean.
  • cargo test -p vortex-layout --lib — 306 passed, 0 failed.

New tests in scan::filter::tests cover grouping a range over one field, same keeping a partial field overlap apart, shared grouping transitively across a bridging conjunct, and disjoint fields never grouping under any setting.

🤖 Generated with Claude Code

https://claude.ai/code/session_01HVk8ebAE2G3oJgMe1UaSfq

`FilterExpr` splits a filter on `AND` so each conjunct can be reordered and
short-circuited on its own selectivity. That costs a separate decode of a
column every time two conjuncts read it.

Regroup the conjuncts after splitting, under a `ConjunctGrouping` selected at
runtime by `VORTEX_CONJUNCT_GROUPING`:

- `shared` (default) merges conjuncts sharing any field path, transitively via
  union-find, so `a > 5 AND a < b AND b = 2` becomes one group;
- `same` merges only conjuncts whose referenced field paths are equal;
- `none` keeps the previous behaviour.

Grouping is by connected component, and both the groups and their members keep
the original conjunct order.

`shared` is the default on TPC-H sf1 evidence. Measured by round-robin
interleaving the three settings (a sequential A/B/C sweep is worthless here: the
same `none` configuration ran 1.76x faster from position 3 than position 1 on
page-cache warming alone). Interleaved, q12 is faster in 8 of 8 rounds, median
ratio 0.852; q1/q6/q19 sit within noise at 0.99-1.04.

q12 is the query that has anything to group: its lineitem filter keeps
`l_receiptdate > l_commitdate`, `l_shipdate < l_commitdate` and a
`l_receiptdate` range, which chain into one group of 4 conjuncts down to 2.
`same` finds nothing to do anywhere in TPC-H, because `find_between` already
folds every same-column literal range into a single `Between` before the scan
sees the filter.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01HVk8ebAE2G3oJgMe1UaSfq
@joseph-isaacs joseph-isaacs added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 14, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Sep 14, 2026
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Sep 14, 2026 — with Claude
@github-actions

github-actions Bot commented Sep 14, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 21050aa random-access-bench 1 Explore Profiling Data
🟢 Done 21050aa compress-bench 1 Explore Profiling Data
🟢 Done 21050aa string-bench 1 Explore Profiling Data
🟢 Done 21050aa statpopgen 1 Explore Profiling Data
🟢 Done 21050aa clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 21050aa tpch-nvme-10 1 Explore Profiling Data
🟢 Done 21050aa fineweb 1 Explore Profiling Data
🟢 Done 21050aa tpch-s3-10 1 Explore Profiling Data
🟢 Done 21050aa tpcds-nvme 1 Explore Profiling Data
🟢 Done 21050aa clickbench-nvme 1 Explore Profiling Data
🟢 Done 21050aa fineweb-s3 1 Explore Profiling Data
🟢 Done 21050aa appian-nvme 1 Explore Profiling Data
🟢 Done 21050aa tpch-s3 1 Explore Profiling Data
🟢 Done 21050aa polarsignals 1 Explore Profiling Data
🟢 Done 21050aa tpch-nvme 1 Explore Profiling Data

Powered by Polar Signals Cloud

@codspeed

codspeed Bot commented Sep 14, 2026

Copy link
Copy Markdown

Merging this PR will improve performance by 11.09%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
✅ 2201 untouched benchmarks
⏩ 218 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
WallTime mul_i32_nonnull_avx512 7.9 µs 7.1 µs +11.09%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing claude/conjunct-grouping-scan-builder-8sjfly (c47ccbe) with develop (4af09a9)

Open in CodSpeed

Footnotes

  1. 218 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR 21050aa4 vs base 64654627
Vortex (geomean): hot 0.990x ➖ · cold 0.927x ➖


datafusion / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 45262070 / 45019814 / +0.5% 86811636 / 84699256 / +2.5% 0.52 / 0.53 / -1.9%
polarsignals_q01/datafusion:vortex-file-compressed 50702732 / 50742391 / -0.1% 107690982 / 108949676 / -1.2% 0.47 / 0.47 / +1.1%
polarsignals_q02/datafusion:vortex-file-compressed 35125667 / 36985601 / -5.0% 71068071 / 75693098 / -6.1% 0.49 / 0.49 / +1.2%
polarsignals_q03/datafusion:vortex-file-compressed 54032065 / 53526982 / +0.9% 113838565 / 119910473 / -5.1% 0.47 / 0.45 / +6.3%
polarsignals_q04/datafusion:vortex-file-compressed 9609480 / 9482288 / +1.3% 41333734 / 52259916 / -20.9% 🟢 0.23 / 0.18 / +28.1%
polarsignals_q05/datafusion:vortex-file-compressed 11265793 / 12208728 / -7.7% 46892956 / 57507325 / -18.5% 🟢 0.24 / 0.21 / +13.2%
polarsignals_q06/datafusion:vortex-file-compressed 21335316 / 20774886 / +2.7% 54840662 / 62080493 / -11.7% 🟢 0.39 / 0.33 / +16.3%
polarsignals_q07/datafusion:vortex-file-compressed 11193871 / 11501124 / -2.7% 49960984 / 51340786 / -2.7% 0.22 / 0.22 / +0.0%
polarsignals_q08/datafusion:vortex-file-compressed 101080815 / 100120418 / +1.0% 159927621 / 169798095 / -5.8% 0.63 / 0.59 / +7.2%
polarsignals_q09/datafusion:vortex-file-compressed 9942498 / 9983463 / -0.4% 49827859 / 50100897 / -0.5% 0.20 / 0.20 / +0.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.010x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.003x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 16461759 / 16767282 / -1.8% 46327907 / 46505940 / -0.4% 0.36 / 0.36 / -1.4%
tpch_q02/datafusion:vortex-file-compressed 17323997 / 17396033 / -0.4% 37630692 / 36052552 / +4.4% 0.46 / 0.48 / -4.6%
tpch_q03/datafusion:vortex-file-compressed 19159752 / 19803629 / -3.3% 49503573 / 46569357 / +6.3% 0.39 / 0.43 / -9.0%
tpch_q04/datafusion:vortex-file-compressed 10039889 / 10218246 / -1.7% 35298790 / 32764934 / +7.7% 0.28 / 0.31 / -8.8%
tpch_q05/datafusion:vortex-file-compressed 37172439 / 37449970 / -0.7% 66531390 / 63934634 / +4.1% 0.56 / 0.59 / -4.6%
tpch_q06/datafusion:vortex-file-compressed 6275911 / 6283975 / -0.1% 30647748 / 28629889 / +7.0% 0.20 / 0.22 / -6.7%
tpch_q07/datafusion:vortex-file-compressed 51839310 / 52132831 / -0.6% 83123603 / 82710362 / +0.5% 0.62 / 0.63 / -1.1%
tpch_q08/datafusion:vortex-file-compressed 52649539 / 52097658 / +1.1% 83364936 / 80812624 / +3.2% 0.63 / 0.64 / -2.0%
tpch_q09/datafusion:vortex-file-compressed 51200089 / 50085621 / +2.2% 79519246 / 79081607 / +0.6% 0.64 / 0.63 / +1.7%
tpch_q10/datafusion:vortex-file-compressed 16881690 / 16860049 / +0.1% 50482126 / 50293401 / +0.4% 0.33 / 0.34 / -0.2%
tpch_q11/datafusion:vortex-file-compressed 14974194 / 14950737 / +0.2% 33789850 / 33156577 / +1.9% 0.44 / 0.45 / -1.7%
tpch_q12/datafusion:vortex-file-compressed 21275224 / 23060260 / -7.7% 46404919 / 47436647 / -2.2% 0.46 / 0.49 / -5.7%
tpch_q13/datafusion:vortex-file-compressed 20190252 / 20270080 / -0.4% 39526697 / 39910164 / -1.0% 0.51 / 0.51 / +0.6%
tpch_q14/datafusion:vortex-file-compressed 14711189 / 15121553 / -2.7% 40044712 / 39398240 / +1.6% 0.37 / 0.38 / -4.3%
tpch_q15/datafusion:vortex-file-compressed 18699144 / 18547148 / +0.8% 46073941 / 45750797 / +0.7% 0.41 / 0.41 / +0.1%
tpch_q16/datafusion:vortex-file-compressed 18674132 / 18283742 / +2.1% 37573764 / 37291736 / +0.8% 0.50 / 0.49 / +1.4%
tpch_q17/datafusion:vortex-file-compressed 27914318 / 27945436 / -0.1% 59688608 / 58606913 / +1.8% 0.47 / 0.48 / -1.9%
tpch_q18/datafusion:vortex-file-compressed 36851759 / 37491008 / -1.7% 58750606 / 59456411 / -1.2% 0.63 / 0.63 / -0.5%
tpch_q19/datafusion:vortex-file-compressed 13596129 / 13622193 / -0.2% 38287002 / 38554364 / -0.7% 0.36 / 0.35 / +0.5%
tpch_q20/datafusion:vortex-file-compressed 21158078 / 20932023 / +1.1% 45279218 / 43997780 / +2.9% 0.47 / 0.48 / -1.8%
tpch_q21/datafusion:vortex-file-compressed 39463128 / 38962791 / +1.3% 68551008 / 66717084 / +2.7% 0.58 / 0.58 / -1.4%
tpch_q22/datafusion:vortex-file-compressed 11166624 / 11072684 / +0.8% 32311605 / 31696681 / +1.9% 0.35 / 0.35 / -1.1%
datafusion / vortex-compact / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 18202311 / 17153273 / +6.1% 44801964 / 43008537 / +4.2% 0.41 / 0.40 / +1.9%
tpch_q02/datafusion:vortex-compact 20028358 / 19836504 / +1.0% 36102617 / 36542283 / -1.2% 0.55 / 0.54 / +2.2%
tpch_q03/datafusion:vortex-compact 20160071 / 20335866 / -0.9% 46179242 / 47708370 / -3.2% 0.44 / 0.43 / +2.4%
tpch_q04/datafusion:vortex-compact 11623394 / 11325582 / +2.6% 32437079 / 31729930 / +2.2% 0.36 / 0.36 / +0.4%
tpch_q05/datafusion:vortex-compact 38339390 / 37777317 / +1.5% 65887225 / 64492764 / +2.2% 0.58 / 0.59 / -0.7%
tpch_q06/datafusion:vortex-compact 6907354 / 6705677 / +3.0% 28837599 / 29058418 / -0.8% 0.24 / 0.23 / +3.8%
tpch_q07/datafusion:vortex-compact 52514787 / 52124728 / +0.7% 81759387 / 81981753 / -0.3% 0.64 / 0.64 / +1.0%
tpch_q08/datafusion:vortex-compact 53172482 / 52954772 / +0.4% 84115723 / 84071639 / +0.1% 0.63 / 0.63 / +0.4%
tpch_q09/datafusion:vortex-compact 50741202 / 51314845 / -1.1% 80317937 / 76989109 / +4.3% 0.63 / 0.67 / -5.2%
tpch_q10/datafusion:vortex-compact 19262931 / 18926664 / +1.8% 49905516 / 49495574 / +0.8% 0.39 / 0.38 / +0.9%
tpch_q11/datafusion:vortex-compact 16044193 / 16093128 / -0.3% 34686614 / 34335503 / +1.0% 0.46 / 0.47 / -1.3%
tpch_q12/datafusion:vortex-compact 23357434 / 24770238 / -5.7% 46369706 / 44596871 / +4.0% 0.50 / 0.56 / -9.3%
tpch_q13/datafusion:vortex-compact 20898555 / 21106289 / -1.0% 39515127 / 40354840 / -2.1% 0.53 / 0.52 / +1.1%
tpch_q14/datafusion:vortex-compact 16429552 / 16590366 / -1.0% 40278840 / 40990017 / -1.7% 0.41 / 0.40 / +0.8%
tpch_q15/datafusion:vortex-compact 20181508 / 19980688 / +1.0% 44700875 / 45836828 / -2.5% 0.45 / 0.44 / +3.6%
tpch_q16/datafusion:vortex-compact 19659983 / 19206283 / +2.4% 38577086 / 38780774 / -0.5% 0.51 / 0.50 / +2.9%
tpch_q17/datafusion:vortex-compact 29174014 / 28936332 / +0.8% 58473396 / 55871347 / +4.7% 0.50 / 0.52 / -3.7%
tpch_q18/datafusion:vortex-compact 38467945 / 38286038 / +0.5% 59430334 / 59119139 / +0.5% 0.65 / 0.65 / -0.1%
tpch_q19/datafusion:vortex-compact 16703523 / 16639055 / +0.4% 43440970 / 40777319 / +6.5% 0.38 / 0.41 / -5.8%
tpch_q20/datafusion:vortex-compact 22068365 / 21893985 / +0.8% 45984389 / 45270701 / +1.6% 0.48 / 0.48 / -0.8%
tpch_q21/datafusion:vortex-compact 42084891 / 41996571 / +0.2% 69868961 / 68601990 / +1.8% 0.60 / 0.61 / -1.6%
tpch_q22/datafusion:vortex-compact 12054609 / 11469540 / +5.1% 31232455 / 33431606 / -6.6% 0.39 / 0.34 / +12.5%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 67129432 / 67634215 / -0.7% 84506603 / 85379161 / -1.0% 0.79 / 0.79 / +0.3%
tpch_q02/datafusion:parquet 52893268 / 53470094 / -1.1% 70586883 / 72729795 / -2.9% 0.75 / 0.74 / +1.9%
tpch_q03/datafusion:parquet 72678420 / 72771654 / -0.1% 99413967 / 95876417 / +3.7% 0.73 / 0.76 / -3.7%
tpch_q04/datafusion:parquet 39997185 / 40117643 / -0.3% 59976650 / 61766218 / -2.9% 0.67 / 0.65 / +2.7%
tpch_q05/datafusion:parquet 89095724 / 88582617 / +0.6% 118657352 / 116801896 / +1.6% 0.75 / 0.76 / -1.0%
tpch_q06/datafusion:parquet 28442004 / 28447610 / -0.0% 47809166 / 46345165 / +3.2% 0.59 / 0.61 / -3.1%
tpch_q07/datafusion:parquet 95646157 / 94180372 / +1.6% 125358728 / 120176090 / +4.3% 0.76 / 0.78 / -2.6%
tpch_q08/datafusion:parquet 98089570 / 97789560 / +0.3% 123593186 / 126939800 / -2.6% 0.79 / 0.77 / +3.0%
tpch_q09/datafusion:parquet 114213292 / 113738638 / +0.4% 147334739 / 147272838 / +0.0% 0.78 / 0.77 / +0.4%
tpch_q10/datafusion:parquet 80541745 / 79161880 / +1.7% 112880386 / 111087121 / +1.6% 0.71 / 0.71 / +0.1%
tpch_q11/datafusion:parquet 38934569 / 39327582 / -1.0% 61895024 / 61708916 / +0.3% 0.63 / 0.64 / -1.3%
tpch_q12/datafusion:parquet 62025050 / 62226901 / -0.3% 92438518 / 89827449 / +2.9% 0.67 / 0.69 / -3.1%
tpch_q13/datafusion:parquet 160043856 / 159919232 / +0.1% 184318635 / 182283249 / +1.1% 0.87 / 0.88 / -1.0%
tpch_q14/datafusion:parquet 40470571 / 39876623 / +1.5% 66286508 / 64728260 / +2.4% 0.61 / 0.62 / -0.9%
tpch_q15/datafusion:parquet 46462501 / 46511275 / -0.1% 71409035 / 69226561 / +3.2% 0.65 / 0.67 / -3.2%
tpch_q16/datafusion:parquet 38624778 / 38603073 / +0.1% 56929535 / 57725089 / -1.4% 0.68 / 0.67 / +1.5%
tpch_q17/datafusion:parquet 117526100 / 117975509 / -0.4% 143806746 / 140803546 / +2.1% 0.82 / 0.84 / -2.5%
tpch_q18/datafusion:parquet 115194335 / 115409791 / -0.2% 140046301 / 135814875 / +3.1% 0.82 / 0.85 / -3.2%
tpch_q19/datafusion:parquet 49804148 / 50579859 / -1.5% 78325100 / 79722465 / -1.8% 0.64 / 0.63 / +0.2%
tpch_q20/datafusion:parquet 59197066 / 59204257 / -0.0% 85219352 / 84484577 / +0.9% 0.69 / 0.70 / -0.9%
tpch_q21/datafusion:parquet 98902646 / 99117913 / -0.2% 123769362 / 124604648 / -0.7% 0.80 / 0.80 / +0.5%
tpch_q22/datafusion:parquet 41432114 / 41620572 / -0.5% 61175622 / 59727899 / +2.4% 0.68 / 0.70 / -2.8%
duckdb / vortex-file-compressed / ns (0.995x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 11510113 / 10773132 / +6.8% 21087384 / 22172735 / -4.9% 0.55 / 0.49 / +12.3%
tpch_q02/duckdb:vortex-file-compressed 17302137 / 17670887 / -2.1% 26857929 / 27169216 / -1.1% 0.64 / 0.65 / -1.0%
tpch_q03/duckdb:vortex-file-compressed 18051662 / 18676858 / -3.3% 33720379 / 36438407 / -7.5% 0.54 / 0.51 / +4.4%
tpch_q04/duckdb:vortex-file-compressed 17886451 / 17182056 / +4.1% 32586938 / 33196050 / -1.8% 0.55 / 0.52 / +6.0%
tpch_q05/duckdb:vortex-file-compressed 22134865 / 22252677 / -0.5% 38741885 / 38416525 / +0.8% 0.57 / 0.58 / -1.4%
tpch_q06/duckdb:vortex-file-compressed 6045531 / 6123049 / -1.3% 16489015 / 14274260 / +15.5% 🔴 0.37 / 0.43 / -14.5%
tpch_q07/duckdb:vortex-file-compressed 20775211 / 21099468 / -1.5% 36906812 / 38375751 / -3.8% 0.56 / 0.55 / +2.4%
tpch_q08/duckdb:vortex-file-compressed 23541792 / 23943753 / -1.7% 38406475 / 38150468 / +0.7% 0.61 / 0.63 / -2.3%
tpch_q09/duckdb:vortex-file-compressed 29104623 / 30867872 / -5.7% 48462461 / 50875523 / -4.7% 0.60 / 0.61 / -1.0%
tpch_q10/duckdb:vortex-file-compressed 29098821 / 29212304 / -0.4% 49507132 / 45864468 / +7.9% 0.59 / 0.64 / -7.7%
tpch_q11/duckdb:vortex-file-compressed 8133604 / 8210963 / -0.9% 17073978 / 14720570 / +16.0% 🔴 0.48 / 0.56 / -14.6%
tpch_q12/duckdb:vortex-file-compressed 14407452 / 16598053 / -13.2% 🟢 29022176 / 32657475 / -11.1% 🟢 0.50 / 0.51 / -2.3%
tpch_q13/duckdb:vortex-file-compressed 20748333 / 22244327 / -6.7% 43874234 / 39323577 / +11.6% 🔴 0.47 / 0.57 / -16.4%
tpch_q14/duckdb:vortex-file-compressed 13219887 / 13345247 / -0.9% 26469935 / 24257029 / +9.1% 0.50 / 0.55 / -9.2%
tpch_q15/duckdb:vortex-file-compressed 10637110 / 10259101 / +3.7% 21522580 / 19896902 / +8.2% 0.49 / 0.52 / -4.1%
tpch_q16/duckdb:vortex-file-compressed 18450457 / 18451737 / -0.0% 25791535 / 24038471 / +7.3% 0.72 / 0.77 / -6.8%
tpch_q17/duckdb:vortex-file-compressed 15718987 / 15402961 / +2.1% 32894505 / 34009731 / -3.3% 0.48 / 0.45 / +5.5%
tpch_q18/duckdb:vortex-file-compressed 25034952 / 25039445 / -0.0% 35569628 / 38491441 / -7.6% 0.70 / 0.65 / +8.2%
tpch_q19/duckdb:vortex-file-compressed 23486468 / 23743886 / -1.1% 40393430 / 36457756 / +10.8% 🔴 0.58 / 0.65 / -10.7%
tpch_q20/duckdb:vortex-file-compressed 17203924 / 17639572 / -2.5% 33410385 / 37551662 / -11.0% 🟢 0.51 / 0.47 / +9.6%
tpch_q21/duckdb:vortex-file-compressed 67595400 / 67474751 / +0.2% 85144379 / 84521416 / +0.7% 0.79 / 0.80 / -0.6%
tpch_q22/duckdb:vortex-file-compressed 14123490 / 11946979 / +18.2% 🔴 20692642 / 22119788 / -6.5% 0.68 / 0.54 / +26.4%
duckdb / vortex-compact / ns (0.997x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 14435903 / 12442341 / +16.0% 🔴 23447850 / 24484150 / -4.2% 0.62 / 0.51 / +21.2%
tpch_q02/duckdb:vortex-compact 20040031 / 20245155 / -1.0% 29324687 / 27867098 / +5.2% 0.68 / 0.73 / -5.9%
tpch_q03/duckdb:vortex-compact 19314966 / 20926932 / -7.7% 37915873 / 34299523 / +10.5% 🔴 0.51 / 0.61 / -16.5%
tpch_q04/duckdb:vortex-compact 18583519 / 18682332 / -0.5% 30978595 / 32947144 / -6.0% 0.60 / 0.57 / +5.8%
tpch_q05/duckdb:vortex-compact 22506996 / 22013384 / +2.2% 37487313 / 36634248 / +2.3% 0.60 / 0.60 / -0.1%
tpch_q06/duckdb:vortex-compact 5834293 / 6073188 / -3.9% 17646777 / 16043139 / +10.0% 0.33 / 0.38 / -12.7%
tpch_q07/duckdb:vortex-compact 22550619 / 21876596 / +3.1% 36892573 / 37194542 / -0.8% 0.61 / 0.59 / +3.9%
tpch_q08/duckdb:vortex-compact 26104759 / 25871740 / +0.9% 43309646 / 41336946 / +4.8% 0.60 / 0.63 / -3.7%
tpch_q09/duckdb:vortex-compact 31411597 / 31247587 / +0.5% 45644305 / 44693212 / +2.1% 0.69 / 0.70 / -1.6%
tpch_q10/duckdb:vortex-compact 31891165 / 31044729 / +2.7% 49338132 / 46428455 / +6.3% 0.65 / 0.67 / -3.3%
tpch_q11/duckdb:vortex-compact 9391870 / 9410113 / -0.2% 19066677 / 16402052 / +16.2% 🔴 0.49 / 0.57 / -14.1%
tpch_q12/duckdb:vortex-compact 18946965 / 19120092 / -0.9% 26206177 / 33205534 / -21.1% 🟢 0.72 / 0.58 / +25.6%
tpch_q13/duckdb:vortex-compact 22499293 / 22910413 / -1.8% 45165264 / 45144086 / +0.0% 0.50 / 0.51 / -1.8%
tpch_q14/duckdb:vortex-compact 14529722 / 14673570 / -1.0% 26767736 / 27029354 / -1.0% 0.54 / 0.54 / -0.0%
tpch_q15/duckdb:vortex-compact 10777283 / 11031102 / -2.3% 21252574 / 20748109 / +2.4% 0.51 / 0.53 / -4.6%
tpch_q16/duckdb:vortex-compact 20227176 / 20023929 / +1.0% 26190313 / 26493673 / -1.1% 0.77 / 0.76 / +2.2%
tpch_q17/duckdb:vortex-compact 16557040 / 17137768 / -3.4% 37289690 / 34404028 / +8.4% 0.44 / 0.50 / -10.9%
tpch_q18/duckdb:vortex-compact 26555234 / 26155295 / +1.5% 36020580 / 35312920 / +2.0% 0.74 / 0.74 / -0.5%
tpch_q19/duckdb:vortex-compact 24668736 / 26088164 / -5.4% 36776703 / 41381316 / -11.1% 🟢 0.67 / 0.63 / +6.4%
tpch_q20/duckdb:vortex-compact 19221616 / 18871023 / +1.9% 37503687 / 33878332 / +10.7% 🔴 0.51 / 0.56 / -8.0%
tpch_q21/duckdb:vortex-compact 68573376 / 69924426 / -1.9% 83150814 / 91549672 / -9.2% 0.82 / 0.76 / +8.0%
tpch_q22/duckdb:vortex-compact 14357729 / 14926085 / -3.8% 22532561 / 24026827 / -6.2% 0.64 / 0.62 / +2.6%
duckdb / parquet / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 60240472 / 60327044 / -0.1% 66035929 / 66336170 / -0.5% 0.91 / 0.91 / +0.3%
tpch_q02/duckdb:parquet 34561610 / 34878352 / -0.9% 42427243 / 43482172 / -2.4% 0.81 / 0.80 / +1.6%
tpch_q03/duckdb:parquet 62224674 / 62496511 / -0.4% 73612069 / 73889430 / -0.4% 0.85 / 0.85 / -0.1%
tpch_q04/duckdb:parquet 43196366 / 43649613 / -1.0% 53099921 / 53011827 / +0.2% 0.81 / 0.82 / -1.2%
tpch_q05/duckdb:parquet 60436262 / 61076441 / -1.0% 72942529 / 72590975 / +0.5% 0.83 / 0.84 / -1.5%
tpch_q06/duckdb:parquet 20181393 / 20283029 / -0.5% 24533419 / 23805802 / +3.1% 0.82 / 0.85 / -3.5%
tpch_q07/duckdb:parquet 60581841 / 60855892 / -0.5% 71090048 / 71243107 / -0.2% 0.85 / 0.85 / -0.2%
tpch_q08/duckdb:parquet 72734647 / 73639271 / -1.2% 85914902 / 86038675 / -0.1% 0.85 / 0.86 / -1.1%
tpch_q09/duckdb:parquet 114100957 / 113880263 / +0.2% 127928597 / 127184117 / +0.6% 0.89 / 0.90 / -0.4%
tpch_q10/duckdb:parquet 108265775 / 110038736 / -1.6% 122442202 / 121304027 / +0.9% 0.88 / 0.91 / -2.5%
tpch_q11/duckdb:parquet 19803220 / 20065359 / -1.3% 23540618 / 24110713 / -2.4% 0.84 / 0.83 / +1.1%
tpch_q12/duckdb:parquet 41098641 / 41292253 / -0.5% 49042352 / 48951826 / +0.2% 0.84 / 0.84 / -0.7%
tpch_q13/duckdb:parquet 239205609 / 239074001 / +0.1% 248465918 / 248470674 / -0.0% 0.96 / 0.96 / +0.1%
tpch_q14/duckdb:parquet 43495497 / 43550517 / -0.1% 52722320 / 51588060 / +2.2% 0.82 / 0.84 / -2.3%
tpch_q15/duckdb:parquet 27217487 / 27843188 / -2.2% 31091196 / 31129241 / -0.1% 0.88 / 0.89 / -2.1%
tpch_q16/duckdb:parquet 49960694 / 51375989 / -2.8% 56896626 / 58214459 / -2.3% 0.88 / 0.88 / -0.5%
tpch_q17/duckdb:parquet 44380392 / 44532259 / -0.3% 54361168 / 54385194 / -0.0% 0.82 / 0.82 / -0.3%
tpch_q18/duckdb:parquet 89937254 / 90358363 / -0.5% 99785990 / 100591326 / -0.8% 0.90 / 0.90 / +0.3%
tpch_q19/duckdb:parquet 61256653 / 61285249 / -0.0% 70496517 / 71626319 / -1.6% 0.87 / 0.86 / +1.6%
tpch_q20/duckdb:parquet 58349457 / 59002266 / -1.1% 70433252 / 73825646 / -4.6% 0.83 / 0.80 / +3.7%
tpch_q21/duckdb:parquet 138035484 / 137194714 / +0.6% 151323968 / 148210484 / +2.1% 0.91 / 0.93 / -1.5%
tpch_q22/duckdb:parquet 50021604 / 50773187 / -1.5% 57867828 / 57862131 / +0.0% 0.86 / 0.88 / -1.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Engines: DataFusion No clear signal (+5.1%, low confidence) · DuckDB No clear signal (-2.4%, low confidence)
Vortex (geomean): hot 0.980x ➖ · cold 0.934x ➖
Parquet (geomean): hot 0.967x ➖ · cold 0.945x ➖
Shifts: Parquet (control) -3.3% · Median polish -2.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.987x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6701447 / 6980121 / -4.0% 19534008 / 20441569 / -4.4% 0.34 / 0.34 / +0.5%
fineweb_q01/datafusion:vortex-file-compressed 12503933 / 12628676 / -1.0% 44541850 / 49806884 / -10.6% 🟢 0.28 / 0.25 / +10.7%
fineweb_q02/datafusion:vortex-file-compressed 13365206 / 12457198 / +7.3% 50165427 / 51819046 / -3.2% 0.27 / 0.24 / +10.8%
fineweb_q03/datafusion:vortex-file-compressed 18682393 / 19787070 / -5.6% 98364727 / 113485995 / -13.3% 🟢 0.19 / 0.17 / +8.9%
fineweb_q04/datafusion:vortex-file-compressed 71655316 / 76980339 / -6.9% 158931306 / 169573496 / -6.3% 0.45 / 0.45 / -0.7%
fineweb_q05/datafusion:vortex-file-compressed 57193021 / 60947642 / -6.2% 132951709 / 149746059 / -11.2% 🟢 0.43 / 0.41 / +5.7%
fineweb_q06/datafusion:vortex-file-compressed 19284327 / 20082779 / -4.0% 99300459 / 112073845 / -11.4% 🟢 0.19 / 0.18 / +8.4%
fineweb_q07/datafusion:vortex-file-compressed 18055806 / 18546742 / -2.6% 97333147 / 107620823 / -9.6% 0.19 / 0.17 / +7.6%
fineweb_q08/datafusion:vortex-file-compressed 10860519 / 9650619 / +12.5% 🔴 41105946 / 50215470 / -18.1% 🟢 0.26 / 0.19 / +37.5%
datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 7051563 / 7257540 / -2.8% 18420104 / 19431573 / -5.2% 0.38 / 0.37 / +2.5%
fineweb_q01/datafusion:vortex-compact 44749675 / 45068744 / -0.7% 76767782 / 77254314 / -0.6% 0.58 / 0.58 / -0.1%
fineweb_q02/datafusion:vortex-compact 43677026 / 44577577 / -2.0% 79630495 / 111570784 / -28.6% 🟢 0.55 / 0.40 / +37.3%
fineweb_q03/datafusion:vortex-compact 158441808 / 157380279 / +0.7% 224498556 / 229839097 / -2.3% 0.71 / 0.68 / +3.1%
fineweb_q04/datafusion:vortex-compact 190815548 / 175513194 / +8.7% 262101015 / 249603203 / +5.0% 0.73 / 0.70 / +3.5%
fineweb_q05/datafusion:vortex-compact 159198022 / 170559251 / -6.7% 225090810 / 237537940 / -5.2% 0.71 / 0.72 / -1.5%
fineweb_q06/datafusion:vortex-compact 87130136 / 87827996 / -0.8% 162384335 / 163541513 / -0.7% 0.54 / 0.54 / -0.1%
fineweb_q07/datafusion:vortex-compact 88188390 / 89100828 / -1.0% 153659681 / 161970985 / -5.1% 0.57 / 0.55 / +4.3%
fineweb_q08/datafusion:vortex-compact 10211968 / 9685149 / +5.4% 38142264 / 41334962 / -7.7% 0.27 / 0.23 / +14.3%
datafusion / parquet / ns (0.945x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9440212 / 9187966 / +2.7% 32401152 / 34500917 / -6.1% 0.29 / 0.27 / +9.4%
fineweb_q01/datafusion:parquet 68937800 / 75192195 / -8.3% 142230225 / 162383633 / -12.4% 🟢 0.48 / 0.46 / +4.7%
fineweb_q02/datafusion:parquet 70492386 / 75982290 / -7.2% 144550724 / 150814386 / -4.2% 0.49 / 0.50 / -3.2%
fineweb_q03/datafusion:parquet 69915776 / 73047539 / -4.3% 141770123 / 159572073 / -11.2% 🟢 0.49 / 0.46 / +7.7%
fineweb_q04/datafusion:parquet 76725831 / 81933394 / -6.4% 141193369 / 158481181 / -10.9% 🟢 0.54 / 0.52 / +5.1%
fineweb_q05/datafusion:parquet 75239397 / 82234368 / -8.5% 142932782 / 154742166 / -7.6% 0.53 / 0.53 / -0.9%
fineweb_q06/datafusion:parquet 72121306 / 75277472 / -4.2% 144504412 / 160664359 / -10.1% 🟢 0.50 / 0.47 / +6.5%
fineweb_q07/datafusion:parquet 70267987 / 73900888 / -4.9% 142918461 / 153343645 / -6.8% 0.49 / 0.48 / +2.0%
fineweb_q08/datafusion:parquet 68220027 / 74188574 / -8.0% 137219902 / 154268531 / -11.1% 🟢 0.50 / 0.48 / +3.4%
duckdb / vortex-file-compressed / ns (0.967x ➖, 3↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2013766 / 1859372 / +8.3% 7429654 / 5013128 / +48.2% 🔴 0.27 / 0.37 / -26.9%
fineweb_q01/duckdb:vortex-file-compressed 20477443 / 20845448 / -1.8% 60204205 / 56683321 / +6.2% 0.34 / 0.37 / -7.5%
fineweb_q02/duckdb:vortex-file-compressed 20050560 / 18250990 / +9.9% 58698548 / 48223457 / +21.7% 🔴 0.34 / 0.38 / -9.7%
fineweb_q03/duckdb:vortex-file-compressed 23694535 / 28017863 / -15.4% 🟢 88083625 / 118062312 / -25.4% 🟢 0.27 / 0.24 / +13.4%
fineweb_q04/duckdb:vortex-file-compressed 74769206 / 88814242 / -15.8% 🟢 108933779 / 187993264 / -42.1% 🟢 0.69 / 0.47 / +45.3%
fineweb_q05/duckdb:vortex-file-compressed 69274670 / 68642398 / +0.9% 140228054 / 195552752 / -28.3% 🟢 0.49 / 0.35 / +40.7%
fineweb_q06/duckdb:vortex-file-compressed 36559126 / 56201996 / -35.0% 🟢 125818727 / 156711482 / -19.7% 🟢 0.29 / 0.36 / -19.0%
fineweb_q07/duckdb:vortex-file-compressed 31309426 / 26402534 / +18.6% 🔴 133866528 / 103284979 / +29.6% 🔴 0.23 / 0.26 / -8.5%
fineweb_q08/duckdb:vortex-file-compressed 7347511 / 6417518 / +14.5% 🔴 14654970 / 16558866 / -11.5% 🟢 0.50 / 0.39 / +29.4%
duckdb / vortex-compact / ns (0.966x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2170648 / 2569068 / -15.5% 🟢 4858980 / 6924575 / -29.8% 🟢 0.45 / 0.37 / +20.4%
fineweb_q01/duckdb:vortex-compact 50306758 / 52218790 / -3.7% 93579408 / 87833046 / +6.5% 0.54 / 0.59 / -9.6%
fineweb_q02/duckdb:vortex-compact 48140621 / 53815467 / -10.5% 🟢 86143300 / 85043692 / +1.3% 0.56 / 0.63 / -11.7%
fineweb_q03/duckdb:vortex-compact 210738847 / 182646292 / +15.4% 🔴 244846572 / 266991915 / -8.3% 0.86 / 0.68 / +25.8%
fineweb_q04/duckdb:vortex-compact 185051302 / 184347056 / +0.4% 234919267 / 242994298 / -3.3% 0.79 / 0.76 / +3.8%
fineweb_q05/duckdb:vortex-compact 179320678 / 186207625 / -3.7% 232517720 / 252045541 / -7.7% 0.77 / 0.74 / +4.4%
fineweb_q06/duckdb:vortex-compact 117077152 / 110604390 / +5.9% 199611748 / 175309159 / +13.9% 🔴 0.59 / 0.63 / -7.0%
fineweb_q07/duckdb:vortex-compact 101913014 / 104248276 / -2.2% 154461169 / 156184112 / -1.1% 0.66 / 0.67 / -1.1%
fineweb_q08/duckdb:vortex-compact 6009278 / 6900276 / -12.9% 🟢 12724203 / 12552469 / +1.4% 0.47 / 0.55 / -14.1%
duckdb / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 22933826 / 23375699 / -1.9% 25449557 / 26341595 / -3.4% 0.90 / 0.89 / +1.5%
fineweb_q01/duckdb:parquet 44116927 / 44275818 / -0.4% 54882193 / 54342250 / +1.0% 0.80 / 0.81 / -1.3%
fineweb_q02/duckdb:parquet 44101161 / 44918087 / -1.8% 56173405 / 63974447 / -12.2% 🟢 0.79 / 0.70 / +11.8%
fineweb_q03/duckdb:parquet 96421551 / 94391458 / +2.2% 188917805 / 170265881 / +11.0% 🔴 0.51 / 0.55 / -7.9%
fineweb_q04/duckdb:parquet 151683889 / 152557315 / -0.6% 199366589 / 196616451 / +1.4% 0.76 / 0.78 / -1.9%
fineweb_q05/duckdb:parquet 142805114 / 142862983 / -0.0% 201138294 / 198988342 / +1.1% 0.71 / 0.72 / -1.1%
fineweb_q06/duckdb:parquet 70710616 / 70563530 / +0.2% 114980793 / 123980578 / -7.3% 0.61 / 0.57 / +8.1%
fineweb_q07/duckdb:parquet 72761824 / 71973278 / +1.1% 157467552 / 151226808 / +4.1% 0.46 / 0.48 / -2.9%
fineweb_q08/duckdb:parquet 22296752 / 24062598 / -7.3% 24214557 / 27310383 / -11.3% 🟢 0.92 / 0.88 / +4.5%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-1.7%, low confidence) · DuckDB No clear signal (+0.5%, environment too noisy confidence)
Vortex (geomean): hot 0.990x ➖ · cold 0.992x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 182756081 / 184018036 / -0.7% 528710769 / 528704514 / +0.0% 0.35 / 0.35 / -0.7%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10880712 / 10759474 / +1.1% 46115912 / 47404339 / -2.7% 0.24 / 0.23 / +4.0%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11258170 / 11692976 / -3.7% 48070015 / 47147254 / +2.0% 0.23 / 0.25 / -5.6%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23455410 / 22514480 / +4.2% 68005473 / 66738088 / +1.9% 0.34 / 0.34 / +2.2%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18505398 / 17790496 / +4.0% 58509017 / 59479624 / -1.6% 0.32 / 0.30 / +5.7%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17787997 / 17819053 / -0.2% 58540203 / 58712028 / -0.3% 0.30 / 0.30 / +0.1%
clickbench-sorted_q39/datafusion:vortex-file-compressed 40947895 / 40661767 / +0.7% 87824753 / 90979726 / -3.5% 0.47 / 0.45 / +4.3%
clickbench-sorted_q40/datafusion:vortex-file-compressed 12373871 / 12680694 / -2.4% 40874263 / 42752952 / -4.4% 0.30 / 0.30 / +2.1%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11826178 / 12178981 / -2.9% 41098141 / 42411501 / -3.1% 0.29 / 0.29 / +0.2%
clickbench-sorted_q42/datafusion:vortex-file-compressed 9845001 / 9837208 / +0.1% 34667028 / 36090082 / -3.9% 0.28 / 0.27 / +4.2%
datafusion / vortex-compact / ns (0.994x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 196363386 / 208117118 / -5.6% 397333092 / 477427488 / -16.8% 🟢 0.49 / 0.44 / +13.4%
clickbench-sorted_q24/datafusion:vortex-compact 23889817 / 22376136 / +6.8% 50773486 / 51464813 / -1.3% 0.47 / 0.43 / +8.2%
clickbench-sorted_q26/datafusion:vortex-compact 22509107 / 23569389 / -4.5% 53697519 / 52914055 / +1.5% 0.42 / 0.45 / -5.9%
clickbench-sorted_q36/datafusion:vortex-compact 25326462 / 25434078 / -0.4% 65212474 / 67429248 / -3.3% 0.39 / 0.38 / +3.0%
clickbench-sorted_q37/datafusion:vortex-compact 22010906 / 21761941 / +1.1% 61115523 / 61493639 / -0.6% 0.36 / 0.35 / +1.8%
clickbench-sorted_q38/datafusion:vortex-compact 21093700 / 21061182 / +0.2% 61851206 / 63687116 / -2.9% 0.34 / 0.33 / +3.1%
clickbench-sorted_q39/datafusion:vortex-compact 43697306 / 44243045 / -1.2% 82749496 / 84544671 / -2.1% 0.53 / 0.52 / +0.9%
clickbench-sorted_q40/datafusion:vortex-compact 14320492 / 14395475 / -0.5% 42855818 / 44490887 / -3.7% 0.33 / 0.32 / +3.3%
clickbench-sorted_q41/datafusion:vortex-compact 13992160 / 14115805 / -0.9% 43241222 / 45319514 / -4.6% 0.32 / 0.31 / +3.9%
clickbench-sorted_q42/datafusion:vortex-compact 11155435 / 11178647 / -0.2% 34379140 / 35213464 / -2.4% 0.32 / 0.32 / +2.2%
datafusion / parquet / ns (1.015x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 763492883 / 760951988 / +0.3% 980879777 / 959741634 / +2.2% 0.78 / 0.79 / -1.8%
clickbench-sorted_q24/datafusion:parquet 9663127 / 9123808 / +5.9% 72139092 / 71542394 / +0.8% 0.13 / 0.13 / +5.0%
clickbench-sorted_q26/datafusion:parquet 9341496 / 8832788 / +5.8% 72110217 / 72092351 / +0.0% 0.13 / 0.12 / +5.7%
clickbench-sorted_q36/datafusion:parquet 94081232 / 93615019 / +0.5% 171284241 / 165725758 / +3.4% 0.55 / 0.56 / -2.8%
clickbench-sorted_q37/datafusion:parquet 64702427 / 64151723 / +0.9% 130984705 / 131477595 / -0.4% 0.49 / 0.49 / +1.2%
clickbench-sorted_q38/datafusion:parquet 88609196 / 87733998 / +1.0% 159657247 / 158306830 / +0.9% 0.55 / 0.55 / +0.1%
clickbench-sorted_q39/datafusion:parquet 160323926 / 160462598 / -0.1% 232737054 / 231132891 / +0.7% 0.69 / 0.69 / -0.8%
clickbench-sorted_q40/datafusion:parquet 44669194 / 44850959 / -0.4% 110515363 / 110987045 / -0.4% 0.40 / 0.40 / +0.0%
clickbench-sorted_q41/datafusion:parquet 42257800 / 41768652 / +1.2% 106398045 / 109699163 / -3.0% 0.40 / 0.38 / +4.3%
clickbench-sorted_q42/datafusion:parquet 26169637 / 26223833 / -0.2% 86990281 / 87666591 / -0.8% 0.30 / 0.30 / +0.6%
duckdb / vortex-file-compressed / ns (0.989x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 60833667 / 58350098 / +4.3% 77315942 / 76501978 / +1.1% 0.79 / 0.76 / +3.2%
clickbench-sorted_q24/duckdb:vortex-file-compressed 24100862 / 23983512 / +0.5% 34504668 / 35769638 / -3.5% 0.70 / 0.67 / +4.2%
clickbench-sorted_q26/duckdb:vortex-file-compressed 14218700 / 15979334 / -11.0% 🟢 25359861 / 26388546 / -3.9% 0.56 / 0.61 / -7.4%
clickbench-sorted_q36/duckdb:vortex-file-compressed 29452179 / 30202252 / -2.5% 63920342 / 63937101 / -0.0% 0.46 / 0.47 / -2.5%
clickbench-sorted_q37/duckdb:vortex-file-compressed 24756722 / 24302426 / +1.9% 56768978 / 53570026 / +6.0% 0.44 / 0.45 / -3.9%
clickbench-sorted_q38/duckdb:vortex-file-compressed 25905672 / 26006811 / -0.4% 58923323 / 57707408 / +2.1% 0.44 / 0.45 / -2.4%
clickbench-sorted_q39/duckdb:vortex-file-compressed 46771398 / 48406904 / -3.4% 98798952 / 95863297 / +3.1% 0.47 / 0.50 / -6.2%
clickbench-sorted_q40/duckdb:vortex-file-compressed 16100030 / 16529352 / -2.6% 37815894 / 41430355 / -8.7% 0.43 / 0.40 / +6.7%
clickbench-sorted_q41/duckdb:vortex-file-compressed 16754452 / 15986340 / +4.8% 38245741 / 41661709 / -8.2% 0.44 / 0.38 / +14.2%
clickbench-sorted_q42/duckdb:vortex-file-compressed 13580676 / 13788136 / -1.5% 40378427 / 30841480 / +30.9% 🔴 0.34 / 0.45 / -24.8%
duckdb / vortex-compact / ns (0.977x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 69074412 / 65129488 / +6.1% 95858378 / 85729810 / +11.8% 🔴 0.72 / 0.76 / -5.1%
clickbench-sorted_q24/duckdb:vortex-compact 19107494 / 25368453 / -24.7% 🟢 36788923 / 34604616 / +6.3% 0.52 / 0.73 / -29.2%
clickbench-sorted_q26/duckdb:vortex-compact 17001378 / 16868450 / +0.8% 28980876 / 30995088 / -6.5% 0.59 / 0.54 / +7.8%
clickbench-sorted_q36/duckdb:vortex-compact 39630276 / 39224899 / +1.0% 72212810 / 72833873 / -0.9% 0.55 / 0.54 / +1.9%
clickbench-sorted_q37/duckdb:vortex-compact 31628395 / 30722504 / +2.9% 64907854 / 69422718 / -6.5% 0.49 / 0.44 / +10.1%
clickbench-sorted_q38/duckdb:vortex-compact 33055527 / 33300868 / -0.7% 71046399 / 72655085 / -2.2% 0.47 / 0.46 / +1.5%
clickbench-sorted_q39/duckdb:vortex-compact 62380061 / 61832841 / +0.9% 101186586 / 100623254 / +0.6% 0.62 / 0.61 / +0.3%
clickbench-sorted_q40/duckdb:vortex-compact 19055600 / 19471987 / -2.1% 40543256 / 39682342 / +2.2% 0.47 / 0.49 / -4.2%
clickbench-sorted_q41/duckdb:vortex-compact 19215571 / 19143304 / +0.4% 43794525 / 40779332 / +7.4% 0.44 / 0.47 / -6.5%
clickbench-sorted_q42/duckdb:vortex-compact 14592474 / 15187335 / -3.9% 32947810 / 34006518 / -3.1% 0.44 / 0.45 / -0.8%
duckdb / parquet / ns (0.979x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 125009220 / 125065960 / -0.0% 138577762 / 138927633 / -0.3% 0.90 / 0.90 / +0.2%
clickbench-sorted_q24/duckdb:parquet 17553234 / 17714909 / -0.9% 28782733 / 30686755 / -6.2% 0.61 / 0.58 / +5.6%
clickbench-sorted_q26/duckdb:parquet 12963112 / 12900270 / +0.5% 21008441 / 20571389 / +2.1% 0.62 / 0.63 / -1.6%
clickbench-sorted_q36/duckdb:parquet 45684578 / 47838984 / -4.5% 63789374 / 60866049 / +4.8% 0.72 / 0.79 / -8.9%
clickbench-sorted_q37/duckdb:parquet 29836696 / 30534126 / -2.3% 46801177 / 46420605 / +0.8% 0.64 / 0.66 / -3.1%
clickbench-sorted_q38/duckdb:parquet 43335640 / 41226462 / +5.1% 53629695 / 56051594 / -4.3% 0.81 / 0.74 / +9.9%
clickbench-sorted_q39/duckdb:parquet 69901870 / 72831108 / -4.0% 85506358 / 86897769 / -1.6% 0.82 / 0.84 / -2.5%
clickbench-sorted_q40/duckdb:parquet 19460478 / 18817835 / +3.4% 35783285 / 36415309 / -1.7% 0.54 / 0.52 / +5.2%
clickbench-sorted_q41/duckdb:parquet 17232962 / 17147456 / +0.5% 35246488 / 34640958 / +1.7% 0.49 / 0.50 / -1.2%
clickbench-sorted_q42/duckdb:parquet 11030370 / 13341668 / -17.3% 🟢 22282015 / 23062763 / -3.4% 0.50 / 0.58 / -14.4%

File Size Changes (200 files changed, +0.0% overall, 115↑ 85↓)
File Scale Format Base HEAD Change %
hits_080.vortex 1.0 vortex-compact 94.65 MB 96.47 MB +1.82 MB +1.9%
hits_004.vortex 1.0 vortex-compact 98.33 MB 99.49 MB +1.17 MB +1.2%
hits_087.vortex 1.0 vortex-compact 123.80 MB 125.26 MB +1.46 MB +1.2%
hits_026.vortex 1.0 vortex-compact 97.90 MB 99.01 MB +1.11 MB +1.1%
hits_052.vortex 1.0 vortex-compact 97.81 MB 98.81 MB +1.00 MB +1.0%
hits_061.vortex 1.0 vortex-compact 123.50 MB 124.76 MB +1.26 MB +1.0%
hits_065.vortex 1.0 vortex-compact 124.12 MB 125.31 MB +1.19 MB +1.0%
hits_055.vortex 1.0 vortex-file-compressed 199.27 MB 200.92 MB +1.65 MB +0.8%
hits_034.vortex 1.0 vortex-file-compressed 181.73 MB 183.19 MB +1.46 MB +0.8%
hits_000.vortex 1.0 vortex-compact 97.87 MB 98.65 MB +797.60 KB +0.8%
hits_074.vortex 1.0 vortex-file-compressed 198.74 MB 200.22 MB +1.49 MB +0.7%
hits_090.vortex 1.0 vortex-compact 140.06 MB 141.03 MB +1002.27 KB +0.7%
hits_033.vortex 1.0 vortex-compact 152.68 MB 153.71 MB +1.03 MB +0.7%
hits_048.vortex 1.0 vortex-file-compressed 199.24 MB 200.57 MB +1.33 MB +0.7%
hits_063.vortex 1.0 vortex-compact 97.84 MB 98.46 MB +641.65 KB +0.6%
hits_096.vortex 1.0 vortex-file-compressed 199.19 MB 200.33 MB +1.14 MB +0.6%
hits_048.vortex 1.0 vortex-compact 152.52 MB 153.36 MB +862.66 KB +0.6%
hits_078.vortex 1.0 vortex-compact 97.15 MB 97.68 MB +534.12 KB +0.5%
hits_029.vortex 1.0 vortex-compact 152.62 MB 153.37 MB +766.86 KB +0.5%
hits_093.vortex 1.0 vortex-compact 98.79 MB 99.24 MB +451.76 KB +0.4%
hits_008.vortex 1.0 vortex-file-compressed 139.29 MB 139.90 MB +615.66 KB +0.4%
hits_067.vortex 1.0 vortex-compact 98.35 MB 98.71 MB +368.30 KB +0.4%
hits_051.vortex 1.0 vortex-compact 133.97 MB 134.46 MB +495.57 KB +0.4%
hits_030.vortex 1.0 vortex-compact 98.04 MB 98.35 MB +319.98 KB +0.3%
hits_066.vortex 1.0 vortex-compact 117.16 MB 117.52 MB +373.91 KB +0.3%
hits_006.vortex 1.0 vortex-compact 95.91 MB 96.17 MB +272.22 KB +0.3%
hits_072.vortex 1.0 vortex-file-compressed 101.82 MB 102.09 MB +277.02 KB +0.3%
hits_017.vortex 1.0 vortex-compact 111.59 MB 111.88 MB +293.53 KB +0.3%
hits_094.vortex 1.0 vortex-compact 110.73 MB 111.02 MB +290.75 KB +0.3%
hits_056.vortex 1.0 vortex-file-compressed 134.99 MB 135.32 MB +346.20 KB +0.3%
hits_070.vortex 1.0 vortex-compact 153.27 MB 153.62 MB +356.41 KB +0.2%
hits_084.vortex 1.0 vortex-compact 110.42 MB 110.66 MB +243.39 KB +0.2%
hits_066.vortex 1.0 vortex-file-compressed 162.91 MB 163.20 MB +297.88 KB +0.2%
hits_058.vortex 1.0 vortex-file-compressed 154.50 MB 154.77 MB +279.55 KB +0.2%
hits_068.vortex 1.0 vortex-compact 111.93 MB 112.12 MB +188.52 KB +0.2%
hits_043.vortex 1.0 vortex-compact 94.31 MB 94.46 MB +155.85 KB +0.2%
hits_020.vortex 1.0 vortex-compact 111.58 MB 111.76 MB +183.75 KB +0.2%
hits_005.vortex 1.0 vortex-compact 115.88 MB 116.06 MB +183.51 KB +0.2%
hits_023.vortex 1.0 vortex-file-compressed 194.88 MB 195.16 MB +293.54 KB +0.1%
hits_042.vortex 1.0 vortex-file-compressed 201.98 MB 202.27 MB +293.89 KB +0.1%
hits_015.vortex 1.0 vortex-compact 97.88 MB 98.01 MB +141.64 KB +0.1%
hits_051.vortex 1.0 vortex-file-compressed 172.90 MB 173.14 MB +244.11 KB +0.1%
hits_090.vortex 1.0 vortex-file-compressed 192.29 MB 192.55 MB +267.51 KB +0.1%
hits_055.vortex 1.0 vortex-compact 153.18 MB 153.38 MB +210.18 KB +0.1%
hits_074.vortex 1.0 vortex-compact 152.96 MB 153.15 MB +196.11 KB +0.1%
hits_044.vortex 1.0 vortex-file-compressed 201.05 MB 201.29 MB +247.48 KB +0.1%
hits_052.vortex 1.0 vortex-file-compressed 130.04 MB 130.20 MB +159.67 KB +0.1%
hits_039.vortex 1.0 vortex-file-compressed 161.66 MB 161.85 MB +191.09 KB +0.1%
hits_020.vortex 1.0 vortex-file-compressed 159.83 MB 160.00 MB +170.18 KB +0.1%
hits_035.vortex 1.0 vortex-file-compressed 102.16 MB 102.27 MB +108.27 KB +0.1%
hits_067.vortex 1.0 vortex-file-compressed 130.72 MB 130.86 MB +135.32 KB +0.1%
hits_009.vortex 1.0 vortex-file-compressed 101.16 MB 101.26 MB +99.24 KB +0.1%
hits_069.vortex 1.0 vortex-compact 99.80 MB 99.89 MB +91.26 KB +0.1%
hits_011.vortex 1.0 vortex-compact 152.82 MB 152.96 MB +139.26 KB +0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.76 MB 100.85 MB +90.88 KB +0.1%
hits_095.vortex 1.0 vortex-file-compressed 153.70 MB 153.83 MB +133.60 KB +0.1%
hits_015.vortex 1.0 vortex-file-compressed 130.20 MB 130.31 MB +112.09 KB +0.1%
hits_040.vortex 1.0 vortex-compact 109.98 MB 110.07 MB +94.25 KB +0.1%
hits_012.vortex 1.0 vortex-compact 138.74 MB 138.85 MB +115.05 KB +0.1%
hits_043.vortex 1.0 vortex-file-compressed 126.63 MB 126.73 MB +100.94 KB +0.1%
hits_037.vortex 1.0 vortex-compact 132.24 MB 132.34 MB +102.41 KB +0.1%
hits_077.vortex 1.0 vortex-file-compressed 172.82 MB 172.95 MB +132.83 KB +0.1%
hits_054.vortex 1.0 vortex-compact 111.61 MB 111.69 MB +85.29 KB +0.1%
hits_027.vortex 1.0 vortex-file-compressed 189.49 MB 189.62 MB +137.64 KB +0.1%
hits_092.vortex 1.0 vortex-file-compressed 200.55 MB 200.68 MB +134.82 KB +0.1%
hits_073.vortex 1.0 vortex-file-compressed 173.03 MB 173.14 MB +109.16 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.32 MB 130.40 MB +80.06 KB +0.1%
hits_086.vortex 1.0 vortex-compact 139.51 MB 139.60 MB +84.83 KB +0.1%
hits_054.vortex 1.0 vortex-file-compressed 147.21 MB 147.30 MB +89.23 KB +0.1%
hits_028.vortex 1.0 vortex-file-compressed 152.21 MB 152.29 MB +86.30 KB +0.1%
hits_060.vortex 1.0 vortex-file-compressed 192.78 MB 192.88 MB +107.86 KB +0.1%
hits_027.vortex 1.0 vortex-compact 137.97 MB 138.04 MB +74.47 KB +0.1%
hits_073.vortex 1.0 vortex-compact 134.15 MB 134.22 MB +66.95 KB +0.0%
hits_068.vortex 1.0 vortex-file-compressed 160.38 MB 160.45 MB +73.52 KB +0.0%
hits_037.vortex 1.0 vortex-file-compressed 178.09 MB 178.17 MB +78.41 KB +0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.80 MB 142.86 MB +61.76 KB +0.0%
hits_053.vortex 1.0 vortex-file-compressed 189.44 MB 189.51 MB +75.59 KB +0.0%
hits_019.vortex 1.0 vortex-compact 106.01 MB 106.06 MB +41.12 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 130.81 MB 130.86 MB +49.84 KB +0.0%
hits_031.vortex 1.0 vortex-compact 111.14 MB 111.18 MB +38.63 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.99 MB 127.03 MB +41.48 KB +0.0%
hits_040.vortex 1.0 vortex-file-compressed 143.91 MB 143.95 MB +46.73 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.38 MB 147.42 MB +44.52 KB +0.0%
hits_082.vortex 1.0 vortex-compact 105.62 MB 105.65 MB +30.20 KB +0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.62 MB 126.65 MB +30.92 KB +0.0%
hits_022.vortex 1.0 vortex-compact 153.03 MB 153.06 MB +36.95 KB +0.0%
hits_007.vortex 1.0 vortex-file-compressed 201.11 MB 201.15 MB +46.83 KB +0.0%
hits_029.vortex 1.0 vortex-file-compressed 200.88 MB 200.92 MB +41.95 KB +0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.09 MB 159.13 MB +33.09 KB +0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.05 MB 189.08 MB +39.08 KB +0.0%
hits_060.vortex 1.0 vortex-compact 140.03 MB 140.06 MB +28.86 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.19 MB 147.22 MB +30.02 KB +0.0%
hits_022.vortex 1.0 vortex-file-compressed 200.20 MB 200.24 MB +39.87 KB +0.0%
hits_032.vortex 1.0 vortex-compact 110.59 MB 110.61 MB +21.90 KB +0.0%
hits_059.vortex 1.0 vortex-file-compressed 200.25 MB 200.28 MB +35.73 KB +0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.21 MB 172.24 MB +29.28 KB +0.0%
hits_071.vortex 1.0 vortex-compact 105.58 MB 105.60 MB +17.04 KB +0.0%
hits_098.vortex 1.0 vortex-file-compressed 137.93 MB 137.95 MB +20.41 KB +0.0%
hits_024.vortex 1.0 vortex-compact 124.64 MB 124.66 MB +16.62 KB +0.0%
hits_045.vortex 1.0 vortex-file-compressed 139.13 MB 139.15 MB +18.40 KB +0.0%
hits_033.vortex 1.0 vortex-file-compressed 200.99 MB 201.02 MB +26.12 KB +0.0%
hits_018.vortex 1.0 vortex-compact 153.77 MB 153.79 MB +17.46 KB +0.0%
hits_011.vortex 1.0 vortex-file-compressed 200.18 MB 200.20 MB +19.48 KB +0.0%
hits_097.vortex 1.0 vortex-compact 140.12 MB 140.13 MB +11.12 KB +0.0%
hits_081.vortex 1.0 vortex-file-compressed 201.04 MB 201.06 MB +15.03 KB +0.0%
hits_088.vortex 1.0 vortex-compact 134.10 MB 134.11 MB +10.00 KB +0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.73 MB 153.74 MB +10.27 KB +0.0%
hits_057.vortex 1.0 vortex-compact 111.36 MB 111.37 MB +7.12 KB +0.0%
hits_058.vortex 1.0 vortex-compact 111.04 MB 111.04 MB +5.62 KB +0.0%
hits_032.vortex 1.0 vortex-file-compressed 153.99 MB 154.00 MB +6.92 KB +0.0%
hits_036.vortex 1.0 vortex-compact 133.26 MB 133.27 MB +5.49 KB +0.0%
hits_019.vortex 1.0 vortex-file-compressed 140.08 MB 140.08 MB +4.28 KB +0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.23 MB 156.23 MB +1.78 KB +0.0%
hits_042.vortex 1.0 vortex-compact 136.21 MB 136.21 MB +1.30 KB +0.0%
hits_035.vortex 1.0 vortex-compact 75.95 MB 75.95 MB +456 B +0.0%
hits_063.vortex 1.0 vortex-file-compressed 130.92 MB 130.92 MB 384 B -0.0%
hits_047.vortex 1.0 vortex-compact 110.46 MB 110.46 MB 1.83 KB -0.0%
hits_009.vortex 1.0 vortex-compact 75.22 MB 75.22 MB 1.32 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.10 MB 191.09 MB 6.66 KB -0.0%
hits_095.vortex 1.0 vortex-compact 110.61 MB 110.61 MB 3.98 KB -0.0%
hits_016.vortex 1.0 vortex-compact 127.32 MB 127.31 MB 4.73 KB -0.0%
hits_079.vortex 1.0 vortex-file-compressed 180.54 MB 180.53 MB 8.77 KB -0.0%
hits_050.vortex 1.0 vortex-compact 124.95 MB 124.95 MB 7.61 KB -0.0%
hits_064.vortex 1.0 vortex-file-compressed 190.39 MB 190.38 MB 12.23 KB -0.0%
hits_082.vortex 1.0 vortex-file-compressed 139.20 MB 139.19 MB 9.38 KB -0.0%
hits_064.vortex 1.0 vortex-compact 138.84 MB 138.83 MB 10.59 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.08 MB 131.06 MB 12.01 KB -0.0%
hits_001.vortex 1.0 vortex-file-compressed 188.74 MB 188.72 MB 20.27 KB -0.0%
hits_057.vortex 1.0 vortex-file-compressed 159.79 MB 159.77 MB 17.56 KB -0.0%
hits_096.vortex 1.0 vortex-compact 153.25 MB 153.23 MB 16.94 KB -0.0%
hits_097.vortex 1.0 vortex-file-compressed 192.63 MB 192.60 MB 24.95 KB -0.0%
hits_034.vortex 1.0 vortex-compact 132.38 MB 132.36 MB 17.65 KB -0.0%
hits_045.vortex 1.0 vortex-compact 105.60 MB 105.59 MB 15.96 KB -0.0%
hits_007.vortex 1.0 vortex-compact 153.82 MB 153.80 MB 23.48 KB -0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.70 MB 191.67 MB 32.16 KB -0.0%
hits_008.vortex 1.0 vortex-compact 105.66 MB 105.64 MB 18.95 KB -0.0%
hits_061.vortex 1.0 vortex-file-compressed 161.38 MB 161.35 MB 31.78 KB -0.0%
hits_046.vortex 1.0 vortex-compact 74.90 MB 74.88 MB 15.11 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.32 MB 130.30 MB 28.38 KB -0.0%
hits_021.vortex 1.0 vortex-compact 110.63 MB 110.60 MB 27.85 KB -0.0%
hits_026.vortex 1.0 vortex-file-compressed 130.63 MB 130.60 MB 33.02 KB -0.0%
hits_088.vortex 1.0 vortex-file-compressed 172.75 MB 172.71 MB 44.37 KB -0.0%
hits_001.vortex 1.0 vortex-compact 137.71 MB 137.68 MB 35.40 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 161.85 MB 161.81 MB 45.84 KB -0.0%
hits_056.vortex 1.0 vortex-compact 100.76 MB 100.73 MB 29.69 KB -0.0%
hits_003.vortex 1.0 vortex-file-compressed 136.56 MB 136.52 MB 41.42 KB -0.0%
hits_085.vortex 1.0 vortex-file-compressed 200.81 MB 200.75 MB 63.09 KB -0.0%
hits_065.vortex 1.0 vortex-file-compressed 161.94 MB 161.89 MB 53.04 KB -0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.74 MB 130.69 MB 52.48 KB -0.0%
hits_081.vortex 1.0 vortex-compact 153.69 MB 153.63 MB 63.23 KB -0.0%
hits_099.vortex 1.0 vortex-compact 133.21 MB 133.15 MB 56.12 KB -0.0%
hits_004.vortex 1.0 vortex-file-compressed 130.67 MB 130.61 MB 60.59 KB -0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.69 MB 161.61 MB 82.48 KB -0.0%
hits_076.vortex 1.0 vortex-file-compressed 161.67 MB 161.58 MB 88.90 KB -0.1%
hits_083.vortex 1.0 vortex-compact 110.06 MB 109.99 MB 66.14 KB -0.1%
hits_039.vortex 1.0 vortex-compact 124.85 MB 124.78 MB 76.22 KB -0.1%
hits_059.vortex 1.0 vortex-compact 152.84 MB 152.74 MB 96.44 KB -0.1%
hits_070.vortex 1.0 vortex-file-compressed 201.07 MB 200.92 MB 152.35 KB -0.1%
hits_062.vortex 1.0 vortex-compact 132.57 MB 132.47 MB 101.66 KB -0.1%
hits_014.vortex 1.0 vortex-file-compressed 173.10 MB 172.97 MB 133.88 KB -0.1%
hits_077.vortex 1.0 vortex-compact 134.45 MB 134.34 MB 107.36 KB -0.1%
hits_072.vortex 1.0 vortex-compact 75.61 MB 75.55 MB 63.05 KB -0.1%
hits_044.vortex 1.0 vortex-compact 153.74 MB 153.62 MB 129.50 KB -0.1%
hits_062.vortex 1.0 vortex-file-compressed 171.37 MB 171.21 MB 156.12 KB -0.1%
hits_091.vortex 1.0 vortex-compact 111.88 MB 111.78 MB 104.69 KB -0.1%
hits_094.vortex 1.0 vortex-file-compressed 158.54 MB 158.40 MB 149.62 KB -0.1%
hits_049.vortex 1.0 vortex-compact 140.38 MB 140.24 MB 142.07 KB -0.1%
hits_016.vortex 1.0 vortex-file-compressed 180.01 MB 179.84 MB 182.48 KB -0.1%
hits_099.vortex 1.0 vortex-file-compressed 172.55 MB 172.37 MB 185.04 KB -0.1%
hits_025.vortex 1.0 vortex-compact 133.59 MB 133.45 MB 144.59 KB -0.1%
hits_087.vortex 1.0 vortex-file-compressed 161.77 MB 161.60 MB 176.00 KB -0.1%
hits_085.vortex 1.0 vortex-compact 153.40 MB 153.23 MB 173.11 KB -0.1%
hits_003.vortex 1.0 vortex-compact 104.60 MB 104.48 MB 120.09 KB -0.1%
hits_018.vortex 1.0 vortex-file-compressed 200.95 MB 200.72 MB 234.57 KB -0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.94 MB 168.73 MB 209.67 KB -0.1%
hits_002.vortex 1.0 vortex-compact 123.85 MB 123.70 MB 153.88 KB -0.1%
hits_047.vortex 1.0 vortex-file-compressed 154.08 MB 153.88 MB 203.84 KB -0.1%
hits_089.vortex 1.0 vortex-compact 98.67 MB 98.50 MB 169.61 KB -0.2%
hits_092.vortex 1.0 vortex-compact 153.50 MB 153.24 MB 268.67 KB -0.2%
hits_079.vortex 1.0 vortex-compact 128.10 MB 127.84 MB 263.63 KB -0.2%
hits_005.vortex 1.0 vortex-file-compressed 167.42 MB 167.08 MB 350.90 KB -0.2%
hits_028.vortex 1.0 vortex-compact 115.51 MB 115.28 MB 243.70 KB -0.2%
hits_050.vortex 1.0 vortex-file-compressed 161.65 MB 161.31 MB 342.62 KB -0.2%
hits_014.vortex 1.0 vortex-compact 134.17 MB 133.87 MB 309.04 KB -0.2%
hits_089.vortex 1.0 vortex-file-compressed 130.75 MB 130.45 MB 308.85 KB -0.2%
hits_012.vortex 1.0 vortex-file-compressed 190.82 MB 190.37 MB 458.16 KB -0.2%
hits_010.vortex 1.0 vortex-compact 123.34 MB 123.01 MB 342.03 KB -0.3%
hits_071.vortex 1.0 vortex-file-compressed 139.86 MB 139.29 MB 580.73 KB -0.4%
hits_041.vortex 1.0 vortex-compact 98.15 MB 97.75 MB 408.67 KB -0.4%
hits_084.vortex 1.0 vortex-file-compressed 154.67 MB 153.98 MB 701.59 KB -0.4%
hits_053.vortex 1.0 vortex-compact 138.22 MB 137.53 MB 707.29 KB -0.5%
hits_023.vortex 1.0 vortex-compact 142.43 MB 141.67 MB 778.29 KB -0.5%
hits_036.vortex 1.0 vortex-file-compressed 173.14 MB 172.09 MB 1.05 MB -0.6%
hits_038.vortex 1.0 vortex-file-compressed 190.96 MB 189.67 MB 1.29 MB -0.7%
hits_075.vortex 1.0 vortex-compact 138.84 MB 137.69 MB 1.15 MB -0.8%
hits_038.vortex 1.0 vortex-compact 139.32 MB 138.14 MB 1.18 MB -0.8%
hits_076.vortex 1.0 vortex-compact 124.94 MB 123.73 MB 1.21 MB -1.0%
hits_013.vortex 1.0 vortex-compact 125.36 MB 123.93 MB 1.43 MB -1.1%
hits_024.vortex 1.0 vortex-file-compressed 161.10 MB 159.18 MB 1.91 MB -1.2%
hits_098.vortex 1.0 vortex-compact 103.91 MB 102.51 MB 1.40 MB -1.3%

Totals:

  • vortex-compact: 11.91 GB → 11.91 GB (+0.1%)
  • vortex-file-compressed: 15.96 GB → 15.96 GB (+0.0%)

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.9%
Engines: DataFusion No clear signal (-18.1%, environment too noisy confidence) · DuckDB No clear signal (+1.2%, environment too noisy confidence)
Vortex (geomean): hot 0.969x ➖ · cold 0.988x ➖
Parquet (geomean): hot 1.064x ➖ · cold 1.010x ➖
Shifts: Parquet (control) +6.4% · Median polish -1.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.967x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 54386167 / 63720775 / -14.6% 120958699 / 182194793 / -33.6% 🟢 0.45 / 0.35 / +28.6%
fineweb_q01/datafusion:vortex-file-compressed 378840734 / 392262475 / -3.4% 640737428 / 642283473 / -0.2% 0.59 / 0.61 / -3.2%
fineweb_q02/datafusion:vortex-file-compressed 385257465 / 363258690 / +6.1% 593358604 / 637041453 / -6.9% 0.65 / 0.57 / +13.9%
fineweb_q03/datafusion:vortex-file-compressed 1127172705 / 609599432 / +84.9% 🔴 865913901 / 689470890 / +25.6% 1.30 / 0.88 / +47.2%
fineweb_q04/datafusion:vortex-file-compressed 473887165 / 443413018 / +6.9% 439397017 / 470263522 / -6.6% 1.08 / 0.94 / +14.4%
fineweb_q05/datafusion:vortex-file-compressed 447836516 / 556882868 / -19.6% 724747708 / 495760542 / +46.2% 🔴 0.62 / 1.12 / -45.0%
fineweb_q06/datafusion:vortex-file-compressed 731038460 / 774063570 / -5.6% 732503178 / 759281820 / -3.5% 1.00 / 1.02 / -2.1%
fineweb_q07/datafusion:vortex-file-compressed 624213518 / 650969136 / -4.1% 541145524 / 838352667 / -35.5% 🟢 1.15 / 0.78 / +48.6%
fineweb_q08/datafusion:vortex-file-compressed 229674556 / 390209832 / -41.1% 🟢 358095064 / 208744939 / +71.5% 🔴 0.64 / 1.87 / -65.7%
datafusion / vortex-compact / ns (0.915x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 48330410 / 50911190 / -5.1% 120012973 / 156364993 / -23.2% 0.40 / 0.33 / +23.7%
fineweb_q01/datafusion:vortex-compact 452397287 / 660318090 / -31.5% 🟢 875282867 / 907371415 / -3.5% 0.52 / 0.73 / -29.0%
fineweb_q02/datafusion:vortex-compact 400122825 / 386640960 / +3.5% 483687530 / 501990186 / -3.6% 0.83 / 0.77 / +7.4%
fineweb_q03/datafusion:vortex-compact 530088148 / 515344517 / +2.9% 917238504 / 781687608 / +17.3% 0.58 / 0.66 / -12.3%
fineweb_q04/datafusion:vortex-compact 467878196 / 568254600 / -17.7% 481627583 / 638320754 / -24.5% 0.97 / 0.89 / +9.1%
fineweb_q05/datafusion:vortex-compact 442163617 / 474573841 / -6.8% 494658238 / 546288566 / -9.5% 0.89 / 0.87 / +2.9%
fineweb_q06/datafusion:vortex-compact 675926470 / 1074582934 / -37.1% 🟢 665066069 / 862547472 / -22.9% 1.02 / 1.25 / -18.4%
fineweb_q07/datafusion:vortex-compact 685914396 / 491299236 / +39.6% 🔴 549702100 / 473766964 / +16.0% 1.25 / 1.04 / +20.3%
fineweb_q08/datafusion:vortex-compact 177872568 / 183843936 / -3.2% 215429700 / 230562408 / -6.6% 0.83 / 0.80 / +3.5%
datafusion / parquet / ns (1.148x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 510104582 / 426589288 / +19.6% 811866043 / 732545278 / +10.8% 0.63 / 0.58 / +7.9%
fineweb_q01/datafusion:parquet 727056546 / 717668744 / +1.3% 806352246 / 648798365 / +24.3% 0.90 / 1.11 / -18.5%
fineweb_q02/datafusion:parquet 845931136 / 689061272 / +22.8% 866865350 / 701959989 / +23.5% 0.98 / 0.98 / -0.6%
fineweb_q03/datafusion:parquet 1212107160 / 714326896 / +69.7% 🔴 964770317 / 737311378 / +30.8% 🔴 1.26 / 0.97 / +29.7%
fineweb_q04/datafusion:parquet 940263130 / 680525164 / +38.2% 🔴 881158267 / 786524861 / +12.0% 1.07 / 0.87 / +23.3%
fineweb_q05/datafusion:parquet 725332797 / 851538112 / -14.8% 672116798 / 1116168828 / -39.8% 🟢 1.08 / 0.76 / +41.5%
fineweb_q06/datafusion:parquet 757204026 / 744964664 / +1.6% 744855622 / 721383108 / +3.3% 1.02 / 1.03 / -1.6%
fineweb_q07/datafusion:parquet 749660053 / 644715990 / +16.3% 666864663 / 620763855 / +7.4% 1.12 / 1.04 / +8.2%
fineweb_q08/datafusion:parquet 706068620 / 713170221 / -1.0% 788294061 / 773512957 / +1.9% 0.90 / 0.92 / -2.9%
duckdb / vortex-file-compressed / ns (1.014x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 72517406 / 63298500 / +14.6% 60692215 / 67247809 / -9.7% 1.19 / 0.94 / +26.9%
fineweb_q01/duckdb:vortex-file-compressed 407698304 / 467791161 / -12.8% 473101560 / 528753969 / -10.5% 0.86 / 0.88 / -2.6%
fineweb_q02/duckdb:vortex-file-compressed 584994484 / 578441644 / +1.1% 752418188 / 629184057 / +19.6% 0.78 / 0.92 / -15.4%
fineweb_q03/duckdb:vortex-file-compressed 963691642 / 990704750 / -2.7% 1111538469 / 1026555629 / +8.3% 0.87 / 0.97 / -10.2%
fineweb_q04/duckdb:vortex-file-compressed 1099216312 / 967448013 / +13.6% 958146816 / 1103785961 / -13.2% 1.15 / 0.88 / +30.9%
fineweb_q05/duckdb:vortex-file-compressed 874195696 / 949570658 / -7.9% 987727919 / 982910991 / +0.5% 0.89 / 0.97 / -8.4%
fineweb_q06/duckdb:vortex-file-compressed 1254121264 / 1181814713 / +6.1% 1246897881 / 1152388418 / +8.2% 1.01 / 1.03 / -1.9%
fineweb_q07/duckdb:vortex-file-compressed 1079584382 / 956262232 / +12.9% 1124146492 / 1022900270 / +9.9% 0.96 / 0.93 / +2.7%
fineweb_q08/duckdb:vortex-file-compressed 395959538 / 428351820 / -7.6% 456193108 / 508431674 / -10.3% 0.87 / 0.84 / +3.0%
duckdb / vortex-compact / ns (0.980x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 62575370 / 71308099 / -12.2% 70829564 / 73918669 / -4.2% 0.88 / 0.96 / -8.4%
fineweb_q01/duckdb:vortex-compact 378280257 / 388715826 / -2.7% 447237887 / 448046253 / -0.2% 0.85 / 0.87 / -2.5%
fineweb_q02/duckdb:vortex-compact 573256726 / 523392389 / +9.5% 612271712 / 586370214 / +4.4% 0.94 / 0.89 / +4.9%
fineweb_q03/duckdb:vortex-compact 1124858410 / 1107881136 / +1.5% 1281783369 / 1260006205 / +1.7% 0.88 / 0.88 / -0.2%
fineweb_q04/duckdb:vortex-compact 1167886566 / 1133699224 / +3.0% 1109521411 / 990436165 / +12.0% 1.05 / 1.14 / -8.0%
fineweb_q05/duckdb:vortex-compact 923716516 / 1111705637 / -16.9% 1057400405 / 979577268 / +7.9% 0.87 / 1.13 / -23.0%
fineweb_q06/duckdb:vortex-compact 1108123400 / 1108853152 / -0.1% 1199855761 / 1108134773 / +8.3% 0.92 / 1.00 / -7.7%
fineweb_q07/duckdb:vortex-compact 937432315 / 953923890 / -1.7% 934528751 / 994304180 / -6.0% 1.00 / 0.96 / +4.6%
fineweb_q08/duckdb:vortex-compact 390527000 / 372543006 / +4.8% 405325819 / 415063795 / -2.3% 0.96 / 0.90 / +7.3%
duckdb / parquet / ns (0.985x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 470235864 / 508561760 / -7.5% 512411698 / 557496987 / -8.1% 0.92 / 0.91 / +0.6%
fineweb_q01/duckdb:parquet 683392304 / 578753460 / +18.1% 580853498 / 591757402 / -1.8% 1.18 / 0.98 / +20.3%
fineweb_q02/duckdb:parquet 714689310 / 604806148 / +18.2% 730597796 / 636172664 / +14.8% 0.98 / 0.95 / +2.9%
fineweb_q03/duckdb:parquet 1413627733 / 1484552650 / -4.8% 1472312225 / 1572610938 / -6.4% 0.96 / 0.94 / +1.7%
fineweb_q04/duckdb:parquet 752205778 / 775761385 / -3.0% 785924989 / 911065500 / -13.7% 0.96 / 0.85 / +12.4%
fineweb_q05/duckdb:parquet 892499388 / 917814232 / -2.8% 1069114953 / 862306599 / +24.0% 0.83 / 1.06 / -21.6%
fineweb_q06/duckdb:parquet 1612020480 / 1678045269 / -3.9% 1686568485 / 1704396530 / -1.0% 0.96 / 0.98 / -2.9%
fineweb_q07/duckdb:parquet 1172489873 / 1025338610 / +14.4% 1020972759 / 1094189064 / -6.7% 1.15 / 0.94 / +22.6%
fineweb_q08/duckdb:parquet 439629446 / 639407292 / -31.2% 🟢 508053833 / 695022669 / -26.9% 0.87 / 0.92 / -5.9%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DataFusion No clear signal (-0.6%, low confidence) · DuckDB No clear signal (+1.2%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.016x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.033x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52869973 / 52178056 / +1.3% 72126565 / 71267938 / +1.2% 0.73 / 0.73 / +0.1%
appian_q02/datafusion:vortex-compact 238479511 / 235975222 / +1.1% 264814110 / 261558149 / +1.2% 0.90 / 0.90 / -0.2%
appian_q03/datafusion:vortex-compact 147021385 / 147946821 / -0.6% 188954263 / 183124099 / +3.2% 0.78 / 0.81 / -3.7%
appian_q04/datafusion:vortex-compact 9916619783 / 9889906473 / +0.3% 9759686355 / 9821532655 / -0.6% 1.02 / 1.01 / +0.9%
appian_q05/datafusion:vortex-compact 135030464 / 138326864 / -2.4% 165946816 / 160955167 / +3.1% 0.81 / 0.86 / -5.3%
appian_q06/datafusion:vortex-compact 145821680 / 147138644 / -0.9% 165058678 / 168059655 / -1.8% 0.88 / 0.88 / +0.9%
appian_q07/datafusion:vortex-compact 165383860 / 165831241 / -0.3% 202799562 / 188377728 / +7.7% 0.82 / 0.88 / -7.4%
appian_q08/datafusion:vortex-compact 555394724 / 549813046 / +1.0% 596331317 / 588662122 / +1.3% 0.93 / 0.93 / -0.3%
datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72291201 / 72592517 / -0.4% 96204658 / 90073318 / +6.8% 0.75 / 0.81 / -6.8%
appian_q02/datafusion:parquet 303448998 / 301124603 / +0.8% 336207198 / 328335588 / +2.4% 0.90 / 0.92 / -1.6%
appian_q03/datafusion:parquet 188837814 / 185615935 / +1.7% 226012622 / 221828009 / +1.9% 0.84 / 0.84 / -0.1%
appian_q04/datafusion:parquet 9906947455 / 9932694269 / -0.3% 9818402536 / 9792565257 / +0.3% 1.01 / 1.01 / -0.5%
appian_q05/datafusion:parquet 194467994 / 191240566 / +1.7% 217846156 / 213611805 / +2.0% 0.89 / 0.90 / -0.3%
appian_q06/datafusion:parquet 168080016 / 168858948 / -0.5% 188201105 / 186772695 / +0.8% 0.89 / 0.90 / -1.2%
appian_q07/datafusion:parquet 206512988 / 203636847 / +1.4% 243527577 / 237141314 / +2.7% 0.85 / 0.86 / -1.2%
appian_q08/datafusion:parquet 666511049 / 666176369 / +0.1% 696012726 / 685146229 / +1.6% 0.96 / 0.97 / -1.5%
duckdb / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 91398125 / 90696608 / +0.8% 105227293 / 106748964 / -1.4% 0.87 / 0.85 / +2.2%
appian_q02/duckdb:vortex-compact 213716487 / 212947485 / +0.4% 225262026 / 232266957 / -3.0% 0.95 / 0.92 / +3.5%
appian_q03/duckdb:vortex-compact 122292880 / 121798151 / +0.4% 141064727 / 135487512 / +4.1% 0.87 / 0.90 / -3.6%
appian_q04/duckdb:vortex-compact 563918882 / 544204706 / +3.6% 614327215 / 525978794 / +16.8% 🔴 0.92 / 1.03 / -11.3%
appian_q05/duckdb:vortex-compact 124760248 / 127252571 / -2.0% 152536097 / 148840953 / +2.5% 0.82 / 0.85 / -4.3%
appian_q06/duckdb:vortex-compact 390421339 / 405186600 / -3.6% 379551879 / 399436244 / -5.0% 1.03 / 1.01 / +1.4%
appian_q07/duckdb:vortex-compact 137284569 / 135293970 / +1.5% 154153197 / 157775501 / -2.3% 0.89 / 0.86 / +3.9%
appian_q08/duckdb:vortex-compact 439550946 / 441118774 / -0.4% 481404163 / 476623574 / +1.0% 0.91 / 0.93 / -1.3%
duckdb / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 99687228 / 99764946 / -0.1% 119830647 / 127080144 / -5.7% 0.83 / 0.79 / +6.0%
appian_q02/duckdb:parquet 198525890 / 195899541 / +1.3% 203510500 / 207713970 / -2.0% 0.98 / 0.94 / +3.4%
appian_q03/duckdb:parquet 125211991 / 125843057 / -0.5% 145477250 / 140939773 / +3.2% 0.86 / 0.89 / -3.6%
appian_q04/duckdb:parquet 443884293 / 437005862 / +1.6% 490042627 / 438522248 / +11.7% 🔴 0.91 / 1.00 / -9.1%
appian_q05/duckdb:parquet 143979076 / 144597710 / -0.4% 166046398 / 165585407 / +0.3% 0.87 / 0.87 / -0.7%
appian_q06/duckdb:parquet 237170403 / 261733772 / -9.4% 303111633 / 259502350 / +16.8% 🔴 0.78 / 1.01 / -22.4%
appian_q07/duckdb:parquet 155390408 / 152888817 / +1.6% 174594942 / 171232033 / +2.0% 0.89 / 0.89 / -0.3%
appian_q08/duckdb:parquet 370359091 / 380627631 / -2.7% 410009742 / 374450211 / +9.5% 0.90 / 1.02 / -11.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.3%
Engines: DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.986x ➖
Parquet (geomean): hot 0.997x ➖ · cold 1.006x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 9034154 / 9010022 / +0.3% 9428724 / 9517375 / -0.9% 0.96 / 0.95 / +1.2%
statpopgen_q01/duckdb:vortex-file-compressed 10328256 / 10387812 / -0.6% 15416069 / 14722708 / +4.7% 0.67 / 0.71 / -5.0%
statpopgen_q02/duckdb:vortex-file-compressed 303877858 / 299424406 / +1.5% 322144819 / 339086354 / -5.0% 0.94 / 0.88 / +6.8%
statpopgen_q03/duckdb:vortex-file-compressed 812447696 / 812690058 / -0.0% 825121270 / 810086157 / +1.9% 0.98 / 1.00 / -1.9%
statpopgen_q04/duckdb:vortex-file-compressed 813864054 / 814450308 / -0.1% 822740632 / 815510290 / +0.9% 0.99 / 1.00 / -1.0%
statpopgen_q05/duckdb:vortex-file-compressed 316246148 / 314211116 / +0.6% 346594722 / 335128042 / +3.4% 0.91 / 0.94 / -2.7%
statpopgen_q06/duckdb:vortex-file-compressed 1130116036 / 1138451046 / -0.7% 1142744007 / 1148413068 / -0.5% 0.99 / 0.99 / -0.2%
statpopgen_q07/duckdb:vortex-file-compressed 130801434 / 131881083 / -0.8% 147215204 / 188976457 / -22.1% 🟢 0.89 / 0.70 / +27.3%
statpopgen_q08/duckdb:vortex-file-compressed 143910684 / 143914109 / -0.0% 158793032 / 159621952 / -0.5% 0.91 / 0.90 / +0.5%
statpopgen_q09/duckdb:vortex-file-compressed 620992956 / 612906962 / +1.3% 631648722 / 645225089 / -2.1% 0.98 / 0.95 / +3.5%
statpopgen_q10/duckdb:vortex-file-compressed 1925527766 / 1938833736 / -0.7% 1921665197 / 1901202974 / +1.1% 1.00 / 1.02 / -1.7%
duckdb / vortex-compact / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 9009154 / 9126262 / -1.3% 9511011 / 9561827 / -0.5% 0.95 / 0.95 / -0.8%
statpopgen_q01/duckdb:vortex-compact 10307066 / 10299910 / +0.1% 14279736 / 14777687 / -3.4% 0.72 / 0.70 / +3.6%
statpopgen_q02/duckdb:vortex-compact 391648312 / 391323081 / +0.1% 406210094 / 404861655 / +0.3% 0.96 / 0.97 / -0.2%
statpopgen_q03/duckdb:vortex-compact 913467162 / 913910590 / -0.0% 919935876 / 915243580 / +0.5% 0.99 / 1.00 / -0.6%
statpopgen_q04/duckdb:vortex-compact 907709875 / 904206799 / +0.4% 924692212 / 911279322 / +1.5% 0.98 / 0.99 / -1.1%
statpopgen_q05/duckdb:vortex-compact 438108634 / 436984370 / +0.3% 447022464 / 444672458 / +0.5% 0.98 / 0.98 / -0.3%
statpopgen_q06/duckdb:vortex-compact 1183510152 / 1176976532 / +0.6% 1177550872 / 1182379921 / -0.4% 1.01 / 1.00 / +1.0%
statpopgen_q07/duckdb:vortex-compact 328107148 / 330239358 / -0.6% 339991286 / 350355061 / -3.0% 0.97 / 0.94 / +2.4%
statpopgen_q08/duckdb:vortex-compact 348249071 / 352481642 / -1.2% 355921835 / 369097253 / -3.6% 0.98 / 0.95 / +2.5%
statpopgen_q09/duckdb:vortex-compact 727812222 / 722201884 / +0.8% 727583254 / 731290178 / -0.5% 1.00 / 0.99 / +1.3%
statpopgen_q10/duckdb:vortex-compact 2024044635 / 2011586268 / +0.6% 1986279388 / 1992525221 / -0.3% 1.02 / 1.01 / +0.9%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 248380244 / 246449860 / +0.8% 247561988 / 249735906 / -0.9% 1.00 / 0.99 / +1.7%
statpopgen_q01/duckdb:parquet 308128324 / 307331994 / +0.3% 309537964 / 307487847 / +0.7% 1.00 / 1.00 / -0.4%
statpopgen_q02/duckdb:parquet 547262454 / 543794798 / +0.6% 562598607 / 554126172 / +1.5% 0.97 / 0.98 / -0.9%
statpopgen_q03/duckdb:parquet 832190888 / 861732794 / -3.4% 843964194 / 881989158 / -4.3% 0.99 / 0.98 / +0.9%
statpopgen_q04/duckdb:parquet 850268992 / 867354378 / -2.0% 847554687 / 857064799 / -1.1% 1.00 / 1.01 / -0.9%
statpopgen_q05/duckdb:parquet 582344586 / 576995108 / +0.9% 577737687 / 581438640 / -0.6% 1.01 / 0.99 / +1.6%
statpopgen_q06/duckdb:parquet 706604730 / 718840870 / -1.7% 722907935 / 699415331 / +3.4% 0.98 / 1.03 / -4.9%
statpopgen_q07/duckdb:parquet 614661290 / 617615294 / -0.5% 723910183 / 687845559 / +5.2% 0.85 / 0.90 / -5.4%
statpopgen_q08/duckdb:parquet 619276118 / 619177624 / +0.0% 678554197 / 717220339 / -5.4% 0.91 / 0.86 / +5.7%
statpopgen_q09/duckdb:parquet 835594433 / 803021710 / +4.1% 852061518 / 794640307 / +7.2% 0.98 / 1.01 / -3.0%
statpopgen_q10/duckdb:parquet 1454816887 / 1480751718 / -1.8% 1265968406 / 1248226600 / +1.4% 1.15 / 1.19 / -3.1%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (-1.9%, low confidence) · DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 0.979x ➖
Parquet (geomean): hot 1.011x ➖ · cold 0.989x ➖
Shifts: Parquet (control) +1.1% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1241578 / 1246770 / -0.4% 19732065 / 21311529 / -7.4% 0.06 / 0.06 / +7.6%
clickbench_q01/datafusion:vortex-file-compressed 5703190 / 6065571 / -6.0% 32140234 / 34342602 / -6.4% 0.18 / 0.18 / +0.5%
clickbench_q02/datafusion:vortex-file-compressed 11017923 / 10121404 / +8.9% 38726726 / 42566849 / -9.0% 0.28 / 0.24 / +19.7%
clickbench_q03/datafusion:vortex-file-compressed 12372775 / 11721434 / +5.6% 51585735 / 54899888 / -6.0% 0.24 / 0.21 / +12.3%
clickbench_q04/datafusion:vortex-file-compressed 55719248 / 55470250 / +0.4% 88151800 / 91052341 / -3.2% 0.63 / 0.61 / +3.8%
clickbench_q05/datafusion:vortex-file-compressed 74413645 / 74236314 / +0.2% 115886141 / 110276868 / +5.1% 0.64 / 0.67 / -4.6%
clickbench_q06/datafusion:vortex-file-compressed 1217271 / 1240737 / -1.9% 19203165 / 20655007 / -7.0% 0.06 / 0.06 / +5.5%
clickbench_q07/datafusion:vortex-file-compressed 9876628 / 9692842 / +1.9% 31679636 / 35434265 / -10.6% 🟢 0.31 / 0.27 / +14.0%
clickbench_q08/datafusion:vortex-file-compressed 74954914 / 75684564 / -1.0% 116315816 / 115708535 / +0.5% 0.64 / 0.65 / -1.5%
clickbench_q09/datafusion:vortex-file-compressed 170889185 / 169843704 / +0.6% 204345897 / 207676950 / -1.6% 0.84 / 0.82 / +2.3%
clickbench_q10/datafusion:vortex-file-compressed 24159316 / 22853762 / +5.7% 66053927 / 71225991 / -7.3% 0.37 / 0.32 / +14.0%
clickbench_q11/datafusion:vortex-file-compressed 27155610 / 26190774 / +3.7% 67540839 / 70084520 / -3.6% 0.40 / 0.37 / +7.6%
clickbench_q12/datafusion:vortex-file-compressed 73081682 / 72324884 / +1.0% 110999385 / 114358013 / -2.9% 0.66 / 0.63 / +4.1%
clickbench_q13/datafusion:vortex-file-compressed 116799318 / 120226162 / -2.9% 174590523 / 174194934 / +0.2% 0.67 / 0.69 / -3.1%
clickbench_q14/datafusion:vortex-file-compressed 75931350 / 74593868 / +1.8% 114644465 / 114179571 / +0.4% 0.66 / 0.65 / +1.4%
clickbench_q15/datafusion:vortex-file-compressed 61547702 / 62139144 / -1.0% 92682131 / 97669239 / -5.1% 0.66 / 0.64 / +4.4%
clickbench_q16/datafusion:vortex-file-compressed 149843677 / 154130696 / -2.8% 210220315 / 198614513 / +5.8% 0.71 / 0.78 / -8.1%
clickbench_q17/datafusion:vortex-file-compressed 149181850 / 148725850 / +0.3% 218262715 / 202077216 / +8.0% 0.68 / 0.74 / -7.1%
clickbench_q18/datafusion:vortex-file-compressed 300685438 / 307355722 / -2.2% 391317482 / 376401077 / +4.0% 0.77 / 0.82 / -5.9%
clickbench_q19/datafusion:vortex-file-compressed 7878702 / 7583318 / +3.9% 46703938 / 49691323 / -6.0% 0.17 / 0.15 / +10.5%
clickbench_q20/datafusion:vortex-file-compressed 61493920 / 61520165 / -0.0% 226696812 / 234598567 / -3.4% 0.27 / 0.26 / +3.4%
clickbench_q21/datafusion:vortex-file-compressed 89472686 / 88303248 / +1.3% 268626200 / 271532653 / -1.1% 0.33 / 0.33 / +2.4%
clickbench_q22/datafusion:vortex-file-compressed 103924094 / 104643066 / -0.7% 344797398 / 349885765 / -1.5% 0.30 / 0.30 / +0.8%
clickbench_q23/datafusion:vortex-file-compressed 198399994 / 202194764 / -1.9% 529914253 / 527541662 / +0.4% 0.37 / 0.38 / -2.3%
clickbench_q24/datafusion:vortex-file-compressed 15911216 / 15917605 / -0.0% 61691008 / 65824169 / -6.3% 0.26 / 0.24 / +6.7%
clickbench_q25/datafusion:vortex-file-compressed 18258558 / 17727398 / +3.0% 54958882 / 58723001 / -6.4% 0.33 / 0.30 / +10.1%
clickbench_q26/datafusion:vortex-file-compressed 16478110 / 17121920 / -3.8% 61238006 / 65502051 / -6.5% 0.27 / 0.26 / +2.9%
clickbench_q27/datafusion:vortex-file-compressed 96627084 / 95371541 / +1.3% 240341611 / 249213133 / -3.6% 0.40 / 0.38 / +5.1%
clickbench_q28/datafusion:vortex-file-compressed 570045281 / 575164587 / -0.9% 619677339 / 614671972 / +0.8% 0.92 / 0.94 / -1.7%
clickbench_q29/datafusion:vortex-file-compressed 22420310 / 22744234 / -1.4% 47998619 / 50326804 / -4.6% 0.47 / 0.45 / +3.4%
clickbench_q30/datafusion:vortex-file-compressed 57824844 / 59435481 / -2.7% 105358334 / 102993332 / +2.3% 0.55 / 0.58 / -4.9%
clickbench_q31/datafusion:vortex-file-compressed 70881168 / 70716008 / +0.2% 148931064 / 155603535 / -4.3% 0.48 / 0.45 / +4.7%
clickbench_q32/datafusion:vortex-file-compressed 297957191 / 291409225 / +2.2% 381145653 / 371328796 / +2.6% 0.78 / 0.78 / -0.4%
clickbench_q33/datafusion:vortex-file-compressed 329972888 / 329758618 / +0.1% 426947484 / 408911312 / +4.4% 0.77 / 0.81 / -4.2%
clickbench_q34/datafusion:vortex-file-compressed 324395306 / 327172894 / -0.8% 421107099 / 422655407 / -0.4% 0.77 / 0.77 / -0.5%
clickbench_q35/datafusion:vortex-file-compressed 55711381 / 56707789 / -1.8% 88141650 / 88017579 / +0.1% 0.63 / 0.64 / -1.9%
clickbench_q36/datafusion:vortex-file-compressed 37607126 / 37222882 / +1.0% 63595739 / 65355137 / -2.7% 0.59 / 0.57 / +3.8%
clickbench_q37/datafusion:vortex-file-compressed 21660898 / 21758644 / -0.4% 45705922 / 48180845 / -5.1% 0.47 / 0.45 / +4.9%
clickbench_q38/datafusion:vortex-file-compressed 11523645 / 11795448 / -2.3% 37056709 / 41167518 / -10.0% 0.31 / 0.29 / +8.5%
clickbench_q39/datafusion:vortex-file-compressed 78364482 / 78204507 / +0.2% 107983467 / 111189102 / -2.9% 0.73 / 0.70 / +3.2%
clickbench_q40/datafusion:vortex-file-compressed 11204464 / 11046814 / +1.4% 35293470 / 37883463 / -6.8% 0.32 / 0.29 / +8.9%
clickbench_q41/datafusion:vortex-file-compressed 10683862 / 10595214 / +0.8% 33352009 / 36083183 / -7.6% 0.32 / 0.29 / +9.1%
clickbench_q42/datafusion:vortex-file-compressed 10967820 / 11147100 / -1.6% 34423713 / 35052533 / -1.8% 0.32 / 0.32 / +0.2%
datafusion / vortex-compact / ns (1.006x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1207762 / 1217980 / -0.8% 18486771 / 21131674 / -12.5% 🟢 0.07 / 0.06 / +13.3%
clickbench_q01/datafusion:vortex-compact 7143400 / 6812214 / +4.9% 27311222 / 30608964 / -10.8% 🟢 0.26 / 0.22 / +17.5%
clickbench_q02/datafusion:vortex-compact 19720090 / 19908316 / -0.9% 41882969 / 44079654 / -5.0% 0.47 / 0.45 / +4.2%
clickbench_q03/datafusion:vortex-compact 13497032 / 14795997 / -8.8% 37635261 / 40319310 / -6.7% 0.36 / 0.37 / -2.3%
clickbench_q04/datafusion:vortex-compact 57732962 / 57603007 / +0.2% 84635541 / 85956856 / -1.5% 0.68 / 0.67 / +1.8%
clickbench_q05/datafusion:vortex-compact 81860834 / 83786218 / -2.3% 117969258 / 118077988 / -0.1% 0.69 / 0.71 / -2.2%
clickbench_q06/datafusion:vortex-compact 1228318 / 1266036 / -3.0% 18749659 / 20444319 / -8.3% 0.07 / 0.06 / +5.8%
clickbench_q07/datafusion:vortex-compact 12674159 / 12057174 / +5.1% 32576492 / 36676587 / -11.2% 🟢 0.39 / 0.33 / +18.3%
clickbench_q08/datafusion:vortex-compact 87198803 / 85013862 / +2.6% 115522040 / 123974353 / -6.8% 0.75 / 0.69 / +10.1%
clickbench_q09/datafusion:vortex-compact 193544526 / 187071242 / +3.5% 212160845 / 215342052 / -1.5% 0.91 / 0.87 / +5.0%
clickbench_q10/datafusion:vortex-compact 43547598 / 43562004 / -0.0% 67324373 / 71433923 / -5.8% 0.65 / 0.61 / +6.1%
clickbench_q11/datafusion:vortex-compact 55813018 / 55755222 / +0.1% 81673204 / 84161092 / -3.0% 0.68 / 0.66 / +3.2%
clickbench_q12/datafusion:vortex-compact 81147766 / 84730880 / -4.2% 119319660 / 122830042 / -2.9% 0.68 / 0.69 / -1.4%
clickbench_q13/datafusion:vortex-compact 139021992 / 137624356 / +1.0% 186559268 / 180055464 / +3.6% 0.75 / 0.76 / -2.5%
clickbench_q14/datafusion:vortex-compact 95692306 / 95215814 / +0.5% 123519881 / 127518903 / -3.1% 0.77 / 0.75 / +3.8%
clickbench_q15/datafusion:vortex-compact 65733816 / 61780554 / +6.4% 92512946 / 92321857 / +0.2% 0.71 / 0.67 / +6.2%
clickbench_q16/datafusion:vortex-compact 159751014 / 165794667 / -3.6% 220444055 / 209901734 / +5.0% 0.72 / 0.79 / -8.3%
clickbench_q17/datafusion:vortex-compact 168172862 / 165217622 / +1.8% 229488636 / 208184420 / +10.2% 🔴 0.73 / 0.79 / -7.7%
clickbench_q18/datafusion:vortex-compact 299307740 / 292932106 / +2.2% 370305490 / 361276544 / +2.5% 0.81 / 0.81 / -0.3%
clickbench_q19/datafusion:vortex-compact 10269937 / 9650488 / +6.4% 37346418 / 39504644 / -5.5% 0.27 / 0.24 / +12.6%
clickbench_q20/datafusion:vortex-compact 72829921 / 72347859 / +0.7% 190833591 / 191957190 / -0.6% 0.38 / 0.38 / +1.3%
clickbench_q21/datafusion:vortex-compact 117701850 / 119430812 / -1.4% 221770859 / 227051456 / -2.3% 0.53 / 0.53 / +0.9%
clickbench_q22/datafusion:vortex-compact 186248336 / 186719358 / -0.3% 267937222 / 280704649 / -4.5% 0.70 / 0.67 / +4.5%
clickbench_q23/datafusion:vortex-compact 639525440 / 524904900 / +21.8% 🔴 612578575 / 654737517 / -6.4% 1.04 / 0.80 / +30.2%
clickbench_q24/datafusion:vortex-compact 28012056 / 27740676 / +1.0% 56819212 / 56752509 / +0.1% 0.49 / 0.49 / +0.9%
clickbench_q25/datafusion:vortex-compact 36158442 / 35835110 / +0.9% 62828159 / 67388740 / -6.8% 0.58 / 0.53 / +8.2%
clickbench_q26/datafusion:vortex-compact 28235933 / 29483254 / -4.2% 58472564 / 61280461 / -4.6% 0.48 / 0.48 / +0.4%
clickbench_q27/datafusion:vortex-compact 103643960 / 105281234 / -1.6% 205630936 / 214008545 / -3.9% 0.50 / 0.49 / +2.5%
clickbench_q28/datafusion:vortex-compact 584192441 / 576152047 / +1.4% 612037921 / 633550660 / -3.4% 0.95 / 0.91 / +5.0%
clickbench_q29/datafusion:vortex-compact 30176305 / 30436552 / -0.9% 53035219 / 55826422 / -5.0% 0.57 / 0.55 / +4.4%
clickbench_q30/datafusion:vortex-compact 91271180 / 91805928 / -0.6% 120255906 / 131005068 / -8.2% 0.76 / 0.70 / +8.3%
clickbench_q31/datafusion:vortex-compact 100042626 / 98816852 / +1.2% 158882576 / 162305091 / -2.1% 0.63 / 0.61 / +3.4%
clickbench_q32/datafusion:vortex-compact 304189808 / 302693926 / +0.5% 381398453 / 365764224 / +4.3% 0.80 / 0.83 / -3.6%
clickbench_q33/datafusion:vortex-compact 339417237 / 345917440 / -1.9% 428342204 / 410739623 / +4.3% 0.79 / 0.84 / -5.9%
clickbench_q34/datafusion:vortex-compact 344306888 / 336223632 / +2.4% 426736786 / 425825394 / +0.2% 0.81 / 0.79 / +2.2%
clickbench_q35/datafusion:vortex-compact 62813396 / 63489772 / -1.1% 88211939 / 90977690 / -3.0% 0.71 / 0.70 / +2.0%
clickbench_q36/datafusion:vortex-compact 38467966 / 38426952 / +0.1% 64485226 / 68638789 / -6.1% 0.60 / 0.56 / +6.6%
clickbench_q37/datafusion:vortex-compact 22320154 / 22489301 / -0.8% 45295493 / 49118023 / -7.8% 0.49 / 0.46 / +7.6%
clickbench_q38/datafusion:vortex-compact 12939358 / 12681212 / +2.0% 37887863 / 40876159 / -7.3% 0.34 / 0.31 / +10.1%
clickbench_q39/datafusion:vortex-compact 79919648 / 79578452 / +0.4% 108511568 / 111315552 / -2.5% 0.74 / 0.71 / +3.0%
clickbench_q40/datafusion:vortex-compact 12692654 / 12366377 / +2.6% 34853073 / 37869691 / -8.0% 0.36 / 0.33 / +11.5%
clickbench_q41/datafusion:vortex-compact 12787662 / 12814836 / -0.2% 34381752 / 36440342 / -5.6% 0.37 / 0.35 / +5.8%
clickbench_q42/datafusion:vortex-compact 11068239 / 11395658 / -2.9% 33116194 / 35572370 / -6.9% 0.33 / 0.32 / +4.3%
datafusion / parquet / ns (1.023x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1255360 / 1273720 / -1.4% 47618082 / 50843474 / -6.3% 0.03 / 0.03 / +5.2%
clickbench_q01/datafusion:parquet 16104160 / 15678672 / +2.7% 70917683 / 67178840 / +5.6% 0.23 / 0.23 / -2.7%
clickbench_q02/datafusion:parquet 18498258 / 19737175 / -6.3% 81265487 / 82245188 / -1.2% 0.23 / 0.24 / -5.1%
clickbench_q03/datafusion:parquet 17316548 / 17283718 / +0.2% 80584798 / 80783414 / -0.2% 0.21 / 0.21 / +0.4%
clickbench_q04/datafusion:parquet 62241179 / 60489084 / +2.9% 127901024 / 123022297 / +4.0% 0.49 / 0.49 / -1.0%
clickbench_q05/datafusion:parquet 88995056 / 86838604 / +2.5% 156942824 / 158823336 / -1.2% 0.57 / 0.55 / +3.7%
clickbench_q06/datafusion:parquet 1262636 / 1275076 / -1.0% 47357912 / 48798143 / -3.0% 0.03 / 0.03 / +2.0%
clickbench_q07/datafusion:parquet 16911058 / 16860368 / +0.3% 66709123 / 67400453 / -1.0% 0.25 / 0.25 / +1.3%
clickbench_q08/datafusion:parquet 86060370 / 88160730 / -2.4% 160350790 / 162815995 / -1.5% 0.54 / 0.54 / -0.9%
clickbench_q09/datafusion:parquet 188953733 / 185570406 / +1.8% 268564707 / 260949169 / +2.9% 0.70 / 0.71 / -1.1%
clickbench_q10/datafusion:parquet 36686340 / 35262998 / +4.0% 100783387 / 101232561 / -0.4% 0.36 / 0.35 / +4.5%
clickbench_q11/datafusion:parquet 43669925 / 41680512 / +4.8% 108009954 / 111353772 / -3.0% 0.40 / 0.37 / +8.0%
clickbench_q12/datafusion:parquet 96680784 / 95106118 / +1.7% 159419303 / 158477439 / +0.6% 0.61 / 0.60 / +1.1%
clickbench_q13/datafusion:parquet 149190146 / 144558528 / +3.2% 228005206 / 222544381 / +2.5% 0.65 / 0.65 / +0.7%
clickbench_q14/datafusion:parquet 101922669 / 99959492 / +2.0% 171104561 / 172366621 / -0.7% 0.60 / 0.58 / +2.7%
clickbench_q15/datafusion:parquet 73495703 / 72173647 / +1.8% 129708646 / 131630157 / -1.5% 0.57 / 0.55 / +3.3%
clickbench_q16/datafusion:parquet 158446783 / 155142002 / +2.1% 236507570 / 231142613 / +2.3% 0.67 / 0.67 / -0.2%
clickbench_q17/datafusion:parquet 156257784 / 154281570 / +1.3% 237145734 / 233484914 / +1.6% 0.66 / 0.66 / -0.3%
clickbench_q18/datafusion:parquet 320256438 / 311877392 / +2.7% 420112923 / 402821168 / +4.3% 0.76 / 0.77 / -1.5%
clickbench_q19/datafusion:parquet 19435442 / 19075126 / +1.9% 75170418 / 75591086 / -0.6% 0.26 / 0.25 / +2.5%
clickbench_q20/datafusion:parquet 179512102 / 168654625 / +6.4% 287251549 / 287327420 / -0.0% 0.62 / 0.59 / +6.5%
clickbench_q21/datafusion:parquet 177339659 / 163978950 / +8.1% 304700377 / 296627151 / +2.7% 0.58 / 0.55 / +5.3%
clickbench_q22/datafusion:parquet 261870651 / 247727673 / +5.7% 437478430 / 427268243 / +2.4% 0.60 / 0.58 / +3.2%
clickbench_q23/datafusion:parquet 1109015454 / 948791535 / +16.9% 🔴 1255768143 / 1196037271 / +5.0% 0.88 / 0.79 / +11.3%
clickbench_q24/datafusion:parquet 30212358 / 29578084 / +2.1% 85677436 / 90425722 / -5.3% 0.35 / 0.33 / +7.8%
clickbench_q25/datafusion:parquet 36953353 / 36136588 / +2.3% 98456855 / 103921538 / -5.3% 0.38 / 0.35 / +7.9%
clickbench_q26/datafusion:parquet 30779468 / 30746233 / +0.1% 87821313 / 90588033 / -3.1% 0.35 / 0.34 / +3.3%
clickbench_q27/datafusion:parquet 192619199 / 180673914 / +6.6% 283466226 / 277820784 / +2.0% 0.68 / 0.65 / +4.5%
clickbench_q28/datafusion:parquet 626270012 / 620761264 / +0.9% 705388335 / 702246797 / +0.4% 0.89 / 0.88 / +0.4%
clickbench_q29/datafusion:parquet 29118073 / 29803803 / -2.3% 89775000 / 91860090 / -2.3% 0.32 / 0.32 / -0.0%
clickbench_q30/datafusion:parquet 91827794 / 88616042 / +3.6% 164464737 / 171750736 / -4.2% 0.56 / 0.52 / +8.2%
clickbench_q31/datafusion:parquet 104074684 / 99480074 / +4.6% 189453634 / 200525752 / -5.5% 0.55 / 0.50 / +10.7%
clickbench_q32/datafusion:parquet 325175390 / 308677150 / +5.3% 431956286 / 411371431 / +5.0% 0.75 / 0.75 / +0.3%
clickbench_q33/datafusion:parquet 387003172 / 367649216 / +5.3% 476036275 / 460739625 / +3.3% 0.81 / 0.80 / +1.9%
clickbench_q34/datafusion:parquet 385963560 / 366150571 / +5.4% 486654754 / 458960684 / +6.0% 0.79 / 0.80 / -0.6%
clickbench_q35/datafusion:parquet 65039053 / 64895809 / +0.2% 121594623 / 124666757 / -2.5% 0.53 / 0.52 / +2.8%
clickbench_q36/datafusion:parquet 73767729 / 72483628 / +1.8% 134499398 / 134758026 / -0.2% 0.55 / 0.54 / +2.0%
clickbench_q37/datafusion:parquet 35204542 / 35145797 / +0.2% 89751015 / 91965125 / -2.4% 0.39 / 0.38 / +2.6%
clickbench_q38/datafusion:parquet 47602285 / 46727293 / +1.9% 105309055 / 110181754 / -4.4% 0.45 / 0.42 / +6.6%
clickbench_q39/datafusion:parquet 144770666 / 142332057 / +1.7% 204152260 / 209882869 / -2.7% 0.71 / 0.68 / +4.6%
clickbench_q40/datafusion:parquet 20103464 / 20080248 / +0.1% 75200587 / 77219546 / -2.6% 0.27 / 0.26 / +2.8%
clickbench_q41/datafusion:parquet 18940288 / 18870018 / +0.4% 74566863 / 76566780 / -2.6% 0.25 / 0.25 / +3.1%
clickbench_q42/datafusion:parquet 19118326 / 18903958 / +1.1% 73315133 / 75152782 / -2.4% 0.26 / 0.25 / +3.7%
duckdb / vortex-file-compressed / ns (1.000x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 1654712 / 1558978 / +6.1% 23130623 / 22762088 / +1.6% 0.07 / 0.07 / +4.4%
clickbench_q01/duckdb:vortex-file-compressed 12125184 / 12017546 / +0.9% 29265893 / 28545153 / +2.5% 0.41 / 0.42 / -1.6%
clickbench_q02/duckdb:vortex-file-compressed 14728266 / 13001364 / +13.3% 🔴 31539816 / 35359028 / -10.8% 🟢 0.47 / 0.37 / +27.0%
clickbench_q03/duckdb:vortex-file-compressed 17139691 / 17269736 / -0.8% 46757449 / 50594380 / -7.6% 0.37 / 0.34 / +7.4%
clickbench_q04/duckdb:vortex-file-compressed 69546195 / 66441144 / +4.7% 108446521 / 106818166 / +1.5% 0.64 / 0.62 / +3.1%
clickbench_q05/duckdb:vortex-file-compressed 68254899 / 69168228 / -1.3% 99601528 / 94544916 / +5.3% 0.69 / 0.73 / -6.3%
clickbench_q06/duckdb:vortex-file-compressed 1844213 / 1842616 / +0.1% 31019275 / 28031728 / +10.7% 🔴 0.06 / 0.07 / -9.6%
clickbench_q07/duckdb:vortex-file-compressed 14135363 / 14050926 / +0.6% 33748558 / 31779687 / +6.2% 0.42 / 0.44 / -5.3%
clickbench_q08/duckdb:vortex-file-compressed 84715827 / 85435702 / -0.8% 120940555 / 125590852 / -3.7% 0.70 / 0.68 / +3.0%
clickbench_q09/duckdb:vortex-file-compressed 109123977 / 109308654 / -0.2% 149959779 / 151009876 / -0.7% 0.73 / 0.72 / +0.5%
clickbench_q10/duckdb:vortex-file-compressed 32966563 / 33529726 / -1.7% 64937846 / 71431953 / -9.1% 0.51 / 0.47 / +8.2%
clickbench_q11/duckdb:vortex-file-compressed 35405081 / 35266165 / +0.4% 69135173 / 73693567 / -6.2% 0.51 / 0.48 / +7.0%
clickbench_q12/duckdb:vortex-file-compressed 76290204 / 76475467 / -0.2% 105397708 / 106533092 / -1.1% 0.72 / 0.72 / +0.8%
clickbench_q13/duckdb:vortex-file-compressed 132398261 / 136155692 / -2.8% 174121682 / 183475248 / -5.1% 0.76 / 0.74 / +2.5%
clickbench_q14/duckdb:vortex-file-compressed 78653436 / 79022924 / -0.5% 117937058 / 108556941 / +8.6% 0.67 / 0.73 / -8.4%
clickbench_q15/duckdb:vortex-file-compressed 91502892 / 92302404 / -0.9% 127414586 / 134959841 / -5.6% 0.72 / 0.68 / +5.0%
clickbench_q16/duckdb:vortex-file-compressed 160182919 / 160488615 / -0.2% 209562908 / 208989343 / +0.3% 0.76 / 0.77 / -0.5%
clickbench_q17/duckdb:vortex-file-compressed 161798260 / 162853468 / -0.6% 205549067 / 209117165 / -1.7% 0.79 / 0.78 / +1.1%
clickbench_q18/duckdb:vortex-file-compressed 321537370 / 316702158 / +1.5% 373158721 / 374569514 / -0.4% 0.86 / 0.85 / +1.9%
clickbench_q19/duckdb:vortex-file-compressed 16047676 / 17998910 / -10.8% 🟢 38142147 / 41262764 / -7.6% 0.42 / 0.44 / -3.5%
clickbench_q20/duckdb:vortex-file-compressed 112210168 / 114425382 / -1.9% 189652363 / 200521706 / -5.4% 0.59 / 0.57 / +3.7%
clickbench_q21/duckdb:vortex-file-compressed 157418106 / 161039506 / -2.2% 290183679 / 303352078 / -4.3% 0.54 / 0.53 / +2.2%
clickbench_q22/duckdb:vortex-file-compressed 238465286 / 245133757 / -2.7% 424165001 / 473428213 / -10.4% 🟢 0.56 / 0.52 / +8.6%
clickbench_q23/duckdb:vortex-file-compressed 56761580 / 57134122 / -0.7% 98637008 / 99766407 / -1.1% 0.58 / 0.57 / +0.5%
clickbench_q24/duckdb:vortex-file-compressed 27453334 / 24783294 / +10.8% 🔴 42980415 / 40305535 / +6.6% 0.64 / 0.61 / +3.9%
clickbench_q25/duckdb:vortex-file-compressed 31709506 / 31711345 / -0.0% 49042019 / 51863537 / -5.4% 0.65 / 0.61 / +5.7%
clickbench_q26/duckdb:vortex-file-compressed 21003726 / 20203218 / +4.0% 36579482 / 35182608 / +4.0% 0.57 / 0.57 / -0.0%
clickbench_q27/duckdb:vortex-file-compressed 146199526 / 145682150 / +0.4% 240102710 / 256000715 / -6.2% 0.61 / 0.57 / +7.0%
clickbench_q28/duckdb:vortex-file-compressed 612732501 / 680476544 / -10.0% 663543821 / 706596514 / -6.1% 0.92 / 0.96 / -4.1%
clickbench_q29/duckdb:vortex-file-compressed 20246809 / 19108928 / +6.0% 37269832 / 36967779 / +0.8% 0.54 / 0.52 / +5.1%
clickbench_q30/duckdb:vortex-file-compressed 67837532 / 68814878 / -1.4% 106214712 / 116411503 / -8.8% 0.64 / 0.59 / +8.0%
clickbench_q31/duckdb:vortex-file-compressed 127059360 / 125804442 / +1.0% 193956639 / 184766993 / +5.0% 0.66 / 0.68 / -3.8%
clickbench_q32/duckdb:vortex-file-compressed 440881904 / 445855118 / -1.1% 510563936 / 537503713 / -5.0% 0.86 / 0.83 / +4.1%
clickbench_q33/duckdb:vortex-file-compressed 401302259 / 389530000 / +3.0% 513161795 / 508992117 / +0.8% 0.78 / 0.77 / +2.2%
clickbench_q34/duckdb:vortex-file-compressed 412729226 / 410085273 / +0.6% 536256212 / 529555558 / +1.3% 0.77 / 0.77 / -0.6%
clickbench_q35/duckdb:vortex-file-compressed 103047005 / 104063606 / -1.0% 135834370 / 142023222 / -4.4% 0.76 / 0.73 / +3.5%
clickbench_q36/duckdb:vortex-file-compressed 16671867 / 16375360 / +1.8% 33780128 / 33392269 / +1.2% 0.49 / 0.49 / +0.6%
clickbench_q37/duckdb:vortex-file-compressed 12013124 / 12335373 / -2.6% 33698908 / 27820497 / +21.1% 🔴 0.36 / 0.44 / -19.6%
clickbench_q38/duckdb:vortex-file-compressed 13574722 / 13030108 / +4.2% 28764072 / 28924665 / -0.6% 0.47 / 0.45 / +4.8%
clickbench_q39/duckdb:vortex-file-compressed 24291558 / 23287310 / +4.3% 42213285 / 39512093 / +6.8% 0.58 / 0.59 / -2.4%
clickbench_q40/duckdb:vortex-file-compressed 11105082 / 10863188 / +2.2% 27091836 / 27548525 / -1.7% 0.41 / 0.39 / +3.9%
clickbench_q41/duckdb:vortex-file-compressed 11367393 / 13367080 / -15.0% 🟢 28950354 / 28775205 / +0.6% 0.39 / 0.46 / -15.5%
clickbench_q42/duckdb:vortex-file-compressed 11548742 / 11836664 / -2.4% 28311586 / 29062945 / -2.6% 0.41 / 0.41 / +0.2%
duckdb / vortex-compact / ns (0.992x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 1562452 / 1553573 / +0.6% 28562527 / 22859123 / +25.0% 🔴 0.05 / 0.07 / -19.5%
clickbench_q01/duckdb:vortex-compact 13918426 / 12441624 / +11.9% 🔴 31350196 / 26266525 / +19.4% 🔴 0.44 / 0.47 / -6.3%
clickbench_q02/duckdb:vortex-compact 19354047 / 20461205 / -5.4% 41604779 / 43269792 / -3.8% 0.47 / 0.47 / -1.6%
clickbench_q03/duckdb:vortex-compact 20248333 / 19852823 / +2.0% 45338340 / 51595371 / -12.1% 🟢 0.45 / 0.38 / +16.1%
clickbench_q04/duckdb:vortex-compact 75001685 / 71686248 / +4.6% 101885512 / 101557762 / +0.3% 0.74 / 0.71 / +4.3%
clickbench_q05/duckdb:vortex-compact 76033709 / 81466465 / -6.7% 108822304 / 102787413 / +5.9% 0.70 / 0.79 / -11.8%
clickbench_q06/duckdb:vortex-compact 1802812 / 1818278 / -0.9% 31088472 / 30352482 / +2.4% 0.06 / 0.06 / -3.2%
clickbench_q07/duckdb:vortex-compact 14992488 / 14582918 / +2.8% 36516134 / 30287928 / +20.6% 🔴 0.41 / 0.48 / -14.7%
clickbench_q08/duckdb:vortex-compact 105676202 / 97434519 / +8.5% 133097380 / 134298105 / -0.9% 0.79 / 0.73 / +9.4%
clickbench_q09/duckdb:vortex-compact 144682892 / 141142610 / +2.5% 183963909 / 185027000 / -0.6% 0.79 / 0.76 / +3.1%
clickbench_q10/duckdb:vortex-compact 53311548 / 54420126 / -2.0% 89846640 / 93798861 / -4.2% 0.59 / 0.58 / +2.3%
clickbench_q11/duckdb:vortex-compact 66145633 / 65038420 / +1.7% 100766054 / 104982916 / -4.0% 0.66 / 0.62 / +6.0%
clickbench_q12/duckdb:vortex-compact 87865980 / 86775162 / +1.3% 121986894 / 121471917 / +0.4% 0.72 / 0.71 / +0.8%
clickbench_q13/duckdb:vortex-compact 167225428 / 162843130 / +2.7% 222170307 / 206666252 / +7.5% 0.75 / 0.79 / -4.5%
clickbench_q14/duckdb:vortex-compact 102636906 / 97206646 / +5.6% 129864737 / 133595719 / -2.8% 0.79 / 0.73 / +8.6%
clickbench_q15/duckdb:vortex-compact 97923878 / 95189386 / +2.9% 141787643 / 134938875 / +5.1% 0.69 / 0.71 / -2.1%
clickbench_q16/duckdb:vortex-compact 178174000 / 182643208 / -2.4% 220645235 / 232422298 / -5.1% 0.81 / 0.79 / +2.8%
clickbench_q17/duckdb:vortex-compact 179764212 / 181739621 / -1.1% 224574703 / 225159324 / -0.3% 0.80 / 0.81 / -0.8%
clickbench_q18/duckdb:vortex-compact 335042340 / 323444484 / +3.6% 382692020 / 438040414 / -12.6% 🟢 0.88 / 0.74 / +18.6%
clickbench_q19/duckdb:vortex-compact 16183919 / 17651602 / -8.3% 37318214 / 39604744 / -5.8% 0.43 / 0.45 / -2.7%
clickbench_q20/duckdb:vortex-compact 107743714 / 114938728 / -6.3% 167585132 / 184457451 / -9.1% 0.64 / 0.62 / +3.2%
clickbench_q21/duckdb:vortex-compact 180271646 / 184351580 / -2.2% 293459216 / 328896472 / -10.8% 🟢 0.61 / 0.56 / +9.6%
clickbench_q22/duckdb:vortex-compact 355616101 / 358811970 / -0.9% 509707136 / 564844474 / -9.8% 0.70 / 0.64 / +9.8%
clickbench_q23/duckdb:vortex-compact 94133938 / 96192584 / -2.1% 127888855 / 126482800 / +1.1% 0.74 / 0.76 / -3.2%
clickbench_q24/duckdb:vortex-compact 30755240 / 32397922 / -5.1% 49651841 / 47299872 / +5.0% 0.62 / 0.68 / -9.6%
clickbench_q25/duckdb:vortex-compact 38925379 / 48036332 / -19.0% 🟢 61179485 / 71347083 / -14.3% 🟢 0.64 / 0.67 / -5.5%
clickbench_q26/duckdb:vortex-compact 26224780 / 24265718 / +8.1% 37387388 / 38580432 / -3.1% 0.70 / 0.63 / +11.5%
clickbench_q27/duckdb:vortex-compact 195198267 / 199347306 / -2.1% 297740970 / 317828960 / -6.3% 0.66 / 0.63 / +4.5%
clickbench_q28/duckdb:vortex-compact 632579596 / 610874544 / +3.6% 670972871 / 699134394 / -4.0% 0.94 / 0.87 / +7.9%
clickbench_q29/duckdb:vortex-compact 22094318 / 21797176 / +1.4% 46509102 / 48211022 / -3.5% 0.48 / 0.45 / +5.1%
clickbench_q30/duckdb:vortex-compact 115453679 / 111768152 / +3.3% 147353896 / 150973318 / -2.4% 0.78 / 0.74 / +5.8%
clickbench_q31/duckdb:vortex-compact 175106484 / 175637525 / -0.3% 212383871 / 254957761 / -16.7% 🟢 0.82 / 0.69 / +19.7%
clickbench_q32/duckdb:vortex-compact 461845728 / 467221031 / -1.2% 516692661 / 492962433 / +4.8% 0.89 / 0.95 / -5.7%
clickbench_q33/duckdb:vortex-compact 389662704 / 386106282 / +0.9% 482162147 / 501129603 / -3.8% 0.81 / 0.77 / +4.9%
clickbench_q34/duckdb:vortex-compact 403495300 / 407731758 / -1.0% 504805912 / 523943720 / -3.7% 0.80 / 0.78 / +2.7%
clickbench_q35/duckdb:vortex-compact 109662342 / 109889242 / -0.2% 149439191 / 138712648 / +7.7% 0.73 / 0.79 / -7.4%
clickbench_q36/duckdb:vortex-compact 16238228 / 18355942 / -11.5% 🟢 32606891 / 34649002 / -5.9% 0.50 / 0.53 / -6.0%
clickbench_q37/duckdb:vortex-compact 13071776 / 13520318 / -3.3% 31377927 / 30774755 / +2.0% 0.42 / 0.44 / -5.2%
clickbench_q38/duckdb:vortex-compact 14939805 / 15325555 / -2.5% 31055056 / 28943683 / +7.3% 0.48 / 0.53 / -9.1%
clickbench_q39/duckdb:vortex-compact 26150863 / 26966177 / -3.0% 46569300 / 45431623 / +2.5% 0.56 / 0.59 / -5.4%
clickbench_q40/duckdb:vortex-compact 12737928 / 13579503 / -6.2% 29723378 / 31354026 / -5.2% 0.43 / 0.43 / -1.1%
clickbench_q41/duckdb:vortex-compact 14311470 / 14366756 / -0.4% 31575077 / 30919830 / +2.1% 0.45 / 0.46 / -2.5%
clickbench_q42/duckdb:vortex-compact 11965690 / 12250160 / -2.3% 29889132 / 29352899 / +1.8% 0.40 / 0.42 / -4.1%
duckdb / parquet / ns (0.999x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 8145550 / 8807100 / -7.5% 18916411 / 19496518 / -3.0% 0.43 / 0.45 / -4.7%
clickbench_q01/duckdb:parquet 9656703 / 9525218 / +1.4% 18601573 / 18907337 / -1.6% 0.52 / 0.50 / +3.0%
clickbench_q02/duckdb:parquet 14807399 / 15952470 / -7.2% 30227566 / 35701412 / -15.3% 🟢 0.49 / 0.45 / +9.6%
clickbench_q03/duckdb:parquet 16316149 / 16009634 / +1.9% 51775707 / 55365579 / -6.5% 0.32 / 0.29 / +9.0%
clickbench_q04/duckdb:parquet 70236013 / 69769334 / +0.7% 93894138 / 91491541 / +2.6% 0.75 / 0.76 / -1.9%
clickbench_q05/duckdb:parquet 79709648 / 81261685 / -1.9% 113496601 / 118583771 / -4.3% 0.70 / 0.69 / +2.5%
clickbench_q06/duckdb:parquet 15657878 / 16174011 / -3.2% 22944295 / 23229650 / -1.2% 0.68 / 0.70 / -2.0%
clickbench_q07/duckdb:parquet 12357404 / 10779777 / +14.6% 🔴 22529705 / 24228668 / -7.0% 0.55 / 0.44 / +23.3%
clickbench_q08/duckdb:parquet 88692530 / 82583176 / +7.4% 127027580 / 129856513 / -2.2% 0.70 / 0.64 / +9.8%
clickbench_q09/duckdb:parquet 117080592 / 118345277 / -1.1% 158497455 / 161909093 / -2.1% 0.74 / 0.73 / +1.1%
clickbench_q10/duckdb:parquet 32104716 / 32768105 / -2.0% 68311790 / 67391389 / +1.4% 0.47 / 0.49 / -3.3%
clickbench_q11/duckdb:parquet 36590611 / 36702000 / -0.3% 74833905 / 81545395 / -8.2% 0.49 / 0.45 / +8.6%
clickbench_q12/duckdb:parquet 92641680 / 92879179 / -0.3% 132970923 / 129770614 / +2.5% 0.70 / 0.72 / -2.7%
clickbench_q13/duckdb:parquet 148878674 / 148796880 / +0.1% 207974001 / 206011919 / +1.0% 0.72 / 0.72 / -0.9%
clickbench_q14/duckdb:parquet 96602460 / 98443748 / -1.9% 151348261 / 136434714 / +10.9% 🔴 0.64 / 0.72 / -11.5%
clickbench_q15/duckdb:parquet 93092368 / 91872972 / +1.3% 119505266 / 121608313 / -1.7% 0.78 / 0.76 / +3.1%
clickbench_q16/duckdb:parquet 168951998 / 172150162 / -1.9% 233922893 / 230119512 / +1.7% 0.72 / 0.75 / -3.5%
clickbench_q17/duckdb:parquet 175667179 / 173758112 / +1.1% 229886602 / 226655457 / +1.4% 0.76 / 0.77 / -0.3%
clickbench_q18/duckdb:parquet 327009542 / 325063890 / +0.6% 431031115 / 445002149 / -3.1% 0.76 / 0.73 / +3.9%
clickbench_q19/duckdb:parquet 13157356 / 13194631 / -0.3% 40036609 / 45057241 / -11.1% 🟢 0.33 / 0.29 / +12.2%
clickbench_q20/duckdb:parquet 131729296 / 133174374 / -1.1% 247991506 / 247028612 / +0.4% 0.53 / 0.54 / -1.5%
clickbench_q21/duckdb:parquet 186494366 / 184712284 / +1.0% 318783566 / 321721693 / -0.9% 0.59 / 0.57 / +1.9%
clickbench_q22/duckdb:parquet 237724634 / 238732274 / -0.4% 406951308 / 410600013 / -0.9% 0.58 / 0.58 / +0.5%
clickbench_q23/duckdb:parquet 146721190 / 147117618 / -0.3% 172233069 / 171201261 / +0.6% 0.85 / 0.86 / -0.9%
clickbench_q24/duckdb:parquet 44071272 / 42342817 / +4.1% 62076175 / 62570845 / -0.8% 0.71 / 0.68 / +4.9%
clickbench_q25/duckdb:parquet 39554932 / 39470378 / +0.2% 89017447 / 91558932 / -2.8% 0.44 / 0.43 / +3.1%
clickbench_q26/duckdb:parquet 30817238 / 29861766 / +3.2% 47005641 / 46969631 / +0.1% 0.66 / 0.64 / +3.1%
clickbench_q27/duckdb:parquet 143946970 / 142538820 / +1.0% 256193237 / 259618659 / -1.3% 0.56 / 0.55 / +2.3%
clickbench_q28/duckdb:parquet 896796852 / 901812472 / -0.6% 1019511951 / 1011934202 / +0.7% 0.88 / 0.89 / -1.3%
clickbench_q29/duckdb:parquet 17644997 / 17664690 / -0.1% 29484238 / 31464163 / -6.3% 0.60 / 0.56 / +6.6%
clickbench_q30/duckdb:parquet 90406500 / 93312149 / -3.1% 176124741 / 170811091 / +3.1% 0.51 / 0.55 / -6.0%
clickbench_q31/duckdb:parquet 146699228 / 144853871 / +1.3% 262666924 / 267657855 / -1.9% 0.56 / 0.54 / +3.2%
clickbench_q32/duckdb:parquet 440438882 / 444870305 / -1.0% 491967201 / 515505633 / -4.6% 0.90 / 0.86 / +3.7%
clickbench_q33/duckdb:parquet 453703919 / 454428532 / -0.2% 463801133 / 476955788 / -2.8% 0.98 / 0.95 / +2.7%
clickbench_q34/duckdb:parquet 454347848 / 470942636 / -3.5% 474238749 / 484963738 / -2.2% 0.96 / 0.97 / -1.3%
clickbench_q35/duckdb:parquet 101529135 / 99419231 / +2.1% 117463743 / 121045354 / -3.0% 0.86 / 0.82 / +5.2%
clickbench_q36/duckdb:parquet 31041829 / 31178890 / -0.4% 42232741 / 42726640 / -1.2% 0.74 / 0.73 / +0.7%
clickbench_q37/duckdb:parquet 22576526 / 22763096 / -0.8% 31074142 / 32303831 / -3.8% 0.73 / 0.70 / +3.1%
clickbench_q38/duckdb:parquet 24449000 / 23940910 / +2.1% 34546620 / 34216530 / +1.0% 0.71 / 0.70 / +1.1%
clickbench_q39/duckdb:parquet 55690872 / 56631085 / -1.7% 65518941 / 66666996 / -1.7% 0.85 / 0.85 / +0.1%
clickbench_q40/duckdb:parquet 12913616 / 12896332 / +0.1% 22380105 / 21930083 / +2.1% 0.58 / 0.59 / -1.9%
clickbench_q41/duckdb:parquet 12603494 / 12918044 / -2.4% 22918626 / 22570315 / +1.5% 0.55 / 0.57 / -3.9%
clickbench_q42/duckdb:parquet 14035482 / 14551576 / -3.5% 25126903 / 24641199 / +2.0% 0.56 / 0.59 / -5.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.6%
Engines: DataFusion No clear signal (-0.4%, low confidence) · DuckDB No clear signal (-0.7%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.018x ➖
Parquet (geomean): hot 1.001x ➖ · cold 1.003x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 90668085 / 92892244 / -2.4% 163736461 / 172602516 / -5.1% 0.55 / 0.54 / +2.9%
tpch_q02/datafusion:vortex-file-compressed 64764178 / 65702051 / -1.4% 95170068 / 95483047 / -0.3% 0.68 / 0.69 / -1.1%
tpch_q03/datafusion:vortex-file-compressed 65955644 / 66147664 / -0.3% 117814916 / 118028338 / -0.2% 0.56 / 0.56 / -0.1%
tpch_q04/datafusion:vortex-file-compressed 35139575 / 35231579 / -0.3% 80904943 / 77546827 / +4.3% 0.43 / 0.45 / -4.4%
tpch_q05/datafusion:vortex-file-compressed 118414167 / 117404572 / +0.9% 178349483 / 173620866 / +2.7% 0.66 / 0.68 / -1.8%
tpch_q06/datafusion:vortex-file-compressed 15167892 / 14959430 / +1.4% 74498474 / 72826401 / +2.3% 0.20 / 0.21 / -0.9%
tpch_q07/datafusion:vortex-file-compressed 139278474 / 138953645 / +0.2% 192269633 / 201447137 / -4.6% 0.72 / 0.69 / +5.0%
tpch_q08/datafusion:vortex-file-compressed 143902904 / 143660629 / +0.2% 212956965 / 211860725 / +0.5% 0.68 / 0.68 / -0.3%
tpch_q09/datafusion:vortex-file-compressed 189114143 / 187839112 / +0.7% 268114418 / 260830881 / +2.8% 0.71 / 0.72 / -2.1%
tpch_q10/datafusion:vortex-file-compressed 74246781 / 73638448 / +0.8% 139451117 / 142385728 / -2.1% 0.53 / 0.52 / +2.9%
tpch_q11/datafusion:vortex-file-compressed 43226990 / 43494219 / -0.6% 66490308 / 66630634 / -0.2% 0.65 / 0.65 / -0.4%
tpch_q12/datafusion:vortex-file-compressed 39399423 / 45166291 / -12.8% 🟢 98543236 / 91103694 / +8.2% 0.40 / 0.50 / -19.4%
tpch_q13/datafusion:vortex-file-compressed 46460514 / 45809222 / +1.4% 81809088 / 77539347 / +5.5% 0.57 / 0.59 / -3.9%
tpch_q14/datafusion:vortex-file-compressed 25078556 / 24812691 / +1.1% 96793403 / 97338649 / -0.6% 0.26 / 0.25 / +1.6%
tpch_q15/datafusion:vortex-file-compressed 37143008 / 37553549 / -1.1% 100449981 / 102356486 / -1.9% 0.37 / 0.37 / +0.8%
tpch_q16/datafusion:vortex-file-compressed 37569688 / 37628003 / -0.2% 65722801 / 68546166 / -4.1% 0.57 / 0.55 / +4.1%
tpch_q17/datafusion:vortex-file-compressed 176450585 / 175440724 / +0.6% 230965644 / 226252232 / +2.1% 0.76 / 0.78 / -1.5%
tpch_q18/datafusion:vortex-file-compressed 201411171 / 201447694 / -0.0% 262362881 / 271019255 / -3.2% 0.77 / 0.74 / +3.3%
tpch_q19/datafusion:vortex-file-compressed 34357501 / 34366463 / -0.0% 92923514 / 96809367 / -4.0% 0.37 / 0.35 / +4.2%
tpch_q20/datafusion:vortex-file-compressed 63091197 / 62826754 / +0.4% 121876309 / 124756411 / -2.3% 0.52 / 0.50 / +2.8%
tpch_q21/datafusion:vortex-file-compressed 180959829 / 182191108 / -0.7% 235389537 / 239572927 / -1.7% 0.77 / 0.76 / +1.1%
tpch_q22/datafusion:vortex-file-compressed 26107737 / 25580822 / +2.1% 57502434 / 54726582 / +5.1% 0.45 / 0.47 / -2.9%
datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 97949597 / 96978644 / +1.0% 158694258 / 147821017 / +7.4% 0.62 / 0.66 / -5.9%
tpch_q02/datafusion:vortex-compact 64822793 / 64903412 / -0.1% 91233587 / 92408253 / -1.3% 0.71 / 0.70 / +1.2%
tpch_q03/datafusion:vortex-compact 67555156 / 66984409 / +0.9% 109853834 / 113225473 / -3.0% 0.61 / 0.59 / +3.9%
tpch_q04/datafusion:vortex-compact 42160909 / 41333699 / +2.0% 79445695 / 80562683 / -1.4% 0.53 / 0.51 / +3.4%
tpch_q05/datafusion:vortex-compact 119778025 / 117874601 / +1.6% 166363748 / 175484473 / -5.2% 0.72 / 0.67 / +7.2%
tpch_q06/datafusion:vortex-compact 18254567 / 17898069 / +2.0% 61146654 / 61834069 / -1.1% 0.30 / 0.29 / +3.1%
tpch_q07/datafusion:vortex-compact 142831946 / 146023607 / -2.2% 180848190 / 210648773 / -14.1% 🟢 0.79 / 0.69 / +13.9%
tpch_q08/datafusion:vortex-compact 149715777 / 146744186 / +2.0% 204944313 / 198299543 / +3.4% 0.73 / 0.74 / -1.3%
tpch_q09/datafusion:vortex-compact 188059062 / 190688794 / -1.4% 253912971 / 252063127 / +0.7% 0.74 / 0.76 / -2.1%
tpch_q10/datafusion:vortex-compact 79392541 / 79605027 / -0.3% 126977786 / 131626718 / -3.5% 0.63 / 0.60 / +3.4%
tpch_q11/datafusion:vortex-compact 43228149 / 43474875 / -0.6% 66652775 / 65098344 / +2.4% 0.65 / 0.67 / -2.9%
tpch_q12/datafusion:vortex-compact 54428147 / 57399974 / -5.2% 96573633 / 93014775 / +3.8% 0.56 / 0.62 / -8.7%
tpch_q13/datafusion:vortex-compact 54778798 / 54160928 / +1.1% 81458536 / 77319327 / +5.4% 0.67 / 0.70 / -4.0%
tpch_q14/datafusion:vortex-compact 28129697 / 27754274 / +1.4% 96232597 / 97428069 / -1.2% 0.29 / 0.28 / +2.6%
tpch_q15/datafusion:vortex-compact 44928986 / 44503468 / +1.0% 100915764 / 103871183 / -2.8% 0.45 / 0.43 / +3.9%
tpch_q16/datafusion:vortex-compact 40629254 / 40305688 / +0.8% 69219609 / 69807871 / -0.8% 0.59 / 0.58 / +1.7%
tpch_q17/datafusion:vortex-compact 175571938 / 174915038 / +0.4% 214968420 / 212008682 / +1.4% 0.82 / 0.83 / -1.0%
tpch_q18/datafusion:vortex-compact 204951372 / 205333436 / -0.2% 258632677 / 261163389 / -1.0% 0.79 / 0.79 / +0.8%
tpch_q19/datafusion:vortex-compact 41090368 / 41944998 / -2.0% 83446206 / 92203821 / -9.5% 0.49 / 0.45 / +8.2%
tpch_q20/datafusion:vortex-compact 66545223 / 65901654 / +1.0% 118359193 / 120436070 / -1.7% 0.56 / 0.55 / +2.7%
tpch_q21/datafusion:vortex-compact 191198873 / 190161738 / +0.5% 237760992 / 242067120 / -1.8% 0.80 / 0.79 / +2.4%
tpch_q22/datafusion:vortex-compact 26217929 / 26740414 / -2.0% 55996102 / 57538539 / -2.7% 0.47 / 0.46 / +0.7%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 83782619 / 83173050 / +0.7% 129384953 / 131271630 / -1.4% 0.65 / 0.63 / +2.2%
tpch_q02/datafusion:parquet 136344042 / 135334630 / +0.7% 164779986 / 165905136 / -0.7% 0.83 / 0.82 / +1.4%
tpch_q03/datafusion:parquet 125213887 / 124271885 / +0.8% 197704402 / 192257885 / +2.8% 0.63 / 0.65 / -2.0%
tpch_q04/datafusion:parquet 53283116 / 53416802 / -0.3% 104438018 / 108181029 / -3.5% 0.51 / 0.49 / +3.3%
tpch_q05/datafusion:parquet 165599911 / 165011210 / +0.4% 243168214 / 241933339 / +0.5% 0.68 / 0.68 / -0.2%
tpch_q06/datafusion:parquet 32491458 / 31894749 / +1.9% 81835786 / 84209027 / -2.8% 0.40 / 0.38 / +4.8%
tpch_q07/datafusion:parquet 212250306 / 216889132 / -2.1% 291941926 / 303410616 / -3.8% 0.73 / 0.71 / +1.7%
tpch_q08/datafusion:parquet 212020440 / 211105409 / +0.4% 291073605 / 292794523 / -0.6% 0.73 / 0.72 / +1.0%
tpch_q09/datafusion:parquet 281174400 / 281505464 / -0.1% 367690023 / 355016902 / +3.6% 0.76 / 0.79 / -3.6%
tpch_q10/datafusion:parquet 304214302 / 300878484 / +1.1% 373977364 / 367442344 / +1.8% 0.81 / 0.82 / -0.7%
tpch_q11/datafusion:parquet 96445212 / 96894139 / -0.5% 119391077 / 122309040 / -2.4% 0.81 / 0.79 / +2.0%
tpch_q12/datafusion:parquet 78443856 / 77989257 / +0.6% 133389493 / 133988220 / -0.4% 0.59 / 0.58 / +1.0%
tpch_q13/datafusion:parquet 195236562 / 194605852 / +0.3% 227955527 / 233132551 / -2.2% 0.86 / 0.83 / +2.6%
tpch_q14/datafusion:parquet 74465905 / 74465102 / +0.0% 170649558 / 176406532 / -3.3% 0.44 / 0.42 / +3.4%
tpch_q15/datafusion:parquet 77130339 / 78380312 / -1.6% 135586393 / 140174962 / -3.3% 0.57 / 0.56 / +1.7%
tpch_q16/datafusion:parquet 84209011 / 84146178 / +0.1% 112817621 / 111577687 / +1.1% 0.75 / 0.75 / -1.0%
tpch_q17/datafusion:parquet 202331802 / 209231317 / -3.3% 263282891 / 265986362 / -1.0% 0.77 / 0.79 / -2.3%
tpch_q18/datafusion:parquet 269265642 / 262222583 / +2.7% 323099285 / 315520736 / +2.4% 0.83 / 0.83 / +0.3%
tpch_q19/datafusion:parquet 97496703 / 96943872 / +0.6% 171098308 / 169540108 / +0.9% 0.57 / 0.57 / -0.3%
tpch_q20/datafusion:parquet 153587865 / 152008118 / +1.0% 216817675 / 209782881 / +3.4% 0.71 / 0.72 / -2.2%
tpch_q21/datafusion:parquet 230088851 / 227711818 / +1.0% 303561036 / 308693584 / -1.7% 0.76 / 0.74 / +2.8%
tpch_q22/datafusion:parquet 162012654 / 161019897 / +0.6% 185605525 / 185850055 / -0.1% 0.87 / 0.87 / +0.7%
duckdb / vortex-file-compressed / ns (0.983x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 53767221 / 56367096 / -4.6% 105063524 / 103535144 / +1.5% 0.51 / 0.54 / -6.0%
tpch_q02/duckdb:vortex-file-compressed 32098174 / 32420668 / -1.0% 49319471 / 46324476 / +6.5% 0.65 / 0.70 / -7.0%
tpch_q03/duckdb:vortex-file-compressed 58160366 / 58220304 / -0.1% 114812087 / 103936594 / +10.5% 🔴 0.51 / 0.56 / -9.6%
tpch_q04/duckdb:vortex-file-compressed 80793346 / 80652607 / +0.2% 124288020 / 116762236 / +6.4% 0.65 / 0.69 / -5.9%
tpch_q05/duckdb:vortex-file-compressed 65169885 / 65530220 / -0.5% 124772654 / 121097233 / +3.0% 0.52 / 0.54 / -3.5%
tpch_q06/duckdb:vortex-file-compressed 20615197 / 21539085 / -4.3% 64928901 / 54255728 / +19.7% 🔴 0.32 / 0.40 / -20.0%
tpch_q07/duckdb:vortex-file-compressed 60725975 / 60346890 / +0.6% 135479260 / 128793653 / +5.2% 0.45 / 0.47 / -4.3%
tpch_q08/duckdb:vortex-file-compressed 85989100 / 85060724 / +1.1% 160776875 / 150938318 / +6.5% 0.53 / 0.56 / -5.1%
tpch_q09/duckdb:vortex-file-compressed 164259036 / 166302578 / -1.2% 239247054 / 239000329 / +0.1% 0.69 / 0.70 / -1.3%
tpch_q10/duckdb:vortex-file-compressed 111028368 / 115252177 / -3.7% 201832275 / 192959707 / +4.6% 0.55 / 0.60 / -7.9%
tpch_q11/duckdb:vortex-file-compressed 16739409 / 16580142 / +1.0% 30680661 / 28916224 / +6.1% 0.55 / 0.57 / -4.8%
tpch_q12/duckdb:vortex-file-compressed 46650722 / 59082226 / -21.0% 🟢 99652718 / 103899312 / -4.1% 0.47 / 0.57 / -17.7%
tpch_q13/duckdb:vortex-file-compressed 90672659 / 88756135 / +2.2% 134521527 / 136825501 / -1.7% 0.67 / 0.65 / +3.9%
tpch_q14/duckdb:vortex-file-compressed 31791160 / 31326230 / +1.5% 76893770 / 73468201 / +4.7% 0.41 / 0.43 / -3.0%
tpch_q15/duckdb:vortex-file-compressed 38681659 / 36507926 / +6.0% 89993363 / 79354137 / +13.4% 🔴 0.43 / 0.46 / -6.6%
tpch_q16/duckdb:vortex-file-compressed 42499814 / 42549243 / -0.1% 55128589 / 53399341 / +3.2% 0.77 / 0.80 / -3.2%
tpch_q17/duckdb:vortex-file-compressed 75737885 / 77717667 / -2.5% 158929839 / 154201748 / +3.1% 0.48 / 0.50 / -5.4%
tpch_q18/duckdb:vortex-file-compressed 130196973 / 138061287 / -5.7% 171426692 / 173393537 / -1.1% 0.76 / 0.80 / -4.6%
tpch_q19/duckdb:vortex-file-compressed 45636048 / 49643839 / -8.1% 114168888 / 109304180 / +4.5% 0.40 / 0.45 / -12.0%
tpch_q20/duckdb:vortex-file-compressed 58661679 / 59208013 / -0.9% 126021923 / 111466111 / +13.1% 🔴 0.47 / 0.53 / -12.4%
tpch_q21/duckdb:vortex-file-compressed 241322171 / 244416907 / -1.3% 299699377 / 279492261 / +7.2% 0.81 / 0.87 / -7.9%
tpch_q22/duckdb:vortex-file-compressed 42840507 / 39696768 / +7.9% 57196153 / 58454709 / -2.2% 0.75 / 0.68 / +10.3%
duckdb / vortex-compact / ns (1.002x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 68622170 / 68602918 / +0.0% 109979959 / 110817985 / -0.8% 0.62 / 0.62 / +0.8%
tpch_q02/duckdb:vortex-compact 35249142 / 35238174 / +0.0% 49058271 / 49093665 / -0.1% 0.72 / 0.72 / +0.1%
tpch_q03/duckdb:vortex-compact 63290422 / 63754935 / -0.7% 109095213 / 101243546 / +7.8% 0.58 / 0.63 / -7.9%
tpch_q04/duckdb:vortex-compact 88365552 / 88836707 / -0.5% 120812515 / 117815900 / +2.5% 0.73 / 0.75 / -3.0%
tpch_q05/duckdb:vortex-compact 69163955 / 71294273 / -3.0% 129064211 / 121357635 / +6.4% 0.54 / 0.59 / -8.8%
tpch_q06/duckdb:vortex-compact 23850631 / 24091211 / -1.0% 63647153 / 55541742 / +14.6% 🔴 0.37 / 0.43 / -13.6%
tpch_q07/duckdb:vortex-compact 70531973 / 72492967 / -2.7% 139311266 / 129527005 / +7.6% 0.51 / 0.56 / -9.5%
tpch_q08/duckdb:vortex-compact 90843768 / 90190552 / +0.7% 150096400 / 139019151 / +8.0% 0.61 / 0.65 / -6.7%
tpch_q09/duckdb:vortex-compact 173021568 / 171873925 / +0.7% 243527816 / 233479044 / +4.3% 0.71 / 0.74 / -3.5%
tpch_q10/duckdb:vortex-compact 123489678 / 121285639 / +1.8% 181105216 / 167796602 / +7.9% 0.68 / 0.72 / -5.7%
tpch_q11/duckdb:vortex-compact 19111305 / 18534194 / +3.1% 35103214 / 39071543 / -10.2% 🟢 0.54 / 0.47 / +14.8%
tpch_q12/duckdb:vortex-compact 63992230 / 69771556 / -8.3% 106655632 / 104720811 / +1.8% 0.60 / 0.67 / -9.9%
tpch_q13/duckdb:vortex-compact 96044561 / 93456272 / +2.8% 152825903 / 134641166 / +13.5% 🔴 0.63 / 0.69 / -9.5%
tpch_q14/duckdb:vortex-compact 33943371 / 33147741 / +2.4% 70996260 / 67516457 / +5.2% 0.48 / 0.49 / -2.6%
tpch_q15/duckdb:vortex-compact 43549196 / 48626026 / -10.4% 🟢 97330099 / 107279099 / -9.3% 0.45 / 0.45 / -1.3%
tpch_q16/duckdb:vortex-compact 44094079 / 44238996 / -0.3% 55046709 / 56397393 / -2.4% 0.80 / 0.78 / +2.1%
tpch_q17/duckdb:vortex-compact 65330912 / 60933035 / +7.2% 125627109 / 134564298 / -6.6% 0.52 / 0.45 / +14.8%
tpch_q18/duckdb:vortex-compact 146254475 / 145543980 / +0.5% 163758774 / 155973285 / +5.0% 0.89 / 0.93 / -4.3%
tpch_q19/duckdb:vortex-compact 48299781 / 47492411 / +1.7% 107298721 / 93885987 / +14.3% 🔴 0.45 / 0.51 / -11.0%
tpch_q20/duckdb:vortex-compact 67766621 / 66452925 / +2.0% 127009578 / 121284552 / +4.7% 0.53 / 0.55 / -2.6%
tpch_q21/duckdb:vortex-compact 264430834 / 258490403 / +2.3% 304746270 / 299427354 / +1.8% 0.87 / 0.86 / +0.5%
tpch_q22/duckdb:vortex-compact 44130164 / 41224591 / +7.0% 62930851 / 59193238 / +6.3% 0.70 / 0.70 / +0.7%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 70038862 / 70187367 / -0.2% 90555821 / 86139688 / +5.1% 0.77 / 0.81 / -5.1%
tpch_q02/duckdb:parquet 70871010 / 70680872 / +0.3% 82954718 / 83020850 / -0.1% 0.85 / 0.85 / +0.3%
tpch_q03/duckdb:parquet 115821508 / 115599831 / +0.2% 159062260 / 159133904 / -0.0% 0.73 / 0.73 / +0.2%
tpch_q04/duckdb:parquet 74899906 / 74465868 / +0.6% 98479004 / 110791271 / -11.1% 🟢 0.76 / 0.67 / +13.2%
tpch_q05/duckdb:parquet 124593043 / 127057851 / -1.9% 173951665 / 179256666 / -3.0% 0.72 / 0.71 / +1.1%
tpch_q06/duckdb:parquet 34905860 / 35269694 / -1.0% 55520733 / 50788005 / +9.3% 0.63 / 0.69 / -9.5%
tpch_q07/duckdb:parquet 90028249 / 89687177 / +0.4% 133111384 / 128346954 / +3.7% 0.68 / 0.70 / -3.2%
tpch_q08/duckdb:parquet 142451327 / 142241555 / +0.1% 186726106 / 185257981 / +0.8% 0.76 / 0.77 / -0.6%
tpch_q09/duckdb:parquet 220270536 / 222612382 / -1.1% 264131362 / 263707283 / +0.2% 0.83 / 0.84 / -1.2%
tpch_q10/duckdb:parquet 469805872 / 468936562 / +0.2% 518116953 / 509853692 / +1.6% 0.91 / 0.92 / -1.4%
tpch_q11/duckdb:parquet 30540466 / 30652819 / -0.4% 38678928 / 37026840 / +4.5% 0.79 / 0.83 / -4.6%
tpch_q12/duckdb:parquet 77451628 / 75867472 / +2.1% 97210282 / 91855693 / +5.8% 0.80 / 0.83 / -3.5%
tpch_q13/duckdb:parquet 314842021 / 320400773 / -1.7% 333570485 / 330662501 / +0.9% 0.94 / 0.97 / -2.6%
tpch_q14/duckdb:parquet 106390063 / 104104700 / +2.2% 142612474 / 137132971 / +4.0% 0.75 / 0.76 / -1.7%
tpch_q15/duckdb:parquet 43319577 / 43077280 / +0.6% 68198619 / 82061444 / -16.9% 🟢 0.64 / 0.52 / +21.0%
tpch_q16/duckdb:parquet 113696387 / 114177207 / -0.4% 131211244 / 124356592 / +5.5% 0.87 / 0.92 / -5.6%
tpch_q17/duckdb:parquet 73542527 / 74197477 / -0.9% 104869232 / 104954975 / -0.1% 0.70 / 0.71 / -0.8%
tpch_q18/duckdb:parquet 205848433 / 203770291 / +1.0% 175690485 / 170676434 / +2.9% 1.17 / 1.19 / -1.9%
tpch_q19/duckdb:parquet 160915095 / 161001580 / -0.1% 193374043 / 191849128 / +0.8% 0.83 / 0.84 / -0.8%
tpch_q20/duckdb:parquet 127761905 / 127795429 / -0.0% 163799278 / 160829723 / +1.8% 0.78 / 0.79 / -1.8%
tpch_q21/duckdb:parquet 272114666 / 275138692 / -1.1% 310640108 / 284388195 / +9.2% 0.88 / 0.97 / -9.5%
tpch_q22/duckdb:parquet 260247584 / 261082319 / -0.3% 275045075 / 271286110 / +1.4% 0.95 / 0.96 / -1.7%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-1.5%, environment too noisy confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.005x ➖
Parquet (geomean): hot 1.004x ➖ · cold 0.996x ➖
Shifts: Parquet (control) +0.4% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 23808440 / 24006110 / -0.8% 42581643 / 42996397 / -1.0% 0.56 / 0.56 / +0.1%
tpcds_q02/datafusion:vortex-file-compressed 45037678 / 45148547 / -0.2% 61958412 / 62432143 / -0.8% 0.73 / 0.72 / +0.5%
tpcds_q03/datafusion:vortex-file-compressed 11694582 / 11553158 / +1.2% 28339680 / 27504846 / +3.0% 0.41 / 0.42 / -1.8%
tpcds_q04/datafusion:vortex-file-compressed 114187190 / 112891544 / +1.1% 141672016 / 139376226 / +1.6% 0.81 / 0.81 / -0.5%
tpcds_q05/datafusion:vortex-file-compressed 59737800 / 58760002 / +1.7% 79906182 / 81900883 / -2.4% 0.75 / 0.72 / +4.2%
tpcds_q06/datafusion:vortex-file-compressed 24073961 / 23749202 / +1.4% 45431282 / 44399691 / +2.3% 0.53 / 0.53 / -0.9%
tpcds_q07/datafusion:vortex-file-compressed 32351292 / 32314814 / +0.1% 54994407 / 55701571 / -1.3% 0.59 / 0.58 / +1.4%
tpcds_q08/datafusion:vortex-file-compressed 25410343 / 25221986 / +0.7% 42742306 / 45423200 / -5.9% 0.59 / 0.56 / +7.1%
tpcds_q09/datafusion:vortex-file-compressed 17475264 / 17720492 / -1.4% 35282242 / 34635795 / +1.9% 0.50 / 0.51 / -3.2%
tpcds_q10/datafusion:vortex-file-compressed 28961381 / 29018026 / -0.2% 49891812 / 49452249 / +0.9% 0.58 / 0.59 / -1.1%
tpcds_q11/datafusion:vortex-file-compressed 62313088 / 62708262 / -0.6% 87198667 / 87872818 / -0.8% 0.71 / 0.71 / +0.1%
tpcds_q12/datafusion:vortex-file-compressed 16025094 / 16190232 / -1.0% 31098205 / 31912925 / -2.6% 0.52 / 0.51 / +1.6%
tpcds_q13/datafusion:vortex-file-compressed 33966808 / 34163112 / -0.6% 52432347 / 51915842 / +1.0% 0.65 / 0.66 / -1.6%
tpcds_q14/datafusion:vortex-file-compressed 91750796 / 91700139 / +0.1% 117881227 / 119645179 / -1.5% 0.78 / 0.77 / +1.6%
tpcds_q15/datafusion:vortex-file-compressed 23686774 / 23791734 / -0.4% 42570270 / 44611824 / -4.6% 0.56 / 0.53 / +4.3%
tpcds_q16/datafusion:vortex-file-compressed 20171790 / 20826118 / -3.1% 41107873 / 41289697 / -0.4% 0.49 / 0.50 / -2.7%
tpcds_q17/datafusion:vortex-file-compressed 61056801 / 61680735 / -1.0% 80347716 / 85937399 / -6.5% 0.76 / 0.72 / +5.9%
tpcds_q18/datafusion:vortex-file-compressed 68669358 / 67648730 / +1.5% 90762332 / 91125464 / -0.4% 0.76 / 0.74 / +1.9%
tpcds_q19/datafusion:vortex-file-compressed 18430355 / 18794384 / -1.9% 39229628 / 40513762 / -3.2% 0.47 / 0.46 / +1.3%
tpcds_q20/datafusion:vortex-file-compressed 17490450 / 17123617 / +2.1% 34193664 / 35305348 / -3.1% 0.51 / 0.49 / +5.5%
tpcds_q21/datafusion:vortex-file-compressed 16618268 / 17004642 / -2.3% 38752492 / 39515543 / -1.9% 0.43 / 0.43 / -0.3%
tpcds_q22/datafusion:vortex-file-compressed 50073019 / 49710301 / +0.7% 69070248 / 70454944 / -2.0% 0.72 / 0.71 / +2.7%
tpcds_q23/datafusion:vortex-file-compressed 72243926 / 72748192 / -0.7% 98242381 / 101935072 / -3.6% 0.74 / 0.71 / +3.0%
tpcds_q24/datafusion:vortex-file-compressed 70501038 / 70328020 / +0.2% 91212371 / 92925325 / -1.8% 0.77 / 0.76 / +2.1%
tpcds_q25/datafusion:vortex-file-compressed 49016560 / 48670800 / +0.7% 82897825 / 75180443 / +10.3% 🔴 0.59 / 0.65 / -8.7%
tpcds_q26/datafusion:vortex-file-compressed 29539910 / 29657875 / -0.4% 48720681 / 49869041 / -2.3% 0.61 / 0.59 / +1.9%
tpcds_q27/datafusion:vortex-file-compressed 65406216 / 64342840 / +1.7% 83919387 / 90931460 / -7.7% 0.78 / 0.71 / +10.1%
tpcds_q28/datafusion:vortex-file-compressed 19007458 / 17884960 / +6.3% 35349918 / 39513246 / -10.5% 🟢 0.54 / 0.45 / +18.8%
tpcds_q29/datafusion:vortex-file-compressed 57176069 / 60837568 / -6.0% 82066229 / 82459948 / -0.5% 0.70 / 0.74 / -5.6%
tpcds_q30/datafusion:vortex-file-compressed 27379766 / 27166035 / +0.8% 43625611 / 43803893 / -0.4% 0.63 / 0.62 / +1.2%
tpcds_q31/datafusion:vortex-file-compressed 64204640 / 64437000 / -0.4% 90622985 / 90641946 / -0.0% 0.71 / 0.71 / -0.3%
tpcds_q32/datafusion:vortex-file-compressed 13514634 / 13396124 / +0.9% 29745793 / 30752001 / -3.3% 0.45 / 0.44 / +4.3%
tpcds_q33/datafusion:vortex-file-compressed 26768346 / 26669569 / +0.4% 48848660 / 48779912 / +0.1% 0.55 / 0.55 / +0.2%
tpcds_q34/datafusion:vortex-file-compressed 18726125 / 18402536 / +1.8% 37342923 / 37303157 / +0.1% 0.50 / 0.49 / +1.7%
tpcds_q35/datafusion:vortex-file-compressed 36035945 / 35531546 / +1.4% 55702646 / 55815250 / -0.2% 0.65 / 0.64 / +1.6%
tpcds_q36/datafusion:vortex-file-compressed 48231749 / 47159990 / +2.3% 70571126 / 71762201 / -1.7% 0.68 / 0.66 / +4.0%
tpcds_q37/datafusion:vortex-file-compressed 13440554 / 13578496 / -1.0% 36906307 / 33578290 / +9.9% 0.36 / 0.40 / -9.9%
tpcds_q38/datafusion:vortex-file-compressed 29696314 / 29806302 / -0.4% 52338630 / 50353024 / +3.9% 0.57 / 0.59 / -4.1%
tpcds_q39/datafusion:vortex-file-compressed 65332076 / 65199312 / +0.2% 88958494 / 90727675 / -1.9% 0.73 / 0.72 / +2.2%
tpcds_q40/datafusion:vortex-file-compressed 24889592 / 24785303 / +0.4% 45390854 / 45859178 / -1.0% 0.55 / 0.54 / +1.5%
tpcds_q41/datafusion:vortex-file-compressed 16473884 / 16637050 / -1.0% 30086184 / 31219099 / -3.6% 0.55 / 0.53 / +2.7%
tpcds_q42/datafusion:vortex-file-compressed 11489727 / 11144471 / +3.1% 27808190 / 28870063 / -3.7% 0.41 / 0.39 / +7.0%
tpcds_q43/datafusion:vortex-file-compressed 13046638 / 13678490 / -4.6% 31417808 / 32073270 / -2.0% 0.42 / 0.43 / -2.6%
tpcds_q44/datafusion:vortex-file-compressed 26548724 / 26464548 / +0.3% 50915935 / 48709705 / +4.5% 0.52 / 0.54 / -4.0%
tpcds_q45/datafusion:vortex-file-compressed 27281729 / 27426430 / -0.5% 47138800 / 47398791 / -0.5% 0.58 / 0.58 / +0.0%
tpcds_q46/datafusion:vortex-file-compressed 23943226 / 25283159 / -5.3% 46000543 / 45603022 / +0.9% 0.52 / 0.55 / -6.1%
tpcds_q47/datafusion:vortex-file-compressed 77532942 / 77819927 / -0.4% 102576582 / 103577837 / -1.0% 0.76 / 0.75 / +0.6%
tpcds_q48/datafusion:vortex-file-compressed 31015092 / 30981244 / +0.1% 50220861 / 51771301 / -3.0% 0.62 / 0.60 / +3.2%
tpcds_q49/datafusion:vortex-file-compressed 60452786 / 58753136 / +2.9% 89693091 / 82677083 / +8.5% 0.67 / 0.71 / -5.2%
tpcds_q50/datafusion:vortex-file-compressed 34717790 / 34227026 / +1.4% 55047491 / 56527503 / -2.6% 0.63 / 0.61 / +4.2%
tpcds_q51/datafusion:vortex-file-compressed 61364312 / 61228975 / +0.2% 84193913 / 83930846 / +0.3% 0.73 / 0.73 / -0.1%
tpcds_q52/datafusion:vortex-file-compressed 11615764 / 11647218 / -0.3% 28688294 / 28239981 / +1.6% 0.40 / 0.41 / -1.8%
tpcds_q53/datafusion:vortex-file-compressed 18119008 / 18135700 / -0.1% 38925466 / 37920352 / +2.7% 0.47 / 0.48 / -2.7%
tpcds_q54/datafusion:vortex-file-compressed 33922764 / 34598974 / -2.0% 56538412 / 60232274 / -6.1% 0.60 / 0.57 / +4.5%
tpcds_q55/datafusion:vortex-file-compressed 11348035 / 11351721 / -0.0% 26937932 / 27260024 / -1.2% 0.42 / 0.42 / +1.2%
tpcds_q56/datafusion:vortex-file-compressed 26275782 / 26696074 / -1.6% 48977919 / 49345567 / -0.7% 0.54 / 0.54 / -0.8%
tpcds_q57/datafusion:vortex-file-compressed 72789841 / 73151627 / -0.5% 96473305 / 97245201 / -0.8% 0.75 / 0.75 / +0.3%
tpcds_q58/datafusion:vortex-file-compressed 40360624 / 40346662 / +0.0% 64727659 / 64285186 / +0.7% 0.62 / 0.63 / -0.6%
tpcds_q59/datafusion:vortex-file-compressed 31977556 / 31921538 / +0.2% 52250549 / 53698147 / -2.7% 0.61 / 0.59 / +3.0%
tpcds_q60/datafusion:vortex-file-compressed 26614530 / 26947634 / -1.2% 47664370 / 49094149 / -2.9% 0.56 / 0.55 / +1.7%
tpcds_q61/datafusion:vortex-file-compressed 24346506 / 23779232 / +2.4% 47018822 / 48419039 / -2.9% 0.52 / 0.49 / +5.4%
tpcds_q62/datafusion:vortex-file-compressed 17137308 / 16909776 / +1.3% 34786964 / 35304462 / -1.5% 0.49 / 0.48 / +2.9%
tpcds_q63/datafusion:vortex-file-compressed 18645116 / 18339735 / +1.7% 38892885 / 38485509 / +1.1% 0.48 / 0.48 / +0.6%
tpcds_q64/datafusion:vortex-file-compressed 322939374 / 324483325 / -0.5% 353949550 / 355283710 / -0.4% 0.91 / 0.91 / -0.1%
tpcds_q65/datafusion:vortex-file-compressed 75462852 / 77162264 / -2.2% 94854211 / 95998189 / -1.2% 0.80 / 0.80 / -1.0%
tpcds_q66/datafusion:vortex-file-compressed 52075006 / 52087656 / -0.0% 74731299 / 73480808 / +1.7% 0.70 / 0.71 / -1.7%
tpcds_q67/datafusion:vortex-file-compressed 55370896 / 55507276 / -0.2% 81886539 / 83167067 / -1.5% 0.68 / 0.67 / +1.3%
tpcds_q68/datafusion:vortex-file-compressed 23820120 / 24488030 / -2.7% 45880105 / 45049410 / +1.8% 0.52 / 0.54 / -4.5%
tpcds_q69/datafusion:vortex-file-compressed 28661778 / 29359940 / -2.4% 48614184 / 48938288 / -0.7% 0.59 / 0.60 / -1.7%
tpcds_q70/datafusion:vortex-file-compressed 70530006 / 70423892 / +0.2% 92295451 / 91446011 / +0.9% 0.76 / 0.77 / -0.8%
tpcds_q71/datafusion:vortex-file-compressed 19652278 / 19753383 / -0.5% 38930042 / 39032600 / -0.3% 0.50 / 0.51 / -0.2%
tpcds_q72/datafusion:vortex-file-compressed 463937782 / 470737432 / -1.4% 496279279 / 497575109 / -0.3% 0.93 / 0.95 / -1.2%
tpcds_q73/datafusion:vortex-file-compressed 17248222 / 17294864 / -0.3% 37292434 / 38032092 / -1.9% 0.46 / 0.45 / +1.7%
tpcds_q74/datafusion:vortex-file-compressed 45387382 / 45614582 / -0.5% 67945076 / 69946141 / -2.9% 0.67 / 0.65 / +2.4%
tpcds_q75/datafusion:vortex-file-compressed 131861065 / 133714319 / -1.4% 160390017 / 159185468 / +0.8% 0.82 / 0.84 / -2.1%
tpcds_q76/datafusion:vortex-file-compressed 42686090 / 44336520 / -3.7% 62751201 / 61336194 / +2.3% 0.68 / 0.72 / -5.9%
tpcds_q77/datafusion:vortex-file-compressed 34385740 / 34491538 / -0.3% 56728606 / 56580808 / +0.3% 0.61 / 0.61 / -0.6%
tpcds_q78/datafusion:vortex-file-compressed 80315739 / 79871888 / +0.6% 106604141 / 107449583 / -0.8% 0.75 / 0.74 / +1.4%
tpcds_q79/datafusion:vortex-file-compressed 20979782 / 21405672 / -2.0% 42316724 / 42065266 / +0.6% 0.50 / 0.51 / -2.6%
tpcds_q80/datafusion:vortex-file-compressed 77661517 / 77312904 / +0.5% 105490012 / 107057038 / -1.5% 0.74 / 0.72 / +1.9%
tpcds_q81/datafusion:vortex-file-compressed 28411377 / 27955239 / +1.6% 44388621 / 43902165 / +1.1% 0.64 / 0.64 / +0.5%
tpcds_q82/datafusion:vortex-file-compressed 13037844 / 13282894 / -1.8% 36753894 / 36381128 / +1.0% 0.35 / 0.37 / -2.8%
tpcds_q83/datafusion:vortex-file-compressed 35835224 / 35274049 / +1.6% 53455400 / 59079301 / -9.5% 0.67 / 0.60 / +12.3%
tpcds_q84/datafusion:vortex-file-compressed 11650359 / 11869368 / -1.8% 27076379 / 28307689 / -4.3% 0.43 / 0.42 / +2.6%
tpcds_q85/datafusion:vortex-file-compressed 59197537 / 59957472 / -1.3% 83197959 / 83792540 / -0.7% 0.71 / 0.72 / -0.6%
tpcds_q86/datafusion:vortex-file-compressed 16366850 / 16097972 / +1.7% 31269711 / 31955454 / -2.1% 0.52 / 0.50 / +3.9%
tpcds_q87/datafusion:vortex-file-compressed 30154980 / 29517188 / +2.2% 49419318 / 50633563 / -2.4% 0.61 / 0.58 / +4.7%
tpcds_q88/datafusion:vortex-file-compressed 34223269 / 33912578 / +0.9% 59887267 / 63385771 / -5.5% 0.57 / 0.54 / +6.8%
tpcds_q89/datafusion:vortex-file-compressed 20694670 / 21221201 / -2.5% 39504291 / 40186396 / -1.7% 0.52 / 0.53 / -0.8%
tpcds_q90/datafusion:vortex-file-compressed 10610502 / 10144030 / +4.6% 26257617 / 26002820 / +1.0% 0.40 / 0.39 / +3.6%
tpcds_q91/datafusion:vortex-file-compressed 17037012 / 17184751 / -0.9% 36573056 / 35227711 / +3.8% 0.47 / 0.49 / -4.5%
tpcds_q92/datafusion:vortex-file-compressed 13276432 / 13530142 / -1.9% 30229553 / 32031646 / -5.6% 0.44 / 0.42 / +4.0%
tpcds_q93/datafusion:vortex-file-compressed 23405923 / 23673716 / -1.1% 43487446 / 43025185 / +1.1% 0.54 / 0.55 / -2.2%
tpcds_q94/datafusion:vortex-file-compressed 19437466 / 19528444 / -0.5% 38955091 / 39379816 / -1.1% 0.50 / 0.50 / +0.6%
tpcds_q95/datafusion:vortex-file-compressed 46002105 / 45854622 / +0.3% 69485897 / 68464655 / +1.5% 0.66 / 0.67 / -1.2%
tpcds_q96/datafusion:vortex-file-compressed 9270336 / 9657276 / -4.0% 24812579 / 26203736 / -5.3% 0.37 / 0.37 / +1.4%
tpcds_q97/datafusion:vortex-file-compressed 21059131 / 20963438 / +0.5% 42184119 / 42032504 / +0.4% 0.50 / 0.50 / +0.1%
tpcds_q98/datafusion:vortex-file-compressed 16619696 / 16790478 / -1.0% 35352897 / 36488907 / -3.1% 0.47 / 0.46 / +2.2%
tpcds_q99/datafusion:vortex-file-compressed 19090714 / 19356186 / -1.4% 37741659 / 38694832 / -2.5% 0.51 / 0.50 / +1.1%
datafusion / vortex-compact / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 26113410 / 25776326 / +1.3% 44358961 / 43314672 / +2.4% 0.59 / 0.60 / -1.1%
tpcds_q02/datafusion:vortex-compact 47352307 / 48716506 / -2.8% 64426468 / 66749811 / -3.5% 0.73 / 0.73 / +0.7%
tpcds_q03/datafusion:vortex-compact 12864346 / 12996261 / -1.0% 34385289 / 33135191 / +3.8% 0.37 / 0.39 / -4.6%
tpcds_q04/datafusion:vortex-compact 119927026 / 122196540 / -1.9% 143967081 / 149787563 / -3.9% 0.83 / 0.82 / +2.1%
tpcds_q05/datafusion:vortex-compact 61307023 / 61013464 / +0.5% 83706563 / 83092810 / +0.7% 0.73 / 0.73 / -0.3%
tpcds_q06/datafusion:vortex-compact 25743015 / 25505718 / +0.9% 45423497 / 46181965 / -1.6% 0.57 / 0.55 / +2.6%
tpcds_q07/datafusion:vortex-compact 34307792 / 36570257 / -6.2% 55057939 / 56191973 / -2.0% 0.62 / 0.65 / -4.3%
tpcds_q08/datafusion:vortex-compact 30444029 / 30310496 / +0.4% 49183903 / 47825202 / +2.8% 0.62 / 0.63 / -2.3%
tpcds_q09/datafusion:vortex-compact 22532656 / 23009131 / -2.1% 38261255 / 40707876 / -6.0% 0.59 / 0.57 / +4.2%
tpcds_q10/datafusion:vortex-compact 36747696 / 37276700 / -1.4% 60333213 / 58346058 / +3.4% 0.61 / 0.64 / -4.7%
tpcds_q11/datafusion:vortex-compact 69475153 / 69062763 / +0.6% 92880058 / 90149262 / +3.0% 0.75 / 0.77 / -2.4%
tpcds_q12/datafusion:vortex-compact 20376443 / 20695094 / -1.5% 38437042 / 39917656 / -3.7% 0.53 / 0.52 / +2.3%
tpcds_q13/datafusion:vortex-compact 56371380 / 54682834 / +3.1% 75358625 / 74135388 / +1.7% 0.75 / 0.74 / +1.4%
tpcds_q14/datafusion:vortex-compact 95969703 / 97096072 / -1.2% 124479102 / 121469664 / +2.5% 0.77 / 0.80 / -3.5%
tpcds_q15/datafusion:vortex-compact 27318690 / 27543981 / -0.8% 45205353 / 46317907 / -2.4% 0.60 / 0.59 / +1.6%
tpcds_q16/datafusion:vortex-compact 23088394 / 24783298 / -6.8% 47269906 / 45186387 / +4.6% 0.49 / 0.55 / -10.9%
tpcds_q17/datafusion:vortex-compact 69053856 / 64117546 / +7.7% 91061393 / 92585864 / -1.6% 0.76 / 0.69 / +9.5%
tpcds_q18/datafusion:vortex-compact 68913764 / 68232262 / +1.0% 89058130 / 91949294 / -3.1% 0.77 / 0.74 / +4.3%
tpcds_q19/datafusion:vortex-compact 23566952 / 22568462 / +4.4% 41340600 / 42528054 / -2.8% 0.57 / 0.53 / +7.4%
tpcds_q20/datafusion:vortex-compact 22051756 / 22020188 / +0.1% 41386090 / 42085787 / -1.7% 0.53 / 0.52 / +1.8%
tpcds_q21/datafusion:vortex-compact 17760936 / 18184798 / -2.3% 39314456 / 41652292 / -5.6% 0.45 / 0.44 / +3.5%
tpcds_q22/datafusion:vortex-compact 49369258 / 49486494 / -0.2% 71776726 / 71562586 / +0.3% 0.69 / 0.69 / -0.5%
tpcds_q23/datafusion:vortex-compact 75227877 / 75095684 / +0.2% 100483924 / 101031461 / -0.5% 0.75 / 0.74 / +0.7%
tpcds_q24/datafusion:vortex-compact 78989640 / 79841786 / -1.1% 99073290 / 101203992 / -2.1% 0.80 / 0.79 / +1.1%
tpcds_q25/datafusion:vortex-compact 58968393 / 55432212 / +6.4% 77859466 / 79302448 / -1.8% 0.76 / 0.70 / +8.4%
tpcds_q26/datafusion:vortex-compact 32480954 / 32691709 / -0.6% 50133165 / 51248766 / -2.2% 0.65 / 0.64 / +1.6%
tpcds_q27/datafusion:vortex-compact 61922956 / 64116815 / -3.4% 85208638 / 87492179 / -2.6% 0.73 / 0.73 / -0.8%
tpcds_q28/datafusion:vortex-compact 27554237 / 26598531 / +3.6% 50981146 / 49835683 / +2.3% 0.54 / 0.53 / +1.3%
tpcds_q29/datafusion:vortex-compact 65076760 / 62717000 / +3.8% 90052156 / 85213102 / +5.7% 0.72 / 0.74 / -1.8%
tpcds_q30/datafusion:vortex-compact 30022665 / 30318496 / -1.0% 46745907 / 49925022 / -6.4% 0.64 / 0.61 / +5.8%
tpcds_q31/datafusion:vortex-compact 75109622 / 75701310 / -0.8% 106358797 / 102695738 / +3.6% 0.71 / 0.74 / -4.2%
tpcds_q32/datafusion:vortex-compact 16357040 / 16230053 / +0.8% 33984953 / 35064012 / -3.1% 0.48 / 0.46 / +4.0%
tpcds_q33/datafusion:vortex-compact 27497046 / 28681070 / -4.1% 48592394 / 49578083 / -2.0% 0.57 / 0.58 / -2.2%
tpcds_q34/datafusion:vortex-compact 20804718 / 20859384 / -0.3% 43632860 / 44913642 / -2.9% 0.48 / 0.46 / +2.7%
tpcds_q35/datafusion:vortex-compact 41455922 / 41673418 / -0.5% 65093697 / 61846906 / +5.2% 0.64 / 0.67 / -5.5%
tpcds_q36/datafusion:vortex-compact 52955745 / 51345954 / +3.1% 74903168 / 76063385 / -1.5% 0.71 / 0.68 / +4.7%
tpcds_q37/datafusion:vortex-compact 15590090 / 15382526 / +1.3% 37698051 / 37639741 / +0.2% 0.41 / 0.41 / +1.2%
tpcds_q38/datafusion:vortex-compact 33082271 / 33375231 / -0.9% 55162668 / 53569786 / +3.0% 0.60 / 0.62 / -3.7%
tpcds_q39/datafusion:vortex-compact 65647480 / 67916722 / -3.3% 90506666 / 89430308 / +1.2% 0.73 / 0.76 / -4.5%
tpcds_q40/datafusion:vortex-compact 28239592 / 28148123 / +0.3% 49808823 / 47999804 / +3.8% 0.57 / 0.59 / -3.3%
tpcds_q41/datafusion:vortex-compact 18806698 / 19026270 / -1.2% 32773730 / 34142220 / -4.0% 0.57 / 0.56 / +3.0%
tpcds_q42/datafusion:vortex-compact 13390596 / 13062441 / +2.5% 31069565 / 31734184 / -2.1% 0.43 / 0.41 / +4.7%
tpcds_q43/datafusion:vortex-compact 15634302 / 15931757 / -1.9% 32342649 / 36314894 / -10.9% 🟢 0.48 / 0.44 / +10.2%
tpcds_q44/datafusion:vortex-compact 31047908 / 31384013 / -1.1% 52059066 / 54027655 / -3.6% 0.60 / 0.58 / +2.7%
tpcds_q45/datafusion:vortex-compact 30468964 / 30938772 / -1.5% 48918744 / 50016222 / -2.2% 0.62 / 0.62 / +0.7%
tpcds_q46/datafusion:vortex-compact 28260938 / 27911336 / +1.3% 48270693 / 49424822 / -2.3% 0.59 / 0.56 / +3.7%
tpcds_q47/datafusion:vortex-compact 85655204 / 87981350 / -2.6% 115529956 / 119001989 / -2.9% 0.74 / 0.74 / +0.3%
tpcds_q48/datafusion:vortex-compact 50537605 / 50500594 / +0.1% 68236742 / 68867864 / -0.9% 0.74 / 0.73 / +1.0%
tpcds_q49/datafusion:vortex-compact 64857583 / 64047102 / +1.3% 87927614 / 87129185 / +0.9% 0.74 / 0.74 / +0.3%
tpcds_q50/datafusion:vortex-compact 37724996 / 36876946 / +2.3% 59238491 / 57065111 / +3.8% 0.64 / 0.65 / -1.5%
tpcds_q51/datafusion:vortex-compact 62936794 / 62273654 / +1.1% 83838177 / 81171817 / +3.3% 0.75 / 0.77 / -2.1%
tpcds_q52/datafusion:vortex-compact 12901676 / 12447747 / +3.6% 32716955 / 30940140 / +5.7% 0.39 / 0.40 / -2.0%
tpcds_q53/datafusion:vortex-compact 21863483 / 23025892 / -5.0% 44946602 / 43085154 / +4.3% 0.49 / 0.53 / -9.0%
tpcds_q54/datafusion:vortex-compact 39404133 / 38488274 / +2.4% 64497050 / 64826815 / -0.5% 0.61 / 0.59 / +2.9%
tpcds_q55/datafusion:vortex-compact 12860202 / 12384582 / +3.8% 32302764 / 30405865 / +6.2% 0.40 / 0.41 / -2.3%
tpcds_q56/datafusion:vortex-compact 28789860 / 28811586 / -0.1% 50628845 / 50689745 / -0.1% 0.57 / 0.57 / +0.0%
tpcds_q57/datafusion:vortex-compact 79044562 / 79148164 / -0.1% 104508684 / 105650301 / -1.1% 0.76 / 0.75 / +1.0%
tpcds_q58/datafusion:vortex-compact 46644672 / 46773582 / -0.3% 70908740 / 70569802 / +0.5% 0.66 / 0.66 / -0.8%
tpcds_q59/datafusion:vortex-compact 39683764 / 38041028 / +4.3% 57069683 / 56073786 / +1.8% 0.70 / 0.68 / +2.5%
tpcds_q60/datafusion:vortex-compact 28261108 / 27987264 / +1.0% 51135948 / 51886061 / -1.4% 0.55 / 0.54 / +2.5%
tpcds_q61/datafusion:vortex-compact 27443505 / 27494894 / -0.2% 47718838 / 49401925 / -3.4% 0.58 / 0.56 / +3.3%
tpcds_q62/datafusion:vortex-compact 18192322 / 17931384 / +1.5% 35647222 / 35792947 / -0.4% 0.51 / 0.50 / +1.9%
tpcds_q63/datafusion:vortex-compact 23356276 / 22857434 / +2.2% 41520484 / 41539366 / -0.0% 0.56 / 0.55 / +2.2%
tpcds_q64/datafusion:vortex-compact 447009475 / 447710524 / -0.2% 461711970 / 456545849 / +1.1% 0.97 / 0.98 / -1.3%
tpcds_q65/datafusion:vortex-compact 82364767 / 80861325 / +1.9% 102392720 / 98961279 / +3.5% 0.80 / 0.82 / -1.6%
tpcds_q66/datafusion:vortex-compact 54091129 / 54217124 / -0.2% 76932812 / 76196915 / +1.0% 0.70 / 0.71 / -1.2%
tpcds_q67/datafusion:vortex-compact 59250396 / 58013408 / +2.1% 87987294 / 88685083 / -0.8% 0.67 / 0.65 / +2.9%
tpcds_q68/datafusion:vortex-compact 27494554 / 27450556 / +0.2% 54656775 / 49836454 / +9.7% 0.50 / 0.55 / -8.7%
tpcds_q69/datafusion:vortex-compact 34930475 / 36010286 / -3.0% 56205363 / 57662608 / -2.5% 0.62 / 0.62 / -0.5%
tpcds_q70/datafusion:vortex-compact 74635911 / 74718286 / -0.1% 95039044 / 96271729 / -1.3% 0.79 / 0.78 / +1.2%
tpcds_q71/datafusion:vortex-compact 20974096 / 20953750 / +0.1% 42261817 / 42576480 / -0.7% 0.50 / 0.49 / +0.8%
tpcds_q72/datafusion:vortex-compact 457905820 / 466737787 / -1.9% 474157606 / 485139592 / -2.3% 0.97 / 0.96 / +0.4%
tpcds_q73/datafusion:vortex-compact 19341370 / 19570536 / -1.2% 39854855 / 41729572 / -4.5% 0.49 / 0.47 / +3.5%
tpcds_q74/datafusion:vortex-compact 49377874 / 50561925 / -2.3% 71597845 / 72062203 / -0.6% 0.69 / 0.70 / -1.7%
tpcds_q75/datafusion:vortex-compact 136727511 / 138512184 / -1.3% 158207649 / 163718500 / -3.4% 0.86 / 0.85 / +2.1%
tpcds_q76/datafusion:vortex-compact 44740104 / 40918374 / +9.3% 61405344 / 66208203 / -7.3% 0.73 / 0.62 / +17.9%
tpcds_q77/datafusion:vortex-compact 39317117 / 37344647 / +5.3% 60393882 / 61619497 / -2.0% 0.65 / 0.61 / +7.4%
tpcds_q78/datafusion:vortex-compact 87763112 / 86085507 / +1.9% 112063046 / 112428064 / -0.3% 0.78 / 0.77 / +2.3%
tpcds_q79/datafusion:vortex-compact 24604196 / 24321632 / +1.2% 45411124 / 49337398 / -8.0% 0.54 / 0.49 / +9.9%
tpcds_q80/datafusion:vortex-compact 79495732 / 78547458 / +1.2% 105837415 / 108710581 / -2.6% 0.75 / 0.72 / +4.0%
tpcds_q81/datafusion:vortex-compact 30170658 / 29304870 / +3.0% 45788877 / 46527126 / -1.6% 0.66 / 0.63 / +4.6%
tpcds_q82/datafusion:vortex-compact 15813130 / 15676746 / +0.9% 40922905 / 38164133 / +7.2% 0.39 / 0.41 / -5.9%
tpcds_q83/datafusion:vortex-compact 36643718 / 36543168 / +0.3% 55421629 / 58883445 / -5.9% 0.66 / 0.62 / +6.5%
tpcds_q84/datafusion:vortex-compact 13000534 / 12939678 / +0.5% 28266993 / 29095989 / -2.8% 0.46 / 0.44 / +3.4%
tpcds_q85/datafusion:vortex-compact 103305554 / 102526320 / +0.8% 127897030 / 129131808 / -1.0% 0.81 / 0.79 / +1.7%
tpcds_q86/datafusion:vortex-compact 16490888 / 16920934 / -2.5% 35025074 / 34998779 / +0.1% 0.47 / 0.48 / -2.6%
tpcds_q87/datafusion:vortex-compact 33697462 / 32965978 / +2.2% 57007564 / 54506101 / +4.6% 0.59 / 0.60 / -2.3%
tpcds_q88/datafusion:vortex-compact 41158544 / 41786882 / -1.5% 65578964 / 69523016 / -5.7% 0.63 / 0.60 / +4.4%
tpcds_q89/datafusion:vortex-compact 25221875 / 24049242 / +4.9% 44136344 / 45525791 / -3.1% 0.57 / 0.53 / +8.2%
tpcds_q90/datafusion:vortex-compact 11360343 / 11500396 / -1.2% 27829298 / 27025032 / +3.0% 0.41 / 0.43 / -4.1%
tpcds_q91/datafusion:vortex-compact 26866396 / 27507622 / -2.3% 46227831 / 46530915 / -0.7% 0.58 / 0.59 / -1.7%
tpcds_q92/datafusion:vortex-compact 15337762 / 15633236 / -1.9% 33595661 / 33680445 / -0.3% 0.46 / 0.46 / -1.6%
tpcds_q93/datafusion:vortex-compact 24622390 / 24618200 / +0.0% 44395681 / 45162260 / -1.7% 0.55 / 0.55 / +1.7%
tpcds_q94/datafusion:vortex-compact 21648082 / 22089728 / -2.0% 41841109 / 42904778 / -2.5% 0.52 / 0.51 / +0.5%
tpcds_q95/datafusion:vortex-compact 50165096 / 49617591 / +1.1% 69389556 / 70416952 / -1.5% 0.72 / 0.70 / +2.6%
tpcds_q96/datafusion:vortex-compact 10687048 / 10836744 / -1.4% 28624171 / 28384043 / +0.8% 0.37 / 0.38 / -2.2%
tpcds_q97/datafusion:vortex-compact 25042626 / 24226920 / +3.4% 43332299 / 43451987 / -0.3% 0.58 / 0.56 / +3.7%
tpcds_q98/datafusion:vortex-compact 22105766 / 22301525 / -0.9% 42136240 / 43669055 / -3.5% 0.52 / 0.51 / +2.7%
tpcds_q99/datafusion:vortex-compact 20929232 / 20813350 / +0.6% 38776936 / 39338289 / -1.4% 0.54 / 0.53 / +2.0%
datafusion / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 30246990 / 29752698 / +1.7% 44511922 / 46376877 / -4.0% 0.68 / 0.64 / +5.9%
tpcds_q02/datafusion:parquet 43234185 / 45530482 / -5.0% 61496907 / 62190185 / -1.1% 0.70 / 0.73 / -4.0%
tpcds_q03/datafusion:parquet 18857134 / 18739488 / +0.6% 32265202 / 32035333 / +0.7% 0.58 / 0.58 / -0.1%
tpcds_q04/datafusion:parquet 194329625 / 193172002 / +0.6% 223370702 / 219894731 / +1.6% 0.87 / 0.88 / -1.0%
tpcds_q05/datafusion:parquet 70845860 / 70157788 / +1.0% 94053549 / 91756024 / +2.5% 0.75 / 0.76 / -1.5%
tpcds_q06/datafusion:parquet 35095472 / 35440002 / -1.0% 53978021 / 50639022 / +6.6% 0.65 / 0.70 / -7.1%
tpcds_q07/datafusion:parquet 45471988 / 45610352 / -0.3% 68257512 / 68068007 / +0.3% 0.67 / 0.67 / -0.6%
tpcds_q08/datafusion:parquet 39977172 / 39718056 / +0.7% 52223702 / 53157067 / -1.8% 0.77 / 0.75 / +2.5%
tpcds_q09/datafusion:parquet 31170684 / 32540396 / -4.2% 44263599 / 45824772 / -3.4% 0.70 / 0.71 / -0.8%
tpcds_q10/datafusion:parquet 50168064 / 50712478 / -1.1% 62943222 / 72224206 / -12.9% 🟢 0.80 / 0.70 / +13.5%
tpcds_q11/datafusion:parquet 92721138 / 93350733 / -0.7% 115947861 / 114360708 / +1.4% 0.80 / 0.82 / -2.0%
tpcds_q12/datafusion:parquet 24182196 / 24109824 / +0.3% 35081490 / 35990657 / -2.5% 0.69 / 0.67 / +2.9%
tpcds_q13/datafusion:parquet 44149722 / 44154490 / -0.0% 66201881 / 68661645 / -3.6% 0.67 / 0.64 / +3.7%
tpcds_q14/datafusion:parquet 137818882 / 139675514 / -1.3% 148915722 / 156920913 / -5.1% 0.93 / 0.89 / +4.0%
tpcds_q15/datafusion:parquet 31060922 / 31358134 / -0.9% 48751634 / 49867315 / -2.2% 0.64 / 0.63 / +1.3%
tpcds_q16/datafusion:parquet 37309108 / 37611054 / -0.8% 54283265 / 55974209 / -3.0% 0.69 / 0.67 / +2.3%
tpcds_q17/datafusion:parquet 74059291 / 75681467 / -2.1% 99775164 / 100090514 / -0.3% 0.74 / 0.76 / -1.8%
tpcds_q18/datafusion:parquet 58894028 / 59702356 / -1.4% 79885893 / 79712560 / +0.2% 0.74 / 0.75 / -1.6%
tpcds_q19/datafusion:parquet 32534826 / 32198255 / +1.0% 49715050 / 49826290 / -0.2% 0.65 / 0.65 / +1.3%
tpcds_q20/datafusion:parquet 25370352 / 25810785 / -1.7% 38133000 / 38100368 / +0.1% 0.67 / 0.68 / -1.8%
tpcds_q21/datafusion:parquet 20556536 / 20116529 / +2.2% 33158700 / 34836211 / -4.8% 0.62 / 0.58 / +7.4%
tpcds_q22/datafusion:parquet 77689677 / 76828104 / +1.1% 90928696 / 91157531 / -0.3% 0.85 / 0.84 / +1.4%
tpcds_q23/datafusion:parquet 116184346 / 114969720 / +1.1% 134219564 / 137201771 / -2.2% 0.87 / 0.84 / +3.3%
tpcds_q24/datafusion:parquet 89879613 / 89330621 / +0.6% 115328713 / 117333369 / -1.7% 0.78 / 0.76 / +2.4%
tpcds_q25/datafusion:parquet 74792676 / 75275368 / -0.6% 99019876 / 98620828 / +0.4% 0.76 / 0.76 / -1.0%
tpcds_q26/datafusion:parquet 42598480 / 42232017 / +0.9% 58705202 / 62129618 / -5.5% 0.73 / 0.68 / +6.8%
tpcds_q27/datafusion:parquet 80423622 / 80627647 / -0.3% 106213912 / 101319813 / +4.8% 0.76 / 0.80 / -4.8%
tpcds_q28/datafusion:parquet 27272294 / 26789665 / +1.8% 43447293 / 45076412 / -3.6% 0.63 / 0.59 / +5.6%
tpcds_q29/datafusion:parquet 76366998 / 75476850 / +1.2% 101030043 / 102543009 / -1.5% 0.76 / 0.74 / +2.7%
tpcds_q30/datafusion:parquet 46863404 / 47435204 / -1.2% 66088112 / 62820490 / +5.2% 0.71 / 0.76 / -6.1%
tpcds_q31/datafusion:parquet 89891936 / 89668036 / +0.2% 102500575 / 107157971 / -4.3% 0.88 / 0.84 / +4.8%
tpcds_q32/datafusion:parquet 25308490 / 25291442 / +0.1% 40817862 / 42880904 / -4.8% 0.62 / 0.59 / +5.1%
tpcds_q33/datafusion:parquet 39095886 / 41727324 / -6.3% 54565818 / 54352423 / +0.4% 0.72 / 0.77 / -6.7%
tpcds_q34/datafusion:parquet 23503788 / 24115174 / -2.5% 37246558 / 38274159 / -2.7% 0.63 / 0.63 / +0.2%
tpcds_q35/datafusion:parquet 54653432 / 54173894 / +0.9% 72897306 / 71021150 / +2.6% 0.75 / 0.76 / -1.7%
tpcds_q36/datafusion:parquet 51832635 / 51786642 / +0.1% 68963498 / 71055538 / -2.9% 0.75 / 0.73 / +3.1%
tpcds_q37/datafusion:parquet 25329386 / 25576540 / -1.0% 39454090 / 38783234 / +1.7% 0.64 / 0.66 / -2.7%
tpcds_q38/datafusion:parquet 44950220 / 44579390 / +0.8% 61182939 / 64206337 / -4.7% 0.73 / 0.69 / +5.8%
tpcds_q39/datafusion:parquet 71276768 / 71551430 / -0.4% 87043560 / 90029860 / -3.3% 0.82 / 0.79 / +3.0%
tpcds_q40/datafusion:parquet 30506793 / 30014688 / +1.6% 48938996 / 50006791 / -2.1% 0.62 / 0.60 / +3.9%
tpcds_q41/datafusion:parquet 19547898 / 19932302 / -1.9% 32016621 / 33783702 / -5.2% 0.61 / 0.59 / +3.5%
tpcds_q42/datafusion:parquet 17930718 / 18397084 / -2.5% 31048917 / 31263200 / -0.7% 0.58 / 0.59 / -1.9%
tpcds_q43/datafusion:parquet 19954331 / 19545630 / +2.1% 32370077 / 33218896 / -2.6% 0.62 / 0.59 / +4.8%
tpcds_q44/datafusion:parquet 34298855 / 33921560 / +1.1% 52588890 / 52659226 / -0.1% 0.65 / 0.64 / +1.2%
tpcds_q45/datafusion:parquet 38109397 / 37696012 / +1.1% 52725553 / 53311901 / -1.1% 0.72 / 0.71 / +2.2%
tpcds_q46/datafusion:parquet 29370484 / 29007050 / +1.3% 48791625 / 48029391 / +1.6% 0.60 / 0.60 / -0.3%
tpcds_q47/datafusion:parquet 98324188 / 98690452 / -0.4% 123058292 / 120177746 / +2.4% 0.80 / 0.82 / -2.7%
tpcds_q48/datafusion:parquet 41207466 / 41223750 / -0.0% 61323855 / 61983253 / -1.1% 0.67 / 0.67 / +1.0%
tpcds_q49/datafusion:parquet 74218690 / 75531127 / -1.7% 95616653 / 99313342 / -3.7% 0.78 / 0.76 / +2.1%
tpcds_q50/datafusion:parquet 47501390 / 47531794 / -0.1% 67759082 / 68888821 / -1.6% 0.70 / 0.69 / +1.6%
tpcds_q51/datafusion:parquet 71360587 / 71055923 / +0.4% 92447007 / 91256796 / +1.3% 0.77 / 0.78 / -0.9%
tpcds_q52/datafusion:parquet 18779266 / 18516544 / +1.4% 32521102 / 33064362 / -1.6% 0.58 / 0.56 / +3.1%
tpcds_q53/datafusion:parquet 21948253 / 22468416 / -2.3% 39786833 / 39715323 / +0.2% 0.55 / 0.57 / -2.5%
tpcds_q54/datafusion:parquet 55108590 / 55254370 / -0.3% 73202905 / 73422849 / -0.3% 0.75 / 0.75 / +0.0%
tpcds_q55/datafusion:parquet 18602262 / 18101334 / +2.8% 32813579 / 31944683 / +2.7% 0.57 / 0.57 / +0.0%
tpcds_q56/datafusion:parquet 45367686 / 45702096 / -0.7% 57947921 / 59394162 / -2.4% 0.78 / 0.77 / +1.7%
tpcds_q57/datafusion:parquet 101671214 / 101119790 / +0.5% 117806781 / 124210455 / -5.2% 0.86 / 0.81 / +6.0%
tpcds_q58/datafusion:parquet 63906955 / 63900936 / +0.0% 81848989 / 82814478 / -1.2% 0.78 / 0.77 / +1.2%
tpcds_q59/datafusion:parquet 46785696 / 47174564 / -0.8% 65735557 / 64203309 / +2.4% 0.71 / 0.73 / -3.1%
tpcds_q60/datafusion:parquet 45254880 / 44991942 / +0.6% 60258463 / 60924780 / -1.1% 0.75 / 0.74 / +1.7%
tpcds_q61/datafusion:parquet 37365390 / 37418234 / -0.1% 60267501 / 58110822 / +3.7% 0.62 / 0.64 / -3.7%
tpcds_q62/datafusion:parquet 25229145 / 25274886 / -0.2% 38924339 / 39126526 / -0.5% 0.65 / 0.65 / +0.3%
tpcds_q63/datafusion:parquet 22072810 / 22076414 / -0.0% 39459488 / 40162383 / -1.8% 0.56 / 0.55 / +1.8%
tpcds_q64/datafusion:parquet 201642350 / 203425252 / -0.9% 235122103 / 238094015 / -1.2% 0.86 / 0.85 / +0.4%
tpcds_q65/datafusion:parquet 38448656 / 38702966 / -0.7% 52569921 / 54619868 / -3.8% 0.73 / 0.71 / +3.2%
tpcds_q66/datafusion:parquet 62115604 / 61491888 / +1.0% 78963733 / 79261991 / -0.4% 0.79 / 0.78 / +1.4%
tpcds_q67/datafusion:parquet 69671460 / 69429106 / +0.3% 93260418 / 95507012 / -2.4% 0.75 / 0.73 / +2.8%
tpcds_q68/datafusion:parquet 30002612 / 29330533 / +2.3% 49734476 / 49116770 / +1.3% 0.60 / 0.60 / +1.0%
tpcds_q69/datafusion:parquet 51166199 / 49497380 / +3.4% 65508892 / 67114000 / -2.4% 0.78 / 0.74 / +5.9%
tpcds_q70/datafusion:parquet 36954442 / 37050502 / -0.3% 55089446 / 57633550 / -4.4% 0.67 / 0.64 / +4.3%
tpcds_q71/datafusion:parquet 27141484 / 27368814 / -0.8% 42820895 / 44364299 / -3.5% 0.63 / 0.62 / +2.7%
tpcds_q72/datafusion:parquet 552451640 / 552347795 / +0.0% 568743033 / 569817271 / -0.2% 0.97 / 0.97 / +0.2%
tpcds_q73/datafusion:parquet 22785096 / 22848631 / -0.3% 37469656 / 38939111 / -3.8% 0.61 / 0.59 / +3.6%
tpcds_q74/datafusion:parquet 69043880 / 68849737 / +0.3% 88930285 / 85978821 / +3.4% 0.78 / 0.80 / -3.0%
tpcds_q75/datafusion:parquet 147555441 / 146482081 / +0.7% 177823836 / 167143434 / +6.4% 0.83 / 0.88 / -5.3%
tpcds_q76/datafusion:parquet 54909433 / 53371008 / +2.9% 71460546 / 72329020 / -1.2% 0.77 / 0.74 / +4.1%
tpcds_q77/datafusion:parquet 56138214 / 54383113 / +3.2% 72874180 / 78122821 / -6.7% 0.77 / 0.70 / +10.7%
tpcds_q78/datafusion:parquet 91128656 / 91201096 / -0.1% 123054576 / 123539162 / -0.4% 0.74 / 0.74 / +0.3%
tpcds_q79/datafusion:parquet 26022538 / 25677203 / +1.3% 44845940 / 43853404 / +2.3% 0.58 / 0.59 / -0.9%
tpcds_q80/datafusion:parquet 79286336 / 79393480 / -0.1% 111309076 / 113552600 / -2.0% 0.71 / 0.70 / +1.9%
tpcds_q81/datafusion:parquet 42927896 / 41976855 / +2.3% 58149741 / 60744293 / -4.3% 0.74 / 0.69 / +6.8%
tpcds_q82/datafusion:parquet 26809316 / 26129978 / +2.6% 40293249 / 42564060 / -5.3% 0.67 / 0.61 / +8.4%
tpcds_q83/datafusion:parquet 57095272 / 58945972 / -3.1% 77023215 / 76507276 / +0.7% 0.74 / 0.77 / -3.8%
tpcds_q84/datafusion:parquet 30262384 / 29994838 / +0.9% 45987465 / 45644135 / +0.8% 0.66 / 0.66 / +0.1%
tpcds_q85/datafusion:parquet 83232828 / 82990360 / +0.3% 106832674 / 105946461 / +0.8% 0.78 / 0.78 / -0.5%
tpcds_q86/datafusion:parquet 20205686 / 20196828 / +0.0% 34728100 / 35205522 / -1.4% 0.58 / 0.57 / +1.4%
tpcds_q87/datafusion:parquet 46519492 / 46722987 / -0.4% 61334656 / 62109906 / -1.2% 0.76 / 0.75 / +0.8%
tpcds_q88/datafusion:parquet 47637398 / 48631372 / -2.0% 57369392 / 71971095 / -20.3% 🟢 0.83 / 0.68 / +22.9%
tpcds_q89/datafusion:parquet 25852296 / 25907611 / -0.2% 42971822 / 43551508 / -1.3% 0.60 / 0.59 / +1.1%
tpcds_q90/datafusion:parquet 19602565 / 19971180 / -1.8% 32204337 / 32383567 / -0.6% 0.61 / 0.62 / -1.3%
tpcds_q91/datafusion:parquet 37115647 / 37188191 / -0.2% 57027511 / 53607030 / +6.4% 0.65 / 0.69 / -6.2%
tpcds_q92/datafusion:parquet 25808494 / 26497286 / -2.6% 40810305 / 42349428 / -3.6% 0.63 / 0.63 / +1.1%
tpcds_q93/datafusion:parquet 26278384 / 26322706 / -0.2% 47802017 / 48430431 / -1.3% 0.55 / 0.54 / +1.1%
tpcds_q94/datafusion:parquet 34596482 / 34573151 / +0.1% 49997549 / 50026634 / -0.1% 0.69 / 0.69 / +0.1%
tpcds_q95/datafusion:parquet 65157510 / 65201516 / -0.1% 80747922 / 80357611 / +0.5% 0.81 / 0.81 / -0.6%
tpcds_q96/datafusion:parquet 16648148 / 16392152 / +1.6% 27942387 / 29831281 / -6.3% 0.60 / 0.55 / +8.4%
tpcds_q97/datafusion:parquet 35531824 / 35657259 / -0.4% 53548280 / 54358196 / -1.5% 0.66 / 0.66 / +1.2%
tpcds_q98/datafusion:parquet 25160184 / 24868068 / +1.2% 38969809 / 38556837 / +1.1% 0.65 / 0.64 / +0.1%
tpcds_q99/datafusion:parquet 29470390 / 29746434 / -0.9% 42539400 / 42436740 / +0.2% 0.69 / 0.70 / -1.2%
duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15121059 / 15264668 / -0.9% 23429664 / 22425155 / +4.5% 0.65 / 0.68 / -5.2%
tpcds_q02/duckdb:vortex-file-compressed 15755330 / 14973434 / +5.2% 21039733 / 19009476 / +10.7% 🔴 0.75 / 0.79 / -4.9%
tpcds_q03/duckdb:vortex-file-compressed 11704860 / 11712371 / -0.1% 21054019 / 19613825 / +7.3% 0.56 / 0.60 / -6.9%
tpcds_q04/duckdb:vortex-file-compressed 50885885 / 51022354 / -0.3% 61362733 / 60795769 / +0.9% 0.83 / 0.84 / -1.2%
tpcds_q05/duckdb:vortex-file-compressed 18992041 / 19096566 / -0.5% 28780920 / 25410592 / +13.3% 🔴 0.66 / 0.75 / -12.2%
tpcds_q06/duckdb:vortex-file-compressed 26728873 / 26787130 / -0.2% 39586282 / 39242376 / +0.9% 0.68 / 0.68 / -1.1%
tpcds_q07/duckdb:vortex-file-compressed 15770326 / 15496019 / +1.8% 27440476 / 30210167 / -9.2% 0.57 / 0.51 / +12.0%
tpcds_q08/duckdb:vortex-file-compressed 19045594 / 19298697 / -1.3% 29112237 / 29352994 / -0.8% 0.65 / 0.66 / -0.5%
tpcds_q09/duckdb:vortex-file-compressed 10361773 / 10476522 / -1.1% 17679069 / 16914855 / +4.5% 0.59 / 0.62 / -5.4%
tpcds_q10/duckdb:vortex-file-compressed 27714547 / 28017654 / -1.1% 45011415 / 39885577 / +12.9% 🔴 0.62 / 0.70 / -12.3%
tpcds_q11/duckdb:vortex-file-compressed 40091590 / 40536698 / -1.1% 50786003 / 51972537 / -2.3% 0.79 / 0.78 / +1.2%
tpcds_q12/duckdb:vortex-file-compressed 11155600 / 10294830 / +8.4% 16978822 / 16201575 / +4.8% 0.66 / 0.64 / +3.4%
tpcds_q13/duckdb:vortex-file-compressed 23442564 / 22209007 / +5.6% 35812148 / 34473656 / +3.9% 0.65 / 0.64 / +1.6%
tpcds_q14/duckdb:vortex-file-compressed 57560895 / 58395479 / -1.4% 75297853 / 71279176 / +5.6% 0.76 / 0.82 / -6.7%
tpcds_q15/duckdb:vortex-file-compressed 20840142 / 20892032 / -0.2% 25680144 / 26150066 / -1.8% 0.81 / 0.80 / +1.6%
tpcds_q16/duckdb:vortex-file-compressed 17637757 / 18320443 / -3.7% 25569798 / 26573916 / -3.8% 0.69 / 0.69 / +0.1%
tpcds_q17/duckdb:vortex-file-compressed 29890759 / 29987678 / -0.3% 44223409 / 44323195 / -0.2% 0.68 / 0.68 / -0.1%
tpcds_q18/duckdb:vortex-file-compressed 28331266 / 28945818 / -2.1% 39360400 / 38133344 / +3.2% 0.72 / 0.76 / -5.2%
tpcds_q19/duckdb:vortex-file-compressed 23706057 / 23747880 / -0.2% 33900386 / 32865726 / +3.1% 0.70 / 0.72 / -3.2%
tpcds_q20/duckdb:vortex-file-compressed 10614204 / 10547249 / +0.6% 17052513 / 17007061 / +0.3% 0.62 / 0.62 / +0.4%
tpcds_q21/duckdb:vortex-file-compressed 9863461 / 9908581 / -0.5% 20895992 / 19444056 / +7.5% 0.47 / 0.51 / -7.4%
tpcds_q22/duckdb:vortex-file-compressed 29271128 / 30117638 / -2.8% 38652523 / 39679503 / -2.6% 0.76 / 0.76 / -0.2%
tpcds_q23/duckdb:vortex-file-compressed 37961296 / 37729862 / +0.6% 48858021 / 49553886 / -1.4% 0.78 / 0.76 / +2.0%
tpcds_q24/duckdb:vortex-file-compressed 27405226 / 28093744 / -2.5% 40379475 / 38443831 / +5.0% 0.68 / 0.73 / -7.1%
tpcds_q25/duckdb:vortex-file-compressed 25090530 / 25595474 / -2.0% 40986103 / 38099067 / +7.6% 0.61 / 0.67 / -8.9%
tpcds_q26/duckdb:vortex-file-compressed 13259310 / 13563135 / -2.2% 21396684 / 19991382 / +7.0% 0.62 / 0.68 / -8.7%
tpcds_q27/duckdb:vortex-file-compressed 18561246 / 17817099 / +4.2% 30721863 / 31313773 / -1.9% 0.60 / 0.57 / +6.2%
tpcds_q28/duckdb:vortex-file-compressed 8023372 / 8355832 / -4.0% 12692791 / 12412079 / +2.3% 0.63 / 0.67 / -6.1%
tpcds_q29/duckdb:vortex-file-compressed 28515444 / 28893654 / -1.3% 43221663 / 43031558 / +0.4% 0.66 / 0.67 / -1.7%
tpcds_q30/duckdb:vortex-file-compressed 19157682 / 19293496 / -0.7% 27792973 / 27213892 / +2.1% 0.69 / 0.71 / -2.8%
tpcds_q31/duckdb:vortex-file-compressed 19152295 / 20282244 / -5.6% 30928552 / 27463842 / +12.6% 🔴 0.62 / 0.74 / -16.1%
tpcds_q32/duckdb:vortex-file-compressed 9879422 / 9918528 / -0.4% 20159896 / 19292046 / +4.5% 0.49 / 0.51 / -4.7%
tpcds_q33/duckdb:vortex-file-compressed 17177620 / 17542028 / -2.1% 32224531 / 28373549 / +13.6% 🔴 0.53 / 0.62 / -13.8%
tpcds_q34/duckdb:vortex-file-compressed 15547948 / 15936054 / -2.4% 24945412 / 23141845 / +7.8% 0.62 / 0.69 / -9.5%
tpcds_q35/duckdb:vortex-file-compressed 46352198 / 46206176 / +0.3% 61129548 / 58774209 / +4.0% 0.76 / 0.79 / -3.5%
tpcds_q36/duckdb:vortex-file-compressed 15107484 / 14847556 / +1.8% 29183688 / 26350312 / +10.8% 🔴 0.52 / 0.56 / -8.1%
tpcds_q37/duckdb:vortex-file-compressed 13877178 / 14061166 / -1.3% 22785917 / 26783769 / -14.9% 🟢 0.61 / 0.52 / +16.0%
tpcds_q38/duckdb:vortex-file-compressed 22408562 / 22480712 / -0.3% 28155047 / 28958869 / -2.8% 0.80 / 0.78 / +2.5%
tpcds_q39/duckdb:vortex-file-compressed 18429373 / 18389855 / +0.2% 28918763 / 28286917 / +2.2% 0.64 / 0.65 / -2.0%
tpcds_q40/duckdb:vortex-file-compressed 13176676 / 13538572 / -2.7% 18434460 / 18700365 / -1.4% 0.71 / 0.72 / -1.3%
tpcds_q41/duckdb:vortex-file-compressed 6577984 / 6611606 / -0.5% 8981737 / 9071192 / -1.0% 0.73 / 0.73 / +0.5%
tpcds_q42/duckdb:vortex-file-compressed 7886635 / 8262243 / -4.5% 17429404 / 21276644 / -18.1% 🟢 0.45 / 0.39 / +16.5%
tpcds_q43/duckdb:vortex-file-compressed 10240071 / 11116478 / -7.9% 18184884 / 19870911 / -8.5% 0.56 / 0.56 / +0.7%
tpcds_q44/duckdb:vortex-file-compressed 15734120 / 13947405 / +12.8% 🔴 23926541 / 22866651 / +4.6% 0.66 / 0.61 / +7.8%
tpcds_q45/duckdb:vortex-file-compressed 22334335 / 22207552 / +0.6% 29088212 / 28682300 / +1.4% 0.77 / 0.77 / -0.8%
tpcds_q46/duckdb:vortex-file-compressed 18677622 / 18286760 / +2.1% 32098537 / 30330635 / +5.8% 0.58 / 0.60 / -3.5%
tpcds_q47/duckdb:vortex-file-compressed 31005247 / 31263590 / -0.8% 43247660 / 40849823 / +5.9% 0.72 / 0.77 / -6.3%
tpcds_q48/duckdb:vortex-file-compressed 19439622 / 19692946 / -1.3% 32778173 / 29904148 / +9.6% 0.59 / 0.66 / -9.9%
tpcds_q49/duckdb:vortex-file-compressed 16868876 / 17161630 / -1.7% 29221553 / 28751919 / +1.6% 0.58 / 0.60 / -3.3%
tpcds_q50/duckdb:vortex-file-compressed 16629701 / 16826516 / -1.2% 27871346 / 26361679 / +5.7% 0.60 / 0.64 / -6.5%
tpcds_q51/duckdb:vortex-file-compressed 76151066 / 77443659 / -1.7% 62159534 / 59926163 / +3.7% 1.23 / 1.29 / -5.2%
tpcds_q52/duckdb:vortex-file-compressed 8247011 / 8182510 / +0.8% 19733497 / 17062283 / +15.7% 🔴 0.42 / 0.48 / -12.9%
tpcds_q53/duckdb:vortex-file-compressed 14909450 / 14486626 / +2.9% 25733804 / 25960479 / -0.9% 0.58 / 0.56 / +3.8%
tpcds_q54/duckdb:vortex-file-compressed 20479986 / 20385356 / +0.5% 29033385 / 32145365 / -9.7% 0.71 / 0.63 / +11.2%
tpcds_q55/duckdb:vortex-file-compressed 8289642 / 8382760 / -1.1% 18234224 / 17073641 / +6.8% 0.45 / 0.49 / -7.4%
tpcds_q56/duckdb:vortex-file-compressed 17336156 / 17496970 / -0.9% 28777753 / 34370379 / -16.3% 🟢 0.60 / 0.51 / +18.3%
tpcds_q57/duckdb:vortex-file-compressed 24076760 / 24360147 / -1.2% 30376965 / 30810019 / -1.4% 0.79 / 0.79 / +0.2%
tpcds_q58/duckdb:vortex-file-compressed 18467966 / 18442466 / +0.1% 32965626 / 29426921 / +12.0% 🔴 0.56 / 0.63 / -10.6%
tpcds_q59/duckdb:vortex-file-compressed 18891240 / 20987948 / -10.0% 25193354 / 24187696 / +4.2% 0.75 / 0.87 / -13.6%
tpcds_q60/duckdb:vortex-file-compressed 17422944 / 17676780 / -1.4% 29430108 / 29188034 / +0.8% 0.59 / 0.61 / -2.2%
tpcds_q61/duckdb:vortex-file-compressed 19658122 / 20183684 / -2.6% 32236152 / 33452959 / -3.6% 0.61 / 0.60 / +1.1%
tpcds_q62/duckdb:vortex-file-compressed 10441758 / 10285519 / +1.5% 15793785 / 15687521 / +0.7% 0.66 / 0.66 / +0.8%
tpcds_q63/duckdb:vortex-file-compressed 13149087 / 13887226 / -5.3% 22595303 / 23478001 / -3.8% 0.58 / 0.59 / -1.6%
tpcds_q64/duckdb:vortex-file-compressed 62824280 / 64107400 / -2.0% 83161929 / 77294832 / +7.6% 0.76 / 0.83 / -8.9%
tpcds_q65/duckdb:vortex-file-compressed 13446960 / 13785554 / -2.5% 22869305 / 23328160 / -2.0% 0.59 / 0.59 / -0.5%
tpcds_q66/duckdb:vortex-file-compressed 21296004 / 21360041 / -0.3% 30387224 / 32153454 / -5.5% 0.70 / 0.66 / +5.5%
tpcds_q67/duckdb:vortex-file-compressed 65225992 / 65605650 / -0.6% 81079428 / 85351395 / -5.0% 0.80 / 0.77 / +4.7%
tpcds_q68/duckdb:vortex-file-compressed 18504290 / 18174535 / +1.8% 30213346 / 31729942 / -4.8% 0.61 / 0.57 / +6.9%
tpcds_q69/duckdb:vortex-file-compressed 29897241 / 29213828 / +2.3% 44558672 / 42134551 / +5.8% 0.67 / 0.69 / -3.2%
tpcds_q70/duckdb:vortex-file-compressed 18622701 / 18776436 / -0.8% 31768399 / 27116461 / +17.2% 🔴 0.59 / 0.69 / -15.3%
tpcds_q71/duckdb:vortex-file-compressed 12629086 / 12783546 / -1.2% 23384402 / 22247231 / +5.1% 0.54 / 0.57 / -6.0%
tpcds_q72/duckdb:vortex-file-compressed 63113778 / 63837688 / -1.1% 75825031 / 79651706 / -4.8% 0.83 / 0.80 / +3.9%
tpcds_q73/duckdb:vortex-file-compressed 15171564 / 15160621 / +0.1% 26069194 / 22563434 / +15.5% 🔴 0.58 / 0.67 / -13.4%
tpcds_q74/duckdb:vortex-file-compressed 27566288 / 27585291 / -0.1% 37118354 / 36217357 / +2.5% 0.74 / 0.76 / -2.5%
tpcds_q75/duckdb:vortex-file-compressed 28503610 / 28364662 / +0.5% 42355909 / 38796858 / +9.2% 0.67 / 0.73 / -8.0%
tpcds_q76/duckdb:vortex-file-compressed 12742256 / 12921974 / -1.4% 23827161 / 24899632 / -4.3% 0.53 / 0.52 / +3.0%
tpcds_q77/duckdb:vortex-file-compressed 16110036 / 16275107 / -1.0% 26266200 / 24483304 / +7.3% 0.61 / 0.66 / -7.7%
tpcds_q78/duckdb:vortex-file-compressed 37645934 / 37466058 / +0.5% 48261784 / 47210583 / +2.2% 0.78 / 0.79 / -1.7%
tpcds_q79/duckdb:vortex-file-compressed 14581872 / 14589405 / -0.1% 24112883 / 24057971 / +0.2% 0.60 / 0.61 / -0.3%
tpcds_q80/duckdb:vortex-file-compressed 28452781 / 28171712 / +1.0% 42968715 / 39190881 / +9.6% 0.66 / 0.72 / -7.9%
tpcds_q81/duckdb:vortex-file-compressed 22306442 / 22565550 / -1.1% 29491032 / 29280411 / +0.7% 0.76 / 0.77 / -1.9%
tpcds_q82/duckdb:vortex-file-compressed 32269118 / 32821301 / -1.7% 40354852 / 39910170 / +1.1% 0.80 / 0.82 / -2.8%
tpcds_q83/duckdb:vortex-file-compressed 18686102 / 19029487 / -1.8% 24854586 / 26619874 / -6.6% 0.75 / 0.71 / +5.2%
tpcds_q84/duckdb:vortex-file-compressed 13000072 / 12908868 / +0.7% 18655038 / 18737009 / -0.4% 0.70 / 0.69 / +1.1%
tpcds_q85/duckdb:vortex-file-compressed 31585393 / 31368313 / +0.7% 40677957 / 40296822 / +0.9% 0.78 / 0.78 / -0.3%
tpcds_q86/duckdb:vortex-file-compressed 10660082 / 10788207 / -1.2% 17312630 / 19389241 / -10.7% 🟢 0.62 / 0.56 / +10.7%
tpcds_q87/duckdb:vortex-file-compressed 24143442 / 24385535 / -1.0% 30427591 / 29884959 / +1.8% 0.79 / 0.82 / -2.8%
tpcds_q88/duckdb:vortex-file-compressed 32825578 / 32410135 / +1.3% 44773007 / 45250130 / -1.1% 0.73 / 0.72 / +2.4%
tpcds_q89/duckdb:vortex-file-compressed 13594563 / 13923612 / -2.4% 23666649 / 24396156 / -3.0% 0.57 / 0.57 / +0.6%
tpcds_q90/duckdb:vortex-file-compressed 7703741 / 7546254 / +2.1% 14499791 / 12976832 / +11.7% 🔴 0.53 / 0.58 / -8.6%
tpcds_q91/duckdb:vortex-file-compressed 15300976 / 15347424 / -0.3% 21893656 / 21180658 / +3.4% 0.70 / 0.72 / -3.5%
tpcds_q92/duckdb:vortex-file-compressed 13255258 / 12969052 / +2.2% 21085746 / 20642231 / +2.1% 0.63 / 0.63 / +0.1%
tpcds_q93/duckdb:vortex-file-compressed 17331552 / 17250600 / +0.5% 25225222 / 25720365 / -1.9% 0.69 / 0.67 / +2.4%
tpcds_q94/duckdb:vortex-file-compressed 16226209 / 16289192 / -0.4% 25996854 / 24637235 / +5.5% 0.62 / 0.66 / -5.6%
tpcds_q95/duckdb:vortex-file-compressed 71448955 / 71140295 / +0.4% 79640295 / 78393722 / +1.6% 0.90 / 0.91 / -1.1%
tpcds_q96/duckdb:vortex-file-compressed 7445836 / 7368641 / +1.0% 18076007 / 14498604 / +24.7% 🔴 0.41 / 0.51 / -19.0%
tpcds_q97/duckdb:vortex-file-compressed 22661914 / 22400943 / +1.2% 31070777 / 28697173 / +8.3% 0.73 / 0.78 / -6.6%
tpcds_q98/duckdb:vortex-file-compressed 14427866 / 13407514 / +7.6% 28782449 / 23563409 / +22.1% 🔴 0.50 / 0.57 / -11.9%
tpcds_q99/duckdb:vortex-file-compressed 13495453 / 14924919 / -9.6% 19197922 / 21332229 / -10.0% 🟢 0.70 / 0.70 / +0.5%
duckdb / vortex-compact / ns (0.990x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 16647226 / 16459386 / +1.1% 24044564 / 23450587 / +2.5% 0.69 / 0.70 / -1.4%
tpcds_q02/duckdb:vortex-compact 16159173 / 16212948 / -0.3% 21444575 / 20250630 / +5.9% 0.75 / 0.80 / -5.9%
tpcds_q03/duckdb:vortex-compact 21995674 / 27388058 / -19.7% 🟢 34999635 / 34060198 / +2.8% 0.63 / 0.80 / -21.8%
tpcds_q04/duckdb:vortex-compact 54782561 / 53777810 / +1.9% 66578467 / 64753131 / +2.8% 0.82 / 0.83 / -0.9%
tpcds_q05/duckdb:vortex-compact 23597118 / 24442865 / -3.5% 32798982 / 34332813 / -4.5% 0.72 / 0.71 / +1.1%
tpcds_q06/duckdb:vortex-compact 33874284 / 35236352 / -3.9% 44911001 / 45241210 / -0.7% 0.75 / 0.78 / -3.2%
tpcds_q07/duckdb:vortex-compact 28183608 / 28922336 / -2.6% 37182699 / 38802193 / -4.2% 0.76 / 0.75 / +1.7%
tpcds_q08/duckdb:vortex-compact 48922080 / 48913566 / +0.0% 58292651 / 56644522 / +2.9% 0.84 / 0.86 / -2.8%
tpcds_q09/duckdb:vortex-compact 12407910 / 12348456 / +0.5% 22472353 / 19830569 / +13.3% 🔴 0.55 / 0.62 / -11.3%
tpcds_q10/duckdb:vortex-compact 45450288 / 45908390 / -1.0% 61965193 / 60472969 / +2.5% 0.73 / 0.76 / -3.4%
tpcds_q11/duckdb:vortex-compact 45806553 / 45290448 / +1.1% 58418310 / 57033314 / +2.4% 0.78 / 0.79 / -1.3%
tpcds_q12/duckdb:vortex-compact 13697219 / 13629099 / +0.5% 19798681 / 20121549 / -1.6% 0.69 / 0.68 / +2.1%
tpcds_q13/duckdb:vortex-compact 37055314 / 36846062 / +0.6% 50927601 / 50102883 / +1.6% 0.73 / 0.74 / -1.1%
tpcds_q14/duckdb:vortex-compact 67342572 / 68776240 / -2.1% 82183431 / 77944813 / +5.4% 0.82 / 0.88 / -7.1%
tpcds_q15/duckdb:vortex-compact 25941020 / 26289078 / -1.3% 31850404 / 31619767 / +0.7% 0.81 / 0.83 / -2.0%
tpcds_q16/duckdb:vortex-compact 24982622 / 25002183 / -0.1% 32712936 / 32227979 / +1.5% 0.76 / 0.78 / -1.6%
tpcds_q17/duckdb:vortex-compact 47768588 / 44894736 / +6.4% 58660555 / 56356258 / +4.1% 0.81 / 0.80 / +2.2%
tpcds_q18/duckdb:vortex-compact 36062692 / 35983510 / +0.2% 44803273 / 44143007 / +1.5% 0.80 / 0.82 / -1.3%
tpcds_q19/duckdb:vortex-compact 36329091 / 36196492 / +0.4% 43799428 / 43976078 / -0.4% 0.83 / 0.82 / +0.8%
tpcds_q20/duckdb:vortex-compact 14067632 / 14299122 / -1.6% 19807192 / 19751864 / +0.3% 0.71 / 0.72 / -1.9%
tpcds_q21/duckdb:vortex-compact 10470100 / 10658024 / -1.8% 18746826 / 18060770 / +3.8% 0.56 / 0.59 / -5.4%
tpcds_q22/duckdb:vortex-compact 31161872 / 30297208 / +2.9% 40441839 / 43203726 / -6.4% 0.77 / 0.70 / +9.9%
tpcds_q23/duckdb:vortex-compact 43382122 / 43556676 / -0.4% 54812890 / 53663931 / +2.1% 0.79 / 0.81 / -2.5%
tpcds_q24/duckdb:vortex-compact 39850054 / 39824984 / +0.1% 51221634 / 48313161 / +6.0% 0.78 / 0.82 / -5.6%
tpcds_q25/duckdb:vortex-compact 44270250 / 43191548 / +2.5% 54516462 / 52676834 / +3.5% 0.81 / 0.82 / -1.0%
tpcds_q26/duckdb:vortex-compact 25364214 / 25132462 / +0.9% 30861112 / 30512857 / +1.1% 0.82 / 0.82 / -0.2%
tpcds_q27/duckdb:vortex-compact 33068360 / 33354914 / -0.9% 45157260 / 43999548 / +2.6% 0.73 / 0.76 / -3.4%
tpcds_q28/duckdb:vortex-compact 11660310 / 10911880 / +6.9% 21538472 / 20253854 / +6.3% 0.54 / 0.54 / +0.5%
tpcds_q29/duckdb:vortex-compact 44368240 / 44742380 / -0.8% 55910828 / 56912113 / -1.8% 0.79 / 0.79 / +0.9%
tpcds_q30/duckdb:vortex-compact 22467862 / 22395954 / +0.3% 29913294 / 30111189 / -0.7% 0.75 / 0.74 / +1.0%
tpcds_q31/duckdb:vortex-compact 23678616 / 23694622 / -0.1% 32143676 / 33004866 / -2.6% 0.74 / 0.72 / +2.6%
tpcds_q32/duckdb:vortex-compact 14381076 / 14014974 / +2.6% 22432074 / 20316676 / +10.4% 🔴 0.64 / 0.69 / -7.1%
tpcds_q33/duckdb:vortex-compact 23625675 / 23115810 / +2.2% 34834753 / 35594211 / -2.1% 0.68 / 0.65 / +4.4%
tpcds_q34/duckdb:vortex-compact 22223025 / 24651496 / -9.9% 29818823 / 32924392 / -9.4% 0.75 / 0.75 / -0.5%
tpcds_q35/duckdb:vortex-compact 62306178 / 62124392 / +0.3% 76460076 / 76753661 / -0.4% 0.81 / 0.81 / +0.7%
tpcds_q36/duckdb:vortex-compact 21670475 / 22357838 / -3.1% 36758642 / 31131172 / +18.1% 🔴 0.59 / 0.72 / -17.9%
tpcds_q37/duckdb:vortex-compact 15258312 / 15327787 / -0.5% 26596281 / 24007229 / +10.8% 🔴 0.57 / 0.64 / -10.1%
tpcds_q38/duckdb:vortex-compact 26760027 / 26219568 / +2.1% 34927481 / 35674556 / -2.1% 0.77 / 0.73 / +4.2%
tpcds_q39/duckdb:vortex-compact 18769941 / 19979516 / -6.1% 29679386 / 26523285 / +11.9% 🔴 0.63 / 0.75 / -16.0%
tpcds_q40/duckdb:vortex-compact 16148364 / 16186364 / -0.2% 21260995 / 23147556 / -8.2% 0.76 / 0.70 / +8.6%
tpcds_q41/duckdb:vortex-compact 7706267 / 7821157 / -1.5% 10743983 / 11480186 / -6.4% 0.72 / 0.68 / +5.3%
tpcds_q42/duckdb:vortex-compact 12607602 / 13008299 / -3.1% 20190063 / 19278789 / +4.7% 0.62 / 0.67 / -7.5%
tpcds_q43/duckdb:vortex-compact 16598582 / 16451138 / +0.9% 25640125 / 24807913 / +3.4% 0.65 / 0.66 / -2.4%
tpcds_q44/duckdb:vortex-compact 20822906 / 20120409 / +3.5% 30774492 / 30486114 / +0.9% 0.68 / 0.66 / +2.5%
tpcds_q45/duckdb:vortex-compact 27525574 / 27597764 / -0.3% 33022644 / 32469274 / +1.7% 0.83 / 0.85 / -1.9%
tpcds_q46/duckdb:vortex-compact 29554624 / 29303422 / +0.9% 40462034 / 41049640 / -1.4% 0.73 / 0.71 / +2.3%
tpcds_q47/duckdb:vortex-compact 36625922 / 39106636 / -6.3% 49321721 / 46426934 / +6.2% 0.74 / 0.84 / -11.8%
tpcds_q48/duckdb:vortex-compact 33701496 / 35891603 / -6.1% 43616781 / 47529418 / -8.2% 0.77 / 0.76 / +2.3%
tpcds_q49/duckdb:vortex-compact 24326180 / 24702360 / -1.5% 39596654 / 37116635 / +6.7% 0.61 / 0.67 / -7.7%
tpcds_q50/duckdb:vortex-compact 28056622 / 32553265 / -13.8% 🟢 37611346 / 40903997 / -8.0% 0.75 / 0.80 / -6.3%
tpcds_q51/duckdb:vortex-compact 53095451 / 67665398 / -21.5% 🟢 87666316 / 67509503 / +29.9% 🔴 0.61 / 1.00 / -39.6%
tpcds_q52/duckdb:vortex-compact 11973605 / 11972988 / +0.0% 20550495 / 19549909 / +5.1% 0.58 / 0.61 / -4.9%
tpcds_q53/duckdb:vortex-compact 20835944 / 21570900 / -3.4% 29919797 / 28964499 / +3.3% 0.70 / 0.74 / -6.5%
tpcds_q54/duckdb:vortex-compact 26043984 / 26203004 / -0.6% 38328621 / 34349298 / +11.6% 🔴 0.68 / 0.76 / -10.9%
tpcds_q55/duckdb:vortex-compact 13133730 / 11781260 / +11.5% 🔴 20851955 / 19167304 / +8.8% 0.63 / 0.61 / +2.5%
tpcds_q56/duckdb:vortex-compact 24066602 / 24462991 / -1.6% 35281181 / 34786773 / +1.4% 0.68 / 0.70 / -3.0%
tpcds_q57/duckdb:vortex-compact 27579006 / 27735197 / -0.6% 36304380 / 33857915 / +7.2% 0.76 / 0.82 / -7.3%
tpcds_q58/duckdb:vortex-compact 21543069 / 21846298 / -1.4% 31057465 / 31526077 / -1.5% 0.69 / 0.69 / +0.1%
tpcds_q59/duckdb:vortex-compact 23547098 / 23233518 / +1.3% 32532095 / 29552570 / +10.1% 🔴 0.72 / 0.79 / -7.9%
tpcds_q60/duckdb:vortex-compact 24572536 / 24564447 / +0.0% 36943537 / 35708626 / +3.5% 0.67 / 0.69 / -3.3%
tpcds_q61/duckdb:vortex-compact 33444390 / 32767204 / +2.1% 49488681 / 43809689 / +13.0% 🔴 0.68 / 0.75 / -9.6%
tpcds_q62/duckdb:vortex-compact 11651437 / 11763070 / -0.9% 17984416 / 19341618 / -7.0% 0.65 / 0.61 / +6.5%
tpcds_q63/duckdb:vortex-compact 19605240 / 20215214 / -3.0% 27723927 / 28635532 / -3.2% 0.71 / 0.71 / +0.2%
tpcds_q64/duckdb:vortex-compact 85422876 / 86845608 / -1.6% 99129932 / 97921032 / +1.2% 0.86 / 0.89 / -2.8%
tpcds_q65/duckdb:vortex-compact 18790474 / 18256522 / +2.9% 28721138 / 28454665 / +0.9% 0.65 / 0.64 / +2.0%
tpcds_q66/duckdb:vortex-compact 25391481 / 25408662 / -0.1% 32843054 / 36882636 / -11.0% 🟢 0.77 / 0.69 / +12.2%
tpcds_q67/duckdb:vortex-compact 74671590 / 71257452 / +4.8% 105185256 / 98067578 / +7.3% 0.71 / 0.73 / -2.3%
tpcds_q68/duckdb:vortex-compact 29537270 / 29134272 / +1.4% 42795448 / 40434348 / +5.8% 0.69 / 0.72 / -4.2%
tpcds_q69/duckdb:vortex-compact 46745152 / 46638959 / +0.2% 56521924 / 61601427 / -8.2% 0.83 / 0.76 / +9.2%
tpcds_q70/duckdb:vortex-compact 31802906 / 32316718 / -1.6% 38820546 / 45663538 / -15.0% 🟢 0.82 / 0.71 / +15.8%
tpcds_q71/duckdb:vortex-compact 19133587 / 19518506 / -2.0% 33168603 / 31546588 / +5.1% 0.58 / 0.62 / -6.8%
tpcds_q72/duckdb:vortex-compact 69389178 / 69459018 / -0.1% 81686591 / 79486748 / +2.8% 0.85 / 0.87 / -2.8%
tpcds_q73/duckdb:vortex-compact 21593618 / 21495154 / +0.5% 28896336 / 27656068 / +4.5% 0.75 / 0.78 / -3.9%
tpcds_q74/duckdb:vortex-compact 32298830 / 32085034 / +0.7% 42248871 / 40604716 / +4.0% 0.76 / 0.79 / -3.3%
tpcds_q75/duckdb:vortex-compact 32470524 / 32967870 / -1.5% 45872223 / 43558387 / +5.3% 0.71 / 0.76 / -6.5%
tpcds_q76/duckdb:vortex-compact 15996650 / 16037258 / -0.3% 29030125 / 29145117 / -0.4% 0.55 / 0.55 / +0.1%
tpcds_q77/duckdb:vortex-compact 22973894 / 24779726 / -7.3% 33787141 / 32965634 / +2.5% 0.68 / 0.75 / -9.5%
tpcds_q78/duckdb:vortex-compact 42047410 / 41665827 / +0.9% 50741038 / 53260798 / -4.7% 0.83 / 0.78 / +5.9%
tpcds_q79/duckdb:vortex-compact 39160600 / 37853456 / +3.5% 46421622 / 63519266 / -26.9% 🟢 0.84 / 0.60 / +41.6%
tpcds_q80/duckdb:vortex-compact 37233408 / 37282711 / -0.1% 50684226 / 54316081 / -6.7% 0.73 / 0.69 / +7.0%
tpcds_q81/duckdb:vortex-compact 24402538 / 24416943 / -0.1% 32477436 / 31095368 / +4.4% 0.75 / 0.79 / -4.3%
tpcds_q82/duckdb:vortex-compact 36466580 / 36111762 / +1.0% 43532418 / 48456028 / -10.2% 🟢 0.84 / 0.75 / +12.4%
tpcds_q83/duckdb:vortex-compact 28525773 / 28202076 / +1.1% 42696323 / 35391433 / +20.6% 🔴 0.67 / 0.80 / -16.2%
tpcds_q84/duckdb:vortex-compact 15017820 / 15809152 / -5.0% 24004662 / 21558239 / +11.3% 🔴 0.63 / 0.73 / -14.7%
tpcds_q85/duckdb:vortex-compact 42013292 / 41548024 / +1.1% 50491771 / 49456115 / +2.1% 0.83 / 0.84 / -1.0%
tpcds_q86/duckdb:vortex-compact 12399340 / 12166100 / +1.9% 19289537 / 17555293 / +9.9% 0.64 / 0.69 / -7.2%
tpcds_q87/duckdb:vortex-compact 27654759 / 28317112 / -2.3% 34361394 / 35058818 / -2.0% 0.80 / 0.81 / -0.4%
tpcds_q88/duckdb:vortex-compact 66251874 / 72543256 / -8.7% 79071140 / 77177226 / +2.5% 0.84 / 0.94 / -10.9%
tpcds_q89/duckdb:vortex-compact 20815316 / 20918780 / -0.5% 28042859 / 29246239 / -4.1% 0.74 / 0.72 / +3.8%
tpcds_q90/duckdb:vortex-compact 11748484 / 11903564 / -1.3% 17843134 / 18421628 / -3.1% 0.66 / 0.65 / +1.9%
tpcds_q91/duckdb:vortex-compact 30557266 / 30616140 / -0.2% 36980849 / 37620920 / -1.7% 0.83 / 0.81 / +1.5%
tpcds_q92/duckdb:vortex-compact 20691991 / 20634156 / +0.3% 30957383 / 27897644 / +11.0% 🔴 0.67 / 0.74 / -9.6%
tpcds_q93/duckdb:vortex-compact 18332718 / 18425444 / -0.5% 26519109 / 27548339 / -3.7% 0.69 / 0.67 / +3.4%
tpcds_q94/duckdb:vortex-compact 21854574 / 22066050 / -1.0% 30481552 / 29253639 / +4.2% 0.72 / 0.75 / -4.9%
tpcds_q95/duckdb:vortex-compact 77503092 / 77740204 / -0.3% 85163484 / 85185221 / -0.0% 0.91 / 0.91 / -0.3%
tpcds_q96/duckdb:vortex-compact 17205092 / 17098389 / +0.6% 24661096 / 24545349 / +0.5% 0.70 / 0.70 / +0.2%
tpcds_q97/duckdb:vortex-compact 25353265 / 25366456 / -0.1% 35571128 / 37450387 / -5.0% 0.71 / 0.68 / +5.2%
tpcds_q98/duckdb:vortex-compact 18331104 / 18369895 / -0.2% 28607284 / 27095493 / +5.6% 0.64 / 0.68 / -5.5%
tpcds_q99/duckdb:vortex-compact 17044886 / 18279984 / -6.8% 25639107 / 24653987 / +4.0% 0.66 / 0.74 / -10.3%
duckdb / parquet / ns (1.008x ➖, 2↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 23531546 / 25689730 / -8.4% 33807916 / 31845488 / +6.2% 0.70 / 0.81 / -13.7%
tpcds_q02/duckdb:parquet 15267946 / 15306013 / -0.2% 19688166 / 19855494 / -0.8% 0.78 / 0.77 / +0.6%
tpcds_q03/duckdb:parquet 10948924 / 8834426 / +23.9% 🔴 18294964 / 15882191 / +15.2% 🔴 0.60 / 0.56 / +7.6%
tpcds_q04/duckdb:parquet 127513710 / 127773884 / -0.2% 134092602 / 132677195 / +1.1% 0.95 / 0.96 / -1.3%
tpcds_q05/duckdb:parquet 21182918 / 21590868 / -1.9% 25732425 / 25433219 / +1.2% 0.82 / 0.85 / -3.0%
tpcds_q06/duckdb:parquet 26967976 / 27143704 / -0.6% 36656576 / 38216930 / -4.1% 0.74 / 0.71 / +3.6%
tpcds_q07/duckdb:parquet 15250450 / 15277979 / -0.2% 24114071 / 22622686 / +6.6% 0.63 / 0.68 / -6.4%
tpcds_q08/duckdb:parquet 25648073 / 25499658 / +0.6% 32438731 / 33355957 / -2.7% 0.79 / 0.76 / +3.4%
tpcds_q09/duckdb:parquet 18540725 / 18496726 / +0.2% 22533512 / 23080749 / -2.4% 0.82 / 0.80 / +2.7%
tpcds_q10/duckdb:parquet 27506566 / 28945609 / -5.0% 37370258 / 38088775 / -1.9% 0.74 / 0.76 / -3.1%
tpcds_q11/duckdb:parquet 71565746 / 71155904 / +0.6% 76637276 / 78054029 / -1.8% 0.93 / 0.91 / +2.4%
tpcds_q12/duckdb:parquet 12738026 / 12771300 / -0.3% 18100113 / 16908840 / +7.0% 0.70 / 0.76 / -6.8%
tpcds_q13/duckdb:parquet 23685326 / 23873824 / -0.8% 31736260 / 31676795 / +0.2% 0.75 / 0.75 / -1.0%
tpcds_q14/duckdb:parquet 60347950 / 61311700 / -1.6% 67878071 / 68070591 / -0.3% 0.89 / 0.90 / -1.3%
tpcds_q15/duckdb:parquet 24889578 / 24620134 / +1.1% 30449181 / 31117877 / -2.1% 0.82 / 0.79 / +3.3%
tpcds_q16/duckdb:parquet 19761433 / 19854356 / -0.5% 28967578 / 28164207 / +2.9% 0.68 / 0.70 / -3.2%
tpcds_q17/duckdb:parquet 32174552 / 32336690 / -0.5% 40734255 / 41074997 / -0.8% 0.79 / 0.79 / +0.3%
tpcds_q18/duckdb:parquet 39008222 / 40049120 / -2.6% 50802794 / 50212490 / +1.2% 0.77 / 0.80 / -3.7%
tpcds_q19/duckdb:parquet 26027881 / 24418270 / +6.6% 36502716 / 31862416 / +14.6% 🔴 0.71 / 0.77 / -7.0%
tpcds_q20/duckdb:parquet 13570087 / 13502086 / +0.5% 17679271 / 18643273 / -5.2% 0.77 / 0.72 / +6.0%
tpcds_q21/duckdb:parquet 9397033 / 9516444 / -1.3% 16327244 / 13047023 / +25.1% 🔴 0.58 / 0.73 / -21.1%
tpcds_q22/duckdb:parquet 34897287 / 35056859 / -0.5% 38943319 / 39300865 / -0.9% 0.90 / 0.89 / +0.5%
tpcds_q23/duckdb:parquet 41578410 / 40775450 / +2.0% 47837453 / 56852027 / -15.9% 🟢 0.87 / 0.72 / +21.2%
tpcds_q24/duckdb:parquet 33309266 / 33274697 / +0.1% 43913165 / 43963692 / -0.1% 0.76 / 0.76 / +0.2%
tpcds_q25/duckdb:parquet 29777351 / 30159328 / -1.3% 39287478 / 40974712 / -4.1% 0.76 / 0.74 / +3.0%
tpcds_q26/duckdb:parquet 30790672 / 30952160 / -0.5% 38173279 / 38860086 / -1.8% 0.81 / 0.80 / +1.3%
tpcds_q27/duckdb:parquet 31834436 / 33106012 / -3.8% 41429067 / 43656825 / -5.1% 0.77 / 0.76 / +1.3%
tpcds_q28/duckdb:parquet 17310736 / 17230477 / +0.5% 22768739 / 19725775 / +15.4% 🔴 0.76 / 0.87 / -13.0%
tpcds_q29/duckdb:parquet 30487968 / 30641357 / -0.5% 39255930 / 39752413 / -1.2% 0.78 / 0.77 / +0.8%
tpcds_q30/duckdb:parquet 32612177 / 32117170 / +1.5% 41714955 / 41855301 / -0.3% 0.78 / 0.77 / +1.9%
tpcds_q31/duckdb:parquet 20052829 / 20276600 / -1.1% 25066079 / 24073187 / +4.1% 0.80 / 0.84 / -5.0%
tpcds_q32/duckdb:parquet 14244668 / 11138008 / +27.9% 🔴 17167769 / 17216163 / -0.3% 0.83 / 0.65 / +28.3%
tpcds_q33/duckdb:parquet 15821199 / 15872476 / -0.3% 22959177 / 23282213 / -1.4% 0.69 / 0.68 / +1.1%
tpcds_q34/duckdb:parquet 16003928 / 16099116 / -0.6% 22303032 / 22486240 / -0.8% 0.72 / 0.72 / +0.2%
tpcds_q35/duckdb:parquet 46820830 / 46699046 / +0.3% 59664501 / 57035567 / +4.6% 0.78 / 0.82 / -4.2%
tpcds_q36/duckdb:parquet 14940762 / 15057915 / -0.8% 22757623 / 23267445 / -2.2% 0.66 / 0.65 / +1.4%
tpcds_q37/duckdb:parquet 11601912 / 12397131 / -6.4% 16745115 / 18671024 / -10.3% 🟢 0.69 / 0.66 / +4.3%
tpcds_q38/duckdb:parquet 26181448 / 26460802 / -1.1% 30969363 / 30846378 / +0.4% 0.85 / 0.86 / -1.4%
tpcds_q39/duckdb:parquet 24674818 / 24660601 / +0.1% 28142981 / 30218437 / -6.9% 0.88 / 0.82 / +7.4%
tpcds_q40/duckdb:parquet 16035462 / 15663362 / +2.4% 21142893 / 20856577 / +1.4% 0.76 / 0.75 / +1.0%
tpcds_q41/duckdb:parquet 7960074 / 7850326 / +1.4% 12585538 / 13874638 / -9.3% 0.63 / 0.57 / +11.8%
tpcds_q42/duckdb:parquet 8351392 / 8341908 / +0.1% 14619144 / 14938831 / -2.1% 0.57 / 0.56 / +2.3%
tpcds_q43/duckdb:parquet 10622126 / 10549999 / +0.7% 15715737 / 15830822 / -0.7% 0.68 / 0.67 / +1.4%
tpcds_q44/duckdb:parquet 16345164 / 16205170 / +0.9% 22839305 / 29253746 / -21.9% 🟢 0.72 / 0.55 / +29.2%
tpcds_q45/duckdb:parquet 23221458 / 22917456 / +1.3% 29996079 / 28671666 / +4.6% 0.77 / 0.80 / -3.1%
tpcds_q46/duckdb:parquet 36948685 / 35762230 / +3.3% 44706413 / 45181830 / -1.1% 0.83 / 0.79 / +4.4%
tpcds_q47/duckdb:parquet 31024104 / 32047240 / -3.2% 45259313 / 37582599 / +20.4% 🔴 0.69 / 0.85 / -19.6%
tpcds_q48/duckdb:parquet 20825772 / 20896598 / -0.3% 28788261 / 28571098 / +0.8% 0.72 / 0.73 / -1.1%
tpcds_q49/duckdb:parquet 18934302 / 18927180 / +0.0% 31691080 / 28032707 / +13.1% 🔴 0.60 / 0.68 / -11.5%
tpcds_q50/duckdb:parquet 17605608 / 17394210 / +1.2% 25447065 / 24590216 / +3.5% 0.69 / 0.71 / -2.2%
tpcds_q51/duckdb:parquet 53263752 / 53253398 / +0.0% 59721687 / 60607611 / -1.5% 0.89 / 0.88 / +1.5%
tpcds_q52/duckdb:parquet 10208756 / 8504144 / +20.0% 🔴 18452797 / 15464175 / +19.3% 🔴 0.55 / 0.55 / +0.6%
tpcds_q53/duckdb:parquet 11509824 / 12633038 / -8.9% 17244118 / 16992349 / +1.5% 0.67 / 0.74 / -10.2%
tpcds_q54/duckdb:parquet 20430370 / 20431619 / -0.0% 29238588 / 31698229 / -7.8% 0.70 / 0.64 / +8.4%
tpcds_q55/duckdb:parquet 8459853 / 8582928 / -1.4% 14924792 / 15007975 / -0.6% 0.57 / 0.57 / -0.9%
tpcds_q56/duckdb:parquet 16287138 / 16194791 / +0.6% 24154717 / 24025621 / +0.5% 0.67 / 0.67 / +0.0%
tpcds_q57/duckdb:parquet 29008538 / 29117336 / -0.4% 33982932 / 36221798 / -6.2% 0.85 / 0.80 / +6.2%
tpcds_q58/duckdb:parquet 18165820 / 18335732 / -0.9% 26391295 / 26181949 / +0.8% 0.69 / 0.70 / -1.7%
tpcds_q59/duckdb:parquet 20004990 / 19985185 / +0.1% 25305375 / 25010967 / +1.2% 0.79 / 0.80 / -1.1%
tpcds_q60/duckdb:parquet 16896134 / 17002700 / -0.6% 24455812 / 24440498 / +0.1% 0.69 / 0.70 / -0.7%
tpcds_q61/duckdb:parquet 21509619 / 21464898 / +0.2% 28696565 / 32727315 / -12.3% 🟢 0.75 / 0.66 / +14.3%
tpcds_q62/duckdb:parquet 10726376 / 12245097 / -12.4% 🟢 14806043 / 14987772 / -1.2% 0.72 / 0.82 / -11.3%
tpcds_q63/duckdb:parquet 11020688 / 10912282 / +1.0% 16621395 / 16478448 / +0.9% 0.66 / 0.66 / +0.1%
tpcds_q64/duckdb:parquet 52442453 / 52328410 / +0.2% 67602454 / 68055711 / -0.7% 0.78 / 0.77 / +0.9%
tpcds_q65/duckdb:parquet 17107110 / 14531382 / +17.7% 🔴 21005628 / 20704828 / +1.5% 0.81 / 0.70 / +16.0%
tpcds_q66/duckdb:parquet 24758802 / 24540897 / +0.9% 34432533 / 33118893 / +4.0% 0.72 / 0.74 / -3.0%
tpcds_q67/duckdb:parquet 77980726 / 77360504 / +0.8% 86039689 / 84620795 / +1.7% 0.91 / 0.91 / -0.9%
tpcds_q68/duckdb:parquet 29198870 / 29293696 / -0.3% 40621492 / 42709566 / -4.9% 0.72 / 0.69 / +4.8%
tpcds_q69/duckdb:parquet 28424700 / 28761226 / -1.2% 38070884 / 41731021 / -8.8% 0.75 / 0.69 / +8.3%
tpcds_q70/duckdb:parquet 16671574 / 16146194 / +3.3% 25099235 / 23233969 / +8.0% 0.66 / 0.69 / -4.4%
tpcds_q71/duckdb:parquet 14684832 / 14719500 / -0.2% 21287575 / 20777871 / +2.5% 0.69 / 0.71 / -2.6%
tpcds_q72/duckdb:parquet 81629111 / 83214758 / -1.9% 87805763 / 85928411 / +2.2% 0.93 / 0.97 / -4.0%
tpcds_q73/duckdb:parquet 13366555 / 13293508 / +0.5% 19391449 / 19886753 / -2.5% 0.69 / 0.67 / +3.1%
tpcds_q74/duckdb:parquet 100379284 / 98402996 / +2.0% 105649383 / 106042019 / -0.4% 0.95 / 0.93 / +2.4%
tpcds_q75/duckdb:parquet 40234557 / 40096330 / +0.3% 49674811 / 50925749 / -2.5% 0.81 / 0.79 / +2.9%
tpcds_q76/duckdb:parquet 13457790 / 13776062 / -2.3% 20494639 / 20012260 / +2.4% 0.66 / 0.69 / -4.6%
tpcds_q77/duckdb:parquet 17824524 / 16954126 / +5.1% 24562942 / 26347446 / -6.8% 0.73 / 0.64 / +12.8%
tpcds_q78/duckdb:parquet 48131998 / 48565195 / -0.9% 53423215 / 53024178 / +0.8% 0.90 / 0.92 / -1.6%
tpcds_q79/duckdb:parquet 20222279 / 20324733 / -0.5% 30644265 / 29003060 / +5.7% 0.66 / 0.70 / -5.8%
tpcds_q80/duckdb:parquet 31205361 / 31302243 / -0.3% 40945293 / 38458892 / +6.5% 0.76 / 0.81 / -6.4%
tpcds_q81/duckdb:parquet 29866772 / 29762328 / +0.4% 42056993 / 38850435 / +8.3% 0.71 / 0.77 / -7.3%
tpcds_q82/duckdb:parquet 12579886 / 14161548 / -11.2% 🟢 18550923 / 19615772 / -5.4% 0.68 / 0.72 / -6.1%
tpcds_q83/duckdb:parquet 15747344 / 15524710 / +1.4% 24737162 / 21165983 / +16.9% 🔴 0.64 / 0.73 / -13.2%
tpcds_q84/duckdb:parquet 17447524 / 17366778 / +0.5% 23160355 / 23998765 / -3.5% 0.75 / 0.72 / +4.1%
tpcds_q85/duckdb:parquet 34902126 / 34542902 / +1.0% 45877157 / 45731309 / +0.3% 0.76 / 0.76 / +0.7%
tpcds_q86/duckdb:parquet 13476418 / 12104650 / +11.3% 🔴 17741294 / 15422557 / +15.0% 🔴 0.76 / 0.78 / -3.2%
tpcds_q87/duckdb:parquet 28159116 / 28383476 / -0.8% 32232321 / 32200783 / +0.1% 0.87 / 0.88 / -0.9%
tpcds_q88/duckdb:parquet 27043506 / 27581796 / -2.0% 35486877 / 30890593 / +14.9% 🔴 0.76 / 0.89 / -14.7%
tpcds_q89/duckdb:parquet 12592626 / 12664836 / -0.6% 18684483 / 21952786 / -14.9% 🟢 0.67 / 0.58 / +16.8%
tpcds_q90/duckdb:parquet 9983570 / 6808624 / +46.6% 🔴 12986099 / 14255886 / -8.9% 0.77 / 0.48 / +61.0%
tpcds_q91/duckdb:parquet 21061050 / 20678984 / +1.8% 29508635 / 29698443 / -0.6% 0.71 / 0.70 / +2.5%
tpcds_q92/duckdb:parquet 11523782 / 11463072 / +0.5% 18567935 / 18403939 / +0.9% 0.62 / 0.62 / -0.4%
tpcds_q93/duckdb:parquet 20930823 / 21598278 / -3.1% 28695828 / 29180867 / -1.7% 0.73 / 0.74 / -1.5%
tpcds_q94/duckdb:parquet 16191214 / 15798436 / +2.5% 24853964 / 24693207 / +0.7% 0.65 / 0.64 / +1.8%
tpcds_q95/duckdb:parquet 89993966 / 89812966 / +0.2% 98177019 / 94521428 / +3.9% 0.92 / 0.95 / -3.5%
tpcds_q96/duckdb:parquet 6867736 / 6993089 / -1.8% 11047253 / 10809977 / +2.2% 0.62 / 0.65 / -3.9%
tpcds_q97/duckdb:parquet 25986240 / 26062654 / -0.3% 37844491 / 33159329 / +14.1% 🔴 0.69 / 0.79 / -12.6%
tpcds_q98/duckdb:parquet 15020446 / 15192564 / -1.1% 21942451 / 22406337 / -2.1% 0.68 / 0.68 / +1.0%
tpcds_q99/duckdb:parquet 17312158 / 17216037 / +0.6% 21231949 / 21615662 / -1.8% 0.82 / 0.80 / +2.4%

No file size changes detected.

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 21050aa4 vs base 64654627


vortex / vortex-file-compressed / ms (0.999x ➖, 0↑ 0↓)
name ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst 32.172842 / 32.353601 / -0.6%
read/clickbench/URL/shard-0/onpair-12 20.299536 / 20.14681 / +0.8%
read/tpch/l_comment/fsst 53.460493 / 54.003204 / -1.0%
read/tpch/l_comment/onpair-12 49.332522 / 49.23386 / +0.2%
write/clickbench/URL/shard-0/fsst 592.426692 / 593.002854 / -0.1%
write/clickbench/URL/shard-0/onpair-12 993.014927 / 987.481327 / +0.6%
write/tpch/l_comment/fsst 1992.28168 / 1994.72654 / -0.1%
write/tpch/l_comment/onpair-12 2202.34755 / 2220.84169 / -0.8%
vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)
name % (PR / base / %diff)
size/clickbench/URL/shard-0/fsst 47.3999586 / 47.3999586 / +0.0%
size/clickbench/URL/shard-0/onpair-12 30.225605 / 30.225605 / +0.0%
size/tpch/l_comment/fsst 30.5819725 / 30.5819725 / +0.0%
size/tpch/l_comment/onpair-12 25.8644092 / 25.8644092 / +0.0%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.4%
Engines: DataFusion No clear signal (-7.4%, environment too noisy confidence) · DuckDB No clear signal (-5.3%, environment too noisy confidence)
Vortex (geomean): hot 0.957x ➖ · cold 0.943x ➖
Parquet (geomean): hot 1.022x ➖ · cold 0.982x ➖
Shifts: Parquet (control) +2.2% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.977x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 219413996 / 218679067 / +0.3% 825993757 / 787804845 / +4.8% 0.27 / 0.28 / -4.3%
tpch_q02/datafusion:vortex-file-compressed 328068759 / 310180241 / +5.8% 742159137 / 587272028 / +26.4% 0.44 / 0.53 / -16.3%
tpch_q03/datafusion:vortex-file-compressed 352623856 / 422498688 / -16.5% 1050826983 / 1660603401 / -36.7% 🟢 0.34 / 0.25 / +31.9%
tpch_q04/datafusion:vortex-file-compressed 193708809 / 173839422 / +11.4% 390321266 / 376309809 / +3.7% 0.50 / 0.46 / +7.4%
tpch_q05/datafusion:vortex-file-compressed 398181588 / 348654345 / +14.2% 601808678 / 531715383 / +13.2% 0.66 / 0.66 / +0.9%
tpch_q06/datafusion:vortex-file-compressed 286436429 / 245372609 / +16.7% 763995384 / 381999671 / +100.0% 🔴 0.37 / 0.64 / -41.6%
tpch_q07/datafusion:vortex-file-compressed 386028456 / 359510543 / +7.4% 696932382 / 496038764 / +40.5% 🔴 0.55 / 0.72 / -23.6%
tpch_q08/datafusion:vortex-file-compressed 439776063 / 544936773 / -19.3% 528044246 / 657882816 / -19.7% 0.83 / 0.83 / +0.5%
tpch_q09/datafusion:vortex-file-compressed 462799988 / 337811871 / +37.0% 🔴 595877978 / 501595582 / +18.8% 0.78 / 0.67 / +15.3%
tpch_q10/datafusion:vortex-file-compressed 370838927 / 398965343 / -7.0% 531899998 / 528161379 / +0.7% 0.70 / 0.76 / -7.7%
tpch_q11/datafusion:vortex-file-compressed 297023697 / 257181480 / +15.5% 414620157 / 418186255 / -0.9% 0.72 / 0.61 / +16.5%
tpch_q12/datafusion:vortex-file-compressed 278794035 / 366346219 / -23.9% 484378345 / 478278777 / +1.3% 0.58 / 0.77 / -24.9%
tpch_q13/datafusion:vortex-file-compressed 130697929 / 140297902 / -6.8% 431674840 / 357511182 / +20.7% 0.30 / 0.39 / -22.8%
tpch_q14/datafusion:vortex-file-compressed 172184017 / 178682473 / -3.6% 321026041 / 641403570 / -49.9% 🟢 0.54 / 0.28 / +92.5%
tpch_q15/datafusion:vortex-file-compressed 290909428 / 295058253 / -1.4% 474621311 / 515283986 / -7.9% 0.61 / 0.57 / +7.0%
tpch_q16/datafusion:vortex-file-compressed 198966771 / 175693989 / +13.2% 339979050 / 295042421 / +15.2% 0.59 / 0.60 / -1.7%
tpch_q17/datafusion:vortex-file-compressed 283601586 / 406248484 / -30.2% 🟢 419242394 / 508601759 / -17.6% 0.68 / 0.80 / -15.3%
tpch_q18/datafusion:vortex-file-compressed 237137991 / 288572448 / -17.8% 359903913 / 659001447 / -45.4% 🟢 0.66 / 0.44 / +50.5%
tpch_q19/datafusion:vortex-file-compressed 322829525 / 436086239 / -26.0% 455949808 / 494699841 / -7.8% 0.71 / 0.88 / -19.7%
tpch_q20/datafusion:vortex-file-compressed 264911470 / 267828376 / -1.1% 421301996 / 416376628 / +1.2% 0.63 / 0.64 / -2.2%
tpch_q21/datafusion:vortex-file-compressed 501777429 / 479959337 / +4.5% 606857247 / 634689067 / -4.4% 0.83 / 0.76 / +9.3%
tpch_q22/datafusion:vortex-file-compressed 178375235 / 167064440 / +6.8% 438551448 / 351933710 / +24.6% 0.41 / 0.47 / -14.3%
datafusion / vortex-compact / ns (0.965x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 218427989 / 222175117 / -1.7% 677538633 / 682185015 / -0.7% 0.32 / 0.33 / -1.0%
tpch_q02/datafusion:vortex-compact 292710183 / 383988082 / -23.8% 559082063 / 568509377 / -1.7% 0.52 / 0.68 / -22.5%
tpch_q03/datafusion:vortex-compact 293439919 / 301753718 / -2.8% 626675676 / 678139175 / -7.6% 0.47 / 0.44 / +5.2%
tpch_q04/datafusion:vortex-compact 149611783 / 144189206 / +3.8% 343420484 / 420728383 / -18.4% 0.44 / 0.34 / +27.1%
tpch_q05/datafusion:vortex-compact 321772335 / 333053111 / -3.4% 541520056 / 672570234 / -19.5% 0.59 / 0.50 / +20.0%
tpch_q06/datafusion:vortex-compact 248726599 / 246656517 / +0.8% 368889306 / 373339572 / -1.2% 0.67 / 0.66 / +2.1%
tpch_q07/datafusion:vortex-compact 334760396 / 485695674 / -31.1% 🟢 495333819 / 1364942981 / -63.7% 🟢 0.68 / 0.36 / +89.9%
tpch_q08/datafusion:vortex-compact 389536468 / 439450134 / -11.4% 517997129 / 639250785 / -19.0% 0.75 / 0.69 / +9.4%
tpch_q09/datafusion:vortex-compact 441132124 / 287502563 / +53.4% 🔴 429168246 / 462733868 / -7.3% 1.03 / 0.62 / +65.4%
tpch_q10/datafusion:vortex-compact 332906173 / 317166765 / +5.0% 541213371 / 566382998 / -4.4% 0.62 / 0.56 / +9.8%
tpch_q11/datafusion:vortex-compact 259292468 / 343814577 / -24.6% 440845191 / 382370328 / +15.3% 0.59 / 0.90 / -34.6%
tpch_q12/datafusion:vortex-compact 302348627 / 351058995 / -13.9% 453629993 / 700026842 / -35.2% 🟢 0.67 / 0.50 / +32.9%
tpch_q13/datafusion:vortex-compact 194454314 / 118510188 / +64.1% 🔴 455600231 / 356429954 / +27.8% 0.43 / 0.33 / +28.4%
tpch_q14/datafusion:vortex-compact 200554405 / 179169996 / +11.9% 315818152 / 318585971 / -0.9% 0.64 / 0.56 / +12.9%
tpch_q15/datafusion:vortex-compact 300927867 / 307873903 / -2.3% 518714653 / 568616486 / -8.8% 0.58 / 0.54 / +7.1%
tpch_q16/datafusion:vortex-compact 149991516 / 147709735 / +1.5% 287050247 / 278242505 / +3.2% 0.52 / 0.53 / -1.6%
tpch_q17/datafusion:vortex-compact 294260991 / 324107681 / -9.2% 406508178 / 430145245 / -5.5% 0.72 / 0.75 / -3.9%
tpch_q18/datafusion:vortex-compact 244348938 / 230466712 / +6.0% 468381221 / 472146519 / -0.8% 0.52 / 0.49 / +6.9%
tpch_q19/datafusion:vortex-compact 406697523 / 498249966 / -18.4% 499311244 / 508536806 / -1.8% 0.81 / 0.98 / -16.9%
tpch_q20/datafusion:vortex-compact 254075046 / 296065948 / -14.2% 380957922 / 483158137 / -21.2% 0.67 / 0.61 / +8.8%
tpch_q21/datafusion:vortex-compact 385196805 / 439592278 / -12.4% 544802191 / 579818183 / -6.0% 0.71 / 0.76 / -6.7%
tpch_q22/datafusion:vortex-compact 135887069 / 151489654 / -10.3% 320299006 / 328926054 / -2.6% 0.42 / 0.46 / -7.9%
datafusion / parquet / ns (1.049x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 189083540 / 164586015 / +14.9% 668326996 / 387639361 / +72.4% 🔴 0.28 / 0.42 / -33.4%
tpch_q02/datafusion:parquet 255128601 / 328260209 / -22.3% 530958062 / 514634835 / +3.2% 0.48 / 0.64 / -24.7%
tpch_q03/datafusion:parquet 299657231 / 297490666 / +0.7% 735557013 / 873214825 / -15.8% 0.41 / 0.34 / +19.6%
tpch_q04/datafusion:parquet 184388253 / 170713185 / +8.0% 374399282 / 419319018 / -10.7% 0.49 / 0.41 / +21.0%
tpch_q05/datafusion:parquet 388956809 / 428066643 / -9.1% 480859593 / 494956572 / -2.8% 0.81 / 0.86 / -6.5%
tpch_q06/datafusion:parquet 136148272 / 128387911 / +6.0% 264066025 / 280647306 / -5.9% 0.52 / 0.46 / +12.7%
tpch_q07/datafusion:parquet 359939514 / 342014598 / +5.2% 562112550 / 567681516 / -1.0% 0.64 / 0.60 / +6.3%
tpch_q08/datafusion:parquet 401801667 / 437492644 / -8.2% 500104997 / 571655983 / -12.5% 0.80 / 0.77 / +5.0%
tpch_q09/datafusion:parquet 419515710 / 464249383 / -9.6% 563969497 / 651677525 / -13.5% 0.74 / 0.71 / +4.4%
tpch_q10/datafusion:parquet 481166076 / 396483583 / +21.4% 554252345 / 476719968 / +16.3% 0.87 / 0.83 / +4.4%
tpch_q11/datafusion:parquet 259183210 / 265632271 / -2.4% 415292121 / 424188068 / -2.1% 0.62 / 0.63 / -0.3%
tpch_q12/datafusion:parquet 246391242 / 210642400 / +17.0% 428808159 / 433832375 / -1.2% 0.57 / 0.49 / +18.3%
tpch_q13/datafusion:parquet 397177592 / 400023980 / -0.7% 522415624 / 541257874 / -3.5% 0.76 / 0.74 / +2.9%
tpch_q14/datafusion:parquet 205039299 / 189075998 / +8.4% 432207534 / 319622140 / +35.2% 🔴 0.47 / 0.59 / -19.8%
tpch_q15/datafusion:parquet 379589448 / 465698774 / -18.5% 588110085 / 747353471 / -21.3% 0.65 / 0.62 / +3.6%
tpch_q16/datafusion:parquet 132958851 / 107605340 / +23.6% 292433888 / 293393967 / -0.3% 0.45 / 0.37 / +24.0%
tpch_q17/datafusion:parquet 312287105 / 266811912 / +17.0% 453796963 / 398471394 / +13.9% 0.69 / 0.67 / +2.8%
tpch_q18/datafusion:parquet 447478463 / 413161275 / +8.3% 583481351 / 539948126 / +8.1% 0.77 / 0.77 / +0.2%
tpch_q19/datafusion:parquet 160827404 / 155658183 / +3.3% 332123037 / 324845938 / +2.2% 0.48 / 0.48 / +1.1%
tpch_q20/datafusion:parquet 241078378 / 254924167 / -5.4% 390497615 / 468846542 / -16.7% 0.62 / 0.54 / +13.5%
tpch_q21/datafusion:parquet 776058820 / 345385213 / +124.7% 🔴 631712492 / 476616327 / +32.5% 🔴 1.23 / 0.72 / +69.5%
tpch_q22/datafusion:parquet 172653375 / 207356353 / -16.7% 322792992 / 351476201 / -8.2% 0.53 / 0.59 / -9.3%
duckdb / vortex-file-compressed / ns (0.971x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 199102618 / 201599013 / -1.2% 283158200 / 266065074 / +6.4% 0.70 / 0.76 / -7.2%
tpch_q02/duckdb:vortex-file-compressed 363285341 / 369779488 / -1.8% 364750677 / 395784417 / -7.8% 1.00 / 0.93 / +6.6%
tpch_q03/duckdb:vortex-file-compressed 423863929 / 422963821 / +0.2% 476911326 / 457998447 / +4.1% 0.89 / 0.92 / -3.8%
tpch_q04/duckdb:vortex-file-compressed 219352629 / 224821617 / -2.4% 252049042 / 283770269 / -11.2% 0.87 / 0.79 / +9.8%
tpch_q05/duckdb:vortex-file-compressed 394238126 / 391073137 / +0.8% 443637432 / 483779642 / -8.3% 0.89 / 0.81 / +9.9%
tpch_q06/duckdb:vortex-file-compressed 273714108 / 285122496 / -4.0% 253862923 / 312736297 / -18.8% 1.08 / 0.91 / +18.3%
tpch_q07/duckdb:vortex-file-compressed 437296801 / 486382036 / -10.1% 488217929 / 564058628 / -13.4% 0.90 / 0.86 / +3.9%
tpch_q08/duckdb:vortex-file-compressed 570481044 / 555322118 / +2.7% 601811453 / 583486996 / +3.1% 0.95 / 0.95 / -0.4%
tpch_q09/duckdb:vortex-file-compressed 481608609 / 481360609 / +0.1% 532724534 / 448096752 / +18.9% 0.90 / 1.07 / -15.8%
tpch_q10/duckdb:vortex-file-compressed 426875491 / 529984614 / -19.5% 450391587 / 537535501 / -16.2% 0.95 / 0.99 / -3.9%
tpch_q11/duckdb:vortex-file-compressed 134244925 / 139116295 / -3.5% 156794193 / 158660094 / -1.2% 0.86 / 0.88 / -2.4%
tpch_q12/duckdb:vortex-file-compressed 320085266 / 461977505 / -30.7% 🟢 267478273 / 471985284 / -43.3% 🟢 1.20 / 0.98 / +22.3%
tpch_q13/duckdb:vortex-file-compressed 353992497 / 315590842 / +12.2% 390548887 / 316148583 / +23.5% 0.91 / 1.00 / -9.2%
tpch_q14/duckdb:vortex-file-compressed 245493452 / 259423899 / -5.4% 280665052 / 333429353 / -15.8% 0.87 / 0.78 / +12.4%
tpch_q15/duckdb:vortex-file-compressed 135230284 / 142258120 / -4.9% 190253373 / 214777489 / -11.4% 0.71 / 0.66 / +7.3%
tpch_q16/duckdb:vortex-file-compressed 185988446 / 173960484 / +6.9% 195206097 / 200896647 / -2.8% 0.95 / 0.87 / +10.0%
tpch_q17/duckdb:vortex-file-compressed 372229351 / 356169226 / +4.5% 360521876 / 381118422 / -5.4% 1.03 / 0.93 / +10.5%
tpch_q18/duckdb:vortex-file-compressed 346635095 / 321072300 / +8.0% 330798155 / 357988691 / -7.6% 1.05 / 0.90 / +16.8%
tpch_q19/duckdb:vortex-file-compressed 307215573 / 339469411 / -9.5% 360143402 / 380337004 / -5.3% 0.85 / 0.89 / -4.4%
tpch_q20/duckdb:vortex-file-compressed 377763264 / 420168614 / -10.1% 401841460 / 429620434 / -6.5% 0.94 / 0.98 / -3.9%
tpch_q21/duckdb:vortex-file-compressed 554973651 / 580106684 / -4.3% 634853220 / 594241180 / +6.8% 0.87 / 0.98 / -10.5%
tpch_q22/duckdb:vortex-file-compressed 135671251 / 112056413 / +21.1% 132439213 / 131104245 / +1.0% 1.02 / 0.85 / +19.9%
duckdb / vortex-compact / ns (0.916x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 208967514 / 210233273 / -0.6% 239071844 / 233147647 / +2.5% 0.87 / 0.90 / -3.1%
tpch_q02/duckdb:vortex-compact 353117164 / 368468104 / -4.2% 345223746 / 398244015 / -13.3% 1.02 / 0.93 / +10.6%
tpch_q03/duckdb:vortex-compact 381123452 / 393799640 / -3.2% 484312477 / 452291753 / +7.1% 0.79 / 0.87 / -9.6%
tpch_q04/duckdb:vortex-compact 242853144 / 876087221 / -72.3% 🟢 236136412 / 285287379 / -17.2% 1.03 / 3.07 / -66.5%
tpch_q05/duckdb:vortex-compact 348325739 / 346070969 / +0.7% 399204766 / 405251730 / -1.5% 0.87 / 0.85 / +2.2%
tpch_q06/duckdb:vortex-compact 330559497 / 271462094 / +21.8% 264989214 / 412242974 / -35.7% 🟢 1.25 / 0.66 / +89.4%
tpch_q07/duckdb:vortex-compact 402867434 / 398278416 / +1.2% 462888767 / 406283707 / +13.9% 0.87 / 0.98 / -11.2%
tpch_q08/duckdb:vortex-compact 496864650 / 511935519 / -2.9% 539256470 / 547005037 / -1.4% 0.92 / 0.94 / -1.5%
tpch_q09/duckdb:vortex-compact 447729354 / 430704858 / +4.0% 413340940 / 452781743 / -8.7% 1.08 / 0.95 / +13.9%
tpch_q10/duckdb:vortex-compact 391413237 / 429689433 / -8.9% 422783016 / 405907369 / +4.2% 0.93 / 1.06 / -12.5%
tpch_q11/duckdb:vortex-compact 133753412 / 131688795 / +1.6% 216826143 / 170118913 / +27.5% 0.62 / 0.77 / -20.3%
tpch_q12/duckdb:vortex-compact 197879772 / 379597675 / -47.9% 🟢 195675578 / 447672565 / -56.3% 🟢 1.01 / 0.85 / +19.3%
tpch_q13/duckdb:vortex-compact 205623633 / 190550704 / +7.9% 222509493 / 240941808 / -7.7% 0.92 / 0.79 / +16.8%
tpch_q14/duckdb:vortex-compact 229220131 / 214356969 / +6.9% 303725655 / 247176106 / +22.9% 0.75 / 0.87 / -13.0%
tpch_q15/duckdb:vortex-compact 139818688 / 138056405 / +1.3% 179563119 / 159241428 / +12.8% 0.78 / 0.87 / -10.2%
tpch_q16/duckdb:vortex-compact 161905126 / 187720204 / -13.8% 203110071 / 217970730 / -6.8% 0.80 / 0.86 / -7.4%
tpch_q17/duckdb:vortex-compact 355735943 / 357885805 / -0.6% 361819772 / 381574028 / -5.2% 0.98 / 0.94 / +4.8%
tpch_q18/duckdb:vortex-compact 266562288 / 267104590 / -0.2% 283187121 / 294036972 / -3.7% 0.94 / 0.91 / +3.6%
tpch_q19/duckdb:vortex-compact 345081999 / 340389363 / +1.4% 373145314 / 364295777 / +2.4% 0.92 / 0.93 / -1.0%
tpch_q20/duckdb:vortex-compact 360091306 / 381532753 / -5.6% 393492672 / 384334482 / +2.4% 0.92 / 0.99 / -7.8%
tpch_q21/duckdb:vortex-compact 514796851 / 505671177 / +1.8% 578723956 / 571794650 / +1.2% 0.89 / 0.88 / +0.6%
tpch_q22/duckdb:vortex-compact 104621495 / 107166145 / -2.4% 117927227 / 138643413 / -14.9% 0.89 / 0.77 / +14.8%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 319298339 / 317531027 / +0.6% 300105680 / 448058769 / -33.0% 🟢 1.06 / 0.71 / +50.1%
tpch_q02/duckdb:parquet 644075059 / 672809495 / -4.3% 662065173 / 627987357 / +5.4% 0.97 / 1.07 / -9.2%
tpch_q03/duckdb:parquet 725652356 / 730266259 / -0.6% 769256927 / 886381656 / -13.2% 0.94 / 0.82 / +14.5%
tpch_q04/duckdb:parquet 451815158 / 489333053 / -7.7% 490542045 / 551961617 / -11.1% 0.92 / 0.89 / +3.9%
tpch_q05/duckdb:parquet 897279357 / 880258413 / +1.9% 902490217 / 1034217844 / -12.7% 0.99 / 0.85 / +16.8%
tpch_q06/duckdb:parquet 315161852 / 281375354 / +12.0% 281121989 / 270672124 / +3.9% 1.12 / 1.04 / +7.8%
tpch_q07/duckdb:parquet 815769341 / 854804223 / -4.6% 751310458 / 836329546 / -10.2% 1.09 / 1.02 / +6.2%
tpch_q08/duckdb:parquet 1020368710 / 1101422340 / -7.4% 1179262587 / 1051498443 / +12.2% 0.87 / 1.05 / -17.4%
tpch_q09/duckdb:parquet 977569210 / 946518058 / +3.3% 985643349 / 981845268 / +0.4% 0.99 / 0.96 / +2.9%
tpch_q10/duckdb:parquet 914084687 / 906624391 / +0.8% 971214728 / 996685116 / -2.6% 0.94 / 0.91 / +3.5%
tpch_q11/duckdb:parquet 421783734 / 425503456 / -0.9% 318900770 / 437002183 / -27.0% 1.32 / 0.97 / +35.8%
tpch_q12/duckdb:parquet 527429044 / 567363043 / -7.0% 692874819 / 539640312 / +28.4% 0.76 / 1.05 / -27.6%
tpch_q13/duckdb:parquet 757904432 / 766306297 / -1.1% 942698070 / 964604272 / -2.3% 0.80 / 0.79 / +1.2%
tpch_q14/duckdb:parquet 541613912 / 520443921 / +4.1% 637646295 / 500891593 / +27.3% 0.85 / 1.04 / -18.3%
tpch_q15/duckdb:parquet 370925275 / 371304170 / -0.1% 499881066 / 870511346 / -42.6% 🟢 0.74 / 0.43 / +74.0%
tpch_q16/duckdb:parquet 462590337 / 489787715 / -5.6% 431235324 / 488188217 / -11.7% 1.07 / 1.00 / +6.9%
tpch_q17/duckdb:parquet 462754803 / 449111914 / +3.0% 483003830 / 429035045 / +12.6% 0.96 / 1.05 / -8.5%
tpch_q18/duckdb:parquet 587419384 / 623466695 / -5.8% 620723143 / 593329835 / +4.6% 0.95 / 1.05 / -9.9%
tpch_q19/duckdb:parquet 583850259 / 525098180 / +11.2% 652882198 / 581003037 / +12.4% 0.89 / 0.90 / -1.1%
tpch_q20/duckdb:parquet 784641192 / 803527414 / -2.4% 795665926 / 757720192 / +5.0% 0.99 / 1.06 / -7.0%
tpch_q21/duckdb:parquet 678226634 / 649364511 / +4.4% 621931646 / 705417782 / -11.8% 1.09 / 0.92 / +18.5%
tpch_q22/duckdb:parquet 383619117 / 381752377 / +0.5% 389770677 / 410230424 / -5.0% 0.98 / 0.93 / +5.8%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -4.1%
Engines: DataFusion No clear signal (-3.5%, environment too noisy confidence) · DuckDB No clear signal (-4.6%, environment too noisy confidence)
Vortex (geomean): hot 0.991x ➖ · cold 0.914x ➖
Parquet (geomean): hot 1.033x ➖ · cold 0.966x ➖
Shifts: Parquet (control) +3.3% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.052x ➖, 1↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 341424690 / 338737876 / +0.8% 1052660725 / 1258533868 / -16.4% 0.32 / 0.27 / +20.5%
tpch_q02/datafusion:vortex-compact 579101102 / 563330797 / +2.8% 1218033033 / 1112558497 / +9.5% 0.48 / 0.51 / -6.1%
tpch_q03/datafusion:vortex-compact 560422618 / 463507590 / +20.9% 1408708942 / 1522170065 / -7.5% 0.40 / 0.30 / +30.6%
tpch_q04/datafusion:vortex-compact 597976628 / 210064512 / +184.7% 🔴 1012810243 / 608496930 / +66.4% 🔴 0.59 / 0.35 / +71.0%
tpch_q05/datafusion:vortex-compact 600946936 / 607585047 / -1.1% 776566636 / 695317897 / +11.7% 0.77 / 0.87 / -11.4%
tpch_q06/datafusion:vortex-compact 290764676 / 277774448 / +4.7% 548652034 / 459209512 / +19.5% 0.53 / 0.60 / -12.4%
tpch_q07/datafusion:vortex-compact 580606438 / 848776951 / -31.6% 🟢 652002506 / 1097017986 / -40.6% 🟢 0.89 / 0.77 / +15.1%
tpch_q08/datafusion:vortex-compact 871165608 / 849001543 / +2.6% 988669490 / 1044728868 / -5.4% 0.88 / 0.81 / +8.4%
tpch_q09/datafusion:vortex-compact 892941252 / 670415016 / +33.2% 🔴 1055078115 / 959929458 / +9.9% 0.85 / 0.70 / +21.2%
tpch_q10/datafusion:vortex-compact 660692892 / 539906153 / +22.4% 719542924 / 829001002 / -13.2% 0.92 / 0.65 / +41.0%
tpch_q11/datafusion:vortex-compact 326877064 / 372818878 / -12.3% 745105431 / 810442664 / -8.1% 0.44 / 0.46 / -4.6%
tpch_q12/datafusion:vortex-compact 428523418 / 543787598 / -21.2% 510188893 / 808547791 / -36.9% 🟢 0.84 / 0.67 / +24.9%
tpch_q13/datafusion:vortex-compact 306455144 / 222241517 / +37.9% 🔴 553354150 / 520203207 / +6.4% 0.55 / 0.43 / +29.6%
tpch_q14/datafusion:vortex-compact 395319943 / 360600333 / +9.6% 388151744 / 404781577 / -4.1% 1.02 / 0.89 / +14.3%
tpch_q15/datafusion:vortex-compact 679374992 / 697227400 / -2.6% 929403628 / 804880492 / +15.5% 0.73 / 0.87 / -15.6%
tpch_q16/datafusion:vortex-compact 252143747 / 243808329 / +3.4% 450076187 / 455019907 / -1.1% 0.56 / 0.54 / +4.6%
tpch_q17/datafusion:vortex-compact 761757717 / 766165822 / -0.6% 791765438 / 902159526 / -12.2% 0.96 / 0.85 / +13.3%
tpch_q18/datafusion:vortex-compact 547126274 / 618359197 / -11.5% 600793844 / 720101771 / -16.6% 0.91 / 0.86 / +6.1%
tpch_q19/datafusion:vortex-compact 435073395 / 604844322 / -28.1% 655888792 / 753552021 / -13.0% 0.66 / 0.80 / -17.4%
tpch_q20/datafusion:vortex-compact 579450569 / 605688577 / -4.3% 869427626 / 980418247 / -11.3% 0.67 / 0.62 / +7.9%
tpch_q21/datafusion:vortex-compact 692480829 / 885861259 / -21.8% 1190400188 / 1012502450 / +17.6% 0.58 / 0.87 / -33.5%
tpch_q22/datafusion:vortex-compact 445539911 / 310273980 / +43.6% 🔴 716854872 / 825727013 / -13.2% 0.62 / 0.38 / +65.4%
datafusion / parquet / ns (1.090x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 363622584 / 247942884 / +46.7% 🔴 825660578 / 829857234 / -0.5% 0.44 / 0.30 / +47.4%
tpch_q02/datafusion:parquet 598768515 / 504613773 / +18.7% 1069409478 / 1065397005 / +0.4% 0.56 / 0.47 / +18.2%
tpch_q03/datafusion:parquet 593027899 / 579520280 / +2.3% 1133319104 / 1202738583 / -5.8% 0.52 / 0.48 / +8.6%
tpch_q04/datafusion:parquet 382071634 / 380053602 / +0.5% 637833661 / 465281537 / +37.1% 🔴 0.60 / 0.82 / -26.7%
tpch_q05/datafusion:parquet 663211472 / 652549411 / +1.6% 881006909 / 968826713 / -9.1% 0.75 / 0.67 / +11.8%
tpch_q06/datafusion:parquet 188990782 / 210382632 / -10.2% 326914419 / 372861304 / -12.3% 0.58 / 0.56 / +2.5%
tpch_q07/datafusion:parquet 686437940 / 675659816 / +1.6% 855931886 / 883858018 / -3.2% 0.80 / 0.76 / +4.9%
tpch_q08/datafusion:parquet 1402327045 / 817607261 / +71.5% 🔴 1287460110 / 1122461485 / +14.7% 1.09 / 0.73 / +49.5%
tpch_q09/datafusion:parquet 1056301609 / 929825915 / +13.6% 1247083175 / 1153184652 / +8.1% 0.85 / 0.81 / +5.0%
tpch_q10/datafusion:parquet 1608627880 / 1650158241 / -2.5% 2313752126 / 2290444921 / +1.0% 0.70 / 0.72 / -3.5%
tpch_q11/datafusion:parquet 446346438 / 416643097 / +7.1% 591208598 / 532496465 / +11.0% 0.75 / 0.78 / -3.5%
tpch_q12/datafusion:parquet 568256368 / 435198011 / +30.6% 🔴 605547752 / 532712479 / +13.7% 0.94 / 0.82 / +14.9%
tpch_q13/datafusion:parquet 481801282 / 460880893 / +4.5% 830354806 / 932814280 / -11.0% 0.58 / 0.49 / +17.4%
tpch_q14/datafusion:parquet 418040351 / 449698964 / -7.0% 648372913 / 620439033 / +4.5% 0.64 / 0.72 / -11.0%
tpch_q15/datafusion:parquet 708710943 / 714361030 / -0.8% 741801916 / 869161405 / -14.7% 0.96 / 0.82 / +16.2%
tpch_q16/datafusion:parquet 316028185 / 284099908 / +11.2% 584994216 / 563882818 / +3.7% 0.54 / 0.50 / +7.2%
tpch_q17/datafusion:parquet 756754437 / 784648412 / -3.6% 833679802 / 1050300052 / -20.6% 0.91 / 0.75 / +21.5%
tpch_q18/datafusion:parquet 864678583 / 956486439 / -9.6% 999274840 / 1085727241 / -8.0% 0.87 / 0.88 / -1.8%
tpch_q19/datafusion:parquet 570802837 / 451632717 / +26.4% 777458183 / 652094507 / +19.2% 0.73 / 0.69 / +6.0%
tpch_q20/datafusion:parquet 962299659 / 760110349 / +26.6% 1222695472 / 1353004363 / -9.6% 0.79 / 0.56 / +40.1%
tpch_q21/datafusion:parquet 1223494161 / 1138736443 / +7.4% 1246543622 / 1189501343 / +4.8% 0.98 / 0.96 / +2.5%
tpch_q22/datafusion:parquet 593969469 / 629824435 / -5.7% 879635387 / 844235047 / +4.2% 0.68 / 0.75 / -9.5%
duckdb / vortex-compact / ns (0.934x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 853278490 / 907857313 / -6.0% 1071798308 / 1917574413 / -44.1% 🟢 0.80 / 0.47 / +68.2%
tpch_q02/duckdb:vortex-compact 532532562 / 572077111 / -6.9% 524292366 / 760286463 / -31.0% 🟢 1.02 / 0.75 / +35.0%
tpch_q03/duckdb:vortex-compact 1079203600 / 1010609214 / +6.8% 1110950414 / 1987794951 / -44.1% 🟢 0.97 / 0.51 / +91.1%
tpch_q04/duckdb:vortex-compact 670573603 / 650451383 / +3.1% 783730640 / 864653176 / -9.4% 0.86 / 0.75 / +13.7%
tpch_q05/duckdb:vortex-compact 1145835915 / 1375964449 / -16.7% 1127463434 / 1770797799 / -36.3% 🟢 1.02 / 0.78 / +30.8%
tpch_q06/duckdb:vortex-compact 1098819026 / 1062482131 / +3.4% 1080520103 / 1203642233 / -10.2% 1.02 / 0.88 / +15.2%
tpch_q07/duckdb:vortex-compact 1334453269 / 1550063377 / -13.9% 1578186923 / 1599398133 / -1.3% 0.85 / 0.97 / -12.8%
tpch_q08/duckdb:vortex-compact 1422845273 / 1264472827 / +12.5% 1645971363 / 1401086405 / +17.5% 0.86 / 0.90 / -4.2%
tpch_q09/duckdb:vortex-compact 1700478354 / 1663391511 / +2.2% 1994586816 / 1793564553 / +11.2% 0.85 / 0.93 / -8.1%
tpch_q10/duckdb:vortex-compact 1315712334 / 1357888106 / -3.1% 1447922939 / 1912717537 / -24.3% 0.91 / 0.71 / +28.0%
tpch_q11/duckdb:vortex-compact 423788297 / 455553947 / -7.0% 574884866 / 662246911 / -13.2% 0.74 / 0.69 / +7.2%
tpch_q12/duckdb:vortex-compact 800024949 / 2006109076 / -60.1% 🟢 951524707 / 2229409396 / -57.3% 🟢 0.84 / 0.90 / -6.6%
tpch_q13/duckdb:vortex-compact 1054750938 / 1056447344 / -0.2% 1530817103 / 1522756024 / +0.5% 0.69 / 0.69 / -0.7%
tpch_q14/duckdb:vortex-compact 754660511 / 761266869 / -0.9% 993943736 / 853969865 / +16.4% 0.76 / 0.89 / -14.8%
tpch_q15/duckdb:vortex-compact 819801419 / 889191697 / -7.8% 874027189 / 895386025 / -2.4% 0.94 / 0.99 / -5.6%
tpch_q16/duckdb:vortex-compact 219901399 / 230592140 / -4.6% 312533689 / 255960977 / +22.1% 0.70 / 0.90 / -21.9%
tpch_q17/duckdb:vortex-compact 1265251133 / 1280766934 / -1.2% 1257960455 / 1261194815 / -0.3% 1.01 / 1.02 / -1.0%
tpch_q18/duckdb:vortex-compact 1083633316 / 1191565563 / -9.1% 1328592054 / 1520006052 / -12.6% 0.82 / 0.78 / +4.0%
tpch_q19/duckdb:vortex-compact 1046067361 / 1041369511 / +0.5% 1210909981 / 1176746273 / +2.9% 0.86 / 0.88 / -2.4%
tpch_q20/duckdb:vortex-compact 1473084911 / 1854407792 / -20.6% 1769104595 / 1787905278 / -1.1% 0.83 / 1.04 / -19.7%
tpch_q21/duckdb:vortex-compact 2155691454 / 2188430105 / -1.5% 2191726576 / 2210474990 / -0.8% 0.98 / 0.99 / -0.7%
tpch_q22/duckdb:vortex-compact 333359820 / 273339337 / +22.0% 403879708 / 411465213 / -1.8% 0.83 / 0.66 / +24.2%
duckdb / parquet / ns (0.979x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 306122725 / 366408979 / -16.5% 358474685 / 566723336 / -36.7% 🟢 0.85 / 0.65 / +32.1%
tpch_q02/duckdb:parquet 703969910 / 733245033 / -4.0% 1180115637 / 1273718271 / -7.3% 0.60 / 0.58 / +3.6%
tpch_q03/duckdb:parquet 888960579 / 961101159 / -7.5% 1124355288 / 1724781009 / -34.8% 🟢 0.79 / 0.56 / +41.9%
tpch_q04/duckdb:parquet 521676250 / 550072017 / -5.2% 649583752 / 779346845 / -16.7% 0.80 / 0.71 / +13.8%
tpch_q05/duckdb:parquet 987637798 / 1071426549 / -7.8% 999187527 / 1253004957 / -20.3% 0.99 / 0.86 / +15.6%
tpch_q06/duckdb:parquet 342117150 / 383217991 / -10.7% 357394982 / 300555414 / +18.9% 0.96 / 1.28 / -24.9%
tpch_q07/duckdb:parquet 1054955062 / 1001950471 / +5.3% 838388233 / 1002393877 / -16.4% 1.26 / 1.00 / +25.9%
tpch_q08/duckdb:parquet 1162695104 / 1208834709 / -3.8% 1247072873 / 1319878928 / -5.5% 0.93 / 0.92 / +1.8%
tpch_q09/duckdb:parquet 1172690150 / 1085711605 / +8.0% 1281380631 / 1228740828 / +4.3% 0.92 / 0.88 / +3.6%
tpch_q10/duckdb:parquet 2205926396 / 2106194396 / +4.7% 2354780295 / 2442585578 / -3.6% 0.94 / 0.86 / +8.6%
tpch_q11/duckdb:parquet 478285146 / 453491764 / +5.5% 467007005 / 490737593 / -4.8% 1.02 / 0.92 / +10.8%
tpch_q12/duckdb:parquet 619457255 / 571321652 / +8.4% 826723741 / 850799333 / -2.8% 0.75 / 0.67 / +11.6%
tpch_q13/duckdb:parquet 874832324 / 892335629 / -2.0% 1224312278 / 1082600866 / +13.1% 0.71 / 0.82 / -13.3%
tpch_q14/duckdb:parquet 582318082 / 690245730 / -15.6% 565986772 / 740695172 / -23.6% 1.03 / 0.93 / +10.4%
tpch_q15/duckdb:parquet 540147061 / 408520089 / +32.2% 🔴 471370414 / 547395686 / -13.9% 1.15 / 0.75 / +53.5%
tpch_q16/duckdb:parquet 576399421 / 597362057 / -3.5% 713789446 / 686244150 / +4.0% 0.81 / 0.87 / -7.2%
tpch_q17/duckdb:parquet 556809972 / 653759164 / -14.8% 789853577 / 579471330 / +36.3% 🔴 0.70 / 1.13 / -37.5%
tpch_q18/duckdb:parquet 795861749 / 723726505 / +10.0% 834035201 / 1052440790 / -20.8% 0.95 / 0.69 / +38.8%
tpch_q19/duckdb:parquet 700239011 / 706412383 / -0.9% 750583779 / 820277886 / -8.5% 0.93 / 0.86 / +8.3%
tpch_q20/duckdb:parquet 1033332525 / 1169184056 / -11.6% 1225441823 / 1066806690 / +14.9% 0.84 / 1.10 / -23.1%
tpch_q21/duckdb:parquet 905784433 / 890363675 / +1.7% 1008367185 / 981294331 / +2.8% 0.90 / 0.91 / -1.0%
tpch_q22/duckdb:parquet 744119588 / 789042149 / -5.7% 844042791 / 882398198 / -4.3% 0.88 / 0.89 / -1.4%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 21050aa4 vs base 64654627


vortex / vortex-file-compressed / ns (0.984x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
compress time/Arade 851949778 / 889596596 / -4.2%
compress time/Bimbo 3899322794 / 3981256579 / -2.1%
compress time/CMSprovider 2885702573 / 3043408117 / -5.2%
compress time/Euro2016 307446470 / 319050483 / -3.6%
compress time/Food 305712409 / 314777398 / -2.9%
compress time/HashTags 555475336 / 567249298 / -2.1%
compress time/TPC-H l_comment canonical 773643117 / 787245680 / -1.7%
compress time/TPC-H l_comment chunked 783569080 / 786942554 / -0.4%
compress time/taxi 423406134 / 436587888 / -3.0%
compress time/wide table cols=100 chunks=1 rows=1000 7395586 / 7255687 / +1.9%
compress time/wide table cols=100 chunks=50 rows=1000 7416113 / 7342022 / +1.0%
compress time/wide table cols=1000 chunks=1 rows=1000 72281402 / 70327749 / +2.8%
compress time/wide table cols=1000 chunks=50 rows=1000 71836240 / 72138312 / -0.4%
compress time/wide table cols=10000 chunks=1 rows=1000 788651092 / 785543336 / +0.4%
compress time/wide table cols=10000 chunks=50 rows=1000 789844092 / 785401455 / +0.6%
decompress time/Arade 9237337 / 9479600 / -2.6%
decompress time/Bimbo 62918790 / 62801156 / +0.2%
decompress time/CMSprovider 26633274 / 27059551 / -1.6%
decompress time/Euro2016 7217908 / 7433908 / -2.9%
decompress time/Food 2991317 / 3073126 / -2.7%
decompress time/HashTags 58892785 / 59887685 / -1.7%
decompress time/TPC-H l_comment canonical 20570394 / 21793890 / -5.6%
decompress time/TPC-H l_comment chunked 20743183 / 21391010 / -3.0%
decompress time/taxi 8563584 / 8719432 / -1.8%
decompress time/wide table cols=100 chunks=1 rows=1000 2017160 / 2071846 / -2.6%
decompress time/wide table cols=100 chunks=50 rows=1000 2041111 / 2044547 / -0.2%
decompress time/wide table cols=1000 chunks=1 rows=1000 19673942 / 20073846 / -2.0%
decompress time/wide table cols=1000 chunks=50 rows=1000 19682987 / 19837126 / -0.8%
decompress time/wide table cols=10000 chunks=1 rows=1000 228306735 / 232264938 / -1.7%
decompress time/wide table cols=10000 chunks=50 rows=1000 228131020 / 229724150 / -0.7%
vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/Arade 142210524 / 142210524 / +0.0%
vortex-file-compressed size/Bimbo 458475220 / 458475220 / +0.0%
vortex-file-compressed size/CMSprovider 420650636 / 420650636 / +0.0%
vortex-file-compressed size/Euro2016 164038260 / 164038260 / +0.0%
vortex-file-compressed size/Food 38946488 / 38946488 / +0.0%
vortex-file-compressed size/HashTags 190336420 / 190336420 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical 179845160 / 179845160 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked 179845160 / 179845160 / +0.0%
vortex-file-compressed size/taxi 50116916 / 50116916 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 932480 / 932480 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9309680 / 9309680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93117680 / 93117680 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93117680 / 93117680 / +0.0%
vortex / vortex-file-compressed / ratio (0.990x ➖, 0↑ 0↓)
name ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade 0.378362591 / 0.39531503 / -4.3%
vortex:parquet-zstd ratio compress time/Bimbo 0.330625252 / 0.336728325 / -1.8%
vortex:parquet-zstd ratio compress time/CMSprovider 0.452295168 / 0.476562481 / -5.1%
vortex:parquet-zstd ratio compress time/Euro2016 0.285124399 / 0.295671418 / -3.6%
vortex:parquet-zstd ratio compress time/Food 0.413567507 / 0.425964854 / -2.9%
vortex:parquet-zstd ratio compress time/HashTags 0.304600963 / 0.310016934 / -1.7%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0.294400055 / 0.298643969 / -1.4%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0.296563838 / 0.298766115 / -0.7%
vortex:parquet-zstd ratio compress time/taxi 0.387374116 / 0.400985767 / -3.4%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1.86208893 / 1.81866027 / +2.4%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1.86759022 / 1.86355574 / +0.2%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1.613423 / 1.57369745 / +2.5%
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1.60531089 / 1.58642199 / +1.2%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1.70887148 / 1.7174817 / -0.5%
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1.71846501 / 1.69809516 / +1.2%
vortex:parquet-zstd ratio decompress time/Arade 0.0165501938 / 0.0170030405 / -2.7%
vortex:parquet-zstd ratio decompress time/Bimbo 0.0392028351 / 0.0391283898 / +0.2%
vortex:parquet-zstd ratio decompress time/CMSprovider 0.0195499411 / 0.0198455927 / -1.5%
vortex:parquet-zstd ratio decompress time/Euro2016 0.0216295347 / 0.0222852317 / -2.9%
vortex:parquet-zstd ratio decompress time/Food 0.0174779194 / 0.0180832727 / -3.3%
vortex:parquet-zstd ratio decompress time/HashTags 0.114012519 / 0.115819916 / -1.6%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0.0413155734 / 0.0438000172 / -5.7%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0.0416409517 / 0.0428898607 / -2.9%
vortex:parquet-zstd ratio decompress time/taxi 0.0392778466 / 0.0400762427 / -2.0%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0.977622129 / 0.991497469 / -1.4%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0.995695473 / 1.00531929 / -1.0%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0.82463848 / 0.846951193 / -2.6%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0.835185356 / 0.816677942 / +2.3%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0.937584127 / 0.948174038 / -1.1%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0.916011508 / 0.922814612 / -0.7%
vortex:parquet-zstd size/Arade 0.55117307 / 0.55117307 / -0.0%
vortex:parquet-zstd size/Bimbo 1.19233967 / 1.19233967 / -0.0%
vortex:parquet-zstd size/CMSprovider 1.11611602 / 1.11611602 / -0.0%
vortex:parquet-zstd size/Euro2016 1.33387159 / 1.33387159 / -0.0%
vortex:parquet-zstd size/Food 1.09095332 / 1.09095332 / +0.0%
vortex:parquet-zstd size/HashTags 1.42576671 / 1.42576671 / +0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical 1.13568553 / 1.13568553 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked 1.13568553 / 1.13568553 / -0.0%
vortex:parquet-zstd size/taxi 0.906541619 / 0.906541619 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 1.00008151 / 1.00008151 / +0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0.99846375 / 0.99846375 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0.998688074 / 0.998688074 / -0.0%
vortex / parquet / ns (0.999x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade 2251675507 / 2250348527 / +0.1%
parquet_rs-zstd compress time/Bimbo 11793783966 / 11823349211 / -0.3%
parquet_rs-zstd compress time/CMSprovider 6380131331 / 6386168101 / -0.1%
parquet_rs-zstd compress time/Euro2016 1078288885 / 1079071101 / -0.1%
parquet_rs-zstd compress time/Food 739207998 / 738975047 / +0.0%
parquet_rs-zstd compress time/HashTags 1823616480 / 1829736497 / -0.3%
parquet_rs-zstd compress time/TPC-H l_comment canonical 2627863357 / 2636067565 / -0.3%
parquet_rs-zstd compress time/TPC-H l_comment chunked 2642159899 / 2633975259 / +0.3%
parquet_rs-zstd compress time/taxi 1093016070 / 1088786495 / +0.4%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 3971661 / 3989578 / -0.4%
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 3970953 / 3939792 / +0.8%
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 44800032 / 44689498 / +0.2%
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 44749114 / 45472335 / -1.6%
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 461504041 / 457380906 / +0.9%
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 459621864 / 462519107 / -0.6%
parquet_rs-zstd decompress time/Arade 558140716 / 557523813 / +0.1%
parquet_rs-zstd decompress time/Bimbo 1604955097 / 1605002310 / -0.0%
parquet_rs-zstd decompress time/CMSprovider 1362319911 / 1363504301 / -0.1%
parquet_rs-zstd decompress time/Euro2016 333706115 / 333580019 / +0.0%
parquet_rs-zstd decompress time/Food 171148346 / 169943021 / +0.7%
parquet_rs-zstd decompress time/HashTags 516546650 / 517075879 / -0.1%
parquet_rs-zstd decompress time/TPC-H l_comment canonical 497884752 / 497577202 / +0.1%
parquet_rs-zstd decompress time/TPC-H l_comment chunked 498143826 / 498742818 / -0.1%
parquet_rs-zstd decompress time/taxi 218025802 / 217571095 / +0.2%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2063333 / 2089613 / -1.3%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2049935 / 2033729 / +0.8%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 23857657 / 23701302 / +0.7%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 23567208 / 24290023 / -3.0%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 243505333 / 244960238 / -0.6%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 249048203 / 248938570 / +0.0%
vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/Arade 258014282 / 258014282 / +0.0%
parquet size/Bimbo 384517292 / 384517292 / +0.0%
parquet size/CMSprovider 376887911 / 376887911 / +0.0%
parquet size/Euro2016 122979049 / 122979049 / +0.0%
parquet size/Food 35699500 / 35699500 / +0.0%
parquet size/HashTags 133497590 / 133497590 / +0.0%
parquet size/TPC-H l_comment canonical 158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked 158358238 / 158358238 / +0.0%
parquet size/taxi 55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / 93240004 / +0.0%
vortex / arrow-ipc / ns (0.999x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
arrow-ipc compress time/Arade 99254607 / 100358644 / -1.1%
arrow-ipc compress time/Bimbo 619408493 / 636006746 / -2.6%
arrow-ipc compress time/CMSprovider 382997641 / 385820016 / -0.7%
arrow-ipc compress time/Euro2016 38534895 / 38696020 / -0.4%
arrow-ipc compress time/Food 34056494 / 34160428 / -0.3%
arrow-ipc compress time/HashTags 79094454 / 79364202 / -0.3%
arrow-ipc compress time/TPC-H l_comment canonical 495858226 / 501024295 / -1.0%
arrow-ipc compress time/TPC-H l_comment chunked 501146133 / 506218345 / -1.0%
arrow-ipc compress time/taxi 75060495 / 75763442 / -0.9%
arrow-ipc compress time/wide table cols=100 chunks=1 rows=1000 202233 / 210131 / -3.8%
arrow-ipc compress time/wide table cols=100 chunks=50 rows=1000 205053 / 204722 / +0.2%
arrow-ipc compress time/wide table cols=1000 chunks=1 rows=1000 2280293 / 2278809 / +0.1%
arrow-ipc compress time/wide table cols=1000 chunks=50 rows=1000 2205249 / 2253259 / -2.1%
arrow-ipc compress time/wide table cols=10000 chunks=1 rows=1000 25356318 / 25718923 / -1.4%
arrow-ipc compress time/wide table cols=10000 chunks=50 rows=1000 25707507 / 25756510 / -0.2%
arrow-ipc decompress time/Arade 140863413 / 140908123 / -0.0%
arrow-ipc decompress time/Bimbo 409750479 / 418397590 / -2.1%
arrow-ipc decompress time/CMSprovider 580110781 / 582602937 / -0.4%
arrow-ipc decompress time/Euro2016 63869337 / 63849044 / +0.0%
arrow-ipc decompress time/Food 48776324 / 48935173 / -0.3%
arrow-ipc decompress time/HashTags 121302883 / 119840676 / +1.2%
arrow-ipc decompress time/TPC-H l_comment canonical 530586297 / 533987074 / -0.6%
arrow-ipc decompress time/TPC-H l_comment chunked 530740411 / 534523309 / -0.7%
arrow-ipc decompress time/taxi 45446107 / 45391425 / +0.1%
arrow-ipc decompress time/wide table cols=100 chunks=1 rows=1000 318699 / 320261 / -0.5%
arrow-ipc decompress time/wide table cols=100 chunks=50 rows=1000 318094 / 320309 / -0.7%
arrow-ipc decompress time/wide table cols=1000 chunks=1 rows=1000 3635487 / 3459339 / +5.1%
arrow-ipc decompress time/wide table cols=1000 chunks=50 rows=1000 3492897 / 3447765 / +1.3%
arrow-ipc decompress time/wide table cols=10000 chunks=1 rows=1000 36629182 / 35186897 / +4.1%
arrow-ipc decompress time/wide table cols=10000 chunks=50 rows=1000 36842206 / 34849878 / +5.7%
vortex / arrow-ipc / bytes (1.000x ➖, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/Arade 691765162 / 691765162 / +0.0%
arrow-ipc size/Bimbo 3279590114 / 3279590114 / +0.0%
arrow-ipc size/CMSprovider 2422259682 / 2422259682 / +0.0%
arrow-ipc size/Euro2016 360582666 / 360582666 / +0.0%
arrow-ipc size/Food 255782338 / 255782338 / +0.0%
arrow-ipc size/HashTags 704785810 / 704785810 / +0.0%
arrow-ipc size/TPC-H l_comment canonical 4852929378 / 4852929378 / +0.0%
arrow-ipc size/TPC-H l_comment chunked 4852929378 / 4852929378 / +0.0%
arrow-ipc size/taxi 482329690 / 482329690 / +0.0%
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1257290 / 1257290 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12568506 / 12568506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 125752506 / 125752506 / +0.0%
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 125752506 / 125752506 / +0.0%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access 📖

Commits: PR 21050aa4 vs base 64654627
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.4%
Engines: random-access No clear signal (+3.4%, low confidence)
Vortex (geomean): hot 1.000x ➖
Parquet (geomean): hot 0.967x ➖
Shifts: Parquet (control) -3.3% · Median polish -1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

vortex / arrow-ipc / ns (0.908x ➖, 3↑ 0↓)
name ns (PR / base / %diff)
random-access/arrow-tokio-local-disk 69690 / 71505 / -2.5%
random-access/arrow-tokio-local-disk-footer 163600 / 170755 / -4.2%
random-access/feature-vectors/correlated/arrow-tokio-local-disk 1335966 / 2436106 / -45.2% 🟢
random-access/feature-vectors/correlated/arrow-tokio-local-disk-footer 2091418 / 3497389 / -40.2% 🟢
random-access/feature-vectors/uniform/arrow-tokio-local-disk 32284369 / 32402123 / -0.4%
random-access/feature-vectors/uniform/arrow-tokio-local-disk-footer 31735171 / 32787299 / -3.2%
random-access/nested-lists/correlated/arrow-tokio-local-disk 58325 / 62913 / -7.3%
random-access/nested-lists/correlated/arrow-tokio-local-disk-footer 101768 / 110210 / -7.7%
random-access/nested-lists/uniform/arrow-tokio-local-disk 1178675 / 1155356 / +2.0%
random-access/nested-lists/uniform/arrow-tokio-local-disk-footer 1157181 / 1203745 / -3.9%
random-access/nested-structs/correlated/arrow-tokio-local-disk 51642 / 57849 / -10.7% 🟢
random-access/nested-structs/correlated/arrow-tokio-local-disk-footer 91216 / 99337 / -8.2%
random-access/nested-structs/uniform/arrow-tokio-local-disk 902205 / 996830 / -9.5%
random-access/nested-structs/uniform/arrow-tokio-local-disk-footer 978775 / 1025637 / -4.6%
random-access/taxi/correlated/arrow-tokio-local-disk 118663 / 123364 / -3.8%
random-access/taxi/correlated/arrow-tokio-local-disk-footer 219161 / 224648 / -2.4%
random-access/taxi/uniform/arrow-tokio-local-disk 2871583 / 2698088 / +6.4%
random-access/taxi/uniform/arrow-tokio-local-disk-footer 2982682 / 2962638 / +0.7%
random-access / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk 244430 / 245525 / -0.4%
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 1223472 / 1248494 / -2.0%
random-access/feature-vectors/uniform/vortex-tokio-local-disk 1471969 / 1457031 / +1.0%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 2708404 / 2691999 / +0.6%
random-access/nested-lists/correlated/vortex-tokio-local-disk 207531 / 217592 / -4.6%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 355210 / 370218 / -4.1%
random-access/nested-lists/uniform/vortex-tokio-local-disk 728482 / 708619 / +2.8%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 950682 / 934608 / +1.7%
random-access/nested-structs/correlated/vortex-tokio-local-disk 274835 / 257858 / +6.6%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 518654 / 536295 / -3.3%
random-access/nested-structs/uniform/vortex-tokio-local-disk 645882 / 639750 / +1.0%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 976231 / 938029 / +4.1%
random-access/taxi/correlated/vortex-tokio-local-disk 671981 / 686835 / -2.2%
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1468099 / 1467498 / +0.0%
random-access/taxi/uniform/vortex-tokio-local-disk 2620211 / 2605801 / +0.6%
random-access/taxi/uniform/vortex-tokio-local-disk-footer 3857268 / 3826862 / +0.8%
random-access/vortex-tokio-local-disk 447497 / 454468 / -1.5%
random-access/vortex-tokio-local-disk-footer 1088232 / 1090362 / -0.2%
random-access / parquet / ns (0.967x ➖, 1↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk 103594508750 / 103932127141 / -0.3%
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 104306835272 / 109717273924 / -4.9%
random-access/feature-vectors/uniform/parquet-tokio-local-disk 103974075231 / 109009604148 / -4.6%
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 104418204196 / 109409744099 / -4.6%
random-access/nested-lists/correlated/parquet-tokio-local-disk 129485428 / 131012095 / -1.2%
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 129600692 / 130902992 / -1.0%
random-access/nested-lists/uniform/parquet-tokio-local-disk 129071810 / 133294567 / -3.2%
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 129004382 / 133620563 / -3.5%
random-access/nested-structs/correlated/parquet-tokio-local-disk 7418926 / 7998946 / -7.3%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 7453386 / 7489611 / -0.5%
random-access/nested-structs/uniform/parquet-tokio-local-disk 7259466 / 8106208 / -10.4% 🟢
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 7570383 / 7727684 / -2.0%
random-access/parquet-tokio-local-disk 118094251 / 121140953 / -2.5%
random-access/parquet-tokio-local-disk-footer 118266857 / 121773342 / -2.9%
random-access/taxi/correlated/parquet-tokio-local-disk 177179378 / 182315391 / -2.8%
random-access/taxi/correlated/parquet-tokio-local-disk-footer 177327624 / 182411641 / -2.8%
random-access/taxi/uniform/parquet-tokio-local-disk 187633403 / 192764608 / -2.7%
random-access/taxi/uniform/parquet-tokio-local-disk-footer 187350140 / 190786359 / -1.8%
random-access / lance / ns (0.986x ➖, 0↑ 0↓)
name ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk 285595 / 285078 / +0.2%
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1222467 / 1276853 / -4.3%
random-access/feature-vectors/uniform/lance-tokio-local-disk 1030055 / 1043807 / -1.3%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1992707 / 2026993 / -1.7%
random-access/lance-tokio-local-disk 525919 / 523107 / +0.5%
random-access/lance-tokio-local-disk-footer 1413588 / 1420702 / -0.5%
random-access/nested-lists/correlated/lance-tokio-local-disk 154581 / 157870 / -2.1%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 703259 / 717762 / -2.0%
random-access/nested-lists/uniform/lance-tokio-local-disk 878207 / 881936 / -0.4%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1394430 / 1448461 / -3.7%
random-access/nested-structs/correlated/lance-tokio-local-disk 271123 / 275493 / -1.6%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 638041 / 651971 / -2.1%
random-access/nested-structs/uniform/lance-tokio-local-disk 2310059 / 2330148 / -0.9%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2765967 / 2722765 / +1.6%
random-access/taxi/correlated/lance-tokio-local-disk 744301 / 752736 / -1.1%
random-access/taxi/correlated/lance-tokio-local-disk-footer 1943665 / 1985041 / -2.1%
random-access/taxi/uniform/lance-tokio-local-disk 8027434 / 8194868 / -2.0%
random-access/taxi/uniform/lance-tokio-local-disk-footer 9183566 / 9269580 / -0.9%

CI's fmt job rejected the `assert_grouped` call in
`disjoint_fields_are_never_grouped`. Reformatted with
nightly-2026-09-10, the toolchain pinned as NIGHTLY_TOOLCHAIN in
.github/workflows/ci.yml.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01HVk8ebAE2G3oJgMe1UaSfq
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs
joseph-isaacs force-pushed the claude/conjunct-grouping-scan-builder-8sjfly branch from 38f66b6 to d641b86 Compare September 15, 2026 08:36
Brings in the rustls 0.23.45 bump from lock file maintenance (#9858), which
clears RUSTSEC-2026-0285 on the advisories check.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01HVk8ebAE2G3oJgMe1UaSfq
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant