Skip to content

perf: align buffer to Alignment::DEFAULT_ALIGNMENT = = Alignment::new(256)#8490

Open
joseph-isaacs wants to merge 10 commits into
developfrom
ji/over-align-buffer-default
Open

perf: align buffer to Alignment::DEFAULT_ALIGNMENT = = Alignment::new(256)#8490
joseph-isaacs wants to merge 10 commits into
developfrom
ji/over-align-buffer-default

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Default alignment of new buffer to 256

@joseph-isaacs joseph-isaacs requested a review from AdamGS June 18, 2026 10:47
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Jun 18, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 18, 2026
@joseph-isaacs joseph-isaacs marked this pull request as ready for review June 18, 2026 10:48
@joseph-isaacs joseph-isaacs requested a review from a team June 18, 2026 10:48
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Jun 18, 2026
@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 9b72179 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 070c3cd 1 Explore Profiling Data
🟢 Done 794fc4c 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.065x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (1.088x ➖, 3↑ 63↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
compress time/Arade 1208899321 1102805679 1.10
compress time/Bimbo 🚨 6251643076 5594811999 1.12
compress time/CMSprovider 🚨 3151443611 2780641365 1.13
compress time/Euro2016 🚨 540791508 476930955 1.13
compress time/Food 🚨 459663471 382622039 1.20
compress time/HashTags 🚨 996871393 870103942 1.15
compress time/TPC-H l_comment canonical 🚨 1339042788 1211147235 1.11
compress time/TPC-H l_comment chunked 🚨 1354431471 1214778046 1.11
compress time/taxi 725767966 664979913 1.09
compress time/wide table cols=100 chunks=1 rows=1000 🚨 15216761 12473680 1.22
compress time/wide table cols=100 chunks=50 rows=1000 🚨 14592406 11461652 1.27
compress time/wide table cols=1000 chunks=1 rows=1000 🚨 153809367 132347875 1.16
compress time/wide table cols=1000 chunks=50 rows=1000 🚨 169170008 130961439 1.29
compress time/wide table cols=10000 chunks=1 rows=1000 🚨 1784581513 1516958114 1.18
compress time/wide table cols=10000 chunks=50 rows=1000 🚨 1817099135 1511194790 1.20
decompress time/Arade 🚨 34543210 26374825 1.31
decompress time/Bimbo 🚨 102360286 81287971 1.26
decompress time/CMSprovider 🚨 101904402 76985391 1.32
decompress time/Euro2016 🚨 23321675 19151254 1.22
decompress time/Food 🚨 10283383 8218812 1.25
decompress time/HashTags 🚨 112151384 93169391 1.20
decompress time/TPC-H l_comment canonical 🚨 49917104 42268366 1.18
decompress time/TPC-H l_comment chunked 🚨 50596240 40978865 1.23
decompress time/taxi 🚨 18680419 15142509 1.23
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 2752073 2216582 1.24
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3308821 2506657 1.32
decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 25020802 21096127 1.19
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 27366612 22222122 1.23
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 330002190 245213678 1.35
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 308066384 237674015 1.30
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 🚨 3030700757 2641749389 1.15
parquet_rs-zstd compress time/Bimbo 🚨 14460884966 12629594281 1.14
parquet_rs-zstd compress time/CMSprovider 🚨 8498041956 6964556315 1.22
parquet_rs-zstd compress time/Euro2016 🚨 1526769337 1331801883 1.15
parquet_rs-zstd compress time/Food 🚨 896246375 798766096 1.12
parquet_rs-zstd compress time/HashTags 🚨 2671561622 2197788909 1.22
parquet_rs-zstd compress time/TPC-H l_comment canonical 🚨 3616039235 3210142556 1.13
parquet_rs-zstd compress time/TPC-H l_comment chunked 🚨 3640942520 3205953070 1.14
parquet_rs-zstd compress time/taxi 🚨 1364906864 1199031530 1.14
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 9184888 6071225 1.51
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 9367373 6100968 1.54
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 🚨 89184574 74649030 1.19
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 🚨 90222330 75138362 1.20
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 🚨 890421441 788868271 1.13
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 🚨 915978940 786229750 1.17
parquet_rs-zstd decompress time/Arade 🚨 682794911 618312327 1.10
parquet_rs-zstd decompress time/Bimbo 1807524092 1696437610 1.07
parquet_rs-zstd decompress time/CMSprovider 🚨 2135611904 1707382514 1.25
parquet_rs-zstd decompress time/Euro2016 🚨 439062711 378739890 1.16
parquet_rs-zstd decompress time/Food 🚨 231539607 196366296 1.18
parquet_rs-zstd decompress time/HashTags 🚨 857684846 640100747 1.34
parquet_rs-zstd decompress time/TPC-H l_comment canonical 🚨 679572321 594177235 1.14
parquet_rs-zstd decompress time/TPC-H l_comment chunked 🚨 659780803 590937021 1.12
parquet_rs-zstd decompress time/taxi 🚨 270121235 245562159 1.10
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 🚨 3839149 2803078 1.37
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3940835 2804829 1.41
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 37584427 32118707 1.17
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 39538492 32971309 1.20
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 395443713 346772152 1.14
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 392964365 349150352 1.13
vortex-file-compressed size/Arade 145359060 145359060 1.00
vortex-file-compressed size/Bimbo 467259636 467259636 1.00
vortex-file-compressed size/CMSprovider 417786676 417783476 1.00
vortex-file-compressed size/Euro2016 157185948 156897132 1.00
vortex-file-compressed size/Food 41977344 41977344 1.00
vortex-file-compressed size/HashTags 184524484 184569972 1.00
vortex-file-compressed size/TPC-H l_comment canonical 172197384 171719040 1.00
vortex-file-compressed size/TPC-H l_comment chunked 172069336 172093808 1.00
vortex-file-compressed size/taxi 52299180 52299180 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930912 930912 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293712 9293712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957712 92957712 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957712 92957712 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.96
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.98
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.93
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio compress time/Food 0 0 1.07
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.94
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.98
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio compress time/taxi 0 0 0.96
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 2 0.81
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 🚀 1 1 0.83
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.08
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 2 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.03
vortex:parquet-zstd ratio decompress time/Arade 🚨 0 0 1.19
vortex:parquet-zstd ratio decompress time/Bimbo 🚨 0 0 1.18
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.06
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.05
vortex:parquet-zstd ratio decompress time/Food 0 0 1.06
vortex:parquet-zstd ratio decompress time/HashTags 🚀 0 0 0.90
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.03
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/taxi 🚨 0 0 1.12
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.91
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.94
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.03
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.18
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 0 0 1.15
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@codspeed-hq

codspeed-hq Bot commented Jun 18, 2026

Copy link
Copy Markdown

Merging this PR will not alter performance

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 14 improved benchmarks
❌ 3 regressed benchmarks
✅ 1564 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation varbinview_large 130.8 µs 393.6 µs -66.76%
Simulation from_iter_bit_buffer[128] 4.4 µs 5.1 µs -14.1%
Simulation chunked_varbinview_canonical_into[(100, 100)] 223.8 µs 259.6 µs -13.78%
Simulation runend_compress_u32 4.8 ms 3.8 ms +24.28%
Simulation chunked_bool_canonical_into[(1000, 10)] 33 µs 26.9 µs +22.64%
Simulation chunked_varbinview_opt_canonical_into[(1000, 10)] 206.7 µs 170.8 µs +21.02%
Simulation chunked_varbinview_opt_into_canonical[(1000, 10)] 220.4 µs 183.7 µs +20%
Simulation bitwise_not_vortex_buffer_mut[2048] 427.8 ns 369.4 ns +15.79%
Simulation bitwise_not_vortex_buffer_mut[128] 244.4 ns 215.3 ns +13.55%
Simulation map_each[BufferMut<i32>, 128] 495.3 ns 436.9 ns +13.35%
Simulation bitwise_not_vortex_buffer_mut[1024] 304.7 ns 275.6 ns +10.58%
Simulation encode_varbin[(1000, 512)] 220.3 µs 199.5 µs +10.43%
Simulation slice_vortex_buffer[1024] 929.7 ns 842.2 ns +10.39%
Simulation slice_vortex_buffer[16384] 929.7 ns 842.2 ns +10.39%
Simulation slice_vortex_buffer[2048] 929.7 ns 842.2 ns +10.39%
Simulation slice_vortex_buffer[128] 929.7 ns 842.2 ns +10.39%
Simulation slice_vortex_buffer[65536] 929.7 ns 842.2 ns +10.39%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/over-align-buffer-default (bfc91e8) with develop (02e085f)

Open in CodSpeed

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.4%, low confidence)
Vortex (geomean): 0.985x ➖
Parquet (geomean): 0.985x ➖
Shifts: Parquet (control) -1.5% · Median polish -1.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
appian_q01/datafusion:vortex-file-compressed 125739005 132263562 0.95
appian_q02/datafusion:vortex-file-compressed 591350668 599789730 0.99
appian_q03/datafusion:vortex-file-compressed 333512761 347725772 0.96
appian_q04/datafusion:vortex-file-compressed 44479654224 43063522551 1.03
appian_q05/datafusion:vortex-file-compressed 246818778 253968527 0.97
appian_q06/datafusion:vortex-file-compressed 333180970 335950570 0.99
appian_q07/datafusion:vortex-file-compressed 422360934 419859406 1.01
appian_q08/datafusion:vortex-file-compressed 1936623857 1956292666 0.99
datafusion / parquet (0.983x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
appian_q01/datafusion:parquet 127595252 134379472 0.95
appian_q02/datafusion:parquet 600234311 620532250 0.97
appian_q03/datafusion:parquet 334913138 342221687 0.98
appian_q04/datafusion:parquet 44475811526 43198612929 1.03
appian_q05/datafusion:parquet 277764515 284470823 0.98
appian_q06/datafusion:parquet 351703465 359354462 0.98
appian_q07/datafusion:parquet 451071315 447823531 1.01
appian_q08/datafusion:parquet 1926963749 1965788830 0.98
duckdb / vortex-file-compressed (0.984x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
appian_q01/duckdb:vortex-file-compressed 192830901 197501935 0.98
appian_q02/duckdb:vortex-file-compressed 629144296 635761416 0.99
appian_q03/duckdb:vortex-file-compressed 259159766 267212462 0.97
appian_q04/duckdb:vortex-file-compressed 1316197513 1338346958 0.98
appian_q05/duckdb:vortex-file-compressed 298908577 295396078 1.01
appian_q06/duckdb:vortex-file-compressed 801534877 805740557 0.99
appian_q07/duckdb:vortex-file-compressed 342398325 357018591 0.96
appian_q08/duckdb:vortex-file-compressed 1295678082 1308928445 0.99
duckdb / parquet (0.988x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
appian_q01/duckdb:parquet 205067111 204021884 1.01
appian_q02/duckdb:parquet 603707232 612298713 0.99
appian_q03/duckdb:parquet 291429273 290695881 1.00
appian_q04/duckdb:parquet 1316299501 1334743496 0.99
appian_q05/duckdb:parquet 298701544 316261871 0.94
appian_q06/duckdb:parquet 794510001 798396956 1.00
appian_q07/duckdb:parquet 363423760 368497704 0.99
appian_q08/duckdb:parquet 1273122084 1275446070 1.00
duckdb / duckdb (0.983x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
appian_q01/duckdb:duckdb 171156346 173936603 0.98
appian_q02/duckdb:duckdb 545844539 556422644 0.98
appian_q03/duckdb:duckdb 381249121 394579935 0.97
appian_q04/duckdb:duckdb 1302643913 1313008255 0.99
appian_q05/duckdb:duckdb 283204890 287285410 0.99
appian_q06/duckdb:duckdb 776121861 789612133 0.98
appian_q07/duckdb:duckdb 324272112 330374898 0.98
appian_q08/duckdb:duckdb 1220416049 1232250598 0.99

File Size Changes (3 files changed, -0.0% overall, 1↑ 2↓)
File Scale Format Base HEAD Change %
orderview.vortex 1.0 vortex-file-compressed 76.14 MB 76.14 MB +1.39 KB +0.0%
creditcardview.vortex 1.0 vortex-file-compressed 58.33 MB 58.24 MB 94.59 KB -0.2%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.96 MB → 271.69 MB (-0.1%)
  • vortex-file-compressed: 476.51 MB → 476.42 MB (-0.0%)

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.0%
Engines: DataFusion No clear signal (+8.6%, environment too noisy confidence) · DuckDB No clear signal (-4.1%, environment too noisy confidence)
Vortex (geomean): 0.965x ➖
Parquet (geomean): 0.945x ➖
Shifts: Parquet (control) -5.5% · Median polish -4.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.930x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 761517636 796238040 0.96
tpch_q02/datafusion:vortex-file-compressed 1293353796 1401385756 0.92
tpch_q03/datafusion:vortex-file-compressed 1058892333 1122404127 0.94
tpch_q04/datafusion:vortex-file-compressed 580796168 629666711 0.92
tpch_q05/datafusion:vortex-file-compressed 1155347425 1098042412 1.05
tpch_q06/datafusion:vortex-file-compressed 655343291 729749062 0.90
tpch_q07/datafusion:vortex-file-compressed 985798511 1394071102 0.71
tpch_q08/datafusion:vortex-file-compressed 1443606723 1418086433 1.02
tpch_q09/datafusion:vortex-file-compressed 1279271984 1378577659 0.93
tpch_q10/datafusion:vortex-file-compressed 1227358519 1360594303 0.90
tpch_q11/datafusion:vortex-file-compressed 637211673 629762886 1.01
tpch_q12/datafusion:vortex-file-compressed 878048356 1095815353 0.80
tpch_q13/datafusion:vortex-file-compressed 453432804 508333077 0.89
tpch_q14/datafusion:vortex-file-compressed 682552996 650663667 1.05
tpch_q15/datafusion:vortex-file-compressed 1170503238 1128890772 1.04
tpch_q16/datafusion:vortex-file-compressed 585721049 597763927 0.98
tpch_q17/datafusion:vortex-file-compressed 1186094790 1202644563 0.99
tpch_q18/datafusion:vortex-file-compressed 1219755293 1180150544 1.03
tpch_q19/datafusion:vortex-file-compressed 1042207408 1099441670 0.95
tpch_q20/datafusion:vortex-file-compressed 961343705 1083448170 0.89
tpch_q21/datafusion:vortex-file-compressed 1554718937 1631314801 0.95
tpch_q22/datafusion:vortex-file-compressed 695753023 938454848 0.74
datafusion / vortex-compact (1.010x ➖, 2↑ 4↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 777003654 812022307 0.96
tpch_q02/datafusion:vortex-compact 952266123 1085387961 0.88
tpch_q03/datafusion:vortex-compact 1103640168 1087136971 1.02
tpch_q04/datafusion:vortex-compact 🚀 531594020 827207781 0.64
tpch_q05/datafusion:vortex-compact 1162439881 1384582716 0.84
tpch_q06/datafusion:vortex-compact 729138090 777511945 0.94
tpch_q07/datafusion:vortex-compact 1053306403 1219479761 0.86
tpch_q08/datafusion:vortex-compact 1423088247 1551326404 0.92
tpch_q09/datafusion:vortex-compact 1316111157 1358673117 0.97
tpch_q10/datafusion:vortex-compact 1154758550 1175682550 0.98
tpch_q11/datafusion:vortex-compact 577288792 530114739 1.09
tpch_q12/datafusion:vortex-compact 🚨 1338480871 816626062 1.64
tpch_q13/datafusion:vortex-compact 🚨 885002936 459216002 1.93
tpch_q14/datafusion:vortex-compact 🚨 882970055 582810022 1.52
tpch_q15/datafusion:vortex-compact 1276591627 1228110582 1.04
tpch_q16/datafusion:vortex-compact 🚀 458943991 794876408 0.58
tpch_q17/datafusion:vortex-compact 1248151960 1323742354 0.94
tpch_q18/datafusion:vortex-compact 1135660810 1134492850 1.00
tpch_q19/datafusion:vortex-compact 1098978640 1241760910 0.89
tpch_q20/datafusion:vortex-compact 935087746 1060426015 0.88
tpch_q21/datafusion:vortex-compact 1768050535 1531716803 1.15
tpch_q22/datafusion:vortex-compact 🚨 923056117 648045292 1.42
datafusion / parquet (0.893x ➖, 3↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 922137108 1151247617 0.80
tpch_q02/datafusion:parquet 1044599982 1438029969 0.73
tpch_q03/datafusion:parquet 🚀 1155112970 1835995922 0.63
tpch_q04/datafusion:parquet 632491389 837854549 0.75
tpch_q05/datafusion:parquet 1488004730 1508693220 0.99
tpch_q06/datafusion:parquet 610844847 561152475 1.09
tpch_q07/datafusion:parquet 1610036565 1673007284 0.96
tpch_q08/datafusion:parquet 2118388926 2290057854 0.93
tpch_q09/datafusion:parquet 2249692508 2058310665 1.09
tpch_q10/datafusion:parquet 3228039202 2635001367 1.23
tpch_q11/datafusion:parquet 889352882 1011731460 0.88
tpch_q12/datafusion:parquet 722788692 894332420 0.81
tpch_q13/datafusion:parquet 721907591 930138957 0.78
tpch_q14/datafusion:parquet 964437185 1027751481 0.94
tpch_q15/datafusion:parquet 🚀 1322851702 1909545767 0.69
tpch_q16/datafusion:parquet 🚀 543856268 898130096 0.61
tpch_q17/datafusion:parquet 1529862947 1705509975 0.90
tpch_q18/datafusion:parquet 1855760371 1801653084 1.03
tpch_q19/datafusion:parquet 1078968793 1095821931 0.98
tpch_q20/datafusion:parquet 1789135530 2042672701 0.88
tpch_q21/datafusion:parquet 2474581412 2011377010 1.23
tpch_q22/datafusion:parquet 1400350915 1278307085 1.10
duckdb / vortex-file-compressed (0.956x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 712301190 711821751 1.00
tpch_q02/duckdb:vortex-file-compressed 1531439039 1357338755 1.13
tpch_q03/duckdb:vortex-file-compressed 991399675 1138115918 0.87
tpch_q04/duckdb:vortex-file-compressed 805823864 820023721 0.98
tpch_q05/duckdb:vortex-file-compressed 1498895397 1354605678 1.11
tpch_q06/duckdb:vortex-file-compressed 629176601 655054714 0.96
tpch_q07/duckdb:vortex-file-compressed 1459731002 1285642115 1.14
tpch_q08/duckdb:vortex-file-compressed 1580660822 1940961052 0.81
tpch_q09/duckdb:vortex-file-compressed 1887698648 2122040844 0.89
tpch_q10/duckdb:vortex-file-compressed 1309956348 1791500264 0.73
tpch_q11/duckdb:vortex-file-compressed 744399910 719825729 1.03
tpch_q12/duckdb:vortex-file-compressed 1299636380 1323314091 0.98
tpch_q13/duckdb:vortex-file-compressed 824720730 899508318 0.92
tpch_q14/duckdb:vortex-file-compressed 777900699 734528328 1.06
tpch_q15/duckdb:vortex-file-compressed 601991551 583458329 1.03
tpch_q16/duckdb:vortex-file-compressed 577852421 609547039 0.95
tpch_q17/duckdb:vortex-file-compressed 1052349725 1190074971 0.88
tpch_q18/duckdb:vortex-file-compressed 935342843 1103962102 0.85
tpch_q19/duckdb:vortex-file-compressed 821896708 853925030 0.96
tpch_q20/duckdb:vortex-file-compressed 1212054779 1336558550 0.91
tpch_q21/duckdb:vortex-file-compressed 2002603859 2044988868 0.98
tpch_q22/duckdb:vortex-file-compressed 493726324 511377419 0.97
duckdb / vortex-compact (0.965x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 621778088 651282136 0.95
tpch_q02/duckdb:vortex-compact 1267948073 1362296979 0.93
tpch_q03/duckdb:vortex-compact 974324313 1096170241 0.89
tpch_q04/duckdb:vortex-compact 673132613 629390068 1.07
tpch_q05/duckdb:vortex-compact 1171030744 1373427769 0.85
tpch_q06/duckdb:vortex-compact 557516352 573180830 0.97
tpch_q07/duckdb:vortex-compact 1260868944 1357596346 0.93
tpch_q08/duckdb:vortex-compact 1579906987 1688717416 0.94
tpch_q09/duckdb:vortex-compact 1722985378 1764609639 0.98
tpch_q10/duckdb:vortex-compact 1232038731 1579196379 0.78
tpch_q11/duckdb:vortex-compact 733592070 819303188 0.90
tpch_q12/duckdb:vortex-compact 1142381557 1202430242 0.95
tpch_q13/duckdb:vortex-compact 920936664 868467714 1.06
tpch_q14/duckdb:vortex-compact 700930991 757493283 0.93
tpch_q15/duckdb:vortex-compact 593572339 608817905 0.97
tpch_q16/duckdb:vortex-compact 451031901 459320045 0.98
tpch_q17/duckdb:vortex-compact 1084831420 978321683 1.11
tpch_q18/duckdb:vortex-compact 1075616639 968701991 1.11
tpch_q19/duckdb:vortex-compact 789391243 842677763 0.94
tpch_q20/duckdb:vortex-compact 1309691813 1274128321 1.03
tpch_q21/duckdb:vortex-compact 1950168582 2082720128 0.94
tpch_q22/duckdb:vortex-compact 490787588 439493236 1.12
duckdb / parquet (1.001x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1030307827 1100003640 0.94
tpch_q02/duckdb:parquet 1617726402 1530596803 1.06
tpch_q03/duckdb:parquet 2130679999 2302547640 0.93
tpch_q04/duckdb:parquet 1159501698 1266935052 0.92
tpch_q05/duckdb:parquet 2715877130 2250639909 1.21
tpch_q06/duckdb:parquet 1196525381 973292201 1.23
tpch_q07/duckdb:parquet 2205436579 2336388455 0.94
tpch_q08/duckdb:parquet 2874788889 2732093910 1.05
tpch_q09/duckdb:parquet 3248075375 2922111507 1.11
tpch_q10/duckdb:parquet 3610859457 3713300894 0.97
tpch_q11/duckdb:parquet 1082183844 1154476829 0.94
tpch_q12/duckdb:parquet 1640141273 1509305987 1.09
tpch_q13/duckdb:parquet 1585754417 1341752948 1.18
tpch_q14/duckdb:parquet 1485856507 1606485815 0.92
tpch_q15/duckdb:parquet 1234790136 1144876886 1.08
tpch_q16/duckdb:parquet 1022462051 1050102379 0.97
tpch_q17/duckdb:parquet 1506613900 1753654816 0.86
tpch_q18/duckdb:parquet 1889437660 1706982375 1.11
tpch_q19/duckdb:parquet 1758104042 2073163066 0.85
tpch_q20/duckdb:parquet 2253315578 2207483870 1.02
tpch_q21/duckdb:parquet 1931327653 2287977800 0.84
tpch_q22/duckdb:parquet 1104362545 1166585192 0.95

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.6%
Engines: DataFusion No clear signal (+13.5%, environment too noisy confidence) · DuckDB No clear signal (+2.1%, environment too noisy confidence)
Vortex (geomean): 0.958x ➖
Parquet (geomean): 0.890x ➖
Shifts: Parquet (control) -11.0% · Median polish -4.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.998x ➖, 1↑ 4↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 416916941 313530483 1.33
tpch_q02/datafusion:vortex-file-compressed 669033164 560378317 1.19
tpch_q03/datafusion:vortex-file-compressed 🚨 778906771 559301213 1.39
tpch_q04/datafusion:vortex-file-compressed 🚨 389948482 283103210 1.38
tpch_q05/datafusion:vortex-file-compressed 651539260 584244816 1.12
tpch_q06/datafusion:vortex-file-compressed 547622024 446517555 1.23
tpch_q07/datafusion:vortex-file-compressed 778791934 698963927 1.11
tpch_q08/datafusion:vortex-file-compressed 🚨 945179168 697201867 1.36
tpch_q09/datafusion:vortex-file-compressed 605575059 532627781 1.14
tpch_q10/datafusion:vortex-file-compressed 696284710 674978491 1.03
tpch_q11/datafusion:vortex-file-compressed 417651268 323188476 1.29
tpch_q12/datafusion:vortex-file-compressed 496912390 494820036 1.00
tpch_q13/datafusion:vortex-file-compressed 221365954 258367570 0.86
tpch_q14/datafusion:vortex-file-compressed 330503273 381239257 0.87
tpch_q15/datafusion:vortex-file-compressed 576303518 748510621 0.77
tpch_q16/datafusion:vortex-file-compressed 255648287 274777693 0.93
tpch_q17/datafusion:vortex-file-compressed 393232852 506984450 0.78
tpch_q18/datafusion:vortex-file-compressed 338215826 472770147 0.72
tpch_q19/datafusion:vortex-file-compressed 577428099 819226779 0.70
tpch_q20/datafusion:vortex-file-compressed 484482937 641205111 0.76
tpch_q21/datafusion:vortex-file-compressed 584921690 634064115 0.92
tpch_q22/datafusion:vortex-file-compressed 🚀 199302227 290782090 0.69
datafusion / vortex-compact (0.850x ➖, 2↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 321771405 303343818 1.06
tpch_q02/datafusion:vortex-compact 473596015 520613858 0.91
tpch_q03/datafusion:vortex-compact 560382185 538651046 1.04
tpch_q04/datafusion:vortex-compact 235781264 304337796 0.77
tpch_q05/datafusion:vortex-compact 657593970 680961946 0.97
tpch_q06/datafusion:vortex-compact 401932222 447615665 0.90
tpch_q07/datafusion:vortex-compact 660357986 668300819 0.99
tpch_q08/datafusion:vortex-compact 700483703 913566193 0.77
tpch_q09/datafusion:vortex-compact 660343576 767871703 0.86
tpch_q10/datafusion:vortex-compact 558727946 620450404 0.90
tpch_q11/datafusion:vortex-compact 381181170 401600969 0.95
tpch_q12/datafusion:vortex-compact 405282854 494491386 0.82
tpch_q13/datafusion:vortex-compact 240973935 229232686 1.05
tpch_q14/datafusion:vortex-compact 🚀 250370254 361630724 0.69
tpch_q15/datafusion:vortex-compact 492395611 566668781 0.87
tpch_q16/datafusion:vortex-compact 230778557 279589308 0.83
tpch_q17/datafusion:vortex-compact 436776567 589638192 0.74
tpch_q18/datafusion:vortex-compact 339107029 479241207 0.71
tpch_q19/datafusion:vortex-compact 699921076 950595602 0.74
tpch_q20/datafusion:vortex-compact 574599507 623896340 0.92
tpch_q21/datafusion:vortex-compact 583247419 791066005 0.74
tpch_q22/datafusion:vortex-compact 🚀 255705662 388886873 0.66
datafusion / parquet (0.811x ➖, 10↑ 2↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 298406393 229531235 1.30
tpch_q02/datafusion:parquet 564359781 435153216 1.30
tpch_q03/datafusion:parquet 379523963 418435919 0.91
tpch_q04/datafusion:parquet 211177216 204336746 1.03
tpch_q05/datafusion:parquet 574262144 525161130 1.09
tpch_q06/datafusion:parquet 🚨 273719857 180554291 1.52
tpch_q07/datafusion:parquet 623064481 627320567 0.99
tpch_q08/datafusion:parquet 804179450 1041157879 0.77
tpch_q09/datafusion:parquet 518066696 489218581 1.06
tpch_q10/datafusion:parquet 🚀 519486128 885465329 0.59
tpch_q11/datafusion:parquet 🚀 392969465 624533302 0.63
tpch_q12/datafusion:parquet 🚀 294706072 540637694 0.55
tpch_q13/datafusion:parquet 🚀 429570822 615296089 0.70
tpch_q14/datafusion:parquet 🚀 252489454 383743783 0.66
tpch_q15/datafusion:parquet 🚀 334383485 654641658 0.51
tpch_q16/datafusion:parquet 🚀 185426449 368919462 0.50
tpch_q17/datafusion:parquet 🚀 442759047 758803526 0.58
tpch_q18/datafusion:parquet 🚀 464856244 768215801 0.61
tpch_q19/datafusion:parquet 443468690 530102525 0.84
tpch_q20/datafusion:parquet 461314776 447743787 1.03
tpch_q21/datafusion:parquet 784836875 770930565 1.02
tpch_q22/datafusion:parquet 🚀 201445787 317693800 0.63
duckdb / vortex-file-compressed (0.958x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 419979054 415269312 1.01
tpch_q02/duckdb:vortex-file-compressed 1205176672 1133642065 1.06
tpch_q03/duckdb:vortex-file-compressed 734109290 835652411 0.88
tpch_q04/duckdb:vortex-file-compressed 451936911 450145495 1.00
tpch_q05/duckdb:vortex-file-compressed 915847814 1102184352 0.83
tpch_q06/duckdb:vortex-file-compressed 454083441 503984592 0.90
tpch_q07/duckdb:vortex-file-compressed 1108734750 1071247410 1.03
tpch_q08/duckdb:vortex-file-compressed 1062476753 1291799439 0.82
tpch_q09/duckdb:vortex-file-compressed 1057636152 976962466 1.08
tpch_q10/duckdb:vortex-file-compressed 808330331 914192315 0.88
tpch_q11/duckdb:vortex-file-compressed 562135444 544930254 1.03
tpch_q12/duckdb:vortex-file-compressed 731466453 780132447 0.94
tpch_q13/duckdb:vortex-file-compressed 486309760 583459322 0.83
tpch_q14/duckdb:vortex-file-compressed 494500176 461421798 1.07
tpch_q15/duckdb:vortex-file-compressed 319636047 411546536 0.78
tpch_q16/duckdb:vortex-file-compressed 363426655 418242997 0.87
tpch_q17/duckdb:vortex-file-compressed 876067013 815595871 1.07
tpch_q18/duckdb:vortex-file-compressed 569707904 627479312 0.91
tpch_q19/duckdb:vortex-file-compressed 566110931 628210989 0.90
tpch_q20/duckdb:vortex-file-compressed 999363563 859808324 1.16
tpch_q21/duckdb:vortex-file-compressed 1233198879 1321519066 0.93
tpch_q22/duckdb:vortex-file-compressed 358478936 294146033 1.22
duckdb / vortex-compact (1.035x ➖, 0↑ 3↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 362644814 397900099 0.91
tpch_q02/duckdb:vortex-compact 1188565315 1123991939 1.06
tpch_q03/duckdb:vortex-compact 686382403 748835368 0.92
tpch_q04/duckdb:vortex-compact 456655873 490188349 0.93
tpch_q05/duckdb:vortex-compact 990894322 839847022 1.18
tpch_q06/duckdb:vortex-compact 🚨 521540051 378296029 1.38
tpch_q07/duckdb:vortex-compact 1146570737 1091363970 1.05
tpch_q08/duckdb:vortex-compact 1050650566 1165494927 0.90
tpch_q09/duckdb:vortex-compact 1236535844 1031965733 1.20
tpch_q10/duckdb:vortex-compact 1046761475 888715393 1.18
tpch_q11/duckdb:vortex-compact 550714806 589701831 0.93
tpch_q12/duckdb:vortex-compact 775492010 685690235 1.13
tpch_q13/duckdb:vortex-compact 🚨 520975933 384809210 1.35
tpch_q14/duckdb:vortex-compact 🚨 499958555 359626467 1.39
tpch_q15/duckdb:vortex-compact 358853219 348116358 1.03
tpch_q16/duckdb:vortex-compact 339100368 357768371 0.95
tpch_q17/duckdb:vortex-compact 714609155 859826654 0.83
tpch_q18/duckdb:vortex-compact 558075218 695335242 0.80
tpch_q19/duckdb:vortex-compact 545428961 539988711 1.01
tpch_q20/duckdb:vortex-compact 820692137 888873261 0.92
tpch_q21/duckdb:vortex-compact 1157166684 1178555063 0.98
tpch_q22/duckdb:vortex-compact 323658557 321036184 1.01
duckdb / parquet (0.976x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 632410735 547000292 1.16
tpch_q02/duckdb:parquet 1139762073 1458866671 0.78
tpch_q03/duckdb:parquet 1332331258 1119349046 1.19
tpch_q04/duckdb:parquet 814901432 797509727 1.02
tpch_q05/duckdb:parquet 1580702053 1646475180 0.96
tpch_q06/duckdb:parquet 540442358 549647606 0.98
tpch_q07/duckdb:parquet 1578034571 1436036902 1.10
tpch_q08/duckdb:parquet 1626345361 1723317224 0.94
tpch_q09/duckdb:parquet 1494183739 1822303202 0.82
tpch_q10/duckdb:parquet 1566560118 1613991517 0.97
tpch_q11/duckdb:parquet 804680091 880393697 0.91
tpch_q12/duckdb:parquet 660807449 866064161 0.76
tpch_q13/duckdb:parquet 1061964415 984829941 1.08
tpch_q14/duckdb:parquet 751868989 917536989 0.82
tpch_q15/duckdb:parquet 758372785 730053250 1.04
tpch_q16/duckdb:parquet 764686604 731308678 1.05
tpch_q17/duckdb:parquet 906676250 957268869 0.95
tpch_q18/duckdb:parquet 1027049994 1065726367 0.96
tpch_q19/duckdb:parquet 1020632593 987035038 1.03
tpch_q20/duckdb:parquet 1451285658 1267118397 1.15
tpch_q21/duckdb:parquet 1269709943 1465869737 0.87
tpch_q22/duckdb:parquet 677328074 620378983 1.09

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (medium confidence)
Attributed Vortex impact: -3.2%
Engines: DataFusion No clear signal (-4.2%, environment too noisy confidence) · DuckDB No clear signal (-2.1%, low confidence)
Vortex (geomean): 1.094x ➖
Parquet (geomean): 1.108x ❌
Shifts: Parquet (control) +10.8% · Median polish +9.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.207x ❌, 0↑ 22↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 469599835 422588611 1.11
tpch_q02/datafusion:vortex-file-compressed 🚨 120387677 102596351 1.17
tpch_q03/datafusion:vortex-file-compressed 🚨 239427318 195175315 1.23
tpch_q04/datafusion:vortex-file-compressed 🚨 116481877 96501165 1.21
tpch_q05/datafusion:vortex-file-compressed 🚨 423502366 337731470 1.25
tpch_q06/datafusion:vortex-file-compressed 🚨 42219356 35294778 1.20
tpch_q07/datafusion:vortex-file-compressed 🚨 579202906 453290370 1.28
tpch_q08/datafusion:vortex-file-compressed 🚨 438047130 342435475 1.28
tpch_q09/datafusion:vortex-file-compressed 🚨 728034491 592320778 1.23
tpch_q10/datafusion:vortex-file-compressed 🚨 275203989 224313747 1.23
tpch_q11/datafusion:vortex-file-compressed 🚨 93100202 78315170 1.19
tpch_q12/datafusion:vortex-file-compressed 🚨 135016582 107660052 1.25
tpch_q13/datafusion:vortex-file-compressed 🚨 246612118 199076691 1.24
tpch_q14/datafusion:vortex-file-compressed 🚨 55518999 48033207 1.16
tpch_q15/datafusion:vortex-file-compressed 🚨 112453385 93896906 1.20
tpch_q16/datafusion:vortex-file-compressed 🚨 87670521 74538614 1.18
tpch_q17/datafusion:vortex-file-compressed 🚨 709889634 577515973 1.23
tpch_q18/datafusion:vortex-file-compressed 🚨 1015843492 819468194 1.24
tpch_q19/datafusion:vortex-file-compressed 🚨 73331471 62555140 1.17
tpch_q20/datafusion:vortex-file-compressed 🚨 184322310 158146263 1.17
tpch_q21/datafusion:vortex-file-compressed 🚨 740958844 603285911 1.23
tpch_q22/datafusion:vortex-file-compressed 🚨 62119506 53997504 1.15
datafusion / vortex-compact (1.150x ❌, 0↑ 20↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚨 502516289 455101413 1.10
tpch_q02/datafusion:vortex-compact 🚨 120366795 105636256 1.14
tpch_q03/datafusion:vortex-compact 🚨 232228959 197305107 1.18
tpch_q04/datafusion:vortex-compact 🚨 128726610 108561757 1.19
tpch_q05/datafusion:vortex-compact 🚨 409489199 343401693 1.19
tpch_q06/datafusion:vortex-compact 🚨 67263960 58565907 1.15
tpch_q07/datafusion:vortex-compact 🚨 555872498 469513858 1.18
tpch_q08/datafusion:vortex-compact 🚨 408519900 349019382 1.17
tpch_q09/datafusion:vortex-compact 🚨 706498257 591156101 1.20
tpch_q10/datafusion:vortex-compact 🚨 274351502 241646389 1.14
tpch_q11/datafusion:vortex-compact 🚨 90287732 80336912 1.12
tpch_q12/datafusion:vortex-compact 🚨 175262215 151360929 1.16
tpch_q13/datafusion:vortex-compact 🚨 282713764 245451128 1.15
tpch_q14/datafusion:vortex-compact 🚨 75043295 64878104 1.16
tpch_q15/datafusion:vortex-compact 🚨 173162060 149588091 1.16
tpch_q16/datafusion:vortex-compact 🚨 88404966 79739218 1.11
tpch_q17/datafusion:vortex-compact 🚨 685960109 581400340 1.18
tpch_q18/datafusion:vortex-compact 🚨 971706385 829064962 1.17
tpch_q19/datafusion:vortex-compact 220778384 204081369 1.08
tpch_q20/datafusion:vortex-compact 🚨 208525521 178693103 1.17
tpch_q21/datafusion:vortex-compact 🚨 730169341 623380266 1.17
tpch_q22/datafusion:vortex-compact 66324561 62555299 1.06
datafusion / parquet (1.187x ❌, 0↑ 19↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 562421101 481007429 1.17
tpch_q02/datafusion:parquet 🚨 198523568 174646587 1.14
tpch_q03/datafusion:parquet 🚨 307336166 264277205 1.16
tpch_q04/datafusion:parquet 🚨 140586232 116808432 1.20
tpch_q05/datafusion:parquet 🚨 489969338 394132257 1.24
tpch_q06/datafusion:parquet 🚨 152154062 125685675 1.21
tpch_q07/datafusion:parquet 🚨 698982187 567797516 1.23
tpch_q08/datafusion:parquet 🚨 557518326 455353665 1.22
tpch_q09/datafusion:parquet 🚨 893172102 725435725 1.23
tpch_q10/datafusion:parquet 🚨 702223630 575925036 1.22
tpch_q11/datafusion:parquet 🚨 150480328 121329091 1.24
tpch_q12/datafusion:parquet 🚨 239245261 212442684 1.13
tpch_q13/datafusion:parquet 384517671 352936801 1.09
tpch_q14/datafusion:parquet 🚨 177527844 153399339 1.16
tpch_q15/datafusion:parquet 🚨 316499837 255402110 1.24
tpch_q16/datafusion:parquet 135070144 125075424 1.08
tpch_q17/datafusion:parquet 🚨 835730900 674974898 1.24
tpch_q18/datafusion:parquet 🚨 1069118607 877423261 1.22
tpch_q19/datafusion:parquet 🚨 332583537 283678957 1.17
tpch_q20/datafusion:parquet 🚨 352517838 297136524 1.19
tpch_q21/datafusion:parquet 🚨 826279376 641890216 1.29
tpch_q22/datafusion:parquet 224815083 209723057 1.07
datafusion / arrow (1.057x ➖, 4↑ 12↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 693299480 902399341 0.77
tpch_q02/datafusion:arrow 🚀 111064201 146396904 0.76
tpch_q03/datafusion:arrow 🚀 505429776 679457902 0.74
tpch_q04/datafusion:arrow 🚀 427793819 500100026 0.86
tpch_q05/datafusion:arrow 902103956 931197700 0.97
tpch_q06/datafusion:arrow 390170766 417020146 0.94
tpch_q07/datafusion:arrow 1383426109 1452319438 0.95
tpch_q08/datafusion:arrow 1155599997 1168599523 0.99
tpch_q09/datafusion:arrow 1278637249 1250971413 1.02
tpch_q10/datafusion:arrow 762684061 765172251 1.00
tpch_q11/datafusion:arrow 🚨 115781532 97953395 1.18
tpch_q12/datafusion:arrow 🚨 1663154308 1448720649 1.15
tpch_q13/datafusion:arrow 🚨 564891901 475715049 1.19
tpch_q14/datafusion:arrow 🚨 446010971 363708633 1.23
tpch_q15/datafusion:arrow 🚨 927174524 758156475 1.22
tpch_q16/datafusion:arrow 🚨 99464427 83107823 1.20
tpch_q17/datafusion:arrow 🚨 1204489995 956080405 1.26
tpch_q18/datafusion:arrow 🚨 2267406378 1847333054 1.23
tpch_q19/datafusion:arrow 🚨 677696835 548182492 1.24
tpch_q20/datafusion:arrow 🚨 644974849 502453250 1.28
tpch_q21/datafusion:arrow 🚨 3626598906 3116945850 1.16
tpch_q22/datafusion:arrow 🚨 103628281 82111662 1.26
duckdb / vortex-file-compressed (1.028x ➖, 0↑ 1↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 174142028 169362399 1.03
tpch_q02/duckdb:vortex-file-compressed 55120943 55204098 1.00
tpch_q03/duckdb:vortex-file-compressed 131791069 124229511 1.06
tpch_q04/duckdb:vortex-file-compressed 171611521 156219452 1.10
tpch_q05/duckdb:vortex-file-compressed 143098202 140578916 1.02
tpch_q06/duckdb:vortex-file-compressed 🚨 36081658 31885993 1.13
tpch_q07/duckdb:vortex-file-compressed 140735880 133606290 1.05
tpch_q08/duckdb:vortex-file-compressed 177557141 174142839 1.02
tpch_q09/duckdb:vortex-file-compressed 411134848 401048593 1.03
tpch_q10/duckdb:vortex-file-compressed 199635955 194134262 1.03
tpch_q11/duckdb:vortex-file-compressed 32673820 33361654 0.98
tpch_q12/duckdb:vortex-file-compressed 106089787 104425295 1.02
tpch_q13/duckdb:vortex-file-compressed 278752573 274204438 1.02
tpch_q14/duckdb:vortex-file-compressed 53341373 53226042 1.00
tpch_q15/duckdb:vortex-file-compressed 89503176 87763410 1.02
tpch_q16/duckdb:vortex-file-compressed 79080087 77106004 1.03
tpch_q17/duckdb:vortex-file-compressed 94726112 93604470 1.01
tpch_q18/duckdb:vortex-file-compressed 295290202 294987059 1.00
tpch_q19/duckdb:vortex-file-compressed 79959341 78749061 1.02
tpch_q20/duckdb:vortex-file-compressed 143431016 143353149 1.00
tpch_q21/duckdb:vortex-file-compressed 502904894 490636497 1.03
tpch_q22/duckdb:vortex-file-compressed 66360341 63378231 1.05
duckdb / vortex-compact (1.005x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 231303919 230776597 1.00
tpch_q02/duckdb:vortex-compact 58187241 61412310 0.95
tpch_q03/duckdb:vortex-compact 137877646 135769208 1.02
tpch_q04/duckdb:vortex-compact 174542507 170944175 1.02
tpch_q05/duckdb:vortex-compact 164982916 164243145 1.00
tpch_q06/duckdb:vortex-compact 56977495 54614033 1.04
tpch_q07/duckdb:vortex-compact 173362298 172249018 1.01
tpch_q08/duckdb:vortex-compact 189018486 196711447 0.96
tpch_q09/duckdb:vortex-compact 431698945 425343146 1.01
tpch_q10/duckdb:vortex-compact 221234471 220891186 1.00
tpch_q11/duckdb:vortex-compact 39523377 38942050 1.01
tpch_q12/duckdb:vortex-compact 162958658 164172236 0.99
tpch_q13/duckdb:vortex-compact 325854610 324119624 1.01
tpch_q14/duckdb:vortex-compact 72561622 72498799 1.00
tpch_q15/duckdb:vortex-compact 115523075 113514935 1.02
tpch_q16/duckdb:vortex-compact 81570621 79304413 1.03
tpch_q17/duckdb:vortex-compact 109103079 107882708 1.01
tpch_q18/duckdb:vortex-compact 293674274 286305151 1.03
tpch_q19/duckdb:vortex-compact 97067097 96253674 1.01
tpch_q20/duckdb:vortex-compact 176681406 178283713 0.99
tpch_q21/duckdb:vortex-compact 521620595 523219704 1.00
tpch_q22/duckdb:vortex-compact 71618779 71729526 1.00
duckdb / parquet (1.035x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 275918873 264081633 1.04
tpch_q02/duckdb:parquet 97481564 105633341 0.92
tpch_q03/duckdb:parquet 221503146 209758321 1.06
tpch_q04/duckdb:parquet 142899306 136153703 1.05
tpch_q05/duckdb:parquet 241976231 223158388 1.08
tpch_q06/duckdb:parquet 76960344 73809928 1.04
tpch_q07/duckdb:parquet 196221812 186180380 1.05
tpch_q08/duckdb:parquet 279939018 263193381 1.06
tpch_q09/duckdb:parquet 509019725 471648511 1.08
tpch_q10/duckdb:parquet 643336285 626540223 1.03
tpch_q11/duckdb:parquet 65691612 67020171 0.98
tpch_q12/duckdb:parquet 137799483 130179031 1.06
tpch_q13/duckdb:parquet 440629339 445022074 0.99
tpch_q14/duckdb:parquet 187777450 179100681 1.05
tpch_q15/duckdb:parquet 107308463 104678841 1.03
tpch_q16/duckdb:parquet 172436467 160205434 1.08
tpch_q17/duckdb:parquet 184899256 180401050 1.02
tpch_q18/duckdb:parquet 376578050 361465657 1.04
tpch_q19/duckdb:parquet 291129958 285961887 1.02
tpch_q20/duckdb:parquet 236332808 232261769 1.02
tpch_q21/duckdb:parquet 592942748 556625664 1.07
tpch_q22/duckdb:parquet 298294756 294974552 1.01
duckdb / duckdb (1.008x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 120802424 120948963 1.00
tpch_q02/duckdb:duckdb 51838897 49104561 1.06
tpch_q03/duckdb:duckdb 105224510 104019815 1.01
tpch_q04/duckdb:duckdb 141098156 138676068 1.02
tpch_q05/duckdb:duckdb 119814952 119806688 1.00
tpch_q06/duckdb:duckdb 44815247 44734694 1.00
tpch_q07/duckdb:duckdb 91522633 90645851 1.01
tpch_q08/duckdb:duckdb 119647063 119776084 1.00
tpch_q09/duckdb:duckdb 282494927 280885687 1.01
tpch_q10/duckdb:duckdb 218061345 213482920 1.02
tpch_q11/duckdb:duckdb 19487278 19623850 0.99
tpch_q12/duckdb:duckdb 90339134 90159055 1.00
tpch_q13/duckdb:duckdb 234100453 228923599 1.02
tpch_q14/duckdb:duckdb 78552530 77951222 1.01
tpch_q15/duckdb:duckdb 82873354 82400635 1.01
tpch_q16/duckdb:duckdb 77134793 75477211 1.02
tpch_q17/duckdb:duckdb 88426067 88065918 1.00
tpch_q18/duckdb:duckdb 233361882 232850124 1.00
tpch_q19/duckdb:duckdb 123884594 123850076 1.00
tpch_q20/duckdb:duckdb 117698526 117953377 1.00
tpch_q21/duckdb:duckdb 301314616 305708603 0.99
tpch_q22/duckdb:duckdb 69301467 68823695 1.01

File Size Changes (26 files changed, +0.0% overall, 12↑ 14↓)
File Scale Format Base HEAD Change %
part_0.vortex 10.0 vortex-compact 16.87 MB 17.02 MB +149.47 KB +0.9%
partsupp_1.vortex 10.0 vortex-compact 104.96 MB 105.36 MB +407.22 KB +0.4%
lineitem_11.vortex 10.0 vortex-file-compressed 129.07 MB 129.43 MB +374.55 KB +0.3%
orders_1.vortex 10.0 vortex-file-compressed 134.50 MB 134.86 MB +377.65 KB +0.3%
partsupp_0.vortex 10.0 vortex-compact 105.09 MB 105.37 MB +281.39 KB +0.3%
lineitem_0.vortex 10.0 vortex-file-compressed 129.34 MB 129.62 MB +285.68 KB +0.2%
lineitem_1.vortex 10.0 vortex-file-compressed 129.18 MB 129.34 MB +161.86 KB +0.1%
orders_2.vortex 10.0 vortex-file-compressed 134.27 MB 134.42 MB +147.38 KB +0.1%
lineitem_8.vortex 10.0 vortex-file-compressed 129.12 MB 129.19 MB +74.33 KB +0.1%
lineitem_3.vortex 10.0 vortex-file-compressed 129.44 MB 129.51 MB +69.24 KB +0.1%
partsupp_0.vortex 10.0 vortex-file-compressed 119.74 MB 119.79 MB +47.71 KB +0.0%
lineitem_5.vortex 10.0 vortex-file-compressed 129.56 MB 129.61 MB +45.26 KB +0.0%
partsupp_1.vortex 10.0 vortex-file-compressed 119.72 MB 119.70 MB 19.69 KB -0.0%
lineitem_6.vortex 10.0 vortex-file-compressed 129.40 MB 129.38 MB 24.59 KB -0.0%
lineitem_4.vortex 10.0 vortex-file-compressed 129.47 MB 129.45 MB 28.07 KB -0.0%
lineitem_7.vortex 10.0 vortex-file-compressed 129.27 MB 129.24 MB 29.47 KB -0.0%
customer_0.vortex 10.0 vortex-file-compressed 88.59 MB 88.57 MB 21.58 KB -0.0%
lineitem_12.vortex 10.0 vortex-file-compressed 129.51 MB 129.45 MB 61.98 KB -0.0%
lineitem_10.vortex 10.0 vortex-file-compressed 129.55 MB 129.46 MB 96.62 KB -0.1%
lineitem_2.vortex 10.0 vortex-file-compressed 129.52 MB 129.40 MB 126.00 KB -0.1%
lineitem_9.vortex 10.0 vortex-file-compressed 129.37 MB 129.18 MB 195.97 KB -0.1%
orders_0.vortex 10.0 vortex-file-compressed 133.36 MB 133.12 MB 250.49 KB -0.2%
supplier_0.vortex 10.0 vortex-file-compressed 5.76 MB 5.73 MB 33.89 KB -0.6%
part_0.vortex 10.0 vortex-file-compressed 24.90 MB 24.65 MB 259.16 KB -1.0%
part_1.vortex 10.0 vortex-compact 17.17 MB 16.96 MB 214.16 KB -1.2%
part_1.vortex 10.0 vortex-file-compressed 24.60 MB 23.85 MB 765.36 KB -3.0%

Totals:

  • vortex-compact: 1.93 GB → 1.93 GB (+0.0%)
  • vortex-file-compressed: 2.41 GB → 2.41 GB (-0.0%)

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (-0.5%, low confidence)
Vortex (geomean): 0.989x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.983x ➖, 3↑ 1↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 24547436 25289801 0.97
tpcds_q02/datafusion:vortex-file-compressed 47299080 49518071 0.96
tpcds_q03/datafusion:vortex-file-compressed 15074932 14738658 1.02
tpcds_q04/datafusion:vortex-file-compressed 247484465 255341409 0.97
tpcds_q05/datafusion:vortex-file-compressed 42953636 44251279 0.97
tpcds_q06/datafusion:vortex-file-compressed 22557471 23241027 0.97
tpcds_q07/datafusion:vortex-file-compressed 38721630 40143932 0.96
tpcds_q08/datafusion:vortex-file-compressed 29340080 29553112 0.99
tpcds_q09/datafusion:vortex-file-compressed 30467853 32005282 0.95
tpcds_q10/datafusion:vortex-file-compressed 39112376 38594946 1.01
tpcds_q11/datafusion:vortex-file-compressed 129061653 127983262 1.01
tpcds_q12/datafusion:vortex-file-compressed 17761225 19258814 0.92
tpcds_q13/datafusion:vortex-file-compressed 38164931 41566772 0.92
tpcds_q14/datafusion:vortex-file-compressed 162737913 163621998 0.99
tpcds_q15/datafusion:vortex-file-compressed 27821762 26458456 1.05
tpcds_q16/datafusion:vortex-file-compressed 25645146 24859697 1.03
tpcds_q17/datafusion:vortex-file-compressed 61210792 61273795 1.00
tpcds_q18/datafusion:vortex-file-compressed 62640929 63301679 0.99
tpcds_q19/datafusion:vortex-file-compressed 21367552 22404506 0.95
tpcds_q20/datafusion:vortex-file-compressed 20033790 20417657 0.98
tpcds_q21/datafusion:vortex-file-compressed 36765948 35594585 1.03
tpcds_q22/datafusion:vortex-file-compressed 129942121 125700272 1.03
tpcds_q23/datafusion:vortex-file-compressed 154390216 154501519 1.00
tpcds_q24/datafusion:vortex-file-compressed 82771115 81589821 1.01
tpcds_q25/datafusion:vortex-file-compressed 63146665 67483808 0.94
tpcds_q26/datafusion:vortex-file-compressed 32868128 33342193 0.99
tpcds_q27/datafusion:vortex-file-compressed 89154763 91220205 0.98
tpcds_q28/datafusion:vortex-file-compressed 28631010 28688467 1.00
tpcds_q29/datafusion:vortex-file-compressed 60236758 61862577 0.97
tpcds_q30/datafusion:vortex-file-compressed 24057668 23406562 1.03
tpcds_q31/datafusion:vortex-file-compressed 72518668 72722536 1.00
tpcds_q32/datafusion:vortex-file-compressed 18203255 18590995 0.98
tpcds_q33/datafusion:vortex-file-compressed 30052448 29970438 1.00
tpcds_q34/datafusion:vortex-file-compressed 24482197 25658055 0.95
tpcds_q35/datafusion:vortex-file-compressed 44029181 44030026 1.00
tpcds_q36/datafusion:vortex-file-compressed 58132153 59966215 0.97
tpcds_q37/datafusion:vortex-file-compressed 20020370 20869381 0.96
tpcds_q38/datafusion:vortex-file-compressed 43462194 41299002 1.05
tpcds_q39/datafusion:vortex-file-compressed 102519271 106210314 0.97
tpcds_q40/datafusion:vortex-file-compressed 29943672 31618067 0.95
tpcds_q41/datafusion:vortex-file-compressed 🚀 15183703 20050912 0.76
tpcds_q42/datafusion:vortex-file-compressed 13629756 13451248 1.01
tpcds_q43/datafusion:vortex-file-compressed 18514590 18203009 1.02
tpcds_q44/datafusion:vortex-file-compressed 28816531 30020380 0.96
tpcds_q45/datafusion:vortex-file-compressed 26405385 27713268 0.95
tpcds_q46/datafusion:vortex-file-compressed 34203610 35846319 0.95
tpcds_q47/datafusion:vortex-file-compressed 133379398 133268638 1.00
tpcds_q48/datafusion:vortex-file-compressed 32416248 34043513 0.95
tpcds_q49/datafusion:vortex-file-compressed 58384003 58846352 0.99
tpcds_q50/datafusion:vortex-file-compressed 38406173 38483993 1.00
tpcds_q51/datafusion:vortex-file-compressed 89563443 87003271 1.03
tpcds_q52/datafusion:vortex-file-compressed 13902620 13614774 1.02
tpcds_q53/datafusion:vortex-file-compressed 21983784 21757203 1.01
tpcds_q54/datafusion:vortex-file-compressed 32554243 33794581 0.96
tpcds_q55/datafusion:vortex-file-compressed 13060344 13602195 0.96
tpcds_q56/datafusion:vortex-file-compressed 28978387 29835283 0.97
tpcds_q57/datafusion:vortex-file-compressed 105718640 107955431 0.98
tpcds_q58/datafusion:vortex-file-compressed 57080652 56672570 1.01
tpcds_q59/datafusion:vortex-file-compressed 58587721 57804180 1.01
tpcds_q60/datafusion:vortex-file-compressed 29795926 28705989 1.04
tpcds_q61/datafusion:vortex-file-compressed 39704685 41552275 0.96
tpcds_q62/datafusion:vortex-file-compressed 🚨 26879804 21908652 1.23
tpcds_q63/datafusion:vortex-file-compressed 22143203 21959877 1.01
tpcds_q64/datafusion:vortex-file-compressed 367987664 379422949 0.97
tpcds_q65/datafusion:vortex-file-compressed 51522036 51052306 1.01
tpcds_q66/datafusion:vortex-file-compressed 74224475 73228586 1.01
tpcds_q67/datafusion:vortex-file-compressed 155688601 153444450 1.01
tpcds_q68/datafusion:vortex-file-compressed 32879071 34904779 0.94
tpcds_q69/datafusion:vortex-file-compressed 35187580 37242963 0.94
tpcds_q70/datafusion:vortex-file-compressed 92872115 96797588 0.96
tpcds_q71/datafusion:vortex-file-compressed 22426452 23636729 0.95
tpcds_q72/datafusion:vortex-file-compressed 2108038700 2113752917 1.00
tpcds_q73/datafusion:vortex-file-compressed 24094274 24377848 0.99
tpcds_q74/datafusion:vortex-file-compressed 79920349 83036879 0.96
tpcds_q75/datafusion:vortex-file-compressed 109339953 110979883 0.99
tpcds_q76/datafusion:vortex-file-compressed 26424538 27387643 0.96
tpcds_q77/datafusion:vortex-file-compressed 🚀 35295876 39358645 0.90
tpcds_q78/datafusion:vortex-file-compressed 112225609 119159144 0.94
tpcds_q79/datafusion:vortex-file-compressed 30023901 29353611 1.02
tpcds_q80/datafusion:vortex-file-compressed 85667695 90056045 0.95
tpcds_q81/datafusion:vortex-file-compressed 24875242 24676121 1.01
tpcds_q82/datafusion:vortex-file-compressed 21277456 20990524 1.01
tpcds_q83/datafusion:vortex-file-compressed 35873443 35850984 1.00
tpcds_q84/datafusion:vortex-file-compressed 12875417 12946566 0.99
tpcds_q85/datafusion:vortex-file-compressed 82513341 87790411 0.94
tpcds_q86/datafusion:vortex-file-compressed 16103151 15465767 1.04
tpcds_q87/datafusion:vortex-file-compressed 42052058 43592493 0.96
tpcds_q88/datafusion:vortex-file-compressed 54703561 55202009 0.99
tpcds_q89/datafusion:vortex-file-compressed 24750308 26526683 0.93
tpcds_q90/datafusion:vortex-file-compressed 14540108 13718165 1.06
tpcds_q91/datafusion:vortex-file-compressed 17603810 18243659 0.96
tpcds_q92/datafusion:vortex-file-compressed 15655532 16596561 0.94
tpcds_q93/datafusion:vortex-file-compressed 33027369 31709031 1.04
tpcds_q94/datafusion:vortex-file-compressed 21075196 21311362 0.99
tpcds_q95/datafusion:vortex-file-compressed 57398412 59256819 0.97
tpcds_q96/datafusion:vortex-file-compressed 13179748 13202459 1.00
tpcds_q97/datafusion:vortex-file-compressed 29575175 29032750 1.02
tpcds_q98/datafusion:vortex-file-compressed 23867272 25659979 0.93
tpcds_q99/datafusion:vortex-file-compressed 🚀 27927546 31212564 0.89
datafusion / vortex-compact (0.991x ➖, 1↑ 3↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 25815226 26649044 0.97
tpcds_q02/datafusion:vortex-compact 54114079 53353665 1.01
tpcds_q03/datafusion:vortex-compact 19119352 19992430 0.96
tpcds_q04/datafusion:vortex-compact 288203733 301993297 0.95
tpcds_q05/datafusion:vortex-compact 46531004 46520650 1.00
tpcds_q06/datafusion:vortex-compact 26067408 26097825 1.00
tpcds_q07/datafusion:vortex-compact 53583862 53470903 1.00
tpcds_q08/datafusion:vortex-compact 36320434 37016768 0.98
tpcds_q09/datafusion:vortex-compact 43529963 44125506 0.99
tpcds_q10/datafusion:vortex-compact 48073577 48262379 1.00
tpcds_q11/datafusion:vortex-compact 156382245 153084746 1.02
tpcds_q12/datafusion:vortex-compact 22494912 22113564 1.02
tpcds_q13/datafusion:vortex-compact 119929368 124439385 0.96
tpcds_q14/datafusion:vortex-compact 184515774 185096939 1.00
tpcds_q15/datafusion:vortex-compact 27324135 28199831 0.97
tpcds_q16/datafusion:vortex-compact 28943914 27904362 1.04
tpcds_q17/datafusion:vortex-compact 71309875 72309857 0.99
tpcds_q18/datafusion:vortex-compact 72208319 70445785 1.03
tpcds_q19/datafusion:vortex-compact 29604963 30325110 0.98
tpcds_q20/datafusion:vortex-compact 25235767 25866087 0.98
tpcds_q21/datafusion:vortex-compact 40189362 40087585 1.00
tpcds_q22/datafusion:vortex-compact 🚨 139396395 125021723 1.11
tpcds_q23/datafusion:vortex-compact 169634856 162496396 1.04
tpcds_q24/datafusion:vortex-compact 93916640 94748023 0.99
tpcds_q25/datafusion:vortex-compact 77145726 75806689 1.02
tpcds_q26/datafusion:vortex-compact 44864614 45356058 0.99
tpcds_q27/datafusion:vortex-compact 116631253 119396432 0.98
tpcds_q28/datafusion:vortex-compact 94732815 95363601 0.99
tpcds_q29/datafusion:vortex-compact 72127808 74953018 0.96
tpcds_q30/datafusion:vortex-compact 30073423 27621209 1.09
tpcds_q31/datafusion:vortex-compact 96731843 97620626 0.99
tpcds_q32/datafusion:vortex-compact 24346548 24507835 0.99
tpcds_q33/datafusion:vortex-compact 36661541 36793962 1.00
tpcds_q34/datafusion:vortex-compact 34280360 33682152 1.02
tpcds_q35/datafusion:vortex-compact 51259159 51409136 1.00
tpcds_q36/datafusion:vortex-compact 75608159 74642487 1.01
tpcds_q37/datafusion:vortex-compact 29693996 31992660 0.93
tpcds_q38/datafusion:vortex-compact 50669721 48980635 1.03
tpcds_q39/datafusion:vortex-compact 112690177 116438265 0.97
tpcds_q40/datafusion:vortex-compact 34333631 34506722 0.99
tpcds_q41/datafusion:vortex-compact 🚀 17884470 21571361 0.83
tpcds_q42/datafusion:vortex-compact 17878996 18472601 0.97
tpcds_q43/datafusion:vortex-compact 24483987 24768299 0.99
tpcds_q44/datafusion:vortex-compact 40628350 40250576 1.01
tpcds_q45/datafusion:vortex-compact 30618169 32067431 0.95
tpcds_q46/datafusion:vortex-compact 46243313 45668496 1.01
tpcds_q47/datafusion:vortex-compact 153830916 153712969 1.00
tpcds_q48/datafusion:vortex-compact 79934706 82421371 0.97
tpcds_q49/datafusion:vortex-compact 65563485 70291060 0.93
tpcds_q50/datafusion:vortex-compact 45288151 44824256 1.01
tpcds_q51/datafusion:vortex-compact 94931156 97976840 0.97
tpcds_q52/datafusion:vortex-compact 19189190 18656884 1.03
tpcds_q53/datafusion:vortex-compact 27852136 28471267 0.98
tpcds_q54/datafusion:vortex-compact 40617988 41086768 0.99
tpcds_q55/datafusion:vortex-compact 18001681 18089911 1.00
tpcds_q56/datafusion:vortex-compact 35035703 38204721 0.92
tpcds_q57/datafusion:vortex-compact 113194378 115490899 0.98
tpcds_q58/datafusion:vortex-compact 64993461 62395636 1.04
tpcds_q59/datafusion:vortex-compact 70889061 70549112 1.00
tpcds_q60/datafusion:vortex-compact 36563359 35846990 1.02
tpcds_q61/datafusion:vortex-compact 54048974 53760015 1.01
tpcds_q62/datafusion:vortex-compact 🚨 27270525 23445934 1.16
tpcds_q63/datafusion:vortex-compact 28980346 31086597 0.93
tpcds_q64/datafusion:vortex-compact 423309937 423344729 1.00
tpcds_q65/datafusion:vortex-compact 64532504 65794951 0.98
tpcds_q66/datafusion:vortex-compact 76088767 78705439 0.97
tpcds_q67/datafusion:vortex-compact 158655375 158051319 1.00
tpcds_q68/datafusion:vortex-compact 45858350 45979805 1.00
tpcds_q69/datafusion:vortex-compact 45755421 45992878 0.99
tpcds_q70/datafusion:vortex-compact 105272694 105577351 1.00
tpcds_q71/datafusion:vortex-compact 30377792 30460039 1.00
tpcds_q72/datafusion:vortex-compact 2060349945 2113602615 0.97
tpcds_q73/datafusion:vortex-compact 30182351 30536465 0.99
tpcds_q74/datafusion:vortex-compact 94801411 102386555 0.93
tpcds_q75/datafusion:vortex-compact 126973596 125871770 1.01
tpcds_q76/datafusion:vortex-compact 34622393 34002497 1.02
tpcds_q77/datafusion:vortex-compact 47890365 51095543 0.94
tpcds_q78/datafusion:vortex-compact 128812020 130209567 0.99
tpcds_q79/datafusion:vortex-compact 39385767 40959958 0.96
tpcds_q80/datafusion:vortex-compact 96898795 100576420 0.96
tpcds_q81/datafusion:vortex-compact 28404490 28869735 0.98
tpcds_q82/datafusion:vortex-compact 31085055 32350412 0.96
tpcds_q83/datafusion:vortex-compact 34916377 36174289 0.97
tpcds_q84/datafusion:vortex-compact 13845190 14186586 0.98
tpcds_q85/datafusion:vortex-compact 151924537 166263446 0.91
tpcds_q86/datafusion:vortex-compact 17215413 18896510 0.91
tpcds_q87/datafusion:vortex-compact 49361656 48473371 1.02
tpcds_q88/datafusion:vortex-compact 76175023 75128631 1.01
tpcds_q89/datafusion:vortex-compact 31791386 31221137 1.02
tpcds_q90/datafusion:vortex-compact 14847537 14523136 1.02
tpcds_q91/datafusion:vortex-compact 31775697 32039500 0.99
tpcds_q92/datafusion:vortex-compact 22375356 22946343 0.98
tpcds_q93/datafusion:vortex-compact 36339776 36551356 0.99
tpcds_q94/datafusion:vortex-compact 24108803 24518825 0.98
tpcds_q95/datafusion:vortex-compact 60739884 63617032 0.95
tpcds_q96/datafusion:vortex-compact 17824766 16688577 1.07
tpcds_q97/datafusion:vortex-compact 34241246 34558888 0.99
tpcds_q98/datafusion:vortex-compact 29734598 31101260 0.96
tpcds_q99/datafusion:vortex-compact 🚨 36705308 31232535 1.18
datafusion / parquet (0.992x ➖, 1↑ 3↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 23676039 23200698 1.02
tpcds_q02/datafusion:parquet 42811993 41778048 1.02
tpcds_q03/datafusion:parquet 13000119 14279868 0.91
tpcds_q04/datafusion:parquet 287280622 314660711 0.91
tpcds_q05/datafusion:parquet 46422437 46829549 0.99
tpcds_q06/datafusion:parquet 22609235 22613738 1.00
tpcds_q07/datafusion:parquet 77025594 76095695 1.01
tpcds_q08/datafusion:parquet 29917849 29481771 1.01
tpcds_q09/datafusion:parquet 40958206 38798117 1.06
tpcds_q10/datafusion:parquet 73266977 69121241 1.06
tpcds_q11/datafusion:parquet 154808268 144022421 1.07
tpcds_q12/datafusion:parquet 🚨 18139847 16244209 1.12
tpcds_q13/datafusion:parquet 73184888 74041466 0.99
tpcds_q14/datafusion:parquet 155811962 156976451 0.99
tpcds_q15/datafusion:parquet 21191580 21245522 1.00
tpcds_q16/datafusion:parquet 🚀 28149287 32813805 0.86
tpcds_q17/datafusion:parquet 58846821 65216478 0.90
tpcds_q18/datafusion:parquet 107527574 106987052 1.01
tpcds_q19/datafusion:parquet 22705587 24610542 0.92
tpcds_q20/datafusion:parquet 16430605 17082922 0.96
tpcds_q21/datafusion:parquet 17810094 18688565 0.95
tpcds_q22/datafusion:parquet 156018437 154066189 1.01
tpcds_q23/datafusion:parquet 155492750 149295635 1.04
tpcds_q24/datafusion:parquet 88249657 89528000 0.99
tpcds_q25/datafusion:parquet 60840750 62116241 0.98
tpcds_q26/datafusion:parquet 67694305 63149909 1.07
tpcds_q27/datafusion:parquet 133030061 136280027 0.98
tpcds_q28/datafusion:parquet 44696718 45460157 0.98
tpcds_q29/datafusion:parquet 62813295 63372250 0.99
tpcds_q30/datafusion:parquet 32606923 32410540 1.01
tpcds_q31/datafusion:parquet 64798749 66499728 0.97
tpcds_q32/datafusion:parquet 16423112 16333759 1.01
tpcds_q33/datafusion:parquet 26318551 27427517 0.96
tpcds_q34/datafusion:parquet 21334665 22232759 0.96
tpcds_q35/datafusion:parquet 69977686 70227398 1.00
tpcds_q36/datafusion:parquet 57073387 57658683 0.99
tpcds_q37/datafusion:parquet 20186935 18988633 1.06
tpcds_q38/datafusion:parquet 41797816 42479573 0.98
tpcds_q39/datafusion:parquet 74311647 73961987 1.00
tpcds_q40/datafusion:parquet 22260951 24201692 0.92
tpcds_q41/datafusion:parquet 14285538 14220627 1.00
tpcds_q42/datafusion:parquet 11790344 12269767 0.96
tpcds_q43/datafusion:parquet 17332235 17212774 1.01
tpcds_q44/datafusion:parquet 32349525 34370294 0.94
tpcds_q45/datafusion:parquet 26992156 28059545 0.96
tpcds_q46/datafusion:parquet 31919593 31966892 1.00
tpcds_q47/datafusion:parquet 131090550 130499979 1.00
tpcds_q48/datafusion:parquet 69588162 67832842 1.03
tpcds_q49/datafusion:parquet 55175180 55729242 0.99
tpcds_q50/datafusion:parquet 41692603 43107078 0.97
tpcds_q51/datafusion:parquet 87001887 89254706 0.97
tpcds_q52/datafusion:parquet 12499402 12226667 1.02
tpcds_q53/datafusion:parquet 19085097 17865081 1.07
tpcds_q54/datafusion:parquet 31336965 32166322 0.97
tpcds_q55/datafusion:parquet 11291593 11914335 0.95
tpcds_q56/datafusion:parquet 28318797 28373049 1.00
tpcds_q57/datafusion:parquet 95338147 101336811 0.94
tpcds_q58/datafusion:parquet 55183865 55501421 0.99
tpcds_q59/datafusion:parquet 64573859 62558563 1.03
tpcds_q60/datafusion:parquet 27665345 27304702 1.01
tpcds_q61/datafusion:parquet 42558113 42824546 0.99
tpcds_q62/datafusion:parquet 🚨 24416468 20372357 1.20
tpcds_q63/datafusion:parquet 17619697 18645757 0.94
tpcds_q64/datafusion:parquet 299071999 298345412 1.00
tpcds_q65/datafusion:parquet 37462034 37891463 0.99
tpcds_q66/datafusion:parquet 66198213 69865074 0.95
tpcds_q67/datafusion:parquet 148786285 158187228 0.94
tpcds_q68/datafusion:parquet 31014989 31234986 0.99
tpcds_q69/datafusion:parquet 64729640 68500656 0.94
tpcds_q70/datafusion:parquet 33509940 32283327 1.04
tpcds_q71/datafusion:parquet 🚨 23679641 21509755 1.10
tpcds_q72/datafusion:parquet 578728411 581065241 1.00
tpcds_q73/datafusion:parquet 21621423 21320278 1.01
tpcds_q74/datafusion:parquet 81602086 83804238 0.97
tpcds_q75/datafusion:parquet 109596154 108360568 1.01
tpcds_q76/datafusion:parquet 30463005 30534816 1.00
tpcds_q77/datafusion:parquet 37830612 38544965 0.98
tpcds_q78/datafusion:parquet 110328960 108031818 1.02
tpcds_q79/datafusion:parquet 27058879 26583037 1.02
tpcds_q80/datafusion:parquet 73556191 74890636 0.98
tpcds_q81/datafusion:parquet 30144321 31028211 0.97
tpcds_q82/datafusion:parquet 18674538 19027088 0.98
tpcds_q83/datafusion:parquet 41207374 41088247 1.00
tpcds_q84/datafusion:parquet 39541842 39881533 0.99
tpcds_q85/datafusion:parquet 143620475 145355204 0.99
tpcds_q86/datafusion:parquet 15364792 16358003 0.94
tpcds_q87/datafusion:parquet 44688744 44669602 1.00
tpcds_q88/datafusion:parquet 58423419 60091390 0.97
tpcds_q89/datafusion:parquet 21375707 22855942 0.94
tpcds_q90/datafusion:parquet 14115931 14594686 0.97
tpcds_q91/datafusion:parquet 58217414 59133957 0.98
tpcds_q92/datafusion:parquet 17944350 17920271 1.00
tpcds_q93/datafusion:parquet 30179426 30971854 0.97
tpcds_q94/datafusion:parquet 21124207 21497953 0.98
tpcds_q95/datafusion:parquet 58253497 60140961 0.97
tpcds_q96/datafusion:parquet 11555114 11268685 1.03
tpcds_q97/datafusion:parquet 30180584 29227531 1.03
tpcds_q98/datafusion:parquet 21396458 21554007 0.99
tpcds_q99/datafusion:parquet 25753061 25936047 0.99
duckdb / vortex-file-compressed (0.998x ➖, 8↑ 5↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 24410009 24346801 1.00
tpcds_q02/duckdb:vortex-file-compressed 🚀 28095838 33676736 0.83
tpcds_q03/duckdb:vortex-file-compressed 15935106 16007987 1.00
tpcds_q04/duckdb:vortex-file-compressed 96049915 89482475 1.07
tpcds_q05/duckdb:vortex-file-compressed 35584259 34500144 1.03
tpcds_q06/duckdb:vortex-file-compressed 34266403 33083738 1.04
tpcds_q07/duckdb:vortex-file-compressed 🚀 22548053 25315166 0.89
tpcds_q08/duckdb:vortex-file-compressed 28199759 26226651 1.08
tpcds_q09/duckdb:vortex-file-compressed 16862465 16060964 1.05
tpcds_q10/duckdb:vortex-file-compressed 39590015 38173430 1.04
tpcds_q11/duckdb:vortex-file-compressed 68478030 65062376 1.05
tpcds_q12/duckdb:vortex-file-compressed 🚨 17428882 15290702 1.14
tpcds_q13/duckdb:vortex-file-compressed 33361803 32184324 1.04
tpcds_q14/duckdb:vortex-file-compressed 99869752 97752963 1.02
tpcds_q15/duckdb:vortex-file-compressed 🚨 30253662 26276920 1.15
tpcds_q16/duckdb:vortex-file-compressed 28042125 26304756 1.07
tpcds_q17/duckdb:vortex-file-compressed 46758187 48443601 0.97
tpcds_q18/duckdb:vortex-file-compressed 40456624 38563550 1.05
tpcds_q19/duckdb:vortex-file-compressed 34594803 32255217 1.07
tpcds_q20/duckdb:vortex-file-compressed 17443704 16823022 1.04
tpcds_q21/duckdb:vortex-file-compressed 17275088 16115266 1.07
tpcds_q22/duckdb:vortex-file-compressed 77538305 76524063 1.01
tpcds_q23/duckdb:vortex-file-compressed 96635851 92986991 1.04
tpcds_q24/duckdb:vortex-file-compressed 52514692 49049866 1.07
tpcds_q25/duckdb:vortex-file-compressed 🚨 44055016 39971390 1.10
tpcds_q26/duckdb:vortex-file-compressed 🚀 19230614 21860171 0.88
tpcds_q27/duckdb:vortex-file-compressed 🚀 23135430 26291019 0.88
tpcds_q28/duckdb:vortex-file-compressed 11775229 12257050 0.96
tpcds_q29/duckdb:vortex-file-compressed 43652638 45177378 0.97
tpcds_q30/duckdb:vortex-file-compressed 26037374 25491413 1.02
tpcds_q31/duckdb:vortex-file-compressed 28886826 29918009 0.97
tpcds_q32/duckdb:vortex-file-compressed 13817757 13436369 1.03
tpcds_q33/duckdb:vortex-file-compressed 24234882 25020077 0.97
tpcds_q34/duckdb:vortex-file-compressed 26228626 25476343 1.03
tpcds_q35/duckdb:vortex-file-compressed 66387247 65613752 1.01
tpcds_q36/duckdb:vortex-file-compressed 23877123 24514072 0.97
tpcds_q37/duckdb:vortex-file-compressed 20026982 19415865 1.03
tpcds_q38/duckdb:vortex-file-compressed 39870869 37796456 1.05
tpcds_q39/duckdb:vortex-file-compressed 36407280 35386077 1.03
tpcds_q40/duckdb:vortex-file-compressed 21440416 19861519 1.08
tpcds_q41/duckdb:vortex-file-compressed 🚀 9391619 12236069 0.77
tpcds_q42/duckdb:vortex-file-compressed 12471144 13241752 0.94
tpcds_q43/duckdb:vortex-file-compressed 🚨 24078629 20866409 1.15
tpcds_q44/duckdb:vortex-file-compressed 22001688 21995240 1.00
tpcds_q45/duckdb:vortex-file-compressed 31463403 30560389 1.03
tpcds_q46/duckdb:vortex-file-compressed 30462389 33559714 0.91
tpcds_q47/duckdb:vortex-file-compressed 53812037 51495520 1.04
tpcds_q48/duckdb:vortex-file-compressed 30907633 28574659 1.08
tpcds_q49/duckdb:vortex-file-compressed 🚀 32670577 40964453 0.80
tpcds_q50/duckdb:vortex-file-compressed 27626643 28141045 0.98
tpcds_q51/duckdb:vortex-file-compressed 108161218 104099539 1.04
tpcds_q52/duckdb:vortex-file-compressed 13063929 13624723 0.96
tpcds_q53/duckdb:vortex-file-compressed 21947527 23490831 0.93
tpcds_q54/duckdb:vortex-file-compressed 29262192 29100061 1.01
tpcds_q55/duckdb:vortex-file-compressed 13200100 12793019 1.03
tpcds_q56/duckdb:vortex-file-compressed 25303194 25408759 1.00
tpcds_q57/duckdb:vortex-file-compressed 44901411 41806408 1.07
tpcds_q58/duckdb:vortex-file-compressed 29298830 30040425 0.98
tpcds_q59/duckdb:vortex-file-compressed 57548305 57405574 1.00
tpcds_q60/duckdb:vortex-file-compressed 26294159 25873396 1.02
tpcds_q61/duckdb:vortex-file-compressed 30762414 31106141 0.99
tpcds_q62/duckdb:vortex-file-compressed 15485751 16818355 0.92
tpcds_q63/duckdb:vortex-file-compressed 20780526 21036186 0.99
tpcds_q64/duckdb:vortex-file-compressed 97533363 96294144 1.01
tpcds_q65/duckdb:vortex-file-compressed 22175806 22562248 0.98
tpcds_q66/duckdb:vortex-file-compressed 🚨 33542581 29620335 1.13
tpcds_q67/duckdb:vortex-file-compressed 140392079 143600895 0.98
tpcds_q68/duckdb:vortex-file-compressed 33631135 31603216 1.06
tpcds_q69/duckdb:vortex-file-compressed 39631640 39810011 1.00
tpcds_q70/duckdb:vortex-file-compressed 37158841 38579025 0.96
tpcds_q71/duckdb:vortex-file-compressed 20663741 21122396 0.98
tpcds_q72/duckdb:vortex-file-compressed 169668078 180634589 0.94
tpcds_q73/duckdb:vortex-file-compressed 25760386 24774362 1.04
tpcds_q74/duckdb:vortex-file-compressed 42526298 41748864 1.02
tpcds_q75/duckdb:vortex-file-compressed 48649869 52634596 0.92
tpcds_q76/duckdb:vortex-file-compressed 18551708 18953799 0.98
tpcds_q77/duckdb:vortex-file-compressed 24882313 23854387 1.04
tpcds_q78/duckdb:vortex-file-compressed 78326017 75306626 1.04
tpcds_q79/duckdb:vortex-file-compressed 23559675 24850531 0.95
tpcds_q80/duckdb:vortex-file-compressed 51840816 48029501 1.08
tpcds_q81/duckdb:vortex-file-compressed 29694708 29460986 1.01
tpcds_q82/duckdb:vortex-file-compressed 45277693 45796970 0.99
tpcds_q83/duckdb:vortex-file-compressed 30103059 30862738 0.98
tpcds_q84/duckdb:vortex-file-compressed 17028241 16699707 1.02
tpcds_q85/duckdb:vortex-file-compressed 🚀 39178391 44506116 0.88
tpcds_q86/duckdb:vortex-file-compressed 16231669 16258888 1.00
tpcds_q87/duckdb:vortex-file-compressed 38944646 42106661 0.92
tpcds_q88/duckdb:vortex-file-compressed 55458398 52889118 1.05
tpcds_q89/duckdb:vortex-file-compressed 22094396 22405774 0.99
tpcds_q90/duckdb:vortex-file-compressed 10145595 10784091 0.94
tpcds_q91/duckdb:vortex-file-compressed 🚀 21930995 24922706 0.88
tpcds_q92/duckdb:vortex-file-compressed 17067259 18586996 0.92
tpcds_q93/duckdb:vortex-file-compressed 32000734 31055541 1.03
tpcds_q94/duckdb:vortex-file-compressed 22417670 21964539 1.02
tpcds_q95/duckdb:vortex-file-compressed 166167998 167160480 0.99
tpcds_q96/duckdb:vortex-file-compressed 12905612 13051892 0.99
tpcds_q97/duckdb:vortex-file-compressed 38601872 38337806 1.01
tpcds_q98/duckdb:vortex-file-compressed 18663932 19871692 0.94
tpcds_q99/duckdb:vortex-file-compressed 22485893 22844311 0.98
duckdb / vortex-compact (0.982x ➖, 7↑ 2↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 25873721 26322028 0.98
tpcds_q02/duckdb:vortex-compact 41957454 41764836 1.00
tpcds_q03/duckdb:vortex-compact 45266343 46570664 0.97
tpcds_q04/duckdb:vortex-compact 102624226 104986007 0.98
tpcds_q05/duckdb:vortex-compact 🚀 40224493 44953288 0.89
tpcds_q06/duckdb:vortex-compact 37915562 38457605 0.99
tpcds_q07/duckdb:vortex-compact 🚀 35968158 41786879 0.86
tpcds_q08/duckdb:vortex-compact 41421549 40020904 1.03
tpcds_q09/duckdb:vortex-compact 20401160 21135654 0.97
tpcds_q10/duckdb:vortex-compact 51974728 54071652 0.96
tpcds_q11/duckdb:vortex-compact 73855728 73912372 1.00
tpcds_q12/duckdb:vortex-compact 🚀 21569605 24236922 0.89
tpcds_q13/duckdb:vortex-compact 52330904 54580801 0.96
tpcds_q14/duckdb:vortex-compact 119215188 118046631 1.01
tpcds_q15/duckdb:vortex-compact 29410361 31029712 0.95
tpcds_q16/duckdb:vortex-compact 28383820 27310927 1.04
tpcds_q17/duckdb:vortex-compact 55116068 58907096 0.94
tpcds_q18/duckdb:vortex-compact 49430132 52028366 0.95
tpcds_q19/duckdb:vortex-compact 45473253 44535154 1.02
tpcds_q20/duckdb:vortex-compact 20638933 21037338 0.98
tpcds_q21/duckdb:vortex-compact 17787260 18545238 0.96
tpcds_q22/duckdb:vortex-compact 79450465 80694625 0.98
tpcds_q23/duckdb:vortex-compact 110150706 109008264 1.01
tpcds_q24/duckdb:vortex-compact 57138987 59390218 0.96
tpcds_q25/duckdb:vortex-compact 54253194 51566619 1.05
tpcds_q26/duckdb:vortex-compact 31419482 34519565 0.91
tpcds_q27/duckdb:vortex-compact 🚀 37000366 43524371 0.85
tpcds_q28/duckdb:vortex-compact 34862010 35811974 0.97
tpcds_q29/duckdb:vortex-compact 🚀 52133047 57979967 0.90
tpcds_q30/duckdb:vortex-compact 29099648 29780648 0.98
tpcds_q31/duckdb:vortex-compact 37830054 38657979 0.98
tpcds_q32/duckdb:vortex-compact 21110602 20610627 1.02
tpcds_q33/duckdb:vortex-compact 33391286 32856982 1.02
tpcds_q34/duckdb:vortex-compact 30323879 30875634 0.98
tpcds_q35/duckdb:vortex-compact 75189883 74936384 1.00
tpcds_q36/duckdb:vortex-compact 35262942 36814280 0.96
tpcds_q37/duckdb:vortex-compact 23339111 24054654 0.97
tpcds_q38/duckdb:vortex-compact 42443722 42644882 1.00
tpcds_q39/duckdb:vortex-compact 38686548 37755776 1.02
tpcds_q40/duckdb:vortex-compact 24180523 24317728 0.99
tpcds_q41/duckdb:vortex-compact 🚀 10567553 14031176 0.75
tpcds_q42/duckdb:vortex-compact 19053753 19507410 0.98
tpcds_q43/duckdb:vortex-compact 31535326 31091162 1.01
tpcds_q44/duckdb:vortex-compact 30327248 30305902 1.00
tpcds_q45/duckdb:vortex-compact 35829421 36818187 0.97
tpcds_q46/duckdb:vortex-compact 45159847 45915640 0.98
tpcds_q47/duckdb:vortex-compact 63460155 63898601 0.99
tpcds_q48/duckdb:vortex-compact 45337791 45036209 1.01
tpcds_q49/duckdb:vortex-compact 🚀 44707456 52204835 0.86
tpcds_q50/duckdb:vortex-compact 38213625 37978340 1.01
tpcds_q51/duckdb:vortex-compact 117180857 122165998 0.96
tpcds_q52/duckdb:vortex-compact 19630200 19355682 1.01
tpcds_q53/duckdb:vortex-compact 33215191 33394332 0.99
tpcds_q54/duckdb:vortex-compact 36697374 38063698 0.96
tpcds_q55/duckdb:vortex-compact 18685880 18971349 0.98
tpcds_q56/duckdb:vortex-compact 33332545 33182015 1.00
tpcds_q57/duckdb:vortex-compact 44715403 46952014 0.95
tpcds_q58/duckdb:vortex-compact 37658562 39375517 0.96
tpcds_q59/duckdb:vortex-compact 66992146 66722400 1.00
tpcds_q60/duckdb:vortex-compact 37404269 36794710 1.02
tpcds_q61/duckdb:vortex-compact 55169280 54293217 1.02
tpcds_q62/duckdb:vortex-compact 20804664 21059319 0.99
tpcds_q63/duckdb:vortex-compact 32872021 32006667 1.03
tpcds_q64/duckdb:vortex-compact 124519170 130055634 0.96
tpcds_q65/duckdb:vortex-compact 32151322 30599000 1.05
tpcds_q66/duckdb:vortex-compact 36506227 35428432 1.03
tpcds_q67/duckdb:vortex-compact 152467467 151806889 1.00
tpcds_q68/duckdb:vortex-compact 46311987 46801929 0.99
tpcds_q69/duckdb:vortex-compact 55912460 54240133 1.03
tpcds_q70/duckdb:vortex-compact 55761517 59214280 0.94
tpcds_q71/duckdb:vortex-compact 30275281 30196123 1.00
tpcds_q72/duckdb:vortex-compact 183733804 188030692 0.98
tpcds_q73/duckdb:vortex-compact 28568409 28346026 1.01
tpcds_q74/duckdb:vortex-compact 48381984 49199425 0.98
tpcds_q75/duckdb:vortex-compact 58894684 64836586 0.91
tpcds_q76/duckdb:vortex-compact 29132440 30551561 0.95
tpcds_q77/duckdb:vortex-compact 40987709 38120304 1.08
tpcds_q78/duckdb:vortex-compact 86804713 89402652 0.97
tpcds_q79/duckdb:vortex-compact 40570741 39237047 1.03
tpcds_q80/duckdb:vortex-compact 72494677 70854075 1.02
tpcds_q81/duckdb:vortex-compact 32997536 33233379 0.99
tpcds_q82/duckdb:vortex-compact 49956925 50471350 0.99
tpcds_q83/duckdb:vortex-compact 36039994 36079341 1.00
tpcds_q84/duckdb:vortex-compact 21346604 22269842 0.96
tpcds_q85/duckdb:vortex-compact 55511729 58782193 0.94
tpcds_q86/duckdb:vortex-compact 20447391 20343518 1.01
tpcds_q87/duckdb:vortex-compact 47150328 43699730 1.08
tpcds_q88/duckdb:vortex-compact 77138522 81972101 0.94
tpcds_q89/duckdb:vortex-compact 32469501 33407072 0.97
tpcds_q90/duckdb:vortex-compact 11198703 11281724 0.99
tpcds_q91/duckdb:vortex-compact 41566428 42426404 0.98
tpcds_q92/duckdb:vortex-compact 47042311 49185929 0.96
tpcds_q93/duckdb:vortex-compact 32200274 33453987 0.96
tpcds_q94/duckdb:vortex-compact 26953263 26959823 1.00
tpcds_q95/duckdb:vortex-compact 168616539 164751502 1.02
tpcds_q96/duckdb:vortex-compact 17561892 16963654 1.04
tpcds_q97/duckdb:vortex-compact 🚨 45242569 40646897 1.11
tpcds_q98/duckdb:vortex-compact 28856125 27758016 1.04
tpcds_q99/duckdb:vortex-compact 🚨 27960803 25251986 1.11
duckdb / parquet (1.011x ➖, 0↑ 2↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29409816 28700575 1.02
tpcds_q02/duckdb:parquet 25216750 24687494 1.02
tpcds_q03/duckdb:parquet 13256294 13288350 1.00
tpcds_q04/duckdb:parquet 166490599 172650428 0.96
tpcds_q05/duckdb:parquet 31719767 29549492 1.07
tpcds_q06/duckdb:parquet 33000854 33825091 0.98
tpcds_q07/duckdb:parquet 23715783 24314604 0.98
tpcds_q08/duckdb:parquet 29121699 29392733 0.99
tpcds_q09/duckdb:parquet 44289472 45056451 0.98
tpcds_q10/duckdb:parquet 37882865 38332353 0.99
tpcds_q11/duckdb:parquet 93691672 88304635 1.06
tpcds_q12/duckdb:parquet 17167807 17289167 0.99
tpcds_q13/duckdb:parquet 35201790 35092017 1.00
tpcds_q14/duckdb:parquet 103027287 100733382 1.02
tpcds_q15/duckdb:parquet 29801866 31264889 0.95
tpcds_q16/duckdb:parquet 22318099 22710807 0.98
tpcds_q17/duckdb:parquet 38233519 39045399 0.98
tpcds_q18/duckdb:parquet 48393805 47687299 1.01
tpcds_q19/duckdb:parquet 31908268 32226575 0.99
tpcds_q20/duckdb:parquet 18293485 18362669 1.00
tpcds_q21/duckdb:parquet 11503866 11468699 1.00
tpcds_q22/duckdb:parquet 70241289 74295334 0.95
tpcds_q23/duckdb:parquet 81040333 82641089 0.98
tpcds_q24/duckdb:parquet 46718972 47262610 0.99
tpcds_q25/duckdb:parquet 35566368 35367397 1.01
tpcds_q26/duckdb:parquet 38889106 39670806 0.98
tpcds_q27/duckdb:parquet 52837411 52743231 1.00
tpcds_q28/duckdb:parquet 43389653 42571181 1.02
tpcds_q29/duckdb:parquet 37510959 38461002 0.98
tpcds_q30/duckdb:parquet 37716035 37613044 1.00
tpcds_q31/duckdb:parquet 28097765 27689831 1.01
tpcds_q32/duckdb:parquet 12748041 12764754 1.00
tpcds_q33/duckdb:parquet 24217231 23901579 1.01
tpcds_q34/duckdb:parquet 21904559 22923725 0.96
tpcds_q35/duckdb:parquet 63010598 62002023 1.02
tpcds_q36/duckdb:parquet 22935368 22601353 1.01
tpcds_q37/duckdb:parquet 13964772 14161846 0.99
tpcds_q38/duckdb:parquet 39804638 36662759 1.09
tpcds_q39/duckdb:parquet 33330455 32216715 1.03
tpcds_q40/duckdb:parquet 19448272 19406882 1.00
tpcds_q41/duckdb:parquet 9045417 8953565 1.01
tpcds_q42/duckdb:parquet 14217557 13710293 1.04
tpcds_q43/duckdb:parquet 18082360 18080476 1.00
tpcds_q44/duckdb:parquet 26186080 26767041 0.98
tpcds_q45/duckdb:parquet 28090698 29137124 0.96
tpcds_q46/duckdb:parquet 48026669 47619041 1.01
tpcds_q47/duckdb:parquet 51502593 52589205 0.98
tpcds_q48/duckdb:parquet 32505492 32509862 1.00
tpcds_q49/duckdb:parquet 28977130 28791875 1.01
tpcds_q50/duckdb:parquet 26049016 26043342 1.00
tpcds_q51/duckdb:parquet 104195466 102193749 1.02
tpcds_q52/duckdb:parquet 12590322 13230734 0.95
tpcds_q53/duckdb:parquet 19341185 19092016 1.01
tpcds_q54/duckdb:parquet 30024576 28930209 1.04
tpcds_q55/duckdb:parquet 12772908 13070074 0.98
tpcds_q56/duckdb:parquet 24617616 23209338 1.06
tpcds_q57/duckdb:parquet 38883582 38229717 1.02
tpcds_q58/duckdb:parquet 26336465 25127122 1.05
tpcds_q59/duckdb:parquet 36877918 36321224 1.02
tpcds_q60/duckdb:parquet 26485460 25167689 1.05
tpcds_q61/duckdb:parquet 36312835 33935310 1.07
tpcds_q62/duckdb:parquet 13265997 12786847 1.04
tpcds_q63/duckdb:parquet 18061400 17571000 1.03
tpcds_q64/duckdb:parquet 77145613 79404781 0.97
tpcds_q65/duckdb:parquet 23109194 24543367 0.94
tpcds_q66/duckdb:parquet 29937080 29288663 1.02
tpcds_q67/duckdb:parquet 142110949 136637872 1.04
tpcds_q68/duckdb:parquet 39541170 38806124 1.02
tpcds_q69/duckdb:parquet 38448574 38496244 1.00
tpcds_q70/duckdb:parquet 22926136 23274734 0.99
tpcds_q71/duckdb:parquet 23938128 23336930 1.03
tpcds_q72/duckdb:parquet 166484024 165753847 1.00
tpcds_q73/duckdb:parquet 19485457 19911228 0.98
tpcds_q74/duckdb:parquet 129845534 127587718 1.02
tpcds_q75/duckdb:parquet 59719944 58938301 1.01
tpcds_q76/duckdb:parquet 23076177 22235673 1.04
tpcds_q77/duckdb:parquet 25603110 25320219 1.01
tpcds_q78/duckdb:parquet 79556850 77724710 1.02
tpcds_q79/duckdb:parquet 30774829 30393908 1.01
tpcds_q80/duckdb:parquet 44888907 43886936 1.02
tpcds_q81/duckdb:parquet 36648032 35451457 1.03
tpcds_q82/duckdb:parquet 18483975 17807964 1.04
tpcds_q83/duckdb:parquet 19196570 18566035 1.03
tpcds_q84/duckdb:parquet 21553305 20345811 1.06
tpcds_q85/duckdb:parquet 44093427 42485702 1.04
tpcds_q86/duckdb:parquet 14355905 13550753 1.06
tpcds_q87/duckdb:parquet 41162304 42078473 0.98
tpcds_q88/duckdb:parquet 55832447 53888984 1.04
tpcds_q89/duckdb:parquet 🚨 22784179 20554241 1.11
tpcds_q90/duckdb:parquet 9376515 8542358 1.10
tpcds_q91/duckdb:parquet 26202724 25945123 1.01
tpcds_q92/duckdb:parquet 13798194 13312614 1.04
tpcds_q93/duckdb:parquet 32792520 31606553 1.04
tpcds_q94/duckdb:parquet 18743237 18164489 1.03
tpcds_q95/duckdb:parquet 🚨 139851490 122795821 1.14
tpcds_q96/duckdb:parquet 10814173 10890485 0.99
tpcds_q97/duckdb:parquet 38571942 38839115 0.99
tpcds_q98/duckdb:parquet 23829640 25245332 0.94
tpcds_q99/duckdb:parquet 20839857 20208799 1.03
duckdb / duckdb (1.038x ➖, 1↑ 5↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 23409587 21766912 1.08
tpcds_q02/duckdb:duckdb 20423563 19455121 1.05
tpcds_q03/duckdb:duckdb 🚨 11279739 9903844 1.14
tpcds_q04/duckdb:duckdb 181406350 181515668 1.00
tpcds_q05/duckdb:duckdb 21363027 20613998 1.04
tpcds_q06/duckdb:duckdb 28789611 28454825 1.01
tpcds_q07/duckdb:duckdb 41793396 39918200 1.05
tpcds_q08/duckdb:duckdb 121068645 120571606 1.00
tpcds_q09/duckdb:duckdb 21016927 20806928 1.01
tpcds_q10/duckdb:duckdb 28582456 27729914 1.03
tpcds_q11/duckdb:duckdb 98383718 90510350 1.09
tpcds_q12/duckdb:duckdb 15047909 13792991 1.09
tpcds_q13/duckdb:duckdb 27105912 26376701 1.03
tpcds_q14/duckdb:duckdb 95286915 93629087 1.02
tpcds_q15/duckdb:duckdb 27136519 25206023 1.08
tpcds_q16/duckdb:duckdb 20222475 19683173 1.03
tpcds_q17/duckdb:duckdb 25830566 24355898 1.06
tpcds_q18/duckdb:duckdb 48292490 47337187 1.02
tpcds_q19/duckdb:duckdb 19954145 19501073 1.02
tpcds_q20/duckdb:duckdb 15074848 14240844 1.06
tpcds_q21/duckdb:duckdb 8151387 7710866 1.06
tpcds_q22/duckdb:duckdb 65103252 66465265 0.98
tpcds_q23/duckdb:duckdb 81828910 76546722 1.07
tpcds_q24/duckdb:duckdb 26098193 25974371 1.00
tpcds_q25/duckdb:duckdb 19571566 18828234 1.04
tpcds_q26/duckdb:duckdb 30255958 28642818 1.06
tpcds_q27/duckdb:duckdb 43676982 41309287 1.06
tpcds_q28/duckdb:duckdb 26568487 26558939 1.00
tpcds_q29/duckdb:duckdb 23572974 22814262 1.03
tpcds_q30/duckdb:duckdb 32161373 31182715 1.03
tpcds_q31/duckdb:duckdb 54176872 50764955 1.07
tpcds_q32/duckdb:duckdb 8815642 8543360 1.03
tpcds_q33/duckdb:duckdb 17143134 16208545 1.06
tpcds_q34/duckdb:duckdb 19771684 18636090 1.06
tpcds_q35/duckdb:duckdb 39350356 36233213 1.09
tpcds_q36/duckdb:duckdb 75779661 71328718 1.06
tpcds_q37/duckdb:duckdb 9521197 8773326 1.09
tpcds_q38/duckdb:duckdb 34398269 33077237 1.04
tpcds_q39/duckdb:duckdb 28779848 28343059 1.02
tpcds_q40/duckdb:duckdb 🚨 15978358 14502138 1.10
tpcds_q41/duckdb:duckdb 9709830 9425400 1.03
tpcds_q42/duckdb:duckdb 9763079 9318211 1.05
tpcds_q43/duckdb:duckdb 15419884 14522531 1.06
tpcds_q44/duckdb:duckdb 15896041 16690946 0.95
tpcds_q45/duckdb:duckdb 19343974 18879687 1.02
tpcds_q46/duckdb:duckdb 39800953 38553726 1.03
tpcds_q47/duckdb:duckdb 46201584 46686522 0.99
tpcds_q48/duckdb:duckdb 25640022 25384769 1.01
tpcds_q49/duckdb:duckdb 20758766 20467358 1.01
tpcds_q50/duckdb:duckdb 16913329 16113567 1.05
tpcds_q51/duckdb:duckdb 101273972 100327016 1.01
tpcds_q52/duckdb:duckdb 9203125 9305622 0.99
tpcds_q53/duckdb:duckdb 17709674 16960172 1.04
tpcds_q54/duckdb:duckdb 19534145 19282430 1.01
tpcds_q55/duckdb:duckdb 🚨 10326381 8884736 1.16
tpcds_q56/duckdb:duckdb 16950538 17359094 0.98
tpcds_q57/duckdb:duckdb 37664321 36132828 1.04
tpcds_q58/duckdb:duckdb 17374757 17247376 1.01
tpcds_q59/duckdb:duckdb 37826064 36522514 1.04
tpcds_q60/duckdb:duckdb 19396672 18261782 1.06
tpcds_q61/duckdb:duckdb 18001490 17202903 1.05
tpcds_q62/duckdb:duckdb 10516680 9854915 1.07
tpcds_q63/duckdb:duckdb 16959745 16178071 1.05
tpcds_q64/duckdb:duckdb 59677202 57840198 1.03
tpcds_q65/duckdb:duckdb 37949422 36644327 1.04
tpcds_q66/duckdb:duckdb 27992069 26239221 1.07
tpcds_q67/duckdb:duckdb 139301685 131991299 1.06
tpcds_q68/duckdb:duckdb 27218860 27032477 1.01
tpcds_q69/duckdb:duckdb 29319603 29176481 1.00
tpcds_q70/duckdb:duckdb 17857936 17032905 1.05
tpcds_q71/duckdb:duckdb 16234190 15764139 1.03
tpcds_q72/duckdb:duckdb 46728005 46193056 1.01
tpcds_q73/duckdb:duckdb 13641436 14301814 0.95
tpcds_q74/duckdb:duckdb 150001488 144594904 1.04
tpcds_q75/duckdb:duckdb 47594885 47655839 1.00
tpcds_q76/duckdb:duckdb 15163914 15112381 1.00
tpcds_q77/duckdb:duckdb 16377488 15779646 1.04
tpcds_q78/duckdb:duckdb 69496121 66386021 1.05
tpcds_q79/duckdb:duckdb 21115237 20175751 1.05
tpcds_q80/duckdb:duckdb 33384893 31453817 1.06
tpcds_q81/duckdb:duckdb 41765365 39872019 1.05
tpcds_q82/duckdb:duckdb 10953606 10113415 1.08
tpcds_q83/duckdb:duckdb 11716621 10870950 1.08
tpcds_q84/duckdb:duckdb 16114136 14818695 1.09
tpcds_q85/duckdb:duckdb 27579696 25646193 1.08
tpcds_q86/duckdb:duckdb 12718942 11980180 1.06
tpcds_q87/duckdb:duckdb 37002705 36224867 1.02
tpcds_q88/duckdb:duckdb 30718910 30256637 1.02
tpcds_q89/duckdb:duckdb 22581499 22601189 1.00
tpcds_q90/duckdb:duckdb 🚨 6796116 6166790 1.10
tpcds_q91/duckdb:duckdb 15917263 14677880 1.08
tpcds_q92/duckdb:duckdb 🚨 10737547 9746346 1.10
tpcds_q93/duckdb:duckdb 25124944 23623873 1.06
tpcds_q94/duckdb:duckdb 14927947 14690727 1.02
tpcds_q95/duckdb:duckdb 🚀 114330783 131880735 0.87
tpcds_q96/duckdb:duckdb 6295018 5929913 1.06
tpcds_q97/duckdb:duckdb 33997624 32592073 1.04
tpcds_q98/duckdb:duckdb 20899887 20939965 1.00
tpcds_q99/duckdb:duckdb 17389829 16829385 1.03

File Size Changes (9 files changed, +0.0% overall, 5↑ 4↓)
File Scale Format Base HEAD Change %
customer_address.vortex 1.0 vortex-file-compressed 820.95 KB 826.93 KB +5.98 KB +0.7%
item.vortex 1.0 vortex-file-compressed 1.64 MB 1.64 MB +2.06 KB +0.1%
store_sales.vortex 1.0 vortex-file-compressed 96.34 MB 96.34 MB +3.12 KB +0.0%
web_sales.vortex 1.0 vortex-file-compressed 34.20 MB 34.21 MB +424 B +0.0%
catalog_sales.vortex 1.0 vortex-file-compressed 70.45 MB 70.45 MB +672 B +0.0%
customer.vortex 1.0 vortex-file-compressed 4.27 MB 4.27 MB 384 B -0.0%
item.vortex 1.0 vortex-compact 994.93 KB 994.57 KB 360 B -0.0%
catalog_page.vortex 1.0 vortex-file-compressed 566.93 KB 565.79 KB 1.14 KB -0.2%
time_dim.vortex 1.0 vortex-file-compressed 382.29 KB 380.73 KB 1.56 KB -0.4%

Totals:

  • vortex-compact: 207.50 MB → 207.50 MB (-0.0%)
  • vortex-file-compressed: 270.03 MB → 270.04 MB (+0.0%)

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (+1.1%, low confidence) · DuckDB No clear signal (-1.5%, low confidence)
Vortex (geomean): 1.014x ➖
Parquet (geomean): 1.021x ➖
Shifts: Parquet (control) +2.1% · Median polish +1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.047x ➖, 1↑ 7↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2033912 1577612 1.29
clickbench_q01/datafusion:vortex-file-compressed 15819933 14921491 1.06
clickbench_q02/datafusion:vortex-file-compressed 36118852 34933141 1.03
clickbench_q03/datafusion:vortex-file-compressed 39409392 38533252 1.02
clickbench_q04/datafusion:vortex-file-compressed 244759683 236367001 1.04
clickbench_q05/datafusion:vortex-file-compressed 325138997 311289241 1.04
clickbench_q06/datafusion:vortex-file-compressed 1646732 1622441 1.01
clickbench_q07/datafusion:vortex-file-compressed 18976777 18792304 1.01
clickbench_q08/datafusion:vortex-file-compressed 342358747 330882841 1.03
clickbench_q09/datafusion:vortex-file-compressed 481358253 446506204 1.08
clickbench_q10/datafusion:vortex-file-compressed 74980425 71803967 1.04
clickbench_q11/datafusion:vortex-file-compressed 85431817 81485427 1.05
clickbench_q12/datafusion:vortex-file-compressed 277663577 257925466 1.08
clickbench_q13/datafusion:vortex-file-compressed 444820894 414378140 1.07
clickbench_q14/datafusion:vortex-file-compressed 🚨 273036063 247382995 1.10
clickbench_q15/datafusion:vortex-file-compressed 293728898 277387850 1.06
clickbench_q16/datafusion:vortex-file-compressed 690198858 651118746 1.06
clickbench_q17/datafusion:vortex-file-compressed 686958346 733823947 0.94
clickbench_q18/datafusion:vortex-file-compressed 1407686636 1374364581 1.02
clickbench_q19/datafusion:vortex-file-compressed 🚨 37732621 29265244 1.29
clickbench_q20/datafusion:vortex-file-compressed 321015715 306134526 1.05
clickbench_q21/datafusion:vortex-file-compressed 408972879 390909683 1.05
clickbench_q22/datafusion:vortex-file-compressed 517171522 501174947 1.03
clickbench_q23/datafusion:vortex-file-compressed 🚨 689457544 610662312 1.13
clickbench_q24/datafusion:vortex-file-compressed 42826705 42880945 1.00
clickbench_q25/datafusion:vortex-file-compressed 71212211 70501069 1.01
clickbench_q26/datafusion:vortex-file-compressed 🚨 45595911 40696589 1.12
clickbench_q27/datafusion:vortex-file-compressed 437629017 414569507 1.06
clickbench_q28/datafusion:vortex-file-compressed 2435912928 2371593953 1.03
clickbench_q29/datafusion:vortex-file-compressed 🚨 58342708 52530171 1.11
clickbench_q30/datafusion:vortex-file-compressed 229741425 226558549 1.01
clickbench_q31/datafusion:vortex-file-compressed 256856827 235485707 1.09
clickbench_q32/datafusion:vortex-file-compressed 1072840502 1043972095 1.03
clickbench_q33/datafusion:vortex-file-compressed 1448249360 1400862595 1.03
clickbench_q34/datafusion:vortex-file-compressed 1430976876 1406267580 1.02
clickbench_q35/datafusion:vortex-file-compressed 247823082 236927365 1.05
clickbench_q36/datafusion:vortex-file-compressed 54259485 55303079 0.98
clickbench_q37/datafusion:vortex-file-compressed 25593971 24639380 1.04
clickbench_q38/datafusion:vortex-file-compressed 🚨 17633195 15974093 1.10
clickbench_q39/datafusion:vortex-file-compressed 121144441 118184052 1.03
clickbench_q40/datafusion:vortex-file-compressed 12852893 12588186 1.02
clickbench_q41/datafusion:vortex-file-compressed 12552120 12610355 1.00
clickbench_q42/datafusion:vortex-file-compressed 🚀 11523629 13892286 0.83
datafusion / parquet (1.036x ➖, 0↑ 2↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1560323 1533131 1.02
clickbench_q01/datafusion:parquet 20185677 19662374 1.03
clickbench_q02/datafusion:parquet 43787894 44250562 0.99
clickbench_q03/datafusion:parquet 34455862 33863447 1.02
clickbench_q04/datafusion:parquet 270483825 275591742 0.98
clickbench_q05/datafusion:parquet 338054402 321006728 1.05
clickbench_q06/datafusion:parquet 1545773 1481531 1.04
clickbench_q07/datafusion:parquet 22695217 20904261 1.09
clickbench_q08/datafusion:parquet 344074974 337162282 1.02
clickbench_q09/datafusion:parquet 509259677 484154564 1.05
clickbench_q10/datafusion:parquet 95099688 96466155 0.99
clickbench_q11/datafusion:parquet 120307504 117546697 1.02
clickbench_q12/datafusion:parquet 327938753 300652379 1.09
clickbench_q13/datafusion:parquet 495628309 468358213 1.06
clickbench_q14/datafusion:parquet 329237602 309779619 1.06
clickbench_q15/datafusion:parquet 308336818 292659874 1.05
clickbench_q16/datafusion:parquet 711128931 662347748 1.07
clickbench_q17/datafusion:parquet 678682210 647775890 1.05
clickbench_q18/datafusion:parquet 1449818681 1452176134 1.00
clickbench_q19/datafusion:parquet 28032651 27985919 1.00
clickbench_q20/datafusion:parquet 574742163 574104382 1.00
clickbench_q21/datafusion:parquet 645250074 628196768 1.03
clickbench_q22/datafusion:parquet 943849945 920035476 1.03
clickbench_q23/datafusion:parquet 4220371115 4093092879 1.03
clickbench_q24/datafusion:parquet 54604406 54785420 1.00
clickbench_q25/datafusion:parquet 131398215 131335529 1.00
clickbench_q26/datafusion:parquet 53547546 54843992 0.98
clickbench_q27/datafusion:parquet 677445493 653314604 1.04
clickbench_q28/datafusion:parquet 2520583626 2461253274 1.02
clickbench_q29/datafusion:parquet 🚨 50398888 44853601 1.12
clickbench_q30/datafusion:parquet 329980488 308675769 1.07
clickbench_q31/datafusion:parquet 349394147 343847820 1.02
clickbench_q32/datafusion:parquet 1162722023 1101398136 1.06
clickbench_q33/datafusion:parquet 1550659307 1509259321 1.03
clickbench_q34/datafusion:parquet 1575664842 1494667229 1.05
clickbench_q35/datafusion:parquet 253107376 252808212 1.00
clickbench_q36/datafusion:parquet 112432739 109621038 1.03
clickbench_q37/datafusion:parquet 🚨 47887954 42915706 1.12
clickbench_q38/datafusion:parquet 65803494 61547831 1.07
clickbench_q39/datafusion:parquet 218554103 210616274 1.04
clickbench_q40/datafusion:parquet 24004005 23553405 1.02
clickbench_q41/datafusion:parquet 22540005 20902849 1.08
clickbench_q42/datafusion:parquet 22452476 21271401 1.06
duckdb / vortex-file-compressed (0.982x ➖, 6↑ 2↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6902532 6712317 1.03
clickbench_q01/duckdb:vortex-file-compressed 11372146 11751391 0.97
clickbench_q02/duckdb:vortex-file-compressed 25923961 26612271 0.97
clickbench_q03/duckdb:vortex-file-compressed 32874943 30458287 1.08
clickbench_q04/duckdb:vortex-file-compressed 195284362 189033000 1.03
clickbench_q05/duckdb:vortex-file-compressed 183465196 180223795 1.02
clickbench_q06/duckdb:vortex-file-compressed 20937429 19341589 1.08
clickbench_q07/duckdb:vortex-file-compressed 15652264 14423147 1.09
clickbench_q08/duckdb:vortex-file-compressed 269102959 263354069 1.02
clickbench_q09/duckdb:vortex-file-compressed 340591239 339174431 1.00
clickbench_q10/duckdb:vortex-file-compressed 71390619 68214860 1.05
clickbench_q11/duckdb:vortex-file-compressed 80743197 80230890 1.01
clickbench_q12/duckdb:vortex-file-compressed 201363629 198112182 1.02
clickbench_q13/duckdb:vortex-file-compressed 407415350 414634647 0.98
clickbench_q14/duckdb:vortex-file-compressed 229015244 234568133 0.98
clickbench_q15/duckdb:vortex-file-compressed 240222325 244396299 0.98
clickbench_q16/duckdb:vortex-file-compressed 528273918 527186128 1.00
clickbench_q17/duckdb:vortex-file-compressed 422954728 435261340 0.97
clickbench_q18/duckdb:vortex-file-compressed 949797310 944182543 1.01
clickbench_q19/duckdb:vortex-file-compressed 21279727 21859643 0.97
clickbench_q20/duckdb:vortex-file-compressed 292851843 304660953 0.96
clickbench_q21/duckdb:vortex-file-compressed 382186741 373375486 1.02
clickbench_q22/duckdb:vortex-file-compressed 🚨 674973054 562251663 1.20
clickbench_q23/duckdb:vortex-file-compressed 🚀 145383771 170274299 0.85
clickbench_q24/duckdb:vortex-file-compressed 35719433 34335772 1.04
clickbench_q25/duckdb:vortex-file-compressed 🚨 84394354 74490793 1.13
clickbench_q26/duckdb:vortex-file-compressed 46858007 51352797 0.91
clickbench_q27/duckdb:vortex-file-compressed 214634391 211295194 1.02
clickbench_q28/duckdb:vortex-file-compressed 2995296694 3035712685 0.99
clickbench_q29/duckdb:vortex-file-compressed 28782811 28816953 1.00
clickbench_q30/duckdb:vortex-file-compressed 201132354 191690459 1.05
clickbench_q31/duckdb:vortex-file-compressed 285980969 291809059 0.98
clickbench_q32/duckdb:vortex-file-compressed 1126119969 1111967334 1.01
clickbench_q33/duckdb:vortex-file-compressed 1135806238 1126540186 1.01
clickbench_q34/duckdb:vortex-file-compressed 1225989310 1227810330 1.00
clickbench_q35/duckdb:vortex-file-compressed 386468821 383049913 1.01
clickbench_q36/duckdb:vortex-file-compressed 🚀 27336421 32396067 0.84
clickbench_q37/duckdb:vortex-file-compressed 🚀 19712937 23249110 0.85
clickbench_q38/duckdb:vortex-file-compressed 🚀 21253885 27314080 0.78
clickbench_q39/duckdb:vortex-file-compressed 46104326 47083507 0.98
clickbench_q40/duckdb:vortex-file-compressed 🚀 18033062 23824068 0.76
clickbench_q41/duckdb:vortex-file-compressed 🚀 19072317 23416720 0.81
clickbench_q42/duckdb:vortex-file-compressed 23125373 24826045 0.93
duckdb / parquet (1.007x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 23458723 21960767 1.07
clickbench_q01/duckdb:parquet 30392182 29865201 1.02
clickbench_q02/duckdb:parquet 50574338 49897275 1.01
clickbench_q03/duckdb:parquet 39509007 40018149 0.99
clickbench_q04/duckdb:parquet 207983333 202617979 1.03
clickbench_q05/duckdb:parquet 260400388 261096891 1.00
clickbench_q06/duckdb:parquet 46929378 47053380 1.00
clickbench_q07/duckdb:parquet 31456758 31488545 1.00
clickbench_q08/duckdb:parquet 271740261 268487980 1.01
clickbench_q09/duckdb:parquet 405163343 402806921 1.01
clickbench_q10/duckdb:parquet 82212651 84777278 0.97
clickbench_q11/duckdb:parquet 101495025 99715623 1.02
clickbench_q12/duckdb:parquet 287560265 280856524 1.02
clickbench_q13/duckdb:parquet 482717946 467200143 1.03
clickbench_q14/duckdb:parquet 317055327 315147640 1.01
clickbench_q15/duckdb:parquet 263502198 261779237 1.01
clickbench_q16/duckdb:parquet 604390059 595401664 1.02
clickbench_q17/duckdb:parquet 502485473 493076569 1.02
clickbench_q18/duckdb:parquet 1050053775 1031710425 1.02
clickbench_q19/duckdb:parquet 28475375 27785068 1.02
clickbench_q20/duckdb:parquet 416300173 416543340 1.00
clickbench_q21/duckdb:parquet 538738861 530157384 1.02
clickbench_q22/duckdb:parquet 922404119 929164295 0.99
clickbench_q23/duckdb:parquet 268204545 264118443 1.02
clickbench_q24/duckdb:parquet 71171753 71340745 1.00
clickbench_q25/duckdb:parquet 162918018 163490857 1.00
clickbench_q26/duckdb:parquet 56088151 53669208 1.05
clickbench_q27/duckdb:parquet 473991333 473512314 1.00
clickbench_q28/duckdb:parquet 4818761396 4781285196 1.01
clickbench_q29/duckdb:parquet 42256840 41560971 1.02
clickbench_q30/duckdb:parquet 316716759 312648950 1.01
clickbench_q31/duckdb:parquet 374518028 379815746 0.99
clickbench_q32/duckdb:parquet 1126035851 1112262298 1.01
clickbench_q33/duckdb:parquet 1132566314 1097397782 1.03
clickbench_q34/duckdb:parquet 1182536835 1158053525 1.02
clickbench_q35/duckdb:parquet 373611834 369568159 1.01
clickbench_q36/duckdb:parquet 46073817 46782931 0.98
clickbench_q37/duckdb:parquet 33746727 34578277 0.98
clickbench_q38/duckdb:parquet 36011147 38329759 0.94
clickbench_q39/duckdb:parquet 92943967 89430090 1.04
clickbench_q40/duckdb:parquet 20151542 20827466 0.97
clickbench_q41/duckdb:parquet 20776148 20803076 1.00
clickbench_q42/duckdb:parquet 23316129 23369450 1.00
duckdb / duckdb (1.003x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17026162 16908865 1.01
clickbench_q01/duckdb:duckdb 34041587 34229968 0.99
clickbench_q02/duckdb:duckdb 50687324 50390884 1.01
clickbench_q03/duckdb:duckdb 56796851 55262556 1.03
clickbench_q04/duckdb:duckdb 208657645 209541398 1.00
clickbench_q05/duckdb:duckdb 282854825 281973576 1.00
clickbench_q06/duckdb:duckdb 32916840 33383426 0.99
clickbench_q07/duckdb:duckdb 34477604 34737382 0.99
clickbench_q08/duckdb:duckdb 275131404 273884013 1.00
clickbench_q09/duckdb:duckdb 388965166 397526529 0.98
clickbench_q10/duckdb:duckdb 117216000 116951070 1.00
clickbench_q11/duckdb:duckdb 126956611 125081254 1.01
clickbench_q12/duckdb:duckdb 256778172 257714729 1.00
clickbench_q13/duckdb:duckdb 443892085 443998867 1.00
clickbench_q14/duckdb:duckdb 282218610 281901109 1.00
clickbench_q15/duckdb:duckdb 241195264 247172276 0.98
clickbench_q16/duckdb:duckdb 556054416 562182525 0.99
clickbench_q17/duckdb:duckdb 468775793 474160511 0.99
clickbench_q18/duckdb:duckdb 986231892 1007359066 0.98
clickbench_q19/duckdb:duckdb 35011226 34841070 1.00
clickbench_q20/duckdb:duckdb 482248006 485016727 0.99
clickbench_q21/duckdb:duckdb 493224944 478213363 1.03
clickbench_q22/duckdb:duckdb 541301106 538390701 1.01
clickbench_q23/duckdb:duckdb 254964632 244700422 1.04
clickbench_q24/duckdb:duckdb 60405972 61135810 0.99
clickbench_q25/duckdb:duckdb 149198948 149621522 1.00
clickbench_q26/duckdb:duckdb 61653257 61154417 1.01
clickbench_q27/duckdb:duckdb 412200341 424498659 0.97
clickbench_q28/duckdb:duckdb 4443698356 4372761964 1.02
clickbench_q29/duckdb:duckdb 49953437 49510473 1.01
clickbench_q30/duckdb:duckdb 281528825 273375127 1.03
clickbench_q31/duckdb:duckdb 364034653 358195958 1.02
clickbench_q32/duckdb:duckdb 1096307578 1112026297 0.99
clickbench_q33/duckdb:duckdb 1120482499 1135459039 0.99
clickbench_q34/duckdb:duckdb 1200381194 1210519020 0.99
clickbench_q35/duckdb:duckdb 296646411 297187761 1.00
clickbench_q36/duckdb:duckdb 50849151 48466612 1.05
clickbench_q37/duckdb:duckdb 28413361 28204688 1.01
clickbench_q38/duckdb:duckdb 32258478 32863224 0.98
clickbench_q39/duckdb:duckdb 83820525 80380733 1.04
clickbench_q40/duckdb:duckdb 27628094 27526952 1.00
clickbench_q41/duckdb:duckdb 27452328 26763852 1.03
clickbench_q42/duckdb:duckdb 28852286 28964638 1.00

File Size Changes (104 files changed, +0.0% overall, 54↑ 50↓)
File Scale Format Base HEAD Change %
hits_90.vortex 1.0 vortex-compact 81.72 MB 82.52 MB +816.95 KB +1.0%
hits_82.vortex 1.0 vortex-compact 66.79 MB 67.00 MB +219.58 KB +0.3%
hits_53.vortex 1.0 vortex-file-compressed 85.75 MB 85.97 MB +229.36 KB +0.3%
hits_10.vortex 1.0 vortex-file-compressed 69.27 MB 69.42 MB +157.87 KB +0.2%
hits_25.vortex 1.0 vortex-file-compressed 113.14 MB 113.37 MB +235.01 KB +0.2%
hits_37.vortex 1.0 vortex-file-compressed 85.35 MB 85.51 MB +164.47 KB +0.2%
hits_52.vortex 1.0 vortex-file-compressed 103.48 MB 103.66 MB +182.43 KB +0.2%
hits_42.vortex 1.0 vortex-file-compressed 221.62 MB 221.94 MB +328.90 KB +0.1%
hits_36.vortex 1.0 vortex-file-compressed 68.27 MB 68.36 MB +88.52 KB +0.1%
hits_31.vortex 1.0 vortex-file-compressed 90.05 MB 90.16 MB +112.67 KB +0.1%
hits_94.vortex 1.0 vortex-file-compressed 138.41 MB 138.58 MB +171.04 KB +0.1%
hits_69.vortex 1.0 vortex-file-compressed 122.86 MB 123.01 MB +149.05 KB +0.1%
hits_28.vortex 1.0 vortex-file-compressed 119.64 MB 119.77 MB +131.33 KB +0.1%
hits_60.vortex 1.0 vortex-file-compressed 103.08 MB 103.18 MB +108.48 KB +0.1%
hits_39.vortex 1.0 vortex-file-compressed 80.04 MB 80.11 MB +77.12 KB +0.1%
hits_87.vortex 1.0 vortex-file-compressed 172.10 MB 172.27 MB +165.49 KB +0.1%
hits_55.vortex 1.0 vortex-file-compressed 168.80 MB 168.95 MB +159.91 KB +0.1%
hits_61.vortex 1.0 vortex-file-compressed 100.99 MB 101.08 MB +90.42 KB +0.1%
hits_23.vortex 1.0 vortex-file-compressed 76.43 MB 76.49 MB +59.95 KB +0.1%
hits_18.vortex 1.0 vortex-file-compressed 104.30 MB 104.37 MB +78.48 KB +0.1%
hits_12.vortex 1.0 vortex-file-compressed 100.78 MB 100.85 MB +73.51 KB +0.1%
hits_24.vortex 1.0 vortex-file-compressed 75.95 MB 76.00 MB +53.46 KB +0.1%
hits_13.vortex 1.0 vortex-file-compressed 99.04 MB 99.11 MB +69.50 KB +0.1%
hits_6.vortex 1.0 vortex-file-compressed 93.24 MB 93.30 MB +63.50 KB +0.1%
hits_64.vortex 1.0 vortex-file-compressed 81.01 MB 81.06 MB +54.18 KB +0.1%
hits_85.vortex 1.0 vortex-file-compressed 91.49 MB 91.55 MB +58.55 KB +0.1%
hits_33.vortex 1.0 vortex-file-compressed 57.04 MB 57.08 MB +36.19 KB +0.1%
hits_83.vortex 1.0 vortex-file-compressed 89.11 MB 89.16 MB +56.51 KB +0.1%
hits_90.vortex 1.0 vortex-file-compressed 139.75 MB 139.84 MB +85.26 KB +0.1%
hits_22.vortex 1.0 vortex-file-compressed 76.86 MB 76.91 MB +46.46 KB +0.1%
hits_80.vortex 1.0 vortex-file-compressed 105.06 MB 105.12 MB +62.45 KB +0.1%
hits_3.vortex 1.0 vortex-file-compressed 141.60 MB 141.68 MB +80.80 KB +0.1%
hits_98.vortex 1.0 vortex-file-compressed 118.13 MB 118.19 MB +65.80 KB +0.1%
hits_15.vortex 1.0 vortex-file-compressed 89.08 MB 89.12 MB +48.36 KB +0.1%
hits_63.vortex 1.0 vortex-file-compressed 69.10 MB 69.14 MB +37.18 KB +0.1%
hits_49.vortex 1.0 vortex-file-compressed 75.45 MB 75.48 MB +36.22 KB +0.0%
hits_57.vortex 1.0 vortex-file-compressed 127.96 MB 128.01 MB +51.72 KB +0.0%
hits_84.vortex 1.0 vortex-file-compressed 116.85 MB 116.89 MB +45.29 KB +0.0%
hits_92.vortex 1.0 vortex-file-compressed 146.46 MB 146.51 MB +52.20 KB +0.0%
hits_81.vortex 1.0 vortex-file-compressed 100.64 MB 100.67 MB +31.57 KB +0.0%
hits_51.vortex 1.0 vortex-file-compressed 277.53 MB 277.61 MB +79.29 KB +0.0%
hits_7.vortex 1.0 vortex-file-compressed 93.88 MB 93.90 MB +22.87 KB +0.0%
hits_5.vortex 1.0 vortex-file-compressed 92.94 MB 92.96 MB +19.96 KB +0.0%
hits_54.vortex 1.0 vortex-file-compressed 221.08 MB 221.12 MB +38.55 KB +0.0%
hits_48.vortex 1.0 vortex-file-compressed 28.02 MB 28.03 MB +4.83 KB +0.0%
hits_9.vortex 1.0 vortex-file-compressed 98.99 MB 99.00 MB +13.91 KB +0.0%
hits_43.vortex 1.0 vortex-file-compressed 226.22 MB 226.25 MB +30.24 KB +0.0%
hits_4.vortex 1.0 vortex-file-compressed 108.26 MB 108.27 MB +13.07 KB +0.0%
hits_40.vortex 1.0 vortex-file-compressed 117.57 MB 117.58 MB +13.70 KB +0.0%
hits_65.vortex 1.0 vortex-file-compressed 183.40 MB 183.42 MB +16.95 KB +0.0%
hits_76.vortex 1.0 vortex-file-compressed 113.82 MB 113.82 MB +4.48 KB +0.0%
hits_96.vortex 1.0 vortex-file-compressed 135.15 MB 135.16 MB +5.02 KB +0.0%
hits_11.vortex 1.0 vortex-file-compressed 79.71 MB 79.71 MB +2.63 KB +0.0%
hits_19.vortex 1.0 vortex-file-compressed 73.25 MB 73.25 MB +544 B +0.0%
hits_38.vortex 1.0 vortex-file-compressed 99.01 MB 99.01 MB 1.41 KB -0.0%
hits_95.vortex 1.0 vortex-file-compressed 96.13 MB 96.13 MB 6.19 KB -0.0%
hits_8.vortex 1.0 vortex-file-compressed 93.25 MB 93.24 MB 6.55 KB -0.0%
hits_32.vortex 1.0 vortex-file-compressed 66.59 MB 66.58 MB 5.86 KB -0.0%
hits_73.vortex 1.0 vortex-file-compressed 109.47 MB 109.46 MB 11.65 KB -0.0%
hits_26.vortex 1.0 vortex-file-compressed 109.26 MB 109.25 MB 11.70 KB -0.0%
hits_59.vortex 1.0 vortex-file-compressed 101.60 MB 101.59 MB 11.09 KB -0.0%
hits_72.vortex 1.0 vortex-file-compressed 84.49 MB 84.47 MB 11.96 KB -0.0%
hits_78.vortex 1.0 vortex-file-compressed 164.15 MB 164.13 MB 28.30 KB -0.0%
hits_86.vortex 1.0 vortex-file-compressed 69.08 MB 69.07 MB 12.74 KB -0.0%
hits_14.vortex 1.0 vortex-file-compressed 111.12 MB 111.10 MB 20.95 KB -0.0%
hits_82.vortex 1.0 vortex-file-compressed 99.46 MB 99.44 MB 21.60 KB -0.0%
hits_27.vortex 1.0 vortex-file-compressed 122.40 MB 122.37 MB 29.48 KB -0.0%
hits_35.vortex 1.0 vortex-file-compressed 114.95 MB 114.92 MB 35.04 KB -0.0%
hits_30.vortex 1.0 vortex-file-compressed 86.76 MB 86.73 MB 28.02 KB -0.0%
hits_47.vortex 1.0 vortex-file-compressed 41.27 MB 41.25 MB 13.69 KB -0.0%
hits_29.vortex 1.0 vortex-file-compressed 59.39 MB 59.37 MB 20.95 KB -0.0%
hits_74.vortex 1.0 vortex-file-compressed 119.44 MB 119.40 MB 42.48 KB -0.0%
hits_75.vortex 1.0 vortex-file-compressed 63.25 MB 63.22 MB 24.25 KB -0.0%
hits_34.vortex 1.0 vortex-file-compressed 97.45 MB 97.41 MB 37.82 KB -0.0%
hits_70.vortex 1.0 vortex-file-compressed 93.44 MB 93.40 MB 38.35 KB -0.0%
hits_77.vortex 1.0 vortex-file-compressed 168.16 MB 168.09 MB 70.55 KB -0.0%
hits_50.vortex 1.0 vortex-file-compressed 179.23 MB 179.15 MB 86.59 KB -0.0%
hits_46.vortex 1.0 vortex-file-compressed 69.11 MB 69.08 MB 36.78 KB -0.1%
hits_16.vortex 1.0 vortex-file-compressed 79.33 MB 79.29 MB 42.53 KB -0.1%
hits_41.vortex 1.0 vortex-file-compressed 223.06 MB 222.94 MB 123.84 KB -0.1%
hits_93.vortex 1.0 vortex-file-compressed 90.22 MB 90.17 MB 51.41 KB -0.1%
hits_0.vortex 1.0 vortex-file-compressed 89.60 MB 89.54 MB 54.03 KB -0.1%
hits_79.vortex 1.0 vortex-file-compressed 143.82 MB 143.73 MB 97.09 KB -0.1%
hits_44.vortex 1.0 vortex-file-compressed 185.87 MB 185.75 MB 130.15 KB -0.1%
hits_99.vortex 1.0 vortex-file-compressed 122.81 MB 122.72 MB 92.53 KB -0.1%
hits_2.vortex 1.0 vortex-file-compressed 186.07 MB 185.92 MB 152.52 KB -0.1%
hits_67.vortex 1.0 vortex-file-compressed 184.11 MB 183.96 MB 153.73 KB -0.1%
hits_1.vortex 1.0 vortex-file-compressed 138.28 MB 138.17 MB 116.33 KB -0.1%
hits_97.vortex 1.0 vortex-compact 69.04 MB 68.98 MB 60.21 KB -0.1%
hits_71.vortex 1.0 vortex-file-compressed 101.66 MB 101.56 MB 98.27 KB -0.1%
hits_88.vortex 1.0 vortex-file-compressed 110.91 MB 110.80 MB 117.09 KB -0.1%
hits_56.vortex 1.0 vortex-file-compressed 123.22 MB 123.09 MB 131.61 KB -0.1%
hits_58.vortex 1.0 vortex-file-compressed 90.29 MB 90.19 MB 102.98 KB -0.1%
hits_20.vortex 1.0 vortex-file-compressed 62.59 MB 62.52 MB 74.62 KB -0.1%
hits_45.vortex 1.0 vortex-file-compressed 122.06 MB 121.90 MB 166.56 KB -0.1%
hits_62.vortex 1.0 vortex-file-compressed 117.53 MB 117.37 MB 168.42 KB -0.1%
hits_89.vortex 1.0 vortex-file-compressed 184.49 MB 184.23 MB 268.36 KB -0.1%
hits_68.vortex 1.0 vortex-file-compressed 122.98 MB 122.81 MB 179.80 KB -0.1%
hits_66.vortex 1.0 vortex-file-compressed 90.23 MB 90.08 MB 154.08 KB -0.2%
hits_91.vortex 1.0 vortex-file-compressed 97.04 MB 96.84 MB 203.64 KB -0.2%
hits_97.vortex 1.0 vortex-file-compressed 106.93 MB 106.71 MB 228.73 KB -0.2%
hits_17.vortex 1.0 vortex-file-compressed 87.28 MB 87.08 MB 201.38 KB -0.2%
hits_21.vortex 1.0 vortex-file-compressed 93.00 MB 92.77 MB 227.81 KB -0.2%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.05 GB → 7.05 GB (+0.0%)
  • vortex-file-compressed: 10.98 GB → 10.98 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.899x ✅

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.899x ✅, 5↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 127894148 130674398 0.98
polarsignals_q01/datafusion:vortex-file-compressed 275826232 297319727 0.93
polarsignals_q02/datafusion:vortex-file-compressed 🚀 24615480 28591909 0.86
polarsignals_q03/datafusion:vortex-file-compressed 🚀 311903539 350845553 0.89
polarsignals_q04/datafusion:vortex-file-compressed 🚀 10710038 12633583 0.85
polarsignals_q05/datafusion:vortex-file-compressed 18341999 20133471 0.91
polarsignals_q06/datafusion:vortex-file-compressed 🚀 21153106 26124132 0.81
polarsignals_q07/datafusion:vortex-file-compressed 🚀 15594881 19296084 0.81
polarsignals_q08/datafusion:vortex-file-compressed 430896898 437644407 0.98
polarsignals_q09/datafusion:vortex-file-compressed 12978884 13056487 0.99

No file size changes detected.

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.1%
Engines: DataFusion No clear signal (-3.0%, environment too noisy confidence) · DuckDB No clear signal (-1.3%, environment too noisy confidence)
Vortex (geomean): 0.971x ➖
Parquet (geomean): 0.972x ➖
Shifts: Parquet (control) -2.8% · Median polish -3.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.009x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 52715065 53598633 0.98
tpch_q02/datafusion:vortex-file-compressed 23846184 24697953 0.97
tpch_q03/datafusion:vortex-file-compressed 33319142 32817603 1.02
tpch_q04/datafusion:vortex-file-compressed 19615687 20501690 0.96
tpch_q05/datafusion:vortex-file-compressed 49857869 48457987 1.03
tpch_q06/datafusion:vortex-file-compressed 10738209 9818187 1.09
tpch_q07/datafusion:vortex-file-compressed 57356258 53169634 1.08
tpch_q08/datafusion:vortex-file-compressed 41302378 39708777 1.04
tpch_q09/datafusion:vortex-file-compressed 53756006 53899838 1.00
tpch_q10/datafusion:vortex-file-compressed 35324804 33433755 1.06
tpch_q11/datafusion:vortex-file-compressed 17387099 17017623 1.02
tpch_q12/datafusion:vortex-file-compressed 24405621 24193237 1.01
tpch_q13/datafusion:vortex-file-compressed 29080631 27282897 1.07
tpch_q14/datafusion:vortex-file-compressed 15717411 14802471 1.06
tpch_q15/datafusion:vortex-file-compressed 23510564 23416920 1.00
tpch_q16/datafusion:vortex-file-compressed 20868954 20604192 1.01
tpch_q17/datafusion:vortex-file-compressed 71233125 68575246 1.04
tpch_q18/datafusion:vortex-file-compressed 81259245 83806552 0.97
tpch_q19/datafusion:vortex-file-compressed 17942922 19023605 0.94
tpch_q20/datafusion:vortex-file-compressed 30985448 32930970 0.94
tpch_q21/datafusion:vortex-file-compressed 74153347 75830294 0.98
tpch_q22/datafusion:vortex-file-compressed 12875750 13346026 0.96
datafusion / vortex-compact (0.960x ➖, 1↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 60461558 63393533 0.95
tpch_q02/datafusion:vortex-compact 27445360 29467956 0.93
tpch_q03/datafusion:vortex-compact 34357550 37469316 0.92
tpch_q04/datafusion:vortex-compact 22557326 23844061 0.95
tpch_q05/datafusion:vortex-compact 50835216 56367775 0.90
tpch_q06/datafusion:vortex-compact 12991075 13684400 0.95
tpch_q07/datafusion:vortex-compact 🚀 58754490 65842751 0.89
tpch_q08/datafusion:vortex-compact 44672482 46279329 0.97
tpch_q09/datafusion:vortex-compact 59001139 61998077 0.95
tpch_q10/datafusion:vortex-compact 37779219 40508564 0.93
tpch_q11/datafusion:vortex-compact 18215765 19995733 0.91
tpch_q12/datafusion:vortex-compact 31567627 32494145 0.97
tpch_q13/datafusion:vortex-compact 33885753 34115821 0.99
tpch_q14/datafusion:vortex-compact 18893243 19758720 0.96
tpch_q15/datafusion:vortex-compact 31322777 32616118 0.96
tpch_q16/datafusion:vortex-compact 25575486 27105495 0.94
tpch_q17/datafusion:vortex-compact 72921557 75798594 0.96
tpch_q18/datafusion:vortex-compact 82050158 82209828 1.00
tpch_q19/datafusion:vortex-compact 41507715 40116850 1.03
tpch_q20/datafusion:vortex-compact 35875917 35068447 1.02
tpch_q21/datafusion:vortex-compact 80565351 76873179 1.05
tpch_q22/datafusion:vortex-compact 13768749 13900740 0.99
datafusion / parquet (0.967x ➖, 5↑ 2↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 132789915 105540562 1.26
tpch_q02/datafusion:parquet 64323105 69290525 0.93
tpch_q03/datafusion:parquet 🚀 78805686 90525753 0.87
tpch_q04/datafusion:parquet 48639208 50236215 0.97
tpch_q05/datafusion:parquet 🚀 95615854 108670755 0.88
tpch_q06/datafusion:parquet 🚨 44375413 37463594 1.18
tpch_q07/datafusion:parquet 🚀 105034325 116753514 0.90
tpch_q08/datafusion:parquet 102080975 103271541 0.99
tpch_q09/datafusion:parquet 131581457 132603991 0.99
tpch_q10/datafusion:parquet 120481444 125545847 0.96
tpch_q11/datafusion:parquet 44062076 45294208 0.97
tpch_q12/datafusion:parquet 🚀 73565594 85576279 0.86
tpch_q13/datafusion:parquet 203378427 209928564 0.97
tpch_q14/datafusion:parquet 47448232 46422346 1.02
tpch_q15/datafusion:parquet 62029962 63332532 0.98
tpch_q16/datafusion:parquet 45238507 49229910 0.92
tpch_q17/datafusion:parquet 🚀 139212063 166367828 0.84
tpch_q18/datafusion:parquet 160932548 175285797 0.92
tpch_q19/datafusion:parquet 82361157 76132523 1.08
tpch_q20/datafusion:parquet 74952341 80824076 0.93
tpch_q21/datafusion:parquet 155300504 152039061 1.02
tpch_q22/datafusion:parquet 45494886 48445456 0.94
datafusion / arrow (0.853x ✅, 15↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 65650577 82156476 0.80
tpch_q02/datafusion:arrow 🚀 17194969 19898583 0.86
tpch_q03/datafusion:arrow 🚀 34975645 44789567 0.78
tpch_q04/datafusion:arrow 🚀 31083662 37101935 0.84
tpch_q05/datafusion:arrow 65698515 68278722 0.96
tpch_q06/datafusion:arrow 🚀 25071961 29284761 0.86
tpch_q07/datafusion:arrow 🚀 110130690 129369622 0.85
tpch_q08/datafusion:arrow 🚀 47073261 68683339 0.69
tpch_q09/datafusion:arrow 🚀 68122084 93771140 0.73
tpch_q10/datafusion:arrow 🚀 53887525 65404923 0.82
tpch_q11/datafusion:arrow 9729871 10471511 0.93
tpch_q12/datafusion:arrow 🚀 55647881 63172567 0.88
tpch_q13/datafusion:arrow 47810128 50625712 0.94
tpch_q14/datafusion:arrow 🚀 24621655 30651479 0.80
tpch_q15/datafusion:arrow 🚀 49077232 59402163 0.83
tpch_q16/datafusion:arrow 17225094 18578112 0.93
tpch_q17/datafusion:arrow 🚀 71502743 84606531 0.85
tpch_q18/datafusion:arrow 117365362 129494414 0.91
tpch_q19/datafusion:arrow 🚀 41697984 49692280 0.84
tpch_q20/datafusion:arrow 🚀 40227926 46020234 0.87
tpch_q21/datafusion:arrow 170627623 189192270 0.90
tpch_q22/datafusion:arrow 13089493 13556474 0.97
duckdb / vortex-file-compressed (0.946x ➖, 4↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32531027 31308990 1.04
tpch_q02/duckdb:vortex-file-compressed 27104521 26259102 1.03
tpch_q03/duckdb:vortex-file-compressed 34121374 34293585 0.99
tpch_q04/duckdb:vortex-file-compressed 29573416 29861694 0.99
tpch_q05/duckdb:vortex-file-compressed 40179101 38604695 1.04
tpch_q06/duckdb:vortex-file-compressed 8664145 8259047 1.05
tpch_q07/duckdb:vortex-file-compressed 37520237 37953574 0.99
tpch_q08/duckdb:vortex-file-compressed 🚀 38495546 42839230 0.90
tpch_q09/duckdb:vortex-file-compressed 61673443 66377549 0.93
tpch_q10/duckdb:vortex-file-compressed 43969957 47306297 0.93
tpch_q11/duckdb:vortex-file-compressed 🚀 15415782 17340953 0.89
tpch_q12/duckdb:vortex-file-compressed 23478421 25513562 0.92
tpch_q13/duckdb:vortex-file-compressed 42456756 45686712 0.93
tpch_q14/duckdb:vortex-file-compressed 22556525 24773359 0.91
tpch_q15/duckdb:vortex-file-compressed 17588226 18696740 0.94
tpch_q16/duckdb:vortex-file-compressed 30335755 31870348 0.95
tpch_q17/duckdb:vortex-file-compressed 24425147 27024820 0.90
tpch_q18/duckdb:vortex-file-compressed 56714904 59291977 0.96
tpch_q19/duckdb:vortex-file-compressed 🚀 30491970 36747436 0.83
tpch_q20/duckdb:vortex-file-compressed 34577133 37385305 0.92
tpch_q21/duckdb:vortex-file-compressed 🚀 106448676 124560274 0.85
tpch_q22/duckdb:vortex-file-compressed 18561491 19570429 0.95
duckdb / vortex-compact (0.970x ➖, 1↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39887169 40419371 0.99
tpch_q02/duckdb:vortex-compact 34630570 36613457 0.95
tpch_q03/duckdb:vortex-compact 36205190 39308409 0.92
tpch_q04/duckdb:vortex-compact 31923126 33747267 0.95
tpch_q05/duckdb:vortex-compact 42575093 47017350 0.91
tpch_q06/duckdb:vortex-compact 11502848 11087855 1.04
tpch_q07/duckdb:vortex-compact 43226134 45864303 0.94
tpch_q08/duckdb:vortex-compact 🚀 42709950 48882667 0.87
tpch_q09/duckdb:vortex-compact 68065465 66876305 1.02
tpch_q10/duckdb:vortex-compact 46971642 48018265 0.98
tpch_q11/duckdb:vortex-compact 18437838 19041309 0.97
tpch_q12/duckdb:vortex-compact 31029292 31427320 0.99
tpch_q13/duckdb:vortex-compact 47805972 48094484 0.99
tpch_q14/duckdb:vortex-compact 27710010 27933364 0.99
tpch_q15/duckdb:vortex-compact 20460723 20796794 0.98
tpch_q16/duckdb:vortex-compact 34400346 33993035 1.01
tpch_q17/duckdb:vortex-compact 30222058 30289849 1.00
tpch_q18/duckdb:vortex-compact 55696716 55464063 1.00
tpch_q19/duckdb:vortex-compact 35024975 35329544 0.99
tpch_q20/duckdb:vortex-compact 41712925 42396184 0.98
tpch_q21/duckdb:vortex-compact 109605488 118920937 0.92
tpch_q22/duckdb:vortex-compact 19631405 20358381 0.96
duckdb / parquet (0.978x ➖, 1↑ 1↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77494980 80897782 0.96
tpch_q02/duckdb:parquet 41171673 43001673 0.96
tpch_q03/duckdb:parquet 72296361 75813514 0.95
tpch_q04/duckdb:parquet 51246363 54908743 0.93
tpch_q05/duckdb:parquet 70116399 74484695 0.94
tpch_q06/duckdb:parquet 22968822 23831727 0.96
tpch_q07/duckdb:parquet 85490693 83428678 1.02
tpch_q08/duckdb:parquet 🚀 85011528 94695392 0.90
tpch_q09/duckdb:parquet 162220896 155527375 1.04
tpch_q10/duckdb:parquet 131478368 132650876 0.99
tpch_q11/duckdb:parquet 23387067 23278870 1.00
tpch_q12/duckdb:parquet 48374024 49794343 0.97
tpch_q13/duckdb:parquet 269729886 290689593 0.93
tpch_q14/duckdb:parquet 52540632 54408290 0.97
tpch_q15/duckdb:parquet 26531405 27725531 0.96
tpch_q16/duckdb:parquet 60170509 63297795 0.95
tpch_q17/duckdb:parquet 58039541 59898053 0.97
tpch_q18/duckdb:parquet 121142458 124050298 0.98
tpch_q19/duckdb:parquet 🚨 92416590 76311506 1.21
tpch_q20/duckdb:parquet 67010175 66971230 1.00
tpch_q21/duckdb:parquet 192580300 201238472 0.96
tpch_q22/duckdb:parquet 54882271 55221897 0.99
duckdb / duckdb (0.980x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 18487711 18541967 1.00
tpch_q02/duckdb:duckdb 15670691 15804236 0.99
tpch_q03/duckdb:duckdb 23716537 24649037 0.96
tpch_q04/duckdb:duckdb 22910336 24790366 0.92
tpch_q05/duckdb:duckdb 24673104 26079148 0.95
tpch_q06/duckdb:duckdb 7603380 7582846 1.00
tpch_q07/duckdb:duckdb 26783802 28156228 0.95
tpch_q08/duckdb:duckdb 25264421 26504198 0.95
tpch_q09/duckdb:duckdb 60841353 66033990 0.92
tpch_q10/duckdb:duckdb 54097695 54979668 0.98
tpch_q11/duckdb:duckdb 7713909 8172649 0.94
tpch_q12/duckdb:duckdb 18553409 19856772 0.93
tpch_q13/duckdb:duckdb 42170818 43633838 0.97
tpch_q14/duckdb:duckdb 22481673 23735413 0.95
tpch_q15/duckdb:duckdb 14183991 14417267 0.98
tpch_q16/duckdb:duckdb 27350616 26940434 1.02
tpch_q17/duckdb:duckdb 16917290 16225667 1.04
tpch_q18/duckdb:duckdb 42435574 41100448 1.03
tpch_q19/duckdb:duckdb 32409235 32062053 1.01
tpch_q20/duckdb:duckdb 26210607 25690174 1.02
tpch_q21/duckdb:duckdb 64218066 63214975 1.02
tpch_q22/duckdb:duckdb 26604126 25698630 1.04

File Size Changes (9 files changed, -0.1% overall, 4↑ 5↓)
File Scale Format Base HEAD Change %
part_0.vortex 1.0 vortex-file-compressed 4.94 MB 4.99 MB +50.45 KB +1.0%
customer_0.vortex 1.0 vortex-file-compressed 8.89 MB 8.91 MB +19.14 KB +0.2%
lineitem_1.vortex 1.0 vortex-file-compressed 81.99 MB 82.12 MB +132.51 KB +0.2%
partsupp_0.vortex 1.0 vortex-file-compressed 23.69 MB 23.73 MB +36.62 KB +0.2%
lineitem_0.vortex 1.0 vortex-file-compressed 82.18 MB 82.07 MB 104.13 KB -0.1%
orders_0.vortex 1.0 vortex-file-compressed 35.48 MB 35.33 MB 159.09 KB -0.4%
part_0.vortex 1.0 vortex-compact 3.35 MB 3.32 MB 25.80 KB -0.8%
partsupp_0.vortex 1.0 vortex-compact 21.23 MB 20.96 MB 274.88 KB -1.3%
supplier_0.vortex 1.0 vortex-file-compressed 616.45 KB 604.28 KB 12.17 KB -2.0%

Totals:

  • vortex-compact: 190.54 MB → 190.24 MB (-0.2%)
  • vortex-file-compressed: 238.05 MB → 238.01 MB (-0.0%)

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.7%
Engines: DataFusion No clear signal (+0.9%, environment too noisy confidence) · DuckDB No clear signal (+4.6%, environment too noisy confidence)
Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.971x ➖
Shifts: Parquet (control) -2.9% · Median polish +2.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (1.024x ➖, 0↑ 1↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 90274045 58393507 1.55
fineweb_q01/datafusion:vortex-file-compressed 685891300 880739759 0.78
fineweb_q02/datafusion:vortex-file-compressed 655871222 797740067 0.82
fineweb_q03/datafusion:vortex-file-compressed 1313859646 1211170986 1.08
fineweb_q04/datafusion:vortex-file-compressed 1175523629 1188820083 0.99
fineweb_q05/datafusion:vortex-file-compressed 1113239358 1110516873 1.00
fineweb_q06/datafusion:vortex-file-compressed 1718899297 1350656765 1.27
fineweb_q07/datafusion:vortex-file-compressed 1213973978 1293609947 0.94
fineweb_q08/datafusion:vortex-file-compressed 546111540 559129937 0.98
datafusion / vortex-compact (0.943x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 40524234 56201623 0.72
fineweb_q01/datafusion:vortex-compact 853731145 787909145 1.08
fineweb_q02/datafusion:vortex-compact 1091635185 929074133 1.17
fineweb_q03/datafusion:vortex-compact 1381223667 1390410718 0.99
fineweb_q04/datafusion:vortex-compact 1664238845 1599037412 1.04
fineweb_q05/datafusion:vortex-compact 1381617589 1370792767 1.01
fineweb_q06/datafusion:vortex-compact 1432175753 1962842526 0.73
fineweb_q07/datafusion:vortex-compact 1293885600 1290082914 1.00
fineweb_q08/datafusion:vortex-compact 454921767 539534773 0.84
datafusion / parquet (0.974x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1459941885 1713571639 0.85
fineweb_q01/datafusion:parquet 2845468722 2530722607 1.12
fineweb_q02/datafusion:parquet 2223953873 2702919015 0.82
fineweb_q03/datafusion:parquet 2259179890 2470538523 0.91
fineweb_q04/datafusion:parquet 2349738541 2672985725 0.88
fineweb_q05/datafusion:parquet 2678456453 2425438687 1.10
fineweb_q06/datafusion:parquet 2350220631 2588074070 0.91
fineweb_q07/datafusion:parquet 2628159808 2245268740 1.17
fineweb_q08/datafusion:parquet 2595629140 2447511774 1.06
duckdb / vortex-file-compressed (1.060x ➖, 0↑ 1↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 90494876 81819895 1.11
fineweb_q01/duckdb:vortex-file-compressed 🚨 1114894104 752643912 1.48
fineweb_q02/duckdb:vortex-file-compressed 633195611 759809092 0.83
fineweb_q03/duckdb:vortex-file-compressed 1621664378 1490846805 1.09
fineweb_q04/duckdb:vortex-file-compressed 1494666990 1446223573 1.03
fineweb_q05/duckdb:vortex-file-compressed 1445833129 1314499055 1.10
fineweb_q06/duckdb:vortex-file-compressed 1669247477 1808428252 0.92
fineweb_q07/duckdb:vortex-file-compressed 1597119946 1446414671 1.10
fineweb_q08/duckdb:vortex-file-compressed 632104048 644567442 0.98
duckdb / vortex-compact (0.969x ➖, 0↑ 1↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 85367116 94840250 0.90
fineweb_q01/duckdb:vortex-compact 632626786 748603539 0.85
fineweb_q02/duckdb:vortex-compact 733721749 992612989 0.74
fineweb_q03/duckdb:vortex-compact 1696341073 1670331769 1.02
fineweb_q04/duckdb:vortex-compact 1808336064 1749558495 1.03
fineweb_q05/duckdb:vortex-compact 1601972550 1550415339 1.03
fineweb_q06/duckdb:vortex-compact 1594070036 1859042335 0.86
fineweb_q07/duckdb:vortex-compact 1511287034 1413389884 1.07
fineweb_q08/duckdb:vortex-compact 🚨 631778066 470304850 1.34
duckdb / parquet (0.969x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1251805515 1266257335 0.99
fineweb_q01/duckdb:parquet 1599363629 1557916660 1.03
fineweb_q02/duckdb:parquet 1522197797 1405284651 1.08
fineweb_q03/duckdb:parquet 4243680733 4362663280 0.97
fineweb_q04/duckdb:parquet 2315254616 2299191770 1.01
fineweb_q05/duckdb:parquet 2240767504 2628017661 0.85
fineweb_q06/duckdb:parquet 4740287119 4808131289 0.99
fineweb_q07/duckdb:parquet 3030737998 3176798030 0.95
fineweb_q08/duckdb:parquet 1240118623 1421506257 0.87

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.3%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (+6.2%, low confidence)
Vortex (geomean): 0.928x ➖
Parquet (geomean): 0.898x ✅
Shifts: Parquet (control) -10.2% · Median polish -10.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

datafusion / vortex-file-compressed (0.889x ✅, 6↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 4980860 5817646 0.86
fineweb_q01/datafusion:vortex-file-compressed 33637248 33701853 1.00
fineweb_q02/datafusion:vortex-file-compressed 🚀 37487563 45883463 0.82
fineweb_q03/datafusion:vortex-file-compressed 🚀 56864052 68461223 0.83
fineweb_q04/datafusion:vortex-file-compressed 🚀 275168836 308657261 0.89
fineweb_q05/datafusion:vortex-file-compressed 223656249 238215563 0.94
fineweb_q06/datafusion:vortex-file-compressed 🚀 48788977 55781133 0.87
fineweb_q07/datafusion:vortex-file-compressed 54178624 59496227 0.91
fineweb_q08/datafusion:vortex-file-compressed 🚀 22190467 24780763 0.90
datafusion / vortex-compact (0.888x ✅, 6↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 5530860 6443928 0.86
fineweb_q01/datafusion:vortex-compact 97003039 105220320 0.92
fineweb_q02/datafusion:vortex-compact 🚀 102276004 117095680 0.87
fineweb_q03/datafusion:vortex-compact 🚀 862885596 965465261 0.89
fineweb_q04/datafusion:vortex-compact 🚀 919264005 1027593087 0.89
fineweb_q05/datafusion:vortex-compact 🚀 805602829 934825792 0.86
fineweb_q06/datafusion:vortex-compact 469748569 518852525 0.91
fineweb_q07/datafusion:vortex-compact 481671303 531919011 0.91
fineweb_q08/datafusion:vortex-compact 🚀 21092297 24100193 0.88
datafusion / parquet (0.884x ✅, 7↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 6387411 7414110 0.86
fineweb_q01/datafusion:parquet 🚀 292410158 332582256 0.88
fineweb_q02/datafusion:parquet 🚀 291924801 327910578 0.89
fineweb_q03/datafusion:parquet 286126511 309214731 0.93
fineweb_q04/datafusion:parquet 🚀 303806987 344721022 0.88
fineweb_q05/datafusion:parquet 🚀 294147667 352392371 0.83
fineweb_q06/datafusion:parquet 🚀 287663843 319667874 0.90
fineweb_q07/datafusion:parquet 282770025 313746503 0.90
fineweb_q08/datafusion:parquet 🚀 277939395 313632014 0.89
duckdb / vortex-file-compressed (0.972x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3610198 3689605 0.98
fineweb_q01/duckdb:vortex-file-compressed 33760995 34672349 0.97
fineweb_q02/duckdb:vortex-file-compressed 41662556 41977272 0.99
fineweb_q03/duckdb:vortex-file-compressed 111401668 114783622 0.97
fineweb_q04/duckdb:vortex-file-compressed 266543482 276255777 0.96
fineweb_q05/duckdb:vortex-file-compressed 212349576 224699500 0.95
fineweb_q06/duckdb:vortex-file-compressed 53145747 53791568 0.99
fineweb_q07/duckdb:vortex-file-compressed 54231428 55398077 0.98
fineweb_q08/duckdb:vortex-file-compressed 20729081 21596411 0.96
duckdb / vortex-compact (0.965x ➖, 1↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4130731 4445227 0.93
fineweb_q01/duckdb:vortex-compact 🚀 101063189 113147588 0.89
fineweb_q02/duckdb:vortex-compact 111877763 112968194 0.99
fineweb_q03/duckdb:vortex-compact 853971311 867075189 0.98
fineweb_q04/duckdb:vortex-compact 893760402 900690492 0.99
fineweb_q05/duckdb:vortex-compact 800435815 813589693 0.98
fineweb_q06/duckdb:vortex-compact 463096096 460113914 1.01
fineweb_q07/duckdb:vortex-compact 474746917 478845997 0.99
fineweb_q08/duckdb:vortex-compact 18973127 20592850 0.92
duckdb / parquet (0.912x ➖, 2↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 🚀 30030519 35036395 0.86
fineweb_q01/duckdb:parquet 83903498 93178201 0.90
fineweb_q02/duckdb:parquet 85312956 94779534 0.90
fineweb_q03/duckdb:parquet 316697409 349337347 0.91
fineweb_q04/duckdb:parquet 447571644 483299344 0.93
fineweb_q05/duckdb:parquet 415905210 443771531 0.94
fineweb_q06/duckdb:parquet 204315915 215517562 0.95
fineweb_q07/duckdb:parquet 215492943 226471469 0.95
fineweb_q08/duckdb:parquet 🚀 32831330 36988172 0.89

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
sample.vortex 1.0 vortex-file-compressed 1.43 GB 1.43 GB +740.64 KB +0.0%

Totals:

  • vortex-compact: 1.23 GB → 1.23 GB (0.0%)
  • vortex-file-compressed: 1.43 GB → 1.43 GB (+0.0%)

@github-actions

github-actions Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DuckDB No clear signal (+1.0%, low confidence)
Vortex (geomean): 1.001x ➖
Parquet (geomean): 0.991x ➖
Shifts: Parquet (control) -0.9% · Median polish -0.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

duckdb / vortex-file-compressed (0.999x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11795377 11867863 0.99
statpopgen_q01/duckdb:vortex-file-compressed 26104041 27393722 0.95
statpopgen_q02/duckdb:vortex-file-compressed 535125709 524694736 1.02
statpopgen_q03/duckdb:vortex-file-compressed 1030368046 1032276386 1.00
statpopgen_q04/duckdb:vortex-file-compressed 1029520873 1045374122 0.98
statpopgen_q05/duckdb:vortex-file-compressed 483323458 447822032 1.08
statpopgen_q06/duckdb:vortex-file-compressed 1535336380 1533665628 1.00
statpopgen_q07/duckdb:vortex-file-compressed 190877240 187028547 1.02
statpopgen_q08/duckdb:vortex-file-compressed 224034197 228887502 0.98
statpopgen_q09/duckdb:vortex-file-compressed 809931105 835516006 0.97
statpopgen_q10/duckdb:vortex-file-compressed 2532337840 2545167285 0.99
duckdb / vortex-compact (1.003x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11922523 11464802 1.04
statpopgen_q01/duckdb:vortex-compact 217089676 214127463 1.01
statpopgen_q02/duckdb:vortex-compact 556967764 559558677 1.00
statpopgen_q03/duckdb:vortex-compact 1135722109 1152974433 0.99
statpopgen_q04/duckdb:vortex-compact 1149837838 1161278905 0.99
statpopgen_q05/duckdb:vortex-compact 566907903 560035642 1.01
statpopgen_q06/duckdb:vortex-compact 1484932833 1497794018 0.99
statpopgen_q07/duckdb:vortex-compact 866769225 872234410 0.99
statpopgen_q08/duckdb:vortex-compact 906157561 901863572 1.00
statpopgen_q09/duckdb:vortex-compact 926564447 913135647 1.01
statpopgen_q10/duckdb:vortex-compact 2584928631 2604373256 0.99
duckdb / parquet (0.991x ➖, 0↑ 0↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 303641317 302850670 1.00
statpopgen_q01/duckdb:parquet 387301440 380446219 1.02
statpopgen_q02/duckdb:parquet 748809492 763559544 0.98
statpopgen_q03/duckdb:parquet 1179561838 1187700158 0.99
statpopgen_q04/duckdb:parquet 1199651008 1179106301 1.02
statpopgen_q05/duckdb:parquet 804165947 811499294 0.99
statpopgen_q06/duckdb:parquet 1424721570 1450978938 0.98
statpopgen_q07/duckdb:parquet 841126176 867554313 0.97
statpopgen_q08/duckdb:parquet 855578308 871151982 0.98
statpopgen_q09/duckdb:parquet 1004029230 1017757136 0.99
statpopgen_q10/duckdb:parquet 2201923603 2249388106 0.98

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)
File Scale Format Base HEAD Change %
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex 100000 vortex-file-compressed 1.96 GB 1.96 GB +155.05 KB +0.0%

Totals:

  • vortex-compact: 959.62 MB → 959.62 MB (0.0%)
  • vortex-file-compressed: 1.96 GB → 1.96 GB (+0.0%)

Comment thread vortex-buffer/src/buffer.rs Outdated
@joseph-isaacs joseph-isaacs force-pushed the ji/over-align-buffer-default branch from 794fc4c to 9810f14 Compare June 18, 2026 12:13
Comment thread vortex-buffer/src/buffer.rs Outdated
@robert3005 robert3005 added the action/benchmark Trigger full benchmarks to run on this PR label Jun 18, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 18, 2026
@robert3005 robert3005 force-pushed the ji/over-align-buffer-default branch 2 times, most recently from e5baa81 to 6f42904 Compare June 18, 2026 17:34
@robert3005 robert3005 added the action/benchmark Trigger full benchmarks to run on this PR label Jun 18, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label Jun 18, 2026
@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 1.097x ➖
Parquet (geomean): 1.081x ➖

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.

unknown / unknown (1.102x ❌, 0↑ 12↓)
name PR 9b72179 (ns) base aef6307 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 1662887 366047 4.54
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1106970 1040514 1.06
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8668199759 8305529871 1.04
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8639299678 8139336024 1.06
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚨 4722655 3106687 1.52
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚨 3080362 2656202 1.16
random-access/feature-vectors/uniform/lance-tokio-local-disk 1259594 1206627 1.04
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1972873 1874795 1.05
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8730073119 8182668933 1.07
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8697571542 8190017264 1.06
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚨 3826469 3476866 1.10
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚨 6491640 5832047 1.11
random-access/lance-tokio-local-disk 660847 632022 1.05
random-access/lance-tokio-local-disk-footer 1354969 1278559 1.06
random-access/nested-lists/correlated/lance-tokio-local-disk 249178 238437 1.05
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 600266 578415 1.04
random-access/nested-lists/correlated/parquet-tokio-local-disk 135945035 131098938 1.04
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 133649414 129305949 1.03
random-access/nested-lists/correlated/vortex-tokio-local-disk 538334 494315 1.09
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚨 684185 600248 1.14
random-access/nested-lists/uniform/lance-tokio-local-disk 1053177 1039535 1.01
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1429340 1389669 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk 133800967 130245695 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 135151843 127730142 1.06
random-access/nested-lists/uniform/vortex-tokio-local-disk 2094059 1915110 1.09
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2215246 2036163 1.09
random-access/nested-structs/correlated/lance-tokio-local-disk 382993 367373 1.04
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 571764 548125 1.04
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 25576368 22377287 1.14
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 25450851 21909777 1.16
random-access/nested-structs/correlated/vortex-tokio-local-disk 618899 578193 1.07
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚨 814479 705139 1.16
random-access/nested-structs/uniform/lance-tokio-local-disk 2817400 2739187 1.03
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2965914 2872250 1.03
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 25605789 21521687 1.19
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 25616739 22171543 1.16
random-access/nested-structs/uniform/vortex-tokio-local-disk 1530653 1426600 1.07
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚨 1734454 1533396 1.13
random-access/parquet-tokio-local-disk 177642876 165512601 1.07
random-access/parquet-tokio-local-disk-footer 177673994 165200902 1.08
random-access/taxi/correlated/lance-tokio-local-disk 978805 933707 1.05
random-access/taxi/correlated/lance-tokio-local-disk-footer 1970020 1812333 1.09
random-access/taxi/correlated/parquet-tokio-local-disk 266874911 248076584 1.08
random-access/taxi/correlated/parquet-tokio-local-disk-footer 266990720 248983482 1.07
random-access/taxi/correlated/vortex-tokio-local-disk 1237371 1268959 0.98
random-access/taxi/correlated/vortex-tokio-local-disk-footer 1839541 1693490 1.09
random-access/taxi/uniform/lance-tokio-local-disk 9646349 9731589 0.99
random-access/taxi/uniform/lance-tokio-local-disk-footer 10357360 10343110 1.00
random-access/taxi/uniform/parquet-tokio-local-disk 284114730 264457203 1.07
random-access/taxi/uniform/parquet-tokio-local-disk-footer 284278003 266848765 1.07
random-access/taxi/uniform/vortex-tokio-local-disk 3606523 3623582 1.00
random-access/taxi/uniform/vortex-tokio-local-disk-footer 4499152 4242835 1.06
random-access/vortex-tokio-local-disk 742865 766877 0.97
random-access/vortex-tokio-local-disk-footer 1180214 1147009 1.03

joseph-isaacs and others added 9 commits June 18, 2026 23:44
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 force-pushed the ji/over-align-buffer-default branch from 9208044 to 5634a7a Compare June 18, 2026 22:44
Signed-off-by: Robert Kruszewski <github@robertk.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants