Skip to content

Add Spice.ai OSS v2.3.1 ClickBench results - #2029

Open
phillipleblanc wants to merge 2 commits into
ClickHouse:mainfrom
spiceai:phillip/spiceai-231-results
Open

phillipleblanc wants to merge 2 commits into
ClickHouse:mainfrom
spiceai:phillip/spiceai-231-results

Conversation

@phillipleblanc

@phillipleblanc phillipleblanc commented Sep 15, 2026

Copy link
Copy Markdown
Contributor

WHAT

Add five results dated 2026-09-15 for Spice.ai OSS v2.3.1: Cayenne on c6a.4xlarge, c7a.metal-48xl and c8g.metal-48xl, plus single-file and partitioned Parquet on c6a.4xlarge.

WHY

Update the existing Spice.ai entries with released v2.3.1 measurements across AMD and Graviton machines.

HOW

Each system installer pins both runtime and CLI to v2.3.1, verifies SHA-256 for the x86_64/aarch64 release archives, and checks the installed versions.

Measurements used harness 3b6a28d with the original four-file installer overlay; this PR preserves its installer semantics in each Spice system directory. The PR base, 4a7fdf2, changes only generated website data relative to that commit; the result JSONs are unchanged.

Add five dated result files and pin the released runtime and CLI installers.
Preserve the measured harness, concurrency errors and Q24 null timings.

Signed-off-by: Phillip LeBlanc <879445+phillipleblanc@users.noreply.github.com>
Comment thread lib/install-spice-2.3.1 Outdated
@alexey-milovidov alexey-milovidov added the machine:all PR benchmark on every machine type label Sep 20, 2026
@alexey-milovidov alexey-milovidov self-assigned this Sep 20, 2026
@alexey-milovidov
alexey-milovidov deployed to benchmark-approval September 20, 2026 17:44 — with GitHub Actions Active
@github-actions

Copy link
Copy Markdown
Contributor

Results for spiceai-cayenne are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
Results for spiceai-parquet are ready for: c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
Results for spiceai-parquet-partitioned are ready for: c6a.2xlarge, c6a.4xlarge, c6a.metal, c6a.xlarge, c7a.metal-48xl, c8g.4xlarge, c8g.metal-48xl.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet-partitioned/results/20260920/c8g.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet-partitioned/results/20260920/c6a.metal.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet-partitioned/results/20260920/c8g.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet-partitioned/results/20260920/c7a.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet-partitioned/results/20260920/c6a.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet/results/20260920/c6a.metal.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet/results/20260920/c7a.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet/results/20260920/c8g.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet/results/20260920/c8g.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet/results/20260920/c6a.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet-partitioned/results/20260920/c6a.2xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-cayenne/results/20260920/c8g.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-cayenne/results/20260920/c6a.metal.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-cayenne/results/20260920/c8g.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-cayenne/results/20260920/c7a.metal-48xl.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-cayenne/results/20260920/c6a.2xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-cayenne/results/20260920/c6a.4xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet-partitioned/results/20260920/c6a.xlarge.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet/results/20260920/c6a.xlarge.json.
The run of spiceai-parquet on c6a.2xlarge did not produce results.

Logs:

@github-actions

Copy link
Copy Markdown
Contributor

Results for spiceai-cayenne are ready for: c6a.xlarge.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-cayenne/results/20260920/c6a.xlarge.json.

Logs:

@github-actions

Copy link
Copy Markdown
Contributor

Results for spiceai-cayenne are ready for: c6a.large.
Results for spiceai-parquet are ready for: c6a.large.
Results for spiceai-parquet-partitioned are ready for: c6a.large.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet/results/20260920/c6a.large.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-cayenne/results/20260920/c6a.large.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet-partitioned/results/20260920/c6a.large.json.

Logs:

@github-actions

Copy link
Copy Markdown
Contributor

Results for spiceai-parquet are ready for: t3a.small.
Results for spiceai-parquet-partitioned are ready for: t3a.small.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet/results/20260920/t3a.small.json.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-parquet-partitioned/results/20260920/t3a.small.json.

Logs:

@github-actions

Copy link
Copy Markdown
Contributor

Results for spiceai-cayenne are ready for: t3a.small.
This pull request is from a fork, so the automation cannot push to it; save this result as spiceai-cayenne/results/20260920/t3a.small.json.

Logs:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

machine:all PR benchmark on every machine type

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants