Skip to content

Regenerate the benchmark report - #421

Merged
sgerbino merged 1 commit into
cppalliance:developfrom
sgerbino:pr/bench-report-refresh
Nov 16, 2026
Merged

sgerbino merged 1 commit into
cppalliance:developfrom
sgerbino:pr/bench-report-refresh

Conversation

@sgerbino

Copy link
Copy Markdown
Collaborator

Regenerates the published benchmark pages from a full run of benchmark-report on develop at 13bcf93. That run builds against capy 25299eb4, which includes the recycling frame allocator's free list from cppalliance/capy#485. The last refresh was on 2026-11-06 (#413). Only the generated pages and charts change.

Source data: run 43810023573, 7 iterations of 2 s on the Linux, Windows and macOS machines.

What moved

Page summaries, corosio against asio callbacks on the same reactor:

Platform Faster / within noise / slower Median
Linux io_uring 73 / 37 / 3 (was 58 / 48 / 7) +3.3% (was +2.9%)
Linux epoll 30 / 34 / 49 (was 31 / 35 / 47) −1.4% (was −1.0%)
Windows IOCP 0 / 17 / 60 (was 0 / 14 / 63) −4.7% (was −5.6%)
macOS kqueue 72 / 24 / 17 (was 70 / 26 / 17) +63.5% (was +62.7%)

The allocator change shows up on the wide fan_out rows, where many frames of one size are live at once. Comparing each configuration's own medians with the previous run:

Row epoll io_uring IOCP kqueue
nested/16 +1.9% +1.9% +7.2% +4.4%
concurrent_parents/16 +1.7% +1.5% +5.9% noisy
fork_join/64 +1.5% +1.5% +6.8% +3.4%

Over the same two runs, asio callbacks moved by no more than 1.5% on any fan_out row except the macOS 16-parent rows (about 20% variation between iterations), and the narrow rows (fork_join/1, /4) are flat on Linux and macOS. The epoll median moves by less than its noise: fan_out is 18 of the 113 rows, and corosio's own epoll medians are unchanged across the other categories.

Testing

The pages were generated with report_page.py as described in bench/README.md, and a second generation produced identical output. The local doc lint reports no findings on the benchmark pages, and the include-tag check passes. The Antora site was not built locally; the Documentation workflow on this PR builds it.

@coderabbitai

coderabbitai Bot commented Nov 16, 2026 •

Copy link
Copy Markdown

Important

Review skipped

Review was skipped due to path filters

⛔ Files ignored due to path filters: 49

  • doc/modules/ROOT/images/bench/linux-accept_churn-epoll.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-accept_churn-uring.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-fan_out-epoll-g1.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-fan_out-epoll-g2.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-fan_out-uring-g1.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-fan_out-uring-g2.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-http_server-epoll.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-http_server-uring.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-local_socket_latency-epoll.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-local_socket_latency-uring.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-local_socket_throughput-epoll-g1.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-local_socket_throughput-epoll-g2.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-local_socket_throughput-uring-g1.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-local_socket_throughput-uring-g2.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-socket_latency-epoll.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-socket_latency-uring.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-socket_throughput-epoll-g1.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-socket_throughput-epoll-g2.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-socket_throughput-epoll-g3.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-socket_throughput-uring-g1.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-socket_throughput-uring-g2.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-socket_throughput-uring-g3.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-summary-epoll.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/linux-summary-uring.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-accept_churn.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-fan_out-g1.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-fan_out-g2.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-http_server.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-local_socket_latency.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-local_socket_throughput-g1.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-local_socket_throughput-g2.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-socket_latency.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-socket_throughput-g1.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-socket_throughput-g2.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-socket_throughput-g3.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/macos-summary.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/windows-accept_churn.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/windows-fan_out-g1.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/windows-fan_out-g2.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/windows-http_server.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/windows-socket_latency.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/windows-socket_throughput-g1.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/windows-socket_throughput-g2.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/windows-socket_throughput-g3.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/images/bench/windows-summary.svg is excluded by !**/*.svg, !**/bench/**, !**/doc/**
  • doc/modules/ROOT/pages/benchmarks/index.adoc is excluded by !**/doc/**
  • doc/modules/ROOT/pages/benchmarks/linux.adoc is excluded by !**/doc/**
  • doc/modules/ROOT/pages/benchmarks/macos.adoc is excluded by !**/doc/**
  • doc/modules/ROOT/pages/benchmarks/windows.adoc is excluded by !**/doc/**

CodeRabbit blocks several paths by default. You can override this behavior by explicitly including those paths in the path filters. For example, including **/dist/** will override the default block on the dist directory, by removing the pattern from both the lists.

Run configuration

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

@greptile-apps

greptile-apps Bot commented Nov 16, 2026 •

Copy link
Copy Markdown

RetriggerView in GreptileConfidence Score: 5/5

[Low impact] The reviewed documentation changes appear safe to merge.

Summary

Refreshes the published benchmark report from the November 16 run at 13bcf933adf8.

  • The benchmark pages now show results from the November 16 run.

Reviews (2) · Last reviewed commit: "docs: regenerate benchmark report" · Reviewed by Greptile

@cppalliance-bot

cppalliance-bot commented Nov 16, 2026 •

Copy link
Copy Markdown

An automated preview of the documentation is available at https://421.corosio.prtest3.cppalliance.org/index.html

If more commits are pushed to the pull request, the docs will rebuild at the same URL.

2026-11-16 18:08:06 UTC

@cppalliance-bot

cppalliance-bot commented Nov 16, 2026 •

Copy link
Copy Markdown

GCOVR code coverage report https://421.corosio.prtest3.cppalliance.org/gcovr/index.html
LCOV code coverage report https://421.corosio.prtest3.cppalliance.org/genhtml/index.html
Coverage Diff Report https://421.corosio.prtest3.cppalliance.org/diff-report/index.html

Build time: 2026-11-16 18:24:16 UTC

@sgerbino
sgerbino force-pushed the pr/bench-report-refresh branch from 0f039af to ffca653 Compare November 16, 2026 18:03
@sgerbino
sgerbino merged commit 4fde70c into cppalliance:develop Nov 16, 2026
45 checks passed
@sgerbino
sgerbino deleted the pr/bench-report-refresh branch November 16, 2026 18:59
@github-project-automation github-project-automation Bot moved this from Backlog to Done in Beast2 Nov 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

2 participants