Repository navigation
Measure batched neighbor queue insertion - #1600
Draft
Wei Wu (wuw92) wants to merge 3 commits into
Draft
Wei Wu (wuw92) wants to merge 3 commits into
Wei Wu (wuw92) wants to merge 3 commits into
Conversation
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Wei Wu (wuw92)
force-pushed
the
wuw92-beam-queue-benchmark
branch
from
November 13, 2026 11:55
1387514 to
ba0b492
Compare
Wei Wu (wuw92)
force-pushed
the
wuw92-beam-queue-batching
branch
from
November 13, 2026 11:55
da80f17 to
25e8b68
Compare
4 of 5 tasks
Wei Wu (wuw92)
changed the base branch from
wuw92-beam-queue-batching
to
main
November 13, 2026 12:47
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## main #1600 +/- ##
==========================================
- Coverage 92.14% 92.14% -0.01%
==========================================
Files 621 622 +1
Lines 130986 131546 +560
==========================================
+ Hits 120694 121207 +513
- Misses 10292 10339 +47
Flags with carried forward coverage won't be shown. Click here to find out more.
🚀 New features to boost your workflow:
|
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Queue-only benchmarks for #1590. This PR is not intended to merge.
Results
The three-platform CI run shows gains across small, medium, and large queues. At L=2,000 with batches of 2,000-4,000 candidates,
batch_insertis 4.88-23.11x faster than per-iteminsert, depending on the platform.Performance depends on the workload. At L=20 with 40 candidates, batching is 23-34% slower across all three platforms. At L=2,000 with 8 candidates, it is 60% slower on Linux x64, 6% slower on Windows, and 1.52x faster on ARM64.
Speedup is
median(insert) / median(batch_insert)over 27 samples per method (3 processes, 9 samples each); above 1x favors batching. Chart panels use independent x-axes. These shared-runner measurements isolate queue updates, not end-to-end search.Raw JSON and full result tables (ZIP downloads; retained for 30 days):
Run
From this PR's checkout, run the same 23-case workload without a dataset (PowerShell):
Edit
neighbor-queue.jsonto change queue capacity, batch size, candidate placement, or cutoff survivors. The summary script reportsbatch_insert / insert, so values below 1 favor batching.