Repository navigation
Run LargeTestSuite with the old backend once - #392
Merged
Merged
Conversation
The LargeTestSuite_OB report in heavy_tests is from 2023 (v1.22), as f1b2023 removed the OB entry. Add it again for one run, to compare the old backend with the new backend. The entry is the NB entry without the new backend flags and with -O0, as the other OB entries. Remove the entry after the run. Assisted-by: Claude Opus 5.5
Collaborator
|
@adrpo the reason it was removed is that it is horribly slow, we know it, and the only cure for that is to switch to the NB. There's no point wasting time to re-discover this every time we run heavy_test. We should spend our limited resource to see what improvements we get with the NB instead 😃 I would suggest (as I already suggested @kabdelhak) to run it once and then remove it again. |
Member
Author
|
I put it back because @kabdelhak wanted baseline numbers, I will take it out again when they told me we don't need to run it again. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
The report LargeTestSuite_OB is from 2023-06-13 (v1.22.0-dev.169). Commit f1b2023 removed the LargeTestSuite OB entry from
configs/heavy_tests.json, so no job updates it.Approach
configs/heavy_tests.json, before the NB entry.ulimitExeModels, but:extraCustomCommands, so it uses the old backend;-O0 -march=native, as the other OB entries.heavy_testsrun. Remove the entry after the run.Testing
An AI agent (Claude Code) wrote this change.
🤖 Generated with Claude Code