Skip to content

feat: script replaying the roadmap#16 robustness scenarios on a test Pi - #70

Open
MateoLostanlen wants to merge 4 commits into
feat/fake-reolink-camerafrom
feat/pi-robustness-replay
Open

MateoLostanlen wants to merge 4 commits into
feat/fake-reolink-camerafrom
feat/pi-robustness-replay

Conversation

@MateoLostanlen

@MateoLostanlen MateoLostanlen commented Oct 28, 2026 •

Copy link
Copy Markdown
Member
  • The robustness PRs of pyro-engine (fix: stop serving and scoring frozen frames when a patrol hangs pyro-engine#458 and #461, part of Engine robustness roadmap#16) were validated by hand on a test Pi. This script makes those runs repeatable by anyone with a Pi: it builds the engine stack from the PR branch, starts the fake Reolink cameras from this repo, injects each failure (camera that never answers, camera API frozen, grayscale frames as infrared, frozen or still camera) and checks the expected reaction in the logs and /patrol_status.
  • One subcommand per scenario, named after the fault (camera-timeout, api-frozen, night-per-frame, camera-silent, camera-frozen), all for the five (about 90 min, the detector's own timings), setup for the Pi, real to go back to the real cameras. FAIL exits non-zero and the iptables redirect is removed on exit.
  • README gains a short "Robustness tests on a Pi" section with the scenario table and the two warnings: point API_URL at preprod, no pi-manager deploy during a run.
  • Depends on the fake camera of feat: fake Reolink camera driven by scenarios #65, hence the base branch. Once the pyro-engine PRs are merged, run with BRANCHES= to test develop alone.

Validated on a Pi 5: every scenario passed through the script. Not run end to end: setup from a bare Pi. The engine-frozen scenario (healthcheck restart) will come back once the heartbeat healthcheck of pyronear/pyro-engine#417 is merged.

Mateo Lostanlen added 4 commits October 28, 2026 16:04
The engine healthcheck scenario matched a PR that is now closed, and the
night-per-frame commits moved onto the stale-patrol branch, so the camera
recovery branch alone carries every change under test.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant