You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
feat(fullsend): add CI triage agent and repair loop - #4567
Add an autonomous Fullsend CI/E2E triage and repair loop for RHDH Plugins.
What changed
Add trusted intake for completed CI workflow runs.
Resolve the matching open PR and verify its current head SHA.
Identify failed leaf jobs and affected workspaces.
Upload and analyze Jest and Playwright failure evidence.
Add a read-only ci-triage agent using the retro role.
Classify failures as code, test, flaky, infrastructure, or unknown.
Retry high-confidence flaky failures once.
Reuse the existing Fullsend fix agent through a CI-specific repair harness.
Restrict repairs to the affected workspace.
Require targeted verification before committing.
Add host-side checks for stale heads, unsafe paths, secrets, oversized diffs, and non-fast-forward pushes.
Add deduplication markers, concurrency controls, repair limits, and needs-human escalation.
Keep forks diagnosis-only and support fullsend-no-fix as a kill switch.
Add observe/repair/off rollout controls.
Safety
The agents never push directly. All mutations are performed only after deterministic host-side validation confirms that:
The PR is still open and unchanged.
The repair is limited to one approved workspace.
The diff is within configured limits.
Secret scanning passes.
Required verification succeeds.
The push can be performed as a fast-forward update.
Rollout
The automation defaults to observe mode. Repairs can be enabled gradually with:
FULLSEND_CI_AUTOMATION=repair
FULLSEND_CI_AUTOFIX_WORKSPACES=boost,scorecard,ai-integrations
Set FULLSEND_CI_AUTOMATION=off to disable the loop immediately.
Testing
CI context and trust-boundary tests
Schema fixture validation
Diff guard tests
Post-script safety tests
Workflow YAML and permission checks
Bash syntax checks
yarn test:ci-agent passes.
✔️ Checklist
A changeset describing the change and affected packages. (more info)
Added or Updated documentation
Tests for new functionality and regression tests for bug fixes
This PR has been automatically marked as stale because it has not had recent activity from the author. It will be closed if no further activity occurs. If the PR was closed and you want it re-opened, let us know and we'll re-open the PR so that you can continue the contribution!
This PR has been automatically marked as stale because it has not had recent activity from the author. It will be closed if no further activity occurs. If the PR was closed and you want it re-opened, let us know and we'll re-open the PR so that you can continue the contribution!
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Add an autonomous Fullsend CI/E2E triage and repair loop for RHDH Plugins.
What changed
Safety
The agents never push directly. All mutations are performed only after deterministic host-side validation confirms that:
Rollout
The automation defaults to observe mode. Repairs can be enabled gradually with:
FULLSEND_CI_AUTOMATION=repair
FULLSEND_CI_AUTOFIX_WORKSPACES=boost,scorecard,ai-integrations
Set FULLSEND_CI_AUTOMATION=off to disable the loop immediately.
Testing
yarn test:ci-agent passes.
✔️ Checklist