AI change review: stop a bad training change before it ships

A repository document, rendered for the site. View source markdown.

Generated at: 2026-07-30T12:38:02.000Z UTC · source: committed helm-expt evidence for this rendered repository document.

This example starts with the AICR PyTorch training runtime already committed in the catalog. The request is to increase the runtime to eight H100 nodes and update its image.

The unchecked proposal does three concrete things: asks for more nodes than the recorded target has, replaces a digest-pinned image with latest, and leaves the API key as confighubplaceholder. The proposal is rejected before apply.

The reviewed candidate stays within the four-node target limit, keeps the pinned image, and reads the API key from the existing training-provider-credentials Secret. This local receipt stops before ConfigHub. A separate live proof stores this same reviewed object and exercises the approval boundary.

This is a deterministic example of an agent-produced change. It is not a transcript from a named model.

What changed

CheckUnchecked proposalReviewed candidate
Requested training nodes8; target limit is 44; target limit is 4
Imagemutable tag; warningdigest pinned; pass
API keyunresolved placeholder; blockexisting Secret reference; pass
ConfigHub checksnot run in this local receiptsee the live proof
Production approvalnot reachedsee the live proof
Kubernetes apply and observationnot runnot run

Open the evidence

Run:

npm run ai-change-review:verify
npm run ai-change-review:self-test
npm run ai-change-review:live:verify