Environment: DRMacIver__shrinkray-7
recorded This page replays a committed certificate. No live calls were made.
View the raw certificate on GitHub: raw certificate (pinned 70f215f)
Result
One attacker, one prompt family, recorded conditions; certified means the recorded attack did not pass, not that no hole remains.
Read the limitations.
| Field | Value |
|---|---|
| Certified | not certified |
| Certified via | not recorded (certificate written before certified_via) |
| Hole status | none: no hole label before hardening |
| Reason | gates failed before hardening (the task is broken): gold gate failed: pytest exited 4 |
| Cost (USD) | $0.0000 (budgeted ledger delta) |
| Timestamp | 2026-10-22T07:30:59.946538+00:00 |
| Sandbox runs | 2 |
What this means: a ledger estimate, not billed spend
Notes
none
Exposure scan
exposure scan not recorded
Task
| Field | Value |
|---|---|
| Instance id | DRMacIver__shrinkray-7 |
| Repo | DRMacIver/shrinkray |
| Base commit | 6bf13612eb5789611975db03aadd50361d955f08 |
| Image | swerebench/sweb.eval.x86_64.drmaciver_1776_shrinkray-7 |
| Image digest | image digest not recorded |
| Source | swe-rebench |
| Gold patch | sha256 89f502a04b69b59fa0b4466df90aa9374168064f05b8a333d6836454bc3120b0, 553 chars |
| Test patch | sha256 8bcaf4c549ef2c6a939b0da8c327bcfaebcd5fc530cf4de6feb3d2281eca2ac5, 1308 chars |
What this means: the task image is not pinned by digest in this certificate
The task prompt and hidden tests are not shown here; see the dataset instance DRMacIver__shrinkray-7.
Attacker settings
| Field | Value |
|---|---|
| attacks_per_round | 1 |
| cmd_timeout | 120 |
| executor | sandbox |
| max_output_tokens | 2048 |
| max_steps | 40 |
| max_tokens | 250000 |
| model | nvidia/nemotron-3-super-120b-a12b |
| strategy | combined |
| visible_passed_basis | PASS_TO_PASS intact |
Gates
| Round | Gold gate | Empty gate | Gates held | Reason |
|---|---|---|---|---|
| Before hardening | fail | fail | no | gold gate failed: pytest exited 4 |
| After hardening | not run | not run | not run | not run |
Holes
| Round | Exploited (holes found) | Attempted | Evidence per label |
|---|---|---|---|
| Before hardening | not run | not run | not run |
| After hardening | not run | not run | not run |
Patches
Patch diff text is not recorded in the certificate; patches are listed by name.
| Field | Value |
|---|---|
| Applied | none |
| Rejected | none |
| Unpatched (hole labels no patch covers) | none |
none recorded
none recorded
Attack rounds
Before hardening
| Field | Value |
|---|---|
| Attack | not run |
| Hidden tests on the attack diff | not run |
| Inconclusive | none |
| Round error | none |
No attack ran in this round.
After hardening
No after round was run.
Transcript (harness record)
No transcript is committed on this site. For the one confirmed case the recorded commands of steps 12 to 15 are in the evidence file.