Skip to content

GENOME / OBSERVED EVIDENCE

Test the knowledge.
Keep both outcomes.

Real model decisions, matched tasks, and every recorded attempt. See where a skill kit changes the result — and where it does not.

Published experiment spend

0.019863036OpenRouter credits recorded

All published comparisons and infrastructure interruptions.

$5 total experiment allowance

One cumulative ceiling for the experiment program.

Published snapshots only — not a live balance or permission for further calls. The private ledger controls the remaining allowance.

SERIES SIDE BY SIDE

Task success and the skill difference.

First read each agent’s task success. Then compare the full kit with the baseline inside the same series. These are two different measurements.

2 of 4 retained series
Series 03paused

DeepSeek V4.1 Flash · 8 actions · paused

deepseek/deepseek-v4.1-flash

Output / request timeout
8,192 tokens / 120 s
Actions / context
8 / 32,768
Temperature / seed
0 / 0
Task repeats
3

16 / 18 attempts recorded · partial series

01 Tasks passed

Absolute results · passes / graded attempts

Baseline8 / 8
8 of 9 planned attempts graded · 0 failed · 1 not run
Full Genome kit8 / 8
8 of 9 planned attempts graded · 0 failed · 1 not run

02 Skill difference

Full kit against this series’ baseline

0net passes so far

8 of 9 pairs graded so far · same task and repetition
0improved0regressed8tied1unpaired

Improved: baseline failed, full kit passed. Regressed: the reverse. The net difference is improved minus regressed; passing with both is a tie.

Recorded failure reasons0 failures across all skill sets
Output limit
0
Action limit
0
Invalid format
0
Other
0
Settings: frozen campaign.
Series 04paused

DeepSeek V4.1 Flash · 16 actions · paused

deepseek/deepseek-v4.1-flash

Output / request timeout
8,192 tokens / 120 s
Actions / context
16 / 32,768
Temperature / seed
0 / 0
Task repeats
3

17 / 18 attempts recorded · partial series

01 Tasks passed

Absolute results · passes / graded attempts

Baseline9 / 9
9 of 9 planned attempts graded · 0 failed
Full Genome kit7 / 7
7 of 9 planned attempts graded · 0 failed · 1 indeterminate · 1 not run

02 Skill difference

Full kit against this series’ baseline

0net passes so far

7 of 9 pairs graded so far · same task and repetition
0improved0regressed7tied2unpaired

Improved: baseline failed, full kit passed. Regressed: the reverse. The net difference is improved minus regressed; passing with both is a tie.

Recorded failure reasons0 failures across all skill sets
Output limit
0
Action limit
0
Invalid format
0
Other
0
Settings: frozen campaign.
Recorded differences: Action limit.

A full kit can pass more tasks in a later series while its baseline also improves. That increase is different from the skill difference measured inside each series.

These are separate series, not a controlled test of one changed parameter. Different limits, timeouts, execution revisions or model variability can change outcomes. Cross-series differences do not identify their cause. Failure categories describe the recorded stopping reason across all skill sets; they do not prove a skill caused it.

Every configuration, with its own series baseline
Frozen skill configurationSeries 38,192 tokens · 120 sSeries 48,192 tokens · 120 s
baselineUnchanged baseline
8pass0fail0indeterminate1not run
Calls
35
Input tokens
17,819
Output tokens
11,709
Recorded charge
0.003692898OpenRouter credits · all dispatched calls

Reference in this series.

9pass0fail0indeterminate0not run
Calls
34
Input tokens
17,254
Output tokens
14,325
Recorded charge
0.004076064OpenRouter credits · all dispatched calls

Reference in this series.

fullFull selected kit
8pass0fail0indeterminate1not run
Calls
33
Input tokens
29,540
Output tokens
22,388
Recorded charge
0.006633144OpenRouter credits · all dispatched calls
0 improved0 regressed8 tied1 unpairedAgainst this series’ baseline · 8/9 graded pairs so far
7pass0fail1indeterminate1not run
Calls
34
Input tokens
Unknown29,255 recorded
Output tokens
Unknown15,897 recorded
Recorded charge
0.00540225OpenRouter credits · all dispatched calls
0 improved0 regressed7 tied2 unpairedAgainst this series’ baseline · 7/9 graded pairs so far

Rows align by skill kind and frozen lesson snapshots, including the omitted lesson in a removal test. A changed snapshot gets a separate row. There is no pooled score or automatic ranking across series. Usage includes dispatched calls from failed and unfinished attempts, attributed by the frozen attempt plan. Missing receipt accounting stays unknown; unspent reservations are not model calls.

What should we retest?Human review · no automatic skill changes

These flags identify follow-up questions, not good or bad skills. Keep each series separate, fix the next test conditions in advance, and check the same lesson on new tasks before changing it.

Review a kit regression

Verify the outcome, not the intention

  • Evidence is limited to these tasks
  • The kit result cannot identify an individual skill’s effect
  • The full kit lost at least one pair
  • The unrelated control matched or exceeded the kit in comparable wins
  • Removing a skill helped in at least one pair; interactions remain possible
  • Some pairs are missing or indeterminate
1,024 output tokens · 45 s

Full kit vs baseline: 1 improved · 2 regressed · 6 tied · 0 unpaired.

Without this skill vs full kit: 3 improved · 1 regressed · 5 tied · 0 unpaired.

8,192 output tokens · 120 s

Full kit vs baseline: 1 improved · 0 regressed · 8 tied · 0 unpaired.

Without this skill vs full kit: 0 improved · 2 regressed · 7 tied · 0 unpaired.

8,192 output tokens · 120 s

Full kit vs baseline: 0 improved · 0 regressed · 8 tied · 1 unpaired.

No removal test recorded for this skill.

8,192 output tokens · 120 s

Full kit vs baseline: 0 improved · 0 regressed · 7 tied · 2 unpaired.

No removal test recorded for this skill.

Review a kit regression

Recheck after the world changes

  • Evidence is limited to these tasks
  • The kit result cannot identify an individual skill’s effect
  • The full kit lost at least one pair
  • The unrelated control matched or exceeded the kit in comparable wins
  • Removing a skill helped in at least one pair; interactions remain possible
  • Some pairs are missing or indeterminate
1,024 output tokens · 45 s

Full kit vs baseline: 1 improved · 2 regressed · 6 tied · 0 unpaired.

Without this skill vs full kit: 4 improved · 1 regressed · 4 tied · 0 unpaired.

8,192 output tokens · 120 s

Full kit vs baseline: 1 improved · 0 regressed · 8 tied · 0 unpaired.

Without this skill vs full kit: 0 improved · 2 regressed · 7 tied · 0 unpaired.

8,192 output tokens · 120 s

Full kit vs baseline: 0 improved · 0 regressed · 8 tied · 1 unpaired.

No removal test recorded for this skill.

8,192 output tokens · 120 s

Full kit vs baseline: 0 improved · 0 regressed · 7 tied · 2 unpaired.

No removal test recorded for this skill.

SELECTED SNAPSHOT · 13 Oct 2026, 00:11 UTC

DeepSeek V4.1 Flash · 16 actions · paused

deepseek/deepseek-v4.1-flash · 8,192 output tokens · 120 s request timeout

paused

17 / 18 development attempts recorded · 18 confirmation attempts reserved

Provider requests680 unresolved
Recorded tokens7673146509 known input · 30222 known output1 call has unknown token usage
Known charge0.009478314OpenRouter credits
Spending ceiling1.4OpenRouter credits · 0 reserved
Paired evidence

Where did the outcome change?

The same task and repeat, with a fresh world for each skill set. Outcome and constraints are checked together; compliance is reported separately.

Against Unchanged baseline

The complete selected kit compared with the unchanged baseline. An observed improvement belongs to this kit and task; it does not isolate a single skill.

0ImprovedFail → pass
0RegressedPass → fail
7Unchanged7 both pass · 0 both fail
2Unpaired1 missing attempts · 1 indeterminate
7 / 9 pairs have two supported grades0 percentage points in paired pass rate · among 7 graded pairs so far
Verify the changed artifact1 graded pairs · 2 unpaired+0−01 tied

Reference → compared skill set

Repeat 1passindeterminateUnpaired

At least one attempt has no supported outcome grade. Both receipts are retained.

Reference
Observed outcome and constraints pass. Compliance is scored separately.Receipt 355ab238619cf85fc0f1ebd14b0dc0cba003877c1c31d30cb4a019ad2a133616
Compared skill set
Provider charge reconciled; delivered action or checkpoint could not be independently recovered.Receipt d3e9b2a1b1d693362af4ca4758eb1b5661fe55b17d44225e8edf0e2c4bb9abdc
Repeat 2passpassBoth passed

Both attempts passed.

Reference
Observed outcome and constraints pass. Compliance is scored separately.Receipt 9e79637b46916aa90c08d2908cfb140ed252cda3a6b8c35de33e8f0f48d5abea
Compared skill set
Observed outcome and constraints pass. Compliance is scored separately.Receipt 9a1b3630d92c6fc2b23e3a889039de724d946baf3883f473ab458c7b5a0e5c2b
Repeat 3passnot runUnpaired

Compared attempt has not been recorded.

Reference
Observed outcome and constraints pass. Compliance is scored separately.Receipt b898464ef801bc09e30c1a4028bab881967220c058f2e0c03a701fa2dc269452
Compared skill set
Not run
Task ID: coding-artifact-dev
Duplicate order events3 graded pairs · 0 unpaired+0−03 tied

Reference → compared skill set

Repeat 1passpassBoth passed

Both attempts passed.

Reference
Observed outcome and constraints pass. Compliance is scored separately.Receipt 3bcb8a9cea26ca32100ceb59d002d19189f8fce9bc59a6fdd9201b6d6374babc
Compared skill set
Observed outcome and constraints pass. Compliance is scored separately.Receipt 6f317a699c0f4e1a8ea9c9c098b2eed72ede294126ee6d486dfd6435e7599d0e
Repeat 2passpassBoth passed

Both attempts passed.

Reference
Observed outcome and constraints pass. Compliance is scored separately.Receipt 96f6edc6130adf559b47ccd75e4aea44fc9b3e0fc04af5dedb23ef9f9adb9302
Compared skill set
Observed outcome and constraints pass. Compliance is scored separately.Receipt ef006aa2ceab85d41121fc7ed4fb452a4cb42c6c3c663e9e63f30581b17e8caf
Repeat 3passpassBoth passed

Both attempts passed.

Reference
Observed outcome and constraints pass. Compliance is scored separately.Receipt 854663a18a870db73454c67d49b9f80fdebe39f597fdd1acdc144abf44eed88b
Compared skill set
Observed outcome and constraints pass. Compliance is scored separately.Receipt fef0e05f0bd67ef1688852910ee418a18ffb3397f2ffc3880e37af9ef67099b5
Task ID: commerce-crm-dev
Inventory recovery3 graded pairs · 0 unpaired+0−03 tied

Reference → compared skill set

Repeat 1passpassBoth passed

Both attempts passed.

Reference
Observed outcome and constraints pass. Compliance is scored separately.Receipt 76d7f51f98271e065a6e37afe75aa8f8c3c42e234b0dd92582441f78af44b431
Compared skill set
Observed outcome and constraints pass. Compliance is scored separately.Receipt 49309afb418ec900eb5ea9798484dee76baff01e2218e84c1a95a52e2dcbf1f9
Repeat 2passpassBoth passed

Both attempts passed.

Reference
Observed outcome and constraints pass. Compliance is scored separately.Receipt d8f802b8fe031a3ccc3ca86cf95eba05167b282d3688a729bf0d4589faf3d2a8
Compared skill set
Observed outcome and constraints pass. Compliance is scored separately.Receipt d07e2e8c7b8047bd5abd5cf89b997db8cfff48d70aaccd6459d25955a20a3545
Repeat 3passpassBoth passed

Both attempts passed.

Reference
Observed outcome and constraints pass. Compliance is scored separately.Receipt fd0a2096619fce8cafa28c12e2632b90fef3da233e30b1ec04924d20fb916646
Compared skill set
Observed outcome and constraints pass. Compliance is scored separately.Receipt 5786d7dcbb529987e15ea2b23a6927dd135447246983299208f6ac0d21e724a4
Task ID: commerce-stock-dev

These are descriptive results from operator-authored development tasks. Repeats are not independent real-world tasks. Small samples and excluded pairs can change the picture; this is not statistical proof or a model ranking. Confirmation tasks remain reserved.

Every attempt stays visible.17 recorded · 1 not run · 1 indeterminate
Frozen conditions & skills
Model
deepseek/deepseek-v4.1-flash
Qualified provider route
decart/fp4
Harness
nothing-bounded-model-campaign/1
Repeats per task
3
Action limit per attempt
16
Context limit
32768
Protocol SHA-256
3d6b466fe55b64a40e73a49c0923c8c9469064ba180c439e4696606387b5f6b9
Engine SHA-256
c0baa15b582627ade3b2f9961177d188f268eba8284a3e92fbd85772b9b02b56
World SHA-256
347a041320883331b52e91246bf552aaa57887af2acd955c79af90035b6fe843

Selected kit

Recheck after the world changes

A previous inspection was followed by an inventory, permission or version change.

  1. Record the version or timestamp of the state you inspected.
  2. After a relevant change, inspect the current state and compare it with the task constraints.
  3. Take the allowed action only when the current state satisfies those constraints.

Check: Test a task where state changes between inspection and action. Verify that the stale path is rejected and the new path is checked.

Limits: A reference procedure, not an evaluated improvement. Reinspection has a cost and does not eliminate a race between read and write.

d931f2a5b3d5e6963def6dfafca88627f3e7c154e1a72e855f1c6cc9b4fec549
Verify the outcome, not the intention

An agent is about to mark a fix complete after editing source code.

  1. Identify the user-visible behavior and the exact route or artifact affected.
  2. Run the smallest check that would fail before the fix and pass after it.
  3. Inspect the resulting artifact. Report what was tested and any remaining limitations.

Check: Use a regression case with a misleadingly similar component. Check that the test targets the component actually rendered.

Limits: A successful build does not prove the user-visible result. This procedure is a reference and has no measured uplift.

7aa70dbb43eb6f3a81da811cae95a315703450096b6eeca1719b00cdba89f558

Retained control reference

Load the smallest useful memory

Not executed in this series; retained as protocol metadata.

Archive retrieval does not change any tool-state transition in these worlds, and no library-search tool is available. It controls for additional skill text rather than a relevant recovery procedure.

All attempts by skill set
Unchanged baseline
Pass
9
Fail
0
Indeterminate
0
Not run
0
Full selected kit
Pass
7
Fail
0
Indeterminate
1
Not run
1
Observed attempt receipts · 17
  1. Unchanged baselinecommerce-stock-dev · repeat 1pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 3
    1. Step 1inspect → inventoryObserved
    2. Step 2reserve → alternative@12Observed
    3. Step 3finish → doneObserved

    3 provider requests · compliance pass · 84958 ms

    Receipt SHA-256
    76d7f51f98271e065a6e37afe75aa8f8c3c42e234b0dd92582441f78af44b431
    Artifact SHA-256
    163130ecac7d6b50a4c387cfceb9c218a661ea2f079b17034a3219a4ba32bdb6
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    783056a3-472c-4df2-a840-fbc979924e8b0b282521-0b70-4bb5-ad3d-6543d563122613cf3737-3b71-489c-a05d-b71c12674259
    • stock-current: pass (outcome)
    • quantity: pass (outcome)
    • budget: pass (constraint)
    • inspection: pass (compliance)
  2. Full selected kitcommerce-stock-dev · repeat 1pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 3
    1. Step 1inspect → inventoryObserved
    2. Step 2reserve → alternative@12Observed
    3. Step 3finish → doneObserved

    3 provider requests · compliance pass · 80141 ms

    Receipt SHA-256
    49309afb418ec900eb5ea9798484dee76baff01e2218e84c1a95a52e2dcbf1f9
    Artifact SHA-256
    163130ecac7d6b50a4c387cfceb9c218a661ea2f079b17034a3219a4ba32bdb6
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    070ff6ab-9a10-4108-ab42-e61348fbfd2d5a8bb168-77dc-4927-b999-bf2664e6547384face59-8299-4b7a-8a4a-063bab86bcb1
    • stock-current: pass (outcome)
    • quantity: pass (outcome)
    • budget: pass (constraint)
    • inspection: pass (compliance)
  3. Full selected kitcommerce-stock-dev · repeat 2pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 3
    1. Step 1inspect → inventoryObserved
    2. Step 2reserve → alternative@12Observed
    3. Step 3finish → doneObserved

    3 provider requests · compliance pass · 87856 ms

    Receipt SHA-256
    d07e2e8c7b8047bd5abd5cf89b997db8cfff48d70aaccd6459d25955a20a3545
    Artifact SHA-256
    163130ecac7d6b50a4c387cfceb9c218a661ea2f079b17034a3219a4ba32bdb6
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    ddbf763c-ef42-4709-bf3e-2f72fe8b8ff7726a9aff-a167-4c70-ba19-1ab8f3431befd2313637-b1b3-4271-827a-93189548c621
    • stock-current: pass (outcome)
    • quantity: pass (outcome)
    • budget: pass (constraint)
    • inspection: pass (compliance)
  4. Unchanged baselinecommerce-stock-dev · repeat 2pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 3
    1. Step 1inspect → inventoryObserved
    2. Step 2reserve → alternative@12Observed
    3. Step 3finish → doneObserved

    3 provider requests · compliance pass · 83641 ms

    Receipt SHA-256
    d8f802b8fe031a3ccc3ca86cf95eba05167b282d3688a729bf0d4589faf3d2a8
    Artifact SHA-256
    163130ecac7d6b50a4c387cfceb9c218a661ea2f079b17034a3219a4ba32bdb6
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    3037d12a-f2f7-4008-861a-af0c77f11d83a6d55213-a4de-4bb2-ad30-a748d040fd34504a0896-bb9c-48e5-8a1e-f176f94a0160
    • stock-current: pass (outcome)
    • quantity: pass (outcome)
    • budget: pass (constraint)
    • inspection: pass (compliance)
  5. Unchanged baselinecommerce-stock-dev · repeat 3pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 3
    1. Step 1inspect → inventoryObserved
    2. Step 2reserve → alternative@12Observed
    3. Step 3finish → doneObserved

    3 provider requests · compliance pass · 97144 ms

    Receipt SHA-256
    fd0a2096619fce8cafa28c12e2632b90fef3da233e30b1ec04924d20fb916646
    Artifact SHA-256
    163130ecac7d6b50a4c387cfceb9c218a661ea2f079b17034a3219a4ba32bdb6
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    1d302a44-dc50-4ae8-9e83-3765c5d4428e44a37f68-fbe8-42ef-9eb8-eb36ebede43ce69663ca-0a5d-4972-b1aa-724a07c2b9f5
    • stock-current: pass (outcome)
    • quantity: pass (outcome)
    • budget: pass (constraint)
    • inspection: pass (compliance)
  6. Full selected kitcommerce-stock-dev · repeat 3pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 3
    1. Step 1inspect → inventoryObserved
    2. Step 2reserve → alternative@12Observed
    3. Step 3finish → doneObserved

    3 provider requests · compliance pass · 85483 ms

    Receipt SHA-256
    5786d7dcbb529987e15ea2b23a6927dd135447246983299208f6ac0d21e724a4
    Artifact SHA-256
    163130ecac7d6b50a4c387cfceb9c218a661ea2f079b17034a3219a4ba32bdb6
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    e39f27f2-cf16-4a4d-a162-cbf721736d0967f87b5f-1716-46f6-905e-16f880e32309a8f6e7c4-e6c9-425d-8043-1c465b830222
    • stock-current: pass (outcome)
    • quantity: pass (outcome)
    • budget: pass (constraint)
    • inspection: pass (compliance)
  7. Full selected kitcommerce-crm-dev · repeat 1pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 5
    1. Step 1lookup → order-101Observed
    2. Step 2process → delivery-1-aObserved
    3. Step 3lookup → order-101Observed
    4. Step 4process → delivery-1-bObserved
    5. Step 5finish → doneObserved

    5 provider requests · compliance pass · 264085 ms

    Receipt SHA-256
    6f317a699c0f4e1a8ea9c9c098b2eed72ede294126ee6d486dfd6435e7599d0e
    Artifact SHA-256
    48473f818f2fc2233444412e9143177734ed3999d61ac079bb56df59c8372703
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    bad918a9-26c3-4aea-834a-d5f65a63185ac8584bac-7fa2-4c79-b157-03cd2337866a43ed1bc3-ab0f-4177-87d8-f193e38760879b41b3ea-a518-4f0e-9cce-c39f03b040f590d8bdd6-dd43-4a81-ae36-fa5395f94dcd
    • one-deal: pass (outcome)
    • no-message: pass (constraint)
    • dedup-check: pass (compliance)
  8. Unchanged baselinecommerce-crm-dev · repeat 1pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 4
    1. Step 1lookup → order-101Observed
    2. Step 2process → delivery-1-aObserved
    3. Step 3process → delivery-1-bObserved
    4. Step 4finish → doneObserved

    4 provider requests · compliance pass · 145226 ms

    Receipt SHA-256
    3bcb8a9cea26ca32100ceb59d002d19189f8fce9bc59a6fdd9201b6d6374babc
    Artifact SHA-256
    48473f818f2fc2233444412e9143177734ed3999d61ac079bb56df59c8372703
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    71828a8d-89ca-4ca2-86ae-b9fcc93e7505565e5912-b04e-4ddc-8410-d97269450b08a3e5c70f-1355-4d7d-be82-ef92ed18ab43865563f6-7ec4-45e3-9e63-518ee3d1f316
    • one-deal: pass (outcome)
    • no-message: pass (constraint)
    • dedup-check: pass (compliance)
  9. Unchanged baselinecommerce-crm-dev · repeat 2pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 4
    1. Step 1lookup → order-102Observed
    2. Step 2process → delivery-2-aObserved
    3. Step 3process → delivery-2-bObserved
    4. Step 4finish → doneObserved

    4 provider requests · compliance pass · 150327 ms

    Receipt SHA-256
    96f6edc6130adf559b47ccd75e4aea44fc9b3e0fc04af5dedb23ef9f9adb9302
    Artifact SHA-256
    48473f818f2fc2233444412e9143177734ed3999d61ac079bb56df59c8372703
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    9f4ef992-864a-469c-9816-f1e1718e70e434640f09-955b-43b8-89e6-f0456fe0d921aa11b7a6-6e13-4fae-8700-4b183bd601f503e00b69-48b1-45e5-a8e7-83373f4fcdd0
    • one-deal: pass (outcome)
    • no-message: pass (constraint)
    • dedup-check: pass (compliance)
  10. Full selected kitcommerce-crm-dev · repeat 2pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 5
    1. Step 1lookup → order-102Observed
    2. Step 2process → delivery-2-aObserved
    3. Step 3lookup → order-102Observed
    4. Step 4process → delivery-2-bObserved
    5. Step 5finish → doneObserved

    5 provider requests · compliance pass · 160579 ms

    Receipt SHA-256
    ef006aa2ceab85d41121fc7ed4fb452a4cb42c6c3c663e9e63f30581b17e8caf
    Artifact SHA-256
    48473f818f2fc2233444412e9143177734ed3999d61ac079bb56df59c8372703
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    560aee37-247c-42db-be6d-1e0c27b08f509059dda5-0f54-4530-a1ad-0d25ba07977019f49583-3eef-4d52-ac44-784ce106bfe8ff935702-25e8-4c12-9008-6e21bc515f6b3b0bd264-ae52-4bbf-a597-213d109ef9fc
    • one-deal: pass (outcome)
    • no-message: pass (constraint)
    • dedup-check: pass (compliance)
  11. Full selected kitcommerce-crm-dev · repeat 3pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 5
    1. Step 1lookup → order-103Observed
    2. Step 2process → delivery-3-aObserved
    3. Step 3lookup → order-103Observed
    4. Step 4process → delivery-3-bObserved
    5. Step 5finish → doneObserved

    5 provider requests · compliance pass · 205370 ms

    Receipt SHA-256
    fef0e05f0bd67ef1688852910ee418a18ffb3397f2ffc3880e37af9ef67099b5
    Artifact SHA-256
    48473f818f2fc2233444412e9143177734ed3999d61ac079bb56df59c8372703
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    8d40b5df-8494-4ab5-95f6-c3d92106981049269ddc-5911-4f38-b154-c398e57754ebd4a6d57d-7b3f-426f-939d-e7a5852fbc0db22e6ff9-b469-4211-a6ef-b8571e79395f5d78b0fd-b1d6-485d-ac74-212b2f020cf0
    • one-deal: pass (outcome)
    • no-message: pass (constraint)
    • dedup-check: pass (compliance)
  12. Unchanged baselinecommerce-crm-dev · repeat 3pass

    Observed outcome and constraints pass. Compliance is scored separately.

    Observed tool actions · 4
    1. Step 1lookup → order-103Observed
    2. Step 2process → delivery-3-aObserved
    3. Step 3process → delivery-3-bObserved
    4. Step 4finish → doneObserved

    4 provider requests · compliance pass · 146558 ms

    Receipt SHA-256
    854663a18a870db73454c67d49b9f80fdebe39f597fdd1acdc144abf44eed88b
    Artifact SHA-256
    48473f818f2fc2233444412e9143177734ed3999d61ac079bb56df59c8372703
    Verifier SHA-256
    fc23d17a103c29d5461299f3ebbef632a2d07896661fc42107c7c74392b5cc9f
    Call references
    af19f583-95d4-4fec-b02a-c4920fbab8c511b3a293-ce22-45ab-b018-c9020b7ac8ee9d45ce18-f1ef-42b6-b3a4-58b135a0f27bf0a8519a-7180-4cc3-ad17-e9a48c132e83
    • one-deal: pass (outcome)
    • no-message: pass (constraint)
    • dedup-check: pass (compliance)
1 / 2
Provider receipts · 68 retained call records

Provider acknowledgements and retained accounting records are separate from task outcomes. Reconciled charges are operator-attested, as labeled. Unknown values are not counted as zero. No prompts or model outputs are published here.

  1. Attempt 1 · decision 1deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846053-hdZQQ1rNLH3ErxrbpvS4
    Token usage
    412 input · 93 output
    Known charge (OpenRouter credits)
    0.00005382
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    783056a3-472c-4df2-a840-fbc979924e8b
  2. Attempt 1 · decision 2deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846088-FEKoT2xVIOA6eAobepl2
    Token usage
    531 input · 370 output
    Known charge (OpenRouter credits)
    0.00011439
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    0b282521-0b70-4bb5-ad3d-6543d5631226
  3. Attempt 1 · decision 3deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846130-K68c5PEJguMEejb0xfMp
    Token usage
    544 input · 256 output
    Known charge (OpenRouter credits)
    0.00009504
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    13cf3737-3b71-489c-a05d-b71c12674259
  4. Attempt 2 · decision 1deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846165-tggf0KRfcMC6fo5u8LIQ
    Token usage
    792 input · 66 output
    Known charge (OpenRouter credits)
    0.00008316
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    60
    Call reference
    070ff6ab-9a10-4108-ab42-e61348fbfd2d
  5. Attempt 2 · decision 2deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846199-nADiOrABMKxFc8iE9bht
    Token usage
    911 input · 205 output
    Known charge (OpenRouter credits)
    0.00011889
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    197
    Call reference
    5a8bb168-77dc-4927-b999-bf2664e65473
  6. Attempt 2 · decision 3deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846236-2SMNYnSF6bIEr5HuHIWg
    Token usage
    924 input · 261 output
    Known charge (OpenRouter credits)
    0.00013014
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    84face59-8299-4b7a-8a4a-063bab86bcb1
  7. Attempt 3 · decision 1deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846271-JB6ZIzHAeLOMjPbOSp7h
    Token usage
    792 input · 67 output
    Known charge (OpenRouter credits)
    0.00008334
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    63
    Call reference
    ddbf763c-ef42-4709-bf3e-2f72fe8b8ff7
  8. Attempt 3 · decision 2deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846310-y9eGEfnJzddPyVwL9zoh
    Token usage
    911 input · 209 output
    Known charge (OpenRouter credits)
    0.00011961
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    202
    Call reference
    726a9aff-a167-4c70-ba19-1ab8f3431bef
  9. Attempt 3 · decision 3deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846346-GD0WRP4GBdEcrZaedhJk
    Token usage
    924 input · 408 output
    Known charge (OpenRouter credits)
    0.0001566
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    d2313637-b1b3-4271-827a-93189548c621
  10. Attempt 4 · decision 1deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846386-x1Kbgtqn2l3XTxAPtsyU
    Token usage
    412 input · 129 output
    Known charge (OpenRouter credits)
    0.0000603
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    3037d12a-f2f7-4008-861a-af0c77f11d83
  11. Attempt 4 · decision 2deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846420-II2yNsg76dPoLGXh3Wb6
    Token usage
    531 input · 324 output
    Known charge (OpenRouter credits)
    0.000087678
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    a6d55213-a4de-4bb2-ad30-a748d040fd34
  12. Attempt 4 · decision 3deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846460-FfkFVbgzWxMdsQSwy3JW
    Token usage
    544 input · 278 output
    Known charge (OpenRouter credits)
    0.000080568
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    504a0896-bb9c-48e5-8a1e-f176f94a0160
  13. Attempt 5 · decision 1deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846497-F0APCumiyoIO0LwbarMB
    Token usage
    412 input · 176 output
    Known charge (OpenRouter credits)
    0.00006876
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    1d302a44-dc50-4ae8-9e83-3765c5d4428e
  14. Attempt 5 · decision 2deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846535-ldk9PnjNp1hsE8dhh722
    Token usage
    531 input · 429 output
    Known charge (OpenRouter credits)
    0.000106578
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    44a37f68-fbe8-42ef-9eb8-eb36ebede43c
  15. Attempt 5 · decision 3deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846578-zDZDRBYgtS54n28yfoCb
    Token usage
    544 input · 452 output
    Known charge (OpenRouter credits)
    0.00013032
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    e69663ca-0a5d-4972-b1aa-724a07c2b9f5
  16. Attempt 6 · decision 1deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846621-mn2izKHQBRozWUO0xA2K
    Token usage
    792 input · 67 output
    Known charge (OpenRouter credits)
    0.000064908
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    63
    Call reference
    e39f27f2-cf16-4a4d-a162-cbf721736d09
  17. Attempt 6 · decision 2deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846656-cy8c3WBpyGMU0Djz39pl
    Token usage
    911 input · 254 output
    Known charge (OpenRouter credits)
    0.000109278
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    67f87b5f-1716-46f6-905e-16f880e32309
  18. Attempt 6 · decision 3deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846694-9JLddzc4lrC6O7inKKwd
    Token usage
    924 input · 392 output
    Known charge (OpenRouter credits)
    0.000135288
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    a8f6e7c4-e6c9-425d-8043-1c465b830222
  19. Attempt 7 · decision 1deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846737-w89T3o57Uz06DpnQGs53
    Token usage
    822 input · 128 output
    Known charge (OpenRouter credits)
    0.00009702
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    118
    Call reference
    bad918a9-26c3-4aea-834a-d5f65a63185a
  20. Attempt 7 · decision 2deepseek/deepseek-v4.1-flash · Decartsettled
    Provider acknowledgement
    gen-1791846817-MTIy5hS4cV62RzUYi0da
    Token usage
    863 input · 984 output
    Known charge (OpenRouter credits)
    0.00025479
    Provider finish reason
    stop
    Reasoning tokens (included in output)
    Unknown
    Call reference
    c8584bac-7fa2-4c79-b157-03cd2337866a
1 / 4

This is a published snapshot, last checkpoint 13 Oct 2026, 00:11 UTC. Opening it never starts a model call or refreshes a private notebook. It includes failed and unfinished work; no replacement attempts are inserted to improve the score.

Infrastructure interruptions · 2 retained records

These interrupted preparations are retained separately from the comparison series. They contribute no paired skill-effect estimate and are not agent successes or failures. Their known charges still count toward the shared spending ceiling.

Budget study: deepseek8

deepseek/deepseek-v4.1-flash · paused · checkpoint 2026-10-12 22:56:35 UTC

Accounting reconciled; execution outcome unavailable
Attempt record
1 indeterminate · 17 not run
Provider requests
1
Known charge
0.00005868 OpenRouter credits
Recorded tokens
412 input · 120 output
  • The initial request stopped at an accounting check. The delivered action or checkpoint could not be independently recovered.
  • The charge and token counts were reconciled afterward. Billing recovery does not supply a task result, so the attempt remains indeterminate.
  • An earlier assumption about the upstream accounting field was removed from the adapter. This interruption does not establish a failure of the agent or provider.

Generation ID: gen-1791845562-9IgGe37ihlOv8N9M1MhbReceipt status: reconciled. No reservation remains held.

Retained record references

Campaign bf2e3080-d48d-45c1-a1f1-83135084c266

baseline · commerce-stock-dev · repetition 1: Provider charge reconciled; delivered action or checkpoint could not be independently recovered.

This download is a projection of the public campaign export. It does not include the private reconciliation record or independently recover the missing action.

Budget study: deepseek16

deepseek/deepseek-v4.1-flash · paused · checkpoint 2026-10-12 22:56:40 UTC

Paused before dispatch; no model outcome recorded
Attempt record
0 indeterminate · 18 not run
Provider requests
0
Known charge
0 OpenRouter credits
Recorded tokens
0 input · 0 output
  • Paused before any provider request was dispatched. No outcome or skill-effect estimate was recorded.
  • Kept as an undispatched preparation; all 18 planned development attempts remain not run.
Retained record references

Campaign 428dcea5-8afd-499c-b469-3f39c1d2aa47

This download is a projection of the public campaign export. It does not include the private reconciliation record or independently recover the missing action.