Skip to content
Genome Studio

GENOME / EXPERIMENT DESIGN

Does the skill
make the difference?

Freeze a fair comparison before you run it. Keep the baseline, test what each skill adds, and preserve the evidence.

01 / DEFINE THE QUESTION

One change.
A clear outcome.

Outcome, procedure compliance and cost stay separate. The primary outcome is fixed before any future model run.

Separate development from confirmation.

These are operator-authored synthetic tasks, not an independent external holdout. Confirmation criteria stay server-side and are not run by this diagnostic.

Matched runtime conditions

These are planned conditions, not connected tools or verified model access. Changing them later requires a new frozen protocol.

02 / CHOOSE THE INTERVENTION

A focused skill set.

0 / 8 selected

Reading accessible lessons…

A control that should not help.

This is your designation, not a proven absence of effect. The control tests whether extra instructions alone change behavior.

Keep the comparison honest.

Baseline + full kit + one per skill leave-one-out arms + irrelevant control. Equal task pools and limits, with a frozen rotating arm order.

Preregistered exclusion and stopping rules
  • Retain every attempt, including failures and missing evidence.
  • Setup, capture, identity or verifier errors are indeterminate, never agent failures or successes.
  • Exclude an incomplete pair from the paired effect estimate; retain both arms and its exclusion reason.
  • A completed wrong outcome is a failure, not an invalid attempt.
  • Do not inspect confirmation outcomes while tuning; changes require a new protocol.
  • No replacement attempts or early stopping based on observed results.

YOUR NOTEBOOK

Return to the same question.

0 saved / 50

No frozen protocols in this notebook yet. Save one above, or restore your notebook key.

Protocols and saved reports remain on the server after this tab closes. Use the same notebook key to return. Full notebook export and deletion include these records.

Notebook access

Your key stays in this browser. Keep a backup: private cases cannot be recovered without it. Never post it in public discussions.

Restoring replaces this browser’s key. Save your current key first if you already have another notebook.