Benchmark optimization loop: turn "make it faster" into a bounded measured loop
Baseline first, one-hypothesis variants, benchmark each against a correctness gate, promote the fastest safe variant
- What
- Baseline first, one-hypothesis variants, benchmark each against a correctness gate, promote the fastest safe variant
- Cost
- Free
- Needs
- an operation to optimize and a correctness gate to protect; nothing else — the skill is a methodology, no accounts or keys required
- Install
- Copy the installer prompt below into your Muse — your agent does the rest.
Curated by Skill Harbor — @affaan-m's discipline for turning "make it 20x faster" into a bounded, measured optimization loop instead of guesswork: no optimization until the baseline, the correctness gate, the metric (wall time, p95 latency, rows/sec, cost/run, memory, error rate) and the search budget exist; then measure the baseline, generate one-hypothesis variants, run each against the same input shape, reject anything that fails correctness, safety or reproducibility, promote the fastest safe variant, codify the winner, and re-run baseline vs. winner to confirm the delta. Includes a variant-tracking table, recursive/hyperparameter search rules (persist every run to a ledger, compare against the prior accepted winner, stop when improvement is within noise or cost exceeds budget), and a promotion gate — no variant becomes the default until correctness passes, the delta repeats, rollback is obvious, and the change is encoded in source control or a durable runbook. By @affaan-m, listed here with credit to its creator. Honest caveats: pairs with companion ECC lanes not included here; MIT-licensed. Skill Harbor never reviews the code, review it yourself before use. Discovered via skills.sh.
Version:
Quick answer
Benchmark optimization loop is a free Muse skill that turns make it faster into a bounded, measured optimization loop instead of guesswork. No optimization begins until the baseline, correctness gate, metric and search budget exist. Then measure the baseline, generate one-hypothesis variants, run each against the same input shape, reject anything failing correctness, and promote the fastest safe variant.
Install
Copy the install package below, then paste it into Muse🧪 Install ran in our test sandbox · Nov 11, 2026📌 Pinned version: commit 4eb71d9Step 0 — before installing anything: read this install prompt, summarize in a few lines what this build does and what installing it involves, then ask me to confirm before you proceed. Prerequisites: an operation to optimize and a correctness gate to protect; nothing else — the skill is a methodology, no accounts or keys required Install "Benchmark optimization loop: turn "make it faster" into a bounded measured loop" for me. Give my agent @affaan-m's benchmark-optimization-loop: define the baseline, correctness gate, metric and search budget before optimizing; measure the baseline, generate one-hypothesis variants, run each against the same input shape, reject variants that fail correctness/safety/reproducibility, promote the fastest safe variant, codify the winner, and re-run baseline vs. winner to confirm the delta — with the variant table and promotion gate. Repository: https://raw.githubusercontent.com/affaan-m/ecc/4eb71d92a39cab44ad40ac9d8a6a5ccb4029d6c2/skills/benchmark-optimization-loop/SKILL.md Pinned version: install the code at commit 4eb71d92a39cab44ad40ac9d8a6a5ccb4029d6c2 exactly (Skill Harbor tested this version). Do not substitute a newer version. If this commit is unreachable, stop and tell me. 1. Fetch the SKILL.md file (and any helper files) from the repository path into a temporary folder 2. Safety check: review the SKILL.md and scripts for anything suspicious (unexpected network calls, shell commands, credential harvesting). This repo should contain zero secrets in code, credentials only via the secure vault, allowed hosts declared in the SKILL.md. Verify that holds here; STOP on any red flag and tell me. 3. Install it as a skill: copy SKILL.md and its helper files into the agent's skills directory, in a folder named "benchmark-optimization-loop". 4. Verify with no network calls: frontmatter valid, files in place. 5. Report what was installed, where, and what I still need to do myself (e.g. nothing — it is a methodology; point it at a real operation with a correctness gate). GitHub is optional: if I have a GitHub account or the gh CLI, you may use it; otherwise public access is fine. Never require it unless it's in the prerequisites above. Rules: don't touch anything outside the temp folder and the install target. If anything looks off, stop and ask me.
Saved to your recent installs. Find it anytime on /connect.
🔒 Security, provenance and what this touches
The install prompt below already includes the vetting steps: your agent follows the community checklist before installing anything with executable code. Want more?
Verification certificate
Dated facts about what was checked for this listing, and how. This is not a safety certification.
- Pinned version
- 4eb71d9 · 2026-10-13
- Sandbox install test
- Install ran in our test sandbox · Nov 11, 2026
- Creator identity
- Not verified
- Fingerprint watch
- Last checked · Nov 19, 2026 : no change detected in the files linked by this install prompt
- Install prompt analysis
- 2026-10-13 : No commands, network calls, packages, file writes or API keys detected.
Skill Harbor never reviews the code of a listed skill. These are dated facts about the install prompt and our install test, not a safety certification. Review a skill yourself before you install it. How we verify
Questions
How do I install a skill?
Every product page includes a copy-paste install prompt. Paste it into your Muse and it sets the skill up for you — no manual configuration.
Where does my money go?
Straight to the seller. Skill Harbor never processes payments: checkout happens on the seller’s own page, usually Stripe.
What does the ✓ next to a creator’s name mean?
It means we confirmed the identity of the person behind the listing. It says nothing about the code itself — always check a skill before installing it.