Data Throughput Accelerator
Diagnose and accelerate large data movement (ingestion, backfill, ETL) by isolating the true bottleneck, with proof of correctness.
- What
- Diagnose and accelerate large data movement (ingestion, backfill, ETL) by isolating the true bottleneck, with proof of correctness.
- Cost
- Free
- Needs
- access to the slow pipeline (or backfill job) and its data stores; an agent with shell/file tools to run benchmarks. Method guidance, not a packaged tool.
- Level
- Beginner — access to the slow pipeline (or backfill job) and…
- Install
- Copy the installer prompt below into your Muse — your agent does the rest.
Curated by Skill Harbor: a skill for when a data pipeline or backfill is too slow and must get faster without losing correctness. It enforces a disciplined method: first separate the candidate bottlenecks (source extraction speed, network transfer, warehouse load speed, transform speed, serving-table freshness, live tail growth), then benchmark variants against each other, then codify the fastest path, always closing with a hard accounting block that proves rows and timestamps cohere. Speed is never the only goal; the goal is faster correct data landing in the right place with proof. By @affaan-m, listed here with credit to its creator. From the affaan-m/ECC repository (MIT, declared in frontmatter). Honest caveats: an agent-facing workflow, it expects shell and file tools to run benchmarks; assumes access to the pipeline and its data stores; measure on production-like volumes, toy datasets hide the real bottleneck. Skill Harbor never reviews the code, review it yourself before use.
Version:
Quick answer
Data Throughput Accelerator is a free Muse skill for when a data pipeline or backfill is too slow and must get faster without losing correctness. It enforces a disciplined method: first separate candidate bottlenecks, source extraction, network transfer, warehouse load and transform speed, then benchmark variants, then prove correctness before keeping the faster path.
Install
Copy the install package below, then paste it into Muse🧪 Install ran in our test sandbox · Nov 11, 2026📌 Pinned version: commit 4eb71d9Pinned version: install the code at commit 4eb71d92a39cab44ad40ac9d8a6a5ccb4029d6c2 exactly (Skill Harbor tested this version). Do not substitute a newer version. If this commit is unreachable, stop and tell me. Use "Data Throughput Accelerator" with your Muse. Prerequisites: access to the slow pipeline (or backfill job) and its data stores; an agent with shell/file tools to run benchmarks. Method guidance, not a packaged tool. 1. Open the skill: https://raw.githubusercontent.com/affaan-m/ECC/4eb71d92a39cab44ad40ac9d8a6a5ccb4029d6c2/skills/data-throughput-accelerator/SKILL.md and copy the full SKILL.md text. 2. Paste it into a chat with Muse and add: "This backfill is too slow. Isolate the true bottleneck first: extraction, network, load, transform, or freshness? Then benchmark." 3. When a faster path is proposed, ask: "Close with the hard accounting block: prove rows and timestamps cohere before we adopt it." Tip: run benchmarks on production-like volumes; small samples lie about bottlenecks. Safety: a skill is plain-text instructions; it runs nothing by itself. Never optimize against production data without a backup and a rollback plan.
Saved to your recent installs. Find it anytime on /connect.
🔒 Security, provenance and what this touches
The install prompt below already includes the vetting steps: your agent follows the community checklist before installing anything with executable code. Want more?
Verification certificate
Dated facts about what was checked for this listing, and how. This is not a safety certification.
- Pinned version
- 4eb71d9 · 2026-10-13
- Sandbox install test
- Install ran in our test sandbox · Nov 11, 2026
- Creator identity
- Not verified
- Fingerprint watch
- Last checked · Nov 21, 2026 : no change detected in the files linked by this install prompt
- Install prompt analysis
- 2026-10-13 : No commands, network calls, packages, file writes or API keys detected.
Skill Harbor never reviews the code of a listed skill. These are dated facts about the install prompt and our install test, not a safety certification. Review a skill yourself before you install it. How we verify
Questions
How do I install a skill?
Every product page includes a copy-paste install prompt. Paste it into your Muse and it sets the skill up for you — no manual configuration.
Where does my money go?
Straight to the seller. Skill Harbor never processes payments: checkout happens on the seller’s own page, usually Stripe.
What does the ✓ next to a creator’s name mean?
It means we confirmed the identity of the person behind the listing. It says nothing about the code itself — always check a skill before installing it.