scikit-learn best practices: leak-proof pipelines, CV, tuning, and evaluation
Split-before-preprocess, pipelines and column transformers against data leakage, stratified CV strategies, GridSearch/RandomizedSearch, right metrics for imbalanced data, and joblib persistence
- What
- Split-before-preprocess, pipelines and column transformers against data leakage, stratified CV strategies, GridSearch/RandomizedSearch, right metrics for imbalanced data, and joblib persistence
- Cost
- Free
- Needs
- a Python ML project with a dataset to work on — the skill is guidance the agent follows, not software to install
- Install
- Copy the installer prompt below into your Muse — your agent does the rest.
Curated by Skill Harbor — @mindrally's scikit-learn best-practices skill: the full discipline of a sound ML workflow — split data before any preprocessing (stratified for imbalanced classes), always chain preprocessing and modeling in `Pipeline`/`ColumnTransformer` so transformers fit only on training data, scale per algorithm (StandardScaler/MinMaxScaler/RobustScaler), encode categoricals, impute missing values, cross-validate with the right strategy (`KFold`, `StratifiedKFold`, `TimeSeriesSplit`, `GroupKFold`), tune with `GridSearchCV`/`RandomizedSearchCV` on train/val only with `n_jobs=-1`, evaluate with metrics matched to the problem (F1/ROC-AUC for imbalance, MAE/R² for regression), report confidence intervals against meaningful baselines, evaluate on the held-out test set once at the end, persist whole pipelines with joblib, and version model artifacts. Honest caveats: methodology only — the agent needs an ML dataset and a Python environment; some rules (e.g. `class_weight='balanced'`) are scikit-learn-specific. Apache-2.0 licensed. Skill Harbor never reviews the code, review it yourself before use. Discovered via skills.sh.
Version:
Quick answer
scikit-learn best practices is a free listing for sound ML workflows. Split data before any preprocessing, stratified for imbalanced classes, chaining preprocessing and modeling in Pipeline or ColumnTransformer so transformers fit on training data only. It covers scaling per algorithm, encoding categoricals, imputing missing values, cross-validating with the right strategy, tuning with GridSearchCV or RandomizedSearchCV, and joblib persistence.
Install
Copy the install package below, then paste it into Muse🧪 Install ran in our test sandbox · Nov 11, 2026📌 Pinned version: commit 7682ca7Step 0 — before installing anything: read this install prompt, summarize in a few lines what this build does and what installing it involves, then ask me to confirm before you proceed. Prerequisites: a Python ML project with a dataset to work on — the skill is guidance the agent follows, not software to install Install "scikit-learn best practices: leak-proof pipelines, CV, tuning, and evaluation" for me. It gives my agent @mindrally's scikit-learn playbook: split-before-preprocess discipline, Pipeline/ColumnTransformer against data leakage, per-algorithm scaling and encoding, the right cross-validation strategy per problem type, GridSearchCV/RandomizedSearchCV tuning, problem-matched metrics (F1/ROC-AUC for imbalance, MAE/R2 for regression), single final held-out evaluation, and joblib persistence with versioned artifacts. Apache-2.0 licensed. Repository: https://raw.githubusercontent.com/mindrally/skills/7682ca77710e0971eab4e0ae5dddfa281aea0ba5/scikit-learn-best-practices/SKILL.md Pinned version: install the code at commit 7682ca77710e0971eab4e0ae5dddfa281aea0ba5 exactly (Skill Harbor tested this version). Do not substitute a newer version. If this commit is unreachable, stop and tell me. 1. Fetch the SKILL.md file (and any helper files) from the repository path into a temporary folder 2. Safety check: review the SKILL.md and scripts for anything suspicious (unexpected network calls, shell commands, credential harvesting). This repo should contain zero secrets in code, credentials only via the secure vault, allowed hosts declared in the SKILL.md. Verify that holds here; STOP on any red flag and tell me. 3. Install it as a skill: copy SKILL.md and its helper files into the agent's skills directory, in a folder named "scikit-learn-best-practices". 4. Verify with no network calls: frontmatter valid, files in place. 5. Report what was installed, where, and what I still need to do myself (e.g. point the agent at my dataset and the model to train or review; nothing else — it's a methodology). GitHub is optional: if I have a GitHub account or the gh CLI, you may use it; otherwise public access is fine. Never require it unless it's in the prerequisites above. Rules: don't touch anything outside the temp folder and the install target. If anything looks off, stop and ask me.
Saved to your recent installs. Find it anytime on /connect.
🔒 Security, provenance and what this touches
The install prompt below already includes the vetting steps: your agent follows the community checklist before installing anything with executable code. Want more?
Verification certificate
Dated facts about what was checked for this listing, and how. This is not a safety certification.
- Pinned version
- 7682ca7 · 2026-10-13
- Sandbox install test
- Install ran in our test sandbox · Nov 11, 2026
- Creator identity
- Not verified
- Fingerprint watch
- Last checked · Nov 19, 2026 : no change detected in the files linked by this install prompt
- Install prompt analysis
- 2026-10-13 : No commands, network calls, packages, file writes or API keys detected.
Skill Harbor never reviews the code of a listed skill. These are dated facts about the install prompt and our install test, not a safety certification. Review a skill yourself before you install it. How we verify
Questions
How do I install a skill?
Every product page includes a copy-paste install prompt. Paste it into your Muse and it sets the skill up for you — no manual configuration.
Where does my money go?
Straight to the seller. Skill Harbor never processes payments: checkout happens on the seller’s own page, usually Stripe.
What does the ✓ next to a creator’s name mean?
It means we confirmed the identity of the person behind the listing. It says nothing about the code itself — always check a skill before installing it.