Just-Scrape Skill for Muse
Search, scrape, extract, crawl, and monitor the web from one CLI
- What
- Search, scrape, extract, crawl, and monitor the web from one CLI
- Cost
- Free
- Needs
- the just-scrape CLI (`npm install -g just-scrape`) and an SGAI_API_KEY on a ScrapeGraph AI account β a paid/credit-based API service. Store the key in the agent's secure vault (or .env / ~/.scrapegraphai/config.json) β never paste secrets here.
- Install
- Copy the installer prompt below into your Muse β your agent does the rest.
π³ Paid API required: every operation consumes ScrapeGraph AI credits β needs an SGAI_API_KEY on a paid/credit-based account. Curated by Skill Harbor β a free, open-source skill (MIT) by @scrapegraphai, listed here with credit to its creator. Turns Muse into a web-data operator through the just-scrape CLI: a single escalation pattern covering search (find pages, answer questions, discover sources), scrape (markdown, HTML, screenshots, branding, links, images, summaries), extract (AI-structured JSON from a known URL with a prompt and optional schema), crawl (bulk extraction of a whole site section), monitor (scheduled page-change tracking with optional webhooks), plus request-history inspection and credit checks. It enforces an economy of fetches β never re-scrape what a search already extracted, reuse crawl results, check .just-scrape/ for existing data before fetching again β and it tells you when NOT to use it: for wiring ScrapeGraph into application code, adding an API key to a project, or choosing endpoint usage in product code, skip the CLI and use the SDK/API docs directly. Discovered via skills.sh. Skills.sh Trust Hub: Pass. Honest note: this is a credit meter, not a free scraper β verify the setup with `just-scrape validate` and `just-scrape credits` before real work, and store the API key in the agent's secure vault (or .env / ~/.scrapegraphai/config.json), never in code or the install prompt. Skill Harbor never reviews the code, review it yourself before use. Not verified.
Version:
Install
Prerequisites: the just-scrape CLI (`npm install -g just-scrape`) and an SGAI_API_KEY on a ScrapeGraph AI account β a paid/credit-based API service. Store the key in the agent's secure vault (or .env / ~/.scrapegraphai/config.json) β never paste secrets here. Install "Just-Scrape Skill for Muse" for me. Operates web data through the just-scrape CLI β search, scrape, AI-structured extraction, site crawling, page-change monitoring with webhooks, history and credit checks β with an economy-of-fetches discipline and a clear rule for when to use the SDK instead. Repository: https://github.com/scrapegraphai/just-scrape/blob/main/skills/just-scrape/SKILL.md 1. Fetch the SKILL.md file from the repository path into a temporary folder and summarize what it does in one or two sentences. 2. Safety check: review the SKILL.md and scripts for anything suspicious (unexpected network calls, shell commands, credential harvesting). This repo should contain zero secrets in code, credentials only via the secure vault, allowed hosts declared in the SKILL.md. Verify that holds here; STOP on any red flag and tell me. 3. Install it as a skill: copy SKILL.md into the agent's skills directory, in a folder named "just-scrape". 4. Verify with no network calls: frontmatter valid, files in place. 5. Report what was installed, where, and what I still need to do myself (e.g. install the just-scrape CLI, save my SGAI_API_KEY in the vault, run `just-scrape validate` and `just-scrape credits`). GitHub is optional: if I have a GitHub account or the gh CLI, you may use it; otherwise public access is fine. Never require it unless it's in the prerequisites above. Rules: don't touch anything outside the temp folder and the install target. If anything looks off, stop and ask me.
Questions
How do I install a build?
Every product page includes a copy-paste install prompt. Paste it into your Muse and it sets the build up for you β no manual configuration.
Where does my money go?
Straight to the seller. Skill Harbor never processes payments: checkout happens on the sellerβs own page, usually Stripe.
What does the β next to a creatorβs name mean?
It means we confirmed the identity of the person behind the listing. It says nothing about the code itself β always check a build before installing it.