topskills
Browse Skills

web-scraping-patterns

Ethical scraping at scale. robots.txt respect, rate-limiting, structured extraction.

Score 0(?)CommunityCodeby scraping-skills
Verified for:

Install

$ npx skills add scraping-skills/patterns

Best for

Research workflows where you need to extract structured data without breaking sites.

About this skill

Ethical web scraping: robots.txt respect, rate-limiting, retry-with-backoff, structured extraction with schema.

ScrapingEthicsSchema

Score breakdown

Score breakdown

rubric 1.0
Install count
0/20
Provenance
8.3/15
GitHub stars
0/15
Recency
8.5/10
Compatibility
6/10
Documentation depth
6.5/10
Install ergonomics
10/10
License
5/5
Verification freshness
4.3/5

Composite 0–100 score derived from 9 verifiable signals. See the rubric →

Related skills

Verified

Web scraping, search, and browser automation built to be agent-friendly.

ScrapingSearchWeb
All surfaces
Community

Deterministic web control. ref-based clicks/fills, no flaky selectors, parallel sessions.

BrowserAutomationAction-taking
Code
Community

Headless browser as an agent tool. Navigate JS-heavy pages, fill forms, extract content.

HeadlessBrowserJS
Code