topskills
Browse Skills

web-scraping-patterns

Ethical scraping at scale. robots.txt respect, rate-limiting, structured extraction.

Score 0(?)CommunityCodeby scraping-skills
Verified for:

Install

$ npx skills add scraping-skills/patterns

Best for

Research workflows where you need to extract structured data without breaking sites.

About this skill

Ethical web scraping: robots.txt respect, rate-limiting, retry-with-backoff, structured extraction with schema.

ScrapingEthicsSchema

Score breakdown

Score breakdown

rubric 1.0
Install count
0/20
Provenance
8.3/15
GitHub stars
0/15
Recency
6/10
Compatibility
6/10
Documentation depth
6.5/10
Install ergonomics
10/10
License
5/5
Verification freshness
3/5

Composite 0–100 score derived from 9 verifiable signals. See the rubric →

Related skills

Verified

Web scraping, search, and browser automation built to be agent-friendly.

ScrapingSearchWeb
All surfaces
Community

Deterministic web control. ref-based clicks/fills, no flaky selectors, parallel sessions.

BrowserAutomationAction-taking
Code
Community

Headless browser as an agent tool. Navigate JS-heavy pages, fill forms, extract content.

HeadlessBrowserJS
Code

Skill FAQ

About web-scraping-patterns

What is the web-scraping-patterns skill?

Ethical web scraping: robots.txt respect, rate-limiting, retry-with-backoff, structured extraction with schema.

Which agents does web-scraping-patterns work with?

Claude Code, Cursor, Codex CLI.

How do I install web-scraping-patterns?

Run `npx skills add scraping-skills/patterns` for Claude Code. See the install panel for per-agent commands.

Is web-scraping-patterns free to use?

Yes — web-scraping-patterns is open source (MIT).

Who maintains web-scraping-patterns?

web-scraping-patterns is published by scraping-skills and was last updated on 2026-04-19.

What is web-scraping-patterns best for?

Research workflows where you need to extract structured data without breaking sites.