web-scraping
Advanced Python web scraping patterns with multi-strategy fallbacks, anti-bot handling, and ethical guidelines.
Install
npx skills add https://github.com/jamditis/claude-skills-journalism --skill web-scrapingStats
| Total installs | 2,590 |
| Weekly installs | 2.6K |
| GitHub stars | 96 |
| First seen | Jan 21, 2026 |
| Source | @jamditis/claude-skills-journalism |
Summary
- Implements a scraping cascade architecture with four strategies: trafilatura for fast article extraction, requests with rotating user agents, Playwright with stealth mode for JavaScript-heavy sites, and async Playwright for Jupyter notebooks
- Includes poison pill detection to identify paywalls, CAPTCHAs, rate limits, Cloudflare blocks, and login walls using pattern matching and status code analysis
- Covers reverse-engineering undocumented APIs through browser dev tools, with examples for autocomplete endpoints and parameter stripping
- Provides ready-to-use patterns for YouTube (yt-dlp), Instagram (instaloader), and TikTok scraping, including metadata extraction, video downloads, and transcript retrieval
- Emphasizes ethical scraping: robots.txt compliance, rate limiting, request delays per domain, and respectful User-Agent headers
Tags
Related skills
| Skill | Installs | vs web-scraping |
|---|---|---|
| gen-paylink-govilo | 2,982 | +392 |
| flowstudio-power-automate-mcp | 2,916 | +326 |
| langgraph-fundamentals | 2,838 | +248 |
| tts | 2,629 | +39 |
| capability-evolver | 2,794 | +204 |
FAQ
- How many installs does web-scraping have?
- web-scraping has 2,590 total installs and 2.6K installs this week.
- Where is web-scraping hosted?
- web-scraping is published by @jamditis/claude-skills-journalism at https://github.com/jamditis/claude-skills-journalism.
- How many GitHub stars does web-scraping have?
- web-scraping has 96 GitHub stars.
- When was web-scraping first indexed?
- OrangeBot.AI first indexed web-scraping on Jan 21, 2026.
- How do I install web-scraping?
- Run: npx skills add https://github.com/jamditis/claude-skills-journalism --skill web-scraping