Skip to content
#

adaptive-crawler

Star

Here is 1 public repository matching this topic...

CercaTrovato / smart-crawler

Star 1

自适应院校/硕士项目公开数据采集系统 · Adaptive crawler for public university & master's-programme data: TLS-impersonation HTTP → real browser → Firecrawl, with per-domain throttling, resume, and human-review-gated JSON output

python web-crawler rate-limiting web-scraping data-collection resumable anti-bot higher-education study-abroad tls-fingerprint playwright firecrawl curl-cffi scrapling adaptive-crawler
  • Updated Jul 7, 2026
  • Python

Improve this page

Add a description, image, and links to the adaptive-crawler topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the adaptive-crawler topic, visit your repo's landing page and select "manage topics."

Learn more