bestofgithub.dev

← Back to the directory

alirezamika/autoscraper

View on GitHub

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

alirezamika/autoscraper is #6,165 on the bestofgithub Elo ladder, in Silver III, with a rating of 1,466 (+50 this week). It has 8,093 stars, 17 gained in the last week.

Silver III

1,466 Elo

  • #6,165 on the ladder
  • +12 today · +50 this week
  • Peak 1,466
16 Elo to Silver II

Stars

8,093

  • +4 today
  • +17 this week
  • – this month

Repository

Forks
834
Language
Python
Last push
Category
AI & Agents

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/alirezamika/autoscraper.svg?style=card)](https://bestofgithub.dev/repo/alirezamika/autoscraper)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/alirezamika/autoscraper.svg)](https://bestofgithub.dev/repo/alirezamika/autoscraper)

Install

git
git clone https://github.com/alirezamika/autoscraper.git

Similar repositories

scrapy/scrapy

Open on GitHubPython

Scrapy, a fast high-level web crawling & scraping framework for Python.

  • 2,020+7 Elo, change today
  • 65.4k stars
  • 12.1k forks
  • 1.7k watchers
brew install scrapy
2.20.09d ago
  • crawler
  • crawling
  • framework
  • hacktoberfest

code4craft/webmagic

Open on GitHubJava

A scalable web crawler framework for Java.

  • 1,483−6 Elo, change today
  • 11.6k stars
  • 4k forks
git
git clone https://github.com/code4craft/webmagic.git
  • crawler
  • framework
  • java
  • scraping

gocolly/colly

Open on GitHubGo

Elegant Scraper and Crawler Framework for Golang

  • 1,658+9 Elo, change today
  • 25.5k stars
  • 1.8k forks
git
git clone https://github.com/gocolly/colly.git
  • crawler
  • crawling
  • framework
  • go

D4Vinci/Scrapling

Open on GitHubPython

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

  • 2,448+2 Elo, change today
  • +392 stars gained
  • 103k stars
  • 10.7k forks
  • 350 watchers
pip
pipx install scrapling
v0.5.111d ago
  • ai
  • ai-scraping
  • automation
  • crawler

firecrawl/firecrawl

Open on GitHubTypeScript

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

  • 2,347+1 Elo, change today
  • +242 stars gained
  • 202k stars
  • 10.5k forks
  • 500 watchers
docker
git clone https://github.com/firecrawl/firecrawl && cd firecrawl && docker compose up -d
v2.11.04mo ago
  • ai
  • ai-agents
  • ai-crawler
  • ai-scraping

apify/crawlee-python

Open on GitHubPython

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.

  • 1,532+6 Elo, change today
  • 9.6k stars
  • 833 forks
git
git clone https://github.com/apify/crawlee-python.git
  • apify
  • automation
  • beautifulsoup
  • crawler

README

Loading README…