bestofgithub.dev

← Back to the directory

gocolly/colly

View on GitHub

Elegant Scraper and Crawler Framework for Golang

gocolly/colly is #2,716 on the bestofgithub Elo ladder, in Platinum IV, with a rating of 1,658 (+7 this week). It has 25,599 stars, 18 gained in the last week.

Platinum IV

1,658 Elo

  • #2,716 on the ladder
  • +9 today · +7 this week
  • Peak 1,735
11 Elo to Platinum III

Stars

25,599

  • +2 today
  • +18 this week
  • – this month

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/gocolly/colly.svg?style=card)](https://bestofgithub.dev/repo/gocolly/colly)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/gocolly/colly.svg)](https://bestofgithub.dev/repo/gocolly/colly)

Install

git
git clone https://github.com/gocolly/colly.git

Similar repositories

code4craft/webmagic

Open on GitHubJava

A scalable web crawler framework for Java.

  • 1,483−6 Elo, change today
  • 11.6k stars
  • 4k forks
git
git clone https://github.com/code4craft/webmagic.git
  • crawler
  • framework
  • java
  • scraping

scrapy/scrapy

Open on GitHubPython

Scrapy, a fast high-level web crawling & scraping framework for Python.

  • 2,020+7 Elo, change today
  • 65.4k stars
  • 12.1k forks
  • 1.7k watchers
brew install scrapy
2.20.09d ago
  • crawler
  • crawling
  • framework
  • hacktoberfest

codelucas/newspaper

Open on GitHubPython

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

  • 1,513−4 Elo, change today
  • 15.1k stars
  • 2.1k forks
git
git clone https://github.com/codelucas/newspaper.git
  • crawler
  • crawling
  • news
  • news-aggregator

apify/crawlee

Open on GitHubTypeScript

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

  • 1,821−2 Elo, change today
  • 26.4k stars
  • 1.7k forks
  • 135 watchers
git
git clone https://github.com/apify/crawlee.git
v3.18.21mo ago
  • apify
  • automation
  • crawler
  • crawling

BruceDone/awesome-crawler

Open on GitHub

A collection of awesome web crawler,spider in different languages

  • 1,384−2 Elo, change today
  • 7.3k stars
  • 751 forks
git
git clone https://github.com/BruceDone/awesome-crawler.git
  • awesome
  • crawler
  • node-crawler
  • scraper

README

Loading README…