bestofgithub.dev

← Back to the directory

andeya/pholcus

View on GitHub

Pholcus is a distributed high-concurrency crawler software written in pure golang

andeya/pholcus is #8,055 on the bestofgithub Elo ladder, in Bronze III, with a rating of 1,394 (−15 this week). It has 7,584 stars.

Bronze III

1,394 Elo

  • #8,055 on the ladder
  • −3 today · −15 this week
  • Peak 1,448
10 Elo to Bronze II

Stars

7,584

  • +0 today
  • +0 this week
  • – this month

Repository

Forks
1.6k
Language
Go
Last push

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/andeya/pholcus.svg?style=card)](https://bestofgithub.dev/repo/andeya/pholcus)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/andeya/pholcus.svg)](https://bestofgithub.dev/repo/andeya/pholcus)

Install

git
git clone https://github.com/andeya/pholcus.git

Similar repositories

luyishisi/Anti-Anti-Spider

Open on GitHubPython

越来越多的网站具有反爬虫特性，有的用图片隐藏关键数据，有的使用反人类的验证码，建立反反爬虫的代码仓库，通过与不同特性的网站做斗争（无恶意）提高技术。（欢迎提交难以采集的网站）（因工作原因，项目暂停）

  • 1,386−1 Elo, change today
  • 7.2k stars
  • 2.1k forks
git
git clone https://github.com/luyishisi/Anti-Anti-Spider.git
  • geek
  • python
  • spider

s0md3v/Photon

Open on GitHubPython

Incredibly fast crawler designed for OSINT.

  • 1,573−2 Elo, change today
  • 13.3k stars
  • 1.6k forks
git
git clone https://github.com/s0md3v/Photon.git
  • crawler
  • information-gathering
  • osint
  • python

gocolly/colly

Open on GitHubGo

Elegant Scraper and Crawler Framework for Golang

  • 1,658+9 Elo, change today
  • 25.5k stars
  • 1.8k forks
git
git clone https://github.com/gocolly/colly.git
  • crawler
  • crawling
  • framework
  • go

bda-research/node-crawler

Open on GitHubTypeScript

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

  • 1,339−2 Elo, change today
  • 6.7k stars
  • 863 forks
git
git clone https://github.com/bda-research/node-crawler.git
  • cheerio
  • crawler
  • extract-data
  • javascript

BruceDone/awesome-crawler

Open on GitHub

A collection of awesome web crawler,spider in different languages

  • 1,384−2 Elo, change today
  • 7.3k stars
  • 751 forks
git
git clone https://github.com/BruceDone/awesome-crawler.git
  • awesome
  • crawler
  • node-crawler
  • scraper

README

Loading README…