← Back to the directory

luyishisi/Anti-Anti-Spider

View on GitHub

越来越多的网站具有反爬虫特性,有的用图片隐藏关键数据,有的使用反人类的验证码,建立反反爬虫的代码仓库,通过与不同特性的网站做斗争(无恶意)提高技术。(欢迎提交难以采集的网站)(因工作原因,项目暂停)

luyishisi/Anti-Anti-Spider is #8,230 on the bestofgithub Elo ladder, in Bronze IV, with a rating of 1,386 (−13 this week). It has 7,291 stars.

Bronze IV

1,386 Elo

  • #8,230 on the ladder
  • −1 today · −13 this week
  • Peak 1,458
4 Elo to Bronze III

Stars

7,291

  • +0 today
  • +0 this week
  • – this month

Repository

Forks
2.1k
Language
Python
Last push

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/luyishisi/Anti-Anti-Spider.svg?style=card)](https://bestofgithub.dev/repo/luyishisi/Anti-Anti-Spider)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/luyishisi/Anti-Anti-Spider.svg)](https://bestofgithub.dev/repo/luyishisi/Anti-Anti-Spider)

Install

git
git clone https://github.com/luyishisi/Anti-Anti-Spider.git

Similar repositories

s0md3v/Photon

Open on GitHubPython

Incredibly fast crawler designed for OSINT.

  • 1,573−2 Elo, change today
  • 13.3k stars
  • 1.6k forks
git
git clone https://github.com/s0md3v/Photon.git
  • crawler
  • information-gathering
  • osint
  • python

andeya/pholcus

Open on GitHubGo

Pholcus is a distributed high-concurrency crawler software written in pure golang

  • 1,394−3 Elo, change today
  • 7.5k stars
  • 1.6k forks
git
git clone https://github.com/andeya/pholcus.git
  • crowler
  • spider

gocolly/colly

Open on GitHubGo

Elegant Scraper and Crawler Framework for Golang

  • 1,658+9 Elo, change today
  • 25.5k stars
  • 1.8k forks
git
git clone https://github.com/gocolly/colly.git
  • crawler
  • crawling
  • framework
  • go

bda-research/node-crawler

Open on GitHubTypeScript

Web Crawler/Spider for NodeJS + server-side jQuery ;-)

  • 1,339−2 Elo, change today
  • 6.7k stars
  • 863 forks
git
git clone https://github.com/bda-research/node-crawler.git
  • cheerio
  • crawler
  • extract-data
  • javascript

BruceDone/awesome-crawler

Open on GitHub

A collection of awesome web crawler,spider in different languages

  • 1,384−2 Elo, change today
  • 7.3k stars
  • 751 forks
git
git clone https://github.com/BruceDone/awesome-crawler.git
  • awesome
  • crawler
  • node-crawler
  • scraper

README

Loading README…