← Back to the directory

binux/pyspider

View on GitHub

A Powerful Spider(Web Crawler) System in Python.

binux/pyspider is #4,632 on the bestofgithub Elo ladder, in Gold IV, with a rating of 1,538 (−41 this week). It has 16,743 stars.

Gold IV

1,538 Elo

  • #4,632 on the ladder
  • −8 today · −41 this week
  • Peak 1,684
21 Elo to Gold III

Stars

16,743

  • +0 today
  • +0 this week
  • – this month

Repository

Forks
3.6k
Language
Python
Last push
Status
Archived

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/binux/pyspider.svg?style=card)](https://bestofgithub.dev/repo/binux/pyspider)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/binux/pyspider.svg)](https://bestofgithub.dev/repo/binux/pyspider)

Install

git
git clone https://github.com/binux/pyspider.git

Similar repositories

injetlee/Python

Open on GitHubPython

Python脚本。模拟登录知乎, 爬虫,操作excel,微信公众号,远程开机

  • 1,550−8 Elo, change today
  • 10.9k stars
  • 4.2k forks
git
git clone https://github.com/injetlee/Python.git
  • crawler
  • excel
  • python
  • wechat

code4craft/webmagic

Open on GitHubJava

A scalable web crawler framework for Java.

  • 1,483−6 Elo, change today
  • 11.6k stars
  • 4k forks
git
git clone https://github.com/code4craft/webmagic.git
  • crawler
  • framework
  • java
  • scraping

s0md3v/Photon

Open on GitHubPython

Incredibly fast crawler designed for OSINT.

  • 1,573−2 Elo, change today
  • 13.3k stars
  • 1.6k forks
git
git clone https://github.com/s0md3v/Photon.git
  • crawler
  • information-gathering
  • osint
  • python

codelucas/newspaper

Open on GitHubPython

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

  • 1,513−4 Elo, change today
  • 15.1k stars
  • 2.1k forks
git
git clone https://github.com/codelucas/newspaper.git
  • crawler
  • crawling
  • news
  • news-aggregator

scrapy/scrapy

Open on GitHubPython

Scrapy, a fast high-level web crawling & scraping framework for Python.

  • 2,020+7 Elo, change today
  • 65.4k stars
  • 12.1k forks
  • 1.7k watchers
brew install scrapy
  • crawler
  • crawling
  • framework
  • hacktoberfest

README

Loading README…