bestofgithub.dev

← Back to the directory

crawlab-team/crawlab

View on GitHub

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

crawlab-team/crawlab is #5,113 on the bestofgithub Elo ladder, in Silver I, with a rating of 1,514 (−18 this week). It has 12,300 stars, 6 gained in the last week.

Silver I

1,514 Elo

  • #5,113 on the ladder
  • +4 today · −18 this week
  • Peak 1,568
6 Elo to Gold V

Stars

12,300

  • +1 today
  • +6 this week
  • – this month

Repository

Forks
1.8k
Language
Go
Last push
Category
DevOps

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/crawlab-team/crawlab.svg?style=card)](https://bestofgithub.dev/repo/crawlab-team/crawlab)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/crawlab-team/crawlab.svg)](https://bestofgithub.dev/repo/crawlab-team/crawlab)

Install

git
git clone https://github.com/crawlab-team/crawlab.git

Similar repositories

ssssssss-team/spider-flow

Open on GitHubJava

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

  • 1,459−5 Elo, change today
  • 11.3k stars
  • 2.1k forks
git
git clone https://github.com/ssssssss-team/spider-flow.git
  • crawler
  • jsoup
  • spider
  • spider-flow

BruceDone/awesome-crawler

Open on GitHub

A collection of awesome web crawler,spider in different languages

  • 1,384−1 Elo, change today
  • 7.3k stars
  • 751 forks
git
git clone https://github.com/BruceDone/awesome-crawler.git
  • awesome
  • crawler
  • node-crawler
  • scraper

chyroc/WechatSogou

Open on GitHubPython

基于搜狗微信搜索的微信公众号爬虫接口

  • 1,382−1 Elo, change today
  • 6.4k stars
  • 1.6k forks
git
git clone https://github.com/chyroc/WechatSogou.git
  • crawler
  • pypi
  • python
  • scrapy

s0md3v/Photon

Open on GitHubPython

Incredibly fast crawler designed for OSINT.

  • 1,572−3 Elo, change today
  • 13.3k stars
  • 1.6k forks
git
git clone https://github.com/s0md3v/Photon.git
  • crawler
  • information-gathering
  • osint
  • python

microsoft/JARVIS

Open on GitHubPython

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

  • 1,816+1 Elo, change today
  • 25.6k stars
  • 2.2k forks
  • 346 watchers
git
git clone https://github.com/microsoft/JARVIS.git
  • deep-learning
  • platform
  • pytorch

README

Loading README…