bestofgithub.dev

← Back to the directory

codelucas/newspaper

View on GitHub

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

codelucas/newspaper is #5,129 on the bestofgithub Elo ladder, in Silver I, with a rating of 1,513 (−34 this week). It has 15,187 stars, 4 gained in the last week.

Silver I

1,513 Elo

  • #5,129 on the ladder
  • −4 today · −34 this week
  • Peak 1,623
7 Elo to Gold V

Stars

15,187

  • +0 today
  • +4 this week
  • – this month

Repository

Forks
2.1k
Language
Python
Last push

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/codelucas/newspaper.svg?style=card)](https://bestofgithub.dev/repo/codelucas/newspaper)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/codelucas/newspaper.svg)](https://bestofgithub.dev/repo/codelucas/newspaper)

Install

git
git clone https://github.com/codelucas/newspaper.git

Similar repositories

gocolly/colly

Open on GitHubGo

Elegant Scraper and Crawler Framework for Golang

  • 1,658+9 Elo, change today
  • 25.5k stars
  • 1.8k forks
git
git clone https://github.com/gocolly/colly.git
  • crawler
  • crawling
  • framework
  • go

binux/pyspider

Open on GitHubPython

A Powerful Spider(Web Crawler) System in Python.

  • 1,538−8 Elo, change today
  • 16.7k stars
  • 3.6k forks
  • archived
git
git clone https://github.com/binux/pyspider.git
  • crawler
  • python

scrapy/scrapy

Open on GitHubPython

Scrapy, a fast high-level web crawling & scraping framework for Python.

  • 2,020+7 Elo, change today
  • 65.4k stars
  • 12.1k forks
  • 1.7k watchers
brew install scrapy
2.20.09d ago
  • crawler
  • crawling
  • framework
  • hacktoberfest

apify/crawlee-python

Open on GitHubPython

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract structured data with LLMs via Pydantic AI, or control the browser in natural language with Stagehand. Works with BeautifulSoup, Parsel, Playwright, and raw HTTP. Download HTML, PDF, images, and other files. Proxy rotation included.

  • 1,532+6 Elo, change today
  • 9.6k stars
  • 833 forks
git
git clone https://github.com/apify/crawlee-python.git
  • apify
  • automation
  • beautifulsoup
  • crawler

apify/crawlee

Open on GitHubTypeScript

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

  • 1,821−2 Elo, change today
  • 26.4k stars
  • 1.7k forks
  • 135 watchers
git
git clone https://github.com/apify/crawlee.git
v3.18.21mo ago
  • apify
  • automation
  • crawler
  • crawling

newsnext/newsnow

Open on GitHubTypeScript

Elegant reading of real-time and hottest news

  • 1,863−14 Elo, change today
  • 22.4k stars
  • 6.1k forks
  • 69 watchers
docker
git clone https://github.com/newsnext/newsnow && cd newsnow && docker compose up -d
v0.0.431mo ago
  • elegant
  • news

README

Loading README…