bestofgithub.dev

← Back to the directory

karpathy/minbpe

View on GitHub

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

karpathy/minbpe is #3,562 on the bestofgithub Elo ladder, in Gold II, with a rating of 1,601 (+25 this week). It has 11,052 stars, 32 gained in the last week.

Gold II

1,601 Elo

  • #3,562 on the ladder
  • +5 today · +25 this week
  • Peak 1,601
3 Elo to Gold I

Stars

11,052

  • +7 today
  • +32 this week
  • – this month

Repository

Forks
1.1k
Language
Python
Last push

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/karpathy/minbpe.svg?style=card)](https://bestofgithub.dev/repo/karpathy/minbpe)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/karpathy/minbpe.svg)](https://bestofgithub.dev/repo/karpathy/minbpe)

Install

git
git clone https://github.com/karpathy/minbpe.git

README

Loading README…