← Back to the directory

jzhang38/TinyLlama

View on GitHub

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

jzhang38/TinyLlama is #8,910 on the bestofgithub Elo ladder, in Copper I, with a rating of 1,355 (−13 this week). It has 9,001 stars.

Copper I

1,355 Elo

  • #8,910 on the ladder
  • −1 today · −13 this week
  • Peak 1,414
2 Elo to Bronze V

Stars

9,001

  • +0 today
  • +0 this week
  • – this month

Repository

Forks
634
Language
Python
Last push
Status
Archived

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/jzhang38/TinyLlama.svg?style=card)](https://bestofgithub.dev/repo/jzhang38/TinyLlama)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/jzhang38/TinyLlama.svg)](https://bestofgithub.dev/repo/jzhang38/TinyLlama)

Install

git
git clone https://github.com/jzhang38/TinyLlama.git

README

Loading README…