← Back to the directory

Morizeyao/GPT2-Chinese

View on GitHub

Chinese version of GPT2 training code, using BERT tokenizer.

Morizeyao/GPT2-Chinese is #7,800 on the bestofgithub Elo ladder, in Bronze III, with a rating of 1,403 (−14 this week). It has 7,599 stars, 2 gained in the last week.

Bronze III

1,403 Elo

  • #7,800 on the ladder
  • −4 today · −14 this week
  • Peak 1,450
1 Elo to Bronze II

Stars

7,599

  • +0 today
  • +2 this week
  • – this month

Repository

Forks
1.6k
Language
Python
Last push
Category
AI & Agents

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/Morizeyao/GPT2-Chinese.svg?style=card)](https://bestofgithub.dev/repo/Morizeyao/GPT2-Chinese)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/Morizeyao/GPT2-Chinese.svg)](https://bestofgithub.dev/repo/Morizeyao/GPT2-Chinese)

Install

git
git clone https://github.com/Morizeyao/GPT2-Chinese.git

Similar repositories

codertimo/BERT-pytorch

Open on GitHubPython

Google AI 2018 BERT pytorch implementation

  • 1,337−1 Elo, change today
  • 6.5k stars
  • 1.3k forks
git
git clone https://github.com/codertimo/BERT-pytorch.git
  • bert
  • language-model
  • nlp
  • pytorch

OpenMOSS/MOSS

Open on GitHubPython

An open-source, tool-augmented conversational language model from Fudan University

  • 1,551−8 Elo, change today
  • 12.3k stars
  • 1.1k forks
git
git clone https://github.com/OpenMOSS/MOSS.git
  • chatgpt
  • deep-learning
  • dialogue-systems
  • large-language-models

EleutherAI/gpt-neo

Open on GitHubPython

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

  • 1,372+2 Elo, change today
  • 8.2k stars
  • 955 forks
  • archived
git
git clone https://github.com/EleutherAI/gpt-neo.git
  • gpt
  • gpt-2
  • gpt-3
  • language-model

NLPchina/ansj_seg

Open on GitHubJava

ansj分词.ict的真正java实现.分词效果速度都超过开源版的ict. 中文分词,人名识别,词性标注,用户自定义词典

  • 1,365−2 Elo, change today
  • 6.4k stars
  • 2.2k forks
git
git clone https://github.com/NLPchina/ansj_seg.git
  • ansj
  • chinese
  • java
  • nlp

BlinkDL/RWKV-LM

Open on GitHubPython

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

  • 1,475−6 Elo, change today
  • 14.7k stars
  • 1k forks
git
git clone https://github.com/BlinkDL/RWKV-LM.git
  • attention-mechanism
  • chatgpt
  • deep-learning
  • gpt

README

Loading README…