← Back to the directory

NVIDIA/Megatron-LM

View on GitHub

Ongoing research training transformer models at scale

NVIDIA/Megatron-LM is #1,435 on the bestofgithub Elo ladder, in Emerald IV, with a rating of 1,793 (−3 this week). It has 18,406 stars, 57 gained in the last week.

Emerald IV

1,793 Elo

  • #1,435 on the ladder
  • −2 today · −3 this week
  • Peak 1,805
16 Elo to Emerald III

Stars

18,406

  • +12 today
  • +57 this week
  • – this month

Repository

Forks
4.7k
Watchers
162
Language
Python
Last push
Category
AI & Agents

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/NVIDIA/Megatron-LM.svg?style=card)](https://bestofgithub.dev/repo/NVIDIA/Megatron-LM)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/NVIDIA/Megatron-LM.svg)](https://bestofgithub.dev/repo/NVIDIA/Megatron-LM)

Install

git
git clone https://github.com/NVIDIA/Megatron-LM.git

Similar repositories

FareedKhan-dev/train-llm-from-scratch

Open on GitHubPython

A straightforward method for training your LLM, from downloading data to generating text.

  • 1,744+3 Elo, change today
  • 13.2k stars
  • 1.8k forks
  • 93 watchers
git
git clone https://github.com/FareedKhan-dev/train-llm-from-scratch.git
  • gemini
  • large-language-models
  • llm
  • openai

01-ai/Yi

Open on GitHubJupyter Notebook

A series of large language models trained from scratch by developers @01-ai

  • 1,331+11 Elo, change today
  • 7.8k stars
  • 500 forks
git
git clone https://github.com/01-ai/Yi.git
  • large-language-models

intel/ipex-llm

Open on GitHubPython

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

  • 1,398−4 Elo, change today
  • 8.8k stars
  • 1.4k forks
  • archived
git
git clone https://github.com/intel/ipex-llm.git
  • gpu
  • llm
  • pytorch
  • transformers

GreyDGL/PentestGPT

Open on GitHubPython

Automated Penetration Testing Agentic Framework Powered by Large Language Models

  • 1,834−4 Elo, change today
  • 16.4k stars
  • 2.8k forks
  • 378 watchers
pipx install pentestgpt
  • large-language-models
  • llm
  • penetration-testing
  • python

QwenLM/Qwen-VL

Open on GitHubPython

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

  • 1,294+3 Elo, change today
  • 6.7k stars
  • 493 forks
git
git clone https://github.com/QwenLM/Qwen-VL.git
  • large-language-models
  • vision-language-model

OpenRLHF/OpenRLHF

Open on GitHubPython

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

  • 1,512+9 Elo, change today
  • 10.1k stars
  • 1k forks
git
git clone https://github.com/OpenRLHF/OpenRLHF.git
  • large-language-models
  • proximal-policy-optimization
  • raylib
  • reinforcement-learning

README

Loading README…