bestofgithub.dev

← Back to the directory

microsoft/LLMLingua

View on GitHub

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

microsoft/LLMLingua is #7,159 on the bestofgithub Elo ladder, in Bronze I, with a rating of 1,427 (+29 this week). It has 6,823 stars, 13 gained in the last week.

Bronze I

1,427 Elo

  • #7,159 on the ladder
  • ±0 today · +29 this week
  • Peak 1,429
5 Elo to Silver V

Stars

6,823

  • +0 today
  • +13 this week
  • – this month

Repository

Forks
454
Language
Python
Last push

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/microsoft/LLMLingua.svg?style=card)](https://bestofgithub.dev/repo/microsoft/LLMLingua)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/microsoft/LLMLingua.svg)](https://bestofgithub.dev/repo/microsoft/LLMLingua)

Install

git
git clone https://github.com/microsoft/LLMLingua.git

README

Loading README…