← Back to the directory

intel/ipex-llm

View on GitHub

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

intel/ipex-llm is #7,924 on the bestofgithub Elo ladder, in Bronze III, with a rating of 1,398 (−16 this week). It has 8,841 stars.

Bronze III

1,398 Elo

  • #7,924 on the ladder
  • −4 today · −16 this week
  • Peak 1,473
6 Elo to Bronze II

Stars

8,841

  • +0 today
  • +0 this week
  • – this month

Repository

Forks
1.4k
Language
Python
Last push
Category
AI & Agents
Status
Archived

Achievements

bestofgithub badgeMaintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/intel/ipex-llm.svg?style=card)](https://bestofgithub.dev/repo/intel/ipex-llm)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/intel/ipex-llm.svg)](https://bestofgithub.dev/repo/intel/ipex-llm)

Install

git
git clone https://github.com/intel/ipex-llm.git

Similar repositories

FareedKhan-dev/train-llm-from-scratch

Open on GitHubPython

A straightforward method for training your LLM, from downloading data to generating text.

  • 1,744+3 Elo, change today
  • 13.2k stars
  • 1.8k forks
  • 93 watchers
git
git clone https://github.com/FareedKhan-dev/train-llm-from-scratch.git
  • gemini
  • large-language-models
  • llm
  • openai

huggingface/peft

Open on GitHubPython

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

  • 1,676+3 Elo, change today
  • 21.8k stars
  • 2.6k forks
git
git clone https://github.com/huggingface/peft.git
  • adapter
  • diffusion
  • fine-tuning
  • llm

facebookresearch/fairseq

Open on GitHubPython

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

  • 1,632−8 Elo, change today
  • 32.2k stars
  • 6.6k forks
  • archived
git
git clone https://github.com/facebookresearch/fairseq.git
  • artificial-intelligence
  • python
  • pytorch

arc53/DocsGPT

Open on GitHubPython

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

  • 1,615−13 Elo, change today
  • 18.3k stars
  • 2.2k forks
git
git clone https://github.com/arc53/DocsGPT.git
  • agent-builder
  • agents
  • ai
  • chatgpt

README

Loading README…