mw00/project-maya

Maintainer? Show your league in your README

Card: your league's emblem, from Copper to Legendary

[![bestofgithub](https://bestofgithub.dev/badge/mw00/project-maya.svg?style=card)](https://bestofgithub.dev/repo/mw00/project-maya)

Flat: fits beside your other badges

[![bestofgithub](https://bestofgithub.dev/badge/mw00/project-maya.svg)](https://bestofgithub.dev/repo/mw00/project-maya)

Loading README…

Model	Maya quant · setup id	Size	Made for
GLM-5.3-Flash _{zai-org · MIT · 321 B, 18 B active · up to 1M context}	Maya-S (default) · `glm-maya-s`	96.5 GB	PCs with a smaller memory pool (RAM and VRAM together)
	Maya-S24 · `glm-maya-s24`	94.7 GB	cards of 24 GB or less: ~1.5 GB more of the card for experts, decode +14%
	Maya-M · `glm-maya-m`	116 GB	a bigger memory pool; calibrated toward tool calls and front-end code
	Maya-M-Derisked · `glm-maya-m-derisked`	116 GB	Maya-M with a weight edit by Blackfrost_AI that reduces blanket refusals; experimental
	Maya-L · `glm-maya-l`	156.3 GB	the biggest memory pools; the closest to the original
DeepSeek-V4.1-Flash-1017 _{DeepSeek · MIT · 748 B}	Maya-S (default) · `deepseek-maya-s`	340 GB	any amount of memory: what VRAM and RAM don't hold is read from the SSD
	Maya-XS · `deepseek-maya-xs`	277 GB	the whole model in a 128 GB PC's memory (the Engram tables stay on the SSD)
MiniMax-M3.1-Flash _{MiniMax · MiniMax Community License · 428 B, 23 B active · up to 1M context}	Maya-XS · `minimax-maya-xs`	93 GB	the whole model in a 128 GB PC's memory
	Maya-S · `minimax-maya-s`	122 GB	closer to the original

Machine	Model	Decode (writing the answer)	Prefill (reading your prompt)	By
2x RTX 5090 32 GB + RTX 4090 48 GB (PCIe 5.0 x8, 5.0 x8, 4.0 x4), Core i7-13700K, 188 GB RAM	Maya-S / Maya-M-Derisked (DFlash2), 32K context	148.6 / 123.4 tokens/s	2605 / 2341 tokens/s	@prismaillya17 (v1.1.26, #498)
2x H100 80 GB (PCIe 5.0), Xeon Platinum 8488C, 504 GB RAM	Maya-L / Maya-M-Derisked, 1M context	122.4 / 123.7 tokens/s	2099 / 1986 tokens/s	@Molyleaf (v1.1.11, #258, #259)
4x RTX 4090 24 GB (PCIe 4.0 x16), Xeon w7-3445, 62 GB RAM	Maya-S24	118 tokens/s	4129 tokens/s	@0xPreDa (v1.0.31, #89)
8x RTX 3090 24 GB (PCIe 4.0, six x16 and two x8), EPYC 7402P, 126 GB RAM	EXL3-4.05bpw (DFlash2), 1M context	117.4 tokens/s	1470 tokens/s	@MarkMakers (v1.1.15, #414)
4x RTX 3090 24 GB	Maya-S24 / Maya-M (DFlash2), 256K context	100.8 / 86.5 tokens/s	979 / 907 tokens/s	@Whamp (v1.1.19, #349)
2x A100 80 GB (PCIe 4.0 x16), EPYC 7742 (a VM, 25 threads), 161 GB RAM	Maya-M, 128K context	91.9 tokens/s	-	@driona-will-fluff (v1.1.19, #326)
RTX PRO 6000 Blackwell 96 GB, Ryzen 7 9800X3D, 61 GB RAM	Maya-M, 256K context	81.0 tokens/s	3102 tokens/s	@yundddd (v1.1.7, #172)
4x Tesla V100 32 GB (PCIe 3.0 x16), 2x Xeon E5-2630 v4, 126-504 GB RAM, SATA SSD	Maya-S / Maya-M / Maya-L, 32K context	69.7 / 67.2 / 43.3 tokens/s	730 / 713 / 627 tokens/s	@HansStrupat (v1.1.36, #327, #340, #653)
4x Tesla V100-SXM2 32 GB (NVLink 2.0)	Maya-S, 32K context	68.4 tokens/s	549 tokens/s	@jeremiahlangner (v1.1.18, #333)
1x H100 80 GB (PCIe 5.0 x16), Xeon Platinum 8488C, 504 GB RAM	Maya-M-Derisked, 1M context	61.4 tokens/s	2014 tokens/s	@Molyleaf (v1.1.15, #260)
2x NVIDIA CMP 170HX 64 GB (PCIe Gen2 x4 each), 2x Xeon E5-2690 v4, 91 GB RAM	Maya-M, every expert in VRAM	61.3 tokens/s	514 tokens/s	@ZackO2o (v1.0.6, #22)
2x RTX A6000 48 GB (PCIe 4.0 x8), Core i9-13900K, 128 GB RAM, SATA SSD	Maya-S / Maya-M / Maya-L, 131K-token prompts	60.7 / 50.9 / 32.1 tokens/s	1726 / 1629 / 1298 tokens/s (131K)	@everson (v1.1.20, #371)
2x RX 7900 XTX 24 GB (PCIe 4.0 x4 each) + Radeon 8060S helper (Ryzen AI Max+ 395, 128 GB)	Maya-M, up to 512K context	56.0 tokens/s (50.1 after a 456K-token prompt)	907 tokens/s (114K)	@pepuscz (v1.1.25 + #454-#457, #458)
2x RTX 5880 Ada 45 GB (PCIe 4.0 x16), Xeon Gold 5420+, 393 GB RAM	Maya-L, 256K context	54.5 tokens/s	1401 tokens/s	@vjsyong (v1.1.4, #149)
2x NVIDIA CMP 170HX 40 GB (PCIe Gen2 x16 each), Xeon w3-2423, 128 GB DDR5	Maya-S, 128K context	54.3 tokens/s	831 tokens/s	@nvsofts (v1.1.15, #263)
2x RTX 3090 24 GB (PCIe 4.0 x16, NVLink, power-capped at 252 W), Threadripper PRO 3975WX, 512 GB RAM	Maya-M / Maya-L, 128K context	54.1 / 40.3 tokens/s	936 / 850 tokens/s	@ksim63-gif (v1.1.23, #404)
2x RTX 3090 24 GB (PCIe 4.0 x16, power-capped at 225 W), Threadripper 3970X, 128 GB RAM	Maya-S24	53.0 tokens/s	885 tokens/s	@briepala (v1.1.2, #135)
3x Tesla V100 32 GB (PCIe 3.0 x16), 2x Xeon E5-2696 v3, 128 GB DDR3L, Windows 10	Maya-S, 128K context	52.9 tokens/s	616 tokens/s	@noahark (v1.1.20, #346)
4x Tesla V100 32 GB (PCIe 3.0 x16), 24 CPU cores, a 100 GiB RAM limit	Maya-L, 32K context	48.3 tokens/s (after `--calibrate`)	499 tokens/s	@areslp (v1.1.3, #130)
2x Radeon AI PRO R9700 32 GB (gfx1201, PCIe 4.0 x16 each, 240 W), EPYC 7313, 256 GB RAM	Maya-M-Derisked, 256K context	44.4 tokens/s	703 tokens/s	@knoodrake (v1.1.28, #509)
4x RTX 3090 24 GB (PCIe 4.0 x8 behind one switch), Xeon Platinum 8260M, 376 GB RAM	Maya-L, 1M context	44.2 tokens/s (tuned)	698 tokens/s	@foureight84 (v1.1.17, #302)
2x Radeon AI PRO R9700 32 GB (gfx1201, PCIe 4.0 x8 each), Ryzen 5 3600, 64 GB RAM	Maya-S24 / Maya-M-Derisked, 256K context	44.1 / 24.9 tokens/s	704 / 617 tokens/s	@gegnep (v1.1.20, #395)
2x RTX 3090 24 GB (PCIe 4.0 x16, power-capped at 250 W), EPYC 7452, 256 GB RAM	Maya-M / Maya-L, 128K context	44.0 / 30.2 tokens/s	860 / 801 tokens/s	@orochifj (v1.1.4, #165)
2x RTX 4090 24 GB (PCIe 3.0 + 4.0 x16), 2x Xeon Silver 4309Y, 188 GB RAM	Maya-S24	40.5 tokens/s	1271 tokens/s	@fuad00 (v1.1.0, #122)
RTX PRO 6000 Blackwell 96 GB (PCIe 4.0 x16), Ryzen 5 5600, 92 GB DDR4	Maya-L, 1M context	39.6 tokens/s	2708 tokens/s (3246 warm)	@QueTensors (v1.1.28, #532)
4x Tesla T10 15 GB (PCIe 3.0 x16), Xeon E5-2680 v4, 63 GB RAM	Maya-S24, 100K context	38.4 tokens/s	393 tokens/s	@zeallag (v1.1.16, #291)
2x Tesla V100 32 GB (PCIe 3.0 x8 each), Ryzen 9 7945HX3D, 96 GB RAM	Maya-M / Maya-L	33.8 / 13.3 tokens/s	490 / 372 tokens/s	@nkhaooat (v1.1.11, #208)
RTX 3090 24 GB + RTX 3060 12 GB (PCIe 4.0 x16), EPYC 7702P (8-channel DDR4), 141 GB RAM (a VM)	Maya-M, 128K context	33.7 tokens/s	682 tokens/s	@erikash (v1.1.4, #157)
AMD Radeon 8065S (Ryzen AI Max+ PRO 495, 192 GB, 160 GB of it for the GPU), Windows 11	Maya-S, 32K context	31.5 tokens/s	342 tokens/s	@tobitege (v1.1.37, #663)
RTX 5090 32 GB, Ryzen 9 7950X, 96 GB DDR5	Maya-M	30+ tokens/s	~2000 tokens/s	@siganos (#43)
2x RTX 3090 24 GB (PCIe 4.0 x16, NVLink), Threadripper PRO 3955WX, 247 GB RAM	EXL3-3.05bpw, 128K context	29.2 tokens/s	-	@catonooka (v1.1.9, #187)
2x Tesla P40 24 GB (Pascal, PCIe 3.0 x16), EPYC 7302P (a VM), 184 GB RAM	Maya-S24 / Maya-L	28.0 / 16.9 tokens/s	202 / 194 tokens/s	@Jw88888 (v1.1.11 + #214, #212)
RX 7900 XTX 24 GB + Radeon 8060S helper (Ryzen AI Max+ 395, 128 GB)	Maya-S24, 114K-token prompts	27.5 tokens/s	836 tokens/s (114K)	@pepuscz (v1.1.17, #311)
1x RTX 3090 24 GB (PCIe 4.0 x16), EPYC 7702P (8-channel DDR4), 141 GB RAM (a VM)	Maya-M, 128K context	27.0 tokens/s	1069 tokens/s	@erikash (v1.1.4, #157)
RTX 4080 SUPER 32 GB (a 32 GB modded card), Threadripper 3970X, 157 GB RAM, SATA SSD	Maya-S24, 262K context	26.7 tokens/s	1552 tokens/s	@Micro-ATP (v1.1.11, #200)
3x Tesla V100 16 GB (PCIe 3.0 x16), 2x Xeon E5-2690 v4, 62 GB RAM	Maya-S, 128K context	26.6 tokens/s	497 tokens/s	@saatvik-viniak (v1.1.11, #211)
4x RTX 3080 20 GB, 64 GB DDR4	Maya-M, 512K context	26.3 tokens/s (a day of use)	-	@CoolJohn-lab (#104)
1x RTX 3090 24 GB (power-capped at 225 W), Threadripper 3970X, 128 GB RAM	Maya-S24	26.0 tokens/s	913 tokens/s	@briepala (v1.1.2, #135)
1x L40S 48 GB (vGPU), Xeon Platinum 8580 (a VM, 32 vCPUs), 504 GB RAM	UD-Q4_K_XL / UD-Q5_K_XL / Q8_0, 512K context	26.0 / 22.3 / 17.8 tokens/s	1987 / 1877 / 1750 tokens/s (185K)	@talisp (v1.1.32, #577)
RTX 4090 24 GB (PCIe 4.0 x16), 2x Xeon Silver 4310, 251 GB RAM	Maya-S24, 32K context	25.7 tokens/s	1963 tokens/s	@oscarlius (v1.1.24, #420)
RTX PRO 4000 Blackwell 24 GB, Core i9-13900K, 128 GB DDR5	Maya-S24	24.7 tokens/s	1146 tokens/s	@morrisfamily (v1.1.7, #174)
RTX 5090 32 GB (PCIe 5.0 x16), Core i9-13900K, 64 GB RAM, Windows 11	Maya-S, 128K context	23.0 tokens/s	2173 tokens/s	@gianbing (v1.1.3, #139)
4x Tesla T4 16 GB, Xeon E5-2660 v2, 220 GB RAM	Maya-S	22.6 tokens/s	416 tokens/s	@ksanislo (v1.0.16, #36)
Radeon AI PRO R9700 32 GB (gfx1201), Core i5-14400F, 128 GB RAM	Maya-S	21.4 tokens/s	-	@potatopote-debug (v1.1.12, #213)
1x NVIDIA CMP 170HX 64 GB (PCIe Gen2 x16), Core i7-9700K, 32 GB RAM	Maya-S24, 32K context	20.6 tokens/s	797 tokens/s	@Kanorin-chan (v1.1.8, #281)
AMD Radeon 8060S (Ryzen AI Max+ 395, 128 GB, 96 GB of it for the GPU), Windows 11	Maya-S	18.3 tokens/s	320 tokens/s	@LIN-LAB-AI (v1.0.30, #102)
RTX 3090 Ti 24 GB (PCIe 3.0 x16, a VM), EPYC 7302P, 240 GB RAM	Maya-L, 32K context	18.2 tokens/s (tuned, #177)	791 tokens/s	@Jw88888 (v1.1.7, #177)
3x Tesla P100 16 GB (Pascal; PCIe 3.0 x8, 3.0 x8, 2.0 x4), Ryzen 5 2600, 64 GB RAM	Maya-S24, 64K context	17.9 tokens/s	105 tokens/s	@maxlawrie (v1.1.28 + #479, #504)
RTX 4090 24 GB, Ryzen 7 9700X, 64 GB RAM	Maya-S24, 32K context	16.6 tokens/s	1320 tokens/s	@MagikEh (#274)
NVIDIA DGX Spark (GB10, 121 GB unified memory)	Maya-S, 128K context	16.5 tokens/s	~730 tokens/s (6K prompt)	@ericoh88 (v1.1.15, #282)
RTX 4090 24 GB, Ryzen 9 9950X3D, 192 GB DDR5, Windows 11	Maya-L, 128K context	16.4 tokens/s	1371 tokens/s	@npc97 (v1.0.24, #63)
RTX 5090 Laptop 24 GB, Core Ultra 9 275HX, 64 GB RAM, Windows 11 (a laptop)	Maya-S24	14.5 tokens/s	994 tokens/s	@klvnblst (v1.0.30, #67)

Machine	Model	Decode (writing the answer)	Prefill (reading your prompt)	By
8x RTX 5090 32 GB, Xeon Gold 6530, 1 TB RAM	Maya-S, 512K context, `--parallel 4`	184.2 tokens/s	2510 tokens/s	@etevrfed34-commits (v1.1.34, #585)
10x RTX 3090 24 GB (tensor parallel 2, PCIe 4.0 x4 each, 200 W), Xeon (24 threads), 64 GB RAM	EXL3 2.9 bpw, 1M context	97.0 tokens/s	2390 tokens/s (128K)	@DoktorMincs (v1.1.28, #494)
RTX 6000D 85 GB (PCIe 5.0 x16), Threadripper PRO 9965WX, 251 GB RAM	EXL3 2.9 bpw, 512K context	89.3 tokens/s	1687 tokens/s (2836 at 33K)	@Ross-Yang-94 (v1.1.25, #423)
2x A100-SXM4 80 GB, Xeon Platinum 8360Y, 1 TB RAM	Maya-S, 1M context	87.4 tokens/s	2084 tokens/s	@SunYong0821 (v1.1.34, #445, #594)
2x RTX PRO 5000 Blackwell 72 GB, Ryzen 9 9950X3D, 249 GB DDR5	Maya-S, 512K context	68-71 tokens/s (prose), up to 162 (code), tuned	~3700 tokens/s (42K)	@realsquall1980-art (v1.1.28, #424)
1x A100-SXM4 80 GB, Xeon Platinum 8360Y, 1 TB RAM	Maya-S, 1M context	60.2 tokens/s	241 tokens/s	@SunYong0821 (v1.1.34, #594)
4x AMD Instinct MI100 32 GB (gfx908, PCIe 4.0 x16 each), EPYC 7402, 252 GB RAM	Maya-XS, 32K context	51.8 tokens/s	172 tokens/s	@nsaxploit (v1.1.22, #396)
4x RTX 3090 24 GB (PCIe 3.0, SM clocks capped at 1500 MHz), Threadripper 1950X, 126 GB RAM	Maya-S, 256K context	50-53 tokens/s (code), 40-43 (prose)	947 tokens/s (10K), 1954 (90K)	@mgabor3141 (v1.1.26, #448)
2x NVIDIA A40 48 GB (PCIe 4.0 x16), 2x Xeon Gold 6330, 256 GB RAM, Windows Server 2022	Maya-S, 256K context	48.9 tokens/s (tuned)	~660 tokens/s (3K)	@yjyz1011 (v1.1.28, #508)
RTX 4090 24 GB (PCIe 4.0 x8), Ryzen 9 9950X3D, 192 GB DDR5	Maya-XS, 64K context	44.1 tokens/s	539 tokens/s	@naeq (v1.1.27, #503)
1x L40S 48 GB (vGPU), Xeon Platinum 8580 (a VM, 32 vCPUs), 504 GB RAM	UD-Q8_K_XL, 256K context	43.2 tokens/s	1862 tokens/s (174K)	@talisp (v1.1.32, #577)
AMD Radeon 8065S (Ryzen AI Max+ PRO 495, 192 GB, 160 GB of it for the GPU), Windows 11	orcarouter abliterated Mix-128G, 256K context, DSpark	43.2 tokens/s	453 tokens/s	@tobitege (v1.1.37, #663)
4x Tesla V100 32 GB (PCIe 3.0 x16), 2x Xeon E5-2630 v4, 504 GB RAM	Maya-S / UD-Q4_K_XL / UD-Q8_K_XL, 64K context	41.4 / 31 / 26.7 tokens/s	556 / 176 / 178 tokens/s	@HansStrupat (v1.1.26-v1.1.27, #467, #497)
2x RX 7900 XTX 24 GB (tensor parallel 2, PCIe 4.0 x4 each) + Radeon 8060S helper (Ryzen AI Max+ 395, 128 GB), the model on a USB4 NVMe	Maya-S, 512K context	41.3 tokens/s (46.1 after a 130K-token prompt, cached)	1291 tokens/s (130K; 482 at 8K)	@pepuscz (v1.1.28 + #511-#519, #510)
4x RX 7900 XT 20 GB (gfx1100, `--tp 4`, tuned), 2x Xeon E5-2699C v4 (a Dell T7910), 1 TB DDR4-2400	UD-Q4_K_XL	35.0 tokens/s	-	@Cass67 (v1.1.32, #566)
2x RTX 3090 24 GB (PCIe 4.0 x8, 270 W), Core Ultra 7 265K, 192 GB DDR5	Maya-S, 1M context, tuned	33.3 tokens/s	467 tokens/s	@Jellepepe (v1.1.35, #614)
3x Tesla V100 32 GB (PCIe 3.0 x16), 2x Xeon E5-2696 v3, 128 GB DDR3L, Windows 10	Maya-S, 64K context	23-26 tokens/s (long answers)	377 tokens/s	@noahark (v1.1.26, #450)
2x RTX 2080 Ti 22 GB (modded, PCIe 3.0 x16, power-capped at 250 W), 2x Xeon E5-2696 v4, 94 GB RAM	Maya-XS, 128K context	23.1 tokens/s	317 tokens/s	@NorwinYu (v1.1.36, #659)
2x RTX 4090 24 GB (PCIe 3.0 + 4.0 x16), 2x Xeon Silver 4309Y, 188 GB RAM	Maya-XS, 64K context	21.5 tokens/s	573 tokens/s	@fuad00 (v1.1.22, #393)
RTX 4000 Ada 20 GB, Xeon w7-3455, 255 GB DDR5, Windows 11	Maya-XS, 256K context	21.1 tokens/s	518 tokens/s (20K)	@pietroMastro92 (v1.1.29, #534)
2x Tesla V100 32 GB (PCIe 3.0 x8 each), Ryzen 9 5900XT, 128 GB DDR4-3200	Maya-S, 64K context	20.8 tokens/s	344 tokens/s	@pirosap (v1.1.34, #586)

Machine	Model	Decode (writing the answer)	Prefill (reading your prompt)	By
RTX 3090 24 GB + 8x RTX 5060 Ti 16 GB (PCIe 3.0 x8 each), 183 GB RAM	EXL3 3.5 bpw, tensor parallel 4 + DSpark, 8K context	38.2 tokens/s (code), 32.4 (prose)	-	@needmorevram (#477)
1x L40S 48 GB (vGPU), Xeon Platinum 8580 (a VM, 32 vCPUs), 504 GB RAM	Maya-S / EXL3 3.55 bpw, 256K context	23.4 / 16.7 tokens/s	332 / 273 tokens/s (158K)	@talisp (v1.1.32, #577)
2x RTX 3090 24 GB (power-capped at 230 W), EPYC 7543 (a VM, 32 vCPUs), 224 GB RAM	Maya-S, 200K context, DSpark	22.0 tokens/s (code), 18.4 (prose)	163 tokens/s (10K)	@noonghunna (v1.1.30, #549)
AMD Radeon 8065S (Ryzen AI Max+ PRO 495, 192 GB, 160 GB of it for the GPU), Windows 11	Maya-S, 128K context, DSpark	21.0 tokens/s	139 tokens/s	@tobitege (v1.1.37, #663)


GPU	NVIDIA, compute capability 7.0 or newer (V100, RTX 20 and newer): one, or up to 16 that share the model. More VRAM is faster. Pascal (Tesla P40 / P100, GTX 10) is experimental, not validated yet. AMD (experimental): RX 7900 XT / XTX, Radeon AI PRO R9700 / RX 9070, Strix Halo and Gorgon Halo (Radeon 8060S / 8065S); RX 6800 / 6900 and Radeon PRO V620 / W6800 not validated yet; GLM-5.3-Flash reads text only there, DeepSeek-V4.1-Flash-1017 pictures too - docs/AMD_MAYA.md
RAM	32 GB runs it. More RAM keeps more experts close and is faster
Disk	A fast NVMe SSD with room for the model (~100 GB for GLM-5.3 · Maya-S, ~160 GB for GLM-5.3 · Maya-L, ~350 GB for DeepSeek V4.1 · Maya-S, ~520 GB for unsloth's GGUF of it, ~95 GB for MiniMax M3.1 · Maya-XS, ~200 GB for MiniMax-M3.1-Flash's EXL3 quant) and its picture encoder (1.1 GB). Not a hard disk
System	Linux (x86-64; a CPU with AVX2 is best), the NVIDIA driver, CUDA 12.x (CUDA 13 works for RTX 20 and newer, not for the V100 or Pascal), g++, Python 3.10+. Windows 10/11 (experimental): docs/WINDOWS.md. Not WSL2. AMD: ROCm 7

mw00/project-maya

Project Maya

Quick start

Pick your model

Quality

How fast is it?

Using it

What you need

Install

Something went wrong?

Support

Sponsors

Credits and license