RunanywhereAI/trnrt
Open on GitHubPythonThe open LLM inference engine for AWS Trainium: NKI megakernels, 1M-token context, OpenAI-compatible API. By RunAnywhere.
- 738−19 Elo, change today
- 1.5k stars
- 18 forks
git clone https://github.com/RunanywhereAI/trnrt.git