A fast inference library for running LLMs locally on modern consumer-class GPUs
Python 4.7k 347
An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs
Python 1.8k 288
Web UI for ExLlamaV2
JavaScript 517 44
Loading…
There was an error while loading. Please reload this page.