Popular repositories Loading

1. lorax lorax Public

   Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

   Python 3.8k 325

2. llm_distillation_playbook llm_distillation_playbook Public

   Best practices for distilling large language models.

   Jupyter Notebook 638 59

3. lora_bakeoff lora_bakeoff Public

   Python 21 2

4. json-mode-benchmark json-mode-benchmark Public

   Jupyter Notebook 7 1

5. neuropod neuropod Public

   Forked from uber/neuropod

   A uniform interface to run deep learning models from multiple frameworks

   C++ 3 2

6. punica punica Public

   Forked from punica-ai/punica

   Serving multiple LoRA finetuned LLM as one

   Cuda 2 4