text-generation-inference server
| Name | Size |
|---|---|
| .. Parent directory | |
| custom_kernels , directory | |
| exllama_kernels , directory | |
| tests , directory | |
| text_generation_server , directory | |
| .gitignore | 2.8 KB |
| Makefile | 1.2 KB |
| Makefile-awq | 371 B |
| Makefile-eetq | 327 B |
| Makefile-flash-att | 718 B |
| Makefile-flash-att-v2 | 490 B |
| Makefile-vllm | 332 B |
| poetry.lock | 243.2 KB |
| pyproject.toml | 1.6 KB |
| README.md | 172 B |
| requirements.txt | 5.5 KB |