text-generation-inference

text-generation-inference server text_generation_server utils gptq

main Live from GitHub Updated 3 years ago View on GitHub

server/text_generation_server/utils/gptq contents
Name	Size
.. Parent directory
custom_autotune.py	9.8 KB
exllama.py	4.2 KB
quant_linear.py	12.2 KB
quantize.py	30.8 KB