text-generation-inference

text-generation-inference server text_generation_server utils

main Live from GitHub Updated 3 years ago View on GitHub
server/text_generation_server/utils contents
Name Size
.. Parent directory
awq , directory
gptq , directory
__init__.py 1.1 KB
convert.py 4.2 KB
dist.py 2.3 KB
flash_attn.py 3.7 KB
hub.py 6.1 KB
layers.py 28.2 KB
logits_process.py 14.6 KB
peft.py 1.4 KB
tokens.py 12.9 KB
watermark.py 3.5 KB
weights.py 14.7 KB