Package Usage: pypi: auto-gptq
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
16 versions
Latest release: about 1 year ago
35 dependent packages
124,645 downloads last month
View more package details: https://packages.ecosystem.code.gouv.fr/registries/pypi.org/packages/auto-gptq