Package Usage: pypi: transformers-stream-generator
This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
5 versions
Latest release: over 1 year ago
21 dependent packages
66,117 downloads last month
View more package details: https://packages.ecosystem.code.gouv.fr/registries/pypi.org/packages/transformers-stream-generator