GitHub / France-Travail / vllm-ft
A high-throughput and memory-efficient inference and serving engine for LLMs
JSON API: https://data.code.gouv.fr/api/v1/hosts/GitHub/repositories/France-Travail%2Fvllm-ft
Stars: 3
Forks: 0
Open issues: 1
License: apache-2.0
Language: Python
Size: 46.8 MB
Dependencies parsed at: Pending
Created at: about 1 month ago
Updated at: 8 days ago
Pushed at: 7 days ago
Last synced at: 6 days ago
Funding Links https://github.com/sponsors/vllm-project, https://opencollective.com/vllm
Readme
Loading...