Topic: "vllm"
France-Travail/happy_vllm
A REST API for vLLM, production ready
Language: Python - Size: 857 KB - Last synced at: 7 days ago - Pushed at: 8 months ago - Stars: 28 - Forks: 4
France-Travail/benchmark_llm_serving
A library to benchmark LLMs via their API exposure
Language: Python - Size: 8.04 MB - Last synced at: 7 days ago - Pushed at: about 1 year ago - Stars: 8 - Forks: 1
Related Topics