GitHub / France-Travail / benchmark_llm_serving
A library to benchmark LLMs via their API exposure
JSON API: https://data.code.gouv.fr/api/v1/hosts/GitHub/repositories/France-Travail%2Fbenchmark_llm_serving
Stars: 6
Forks: 0
Open issues: 0
License: agpl-3.0
Language: Python
Size: 8.04 MB
Dependencies parsed at: Pending
Created at: 11 months ago
Updated at: about 2 months ago
Pushed at: 5 months ago
Last synced at: about 2 hours ago
Topics: benchmark, llm, llm-serving, vllm
Loading...