InseeFrLab/auto-tuning-vllm

Auto-tuning for vllm. Getting the best performance out of your LLM deployment (vllm+guidellm+optuna)

Language: Python - Size: 2.99 MB - Last synced at: about 4 hours ago - Pushed at: about 1 month ago - Stars: 8 - Forks: 0