GitHub / France-Travail / happy_vllm
A REST API for vLLM, production ready
JSON API: https://data.code.gouv.fr/api/v1/hosts/GitHub/repositories/France-Travail%2Fhappy_vllm
Stars: 20
Forks: 2
Open issues: 5
License: agpl-3.0
Language: Python
Size: 859 KB
Dependencies parsed at:
39
Created at: 11 months ago
Updated at: about 1 month ago
Pushed at: 10 days ago
Last synced at: 1 day ago
Topics: api-rest, llm, llm-serving, production, vllm
- actions/checkout v4 composite
- actions/setup-python v5 composite
.github/workflows/docs.yaml
actions
- actions/checkout v3 composite
- actions/setup-python v4 composite
- actions/checkout v4 composite
- actions/setup-python v5 composite
.github/workflows/linter.yaml
actions
- actions/checkout v3 composite
- actions/setup-python v3 composite
- actions/checkout v3 composite
- actions/setup-python v3 composite
- pypa/gh-action-pypi-publish v1.4.1 composite
- actions/checkout v4 composite
- docker/build-push-action 3b5e8027fcad23fda98b2e3ac259d8d67585f671 composite
- docker/login-action f4ef78c080cd8ba55a85445d5b36e214a81df20a composite
- docker/metadata-action 9ec57ed1fcdbf14dcef7dfbe97b2010124a938b7 composite
- actions/checkout v4 composite
- docker/build-push-action f2a1d5e99d037542a71f64918e516c093c6f3fc4 composite
- docker/login-action 65b78e6e13532edd9afa3aa52ac7964289d1a9c1 composite
- docker/metadata-action 9ec57ed1fcdbf14dcef7dfbe97b2010124a938b7 composite
- actions/checkout v3 composite
- actions/setup-python v3 composite
- actions/upload-artifact v3 composite
.github/workflows/wheel.yaml
actions
- actions/checkout v3 composite
- actions/setup-python v3 composite
Dockerfile
docker
- nvidia/cuda 12.1.0-runtime-ubuntu22.04 build
pyproject.toml
pypi
- fastapi >=0.115.5,<1.0
- jsonschema >=4.23.0,<5.0
- numpy >=1.26.4,<2.0
- prometheus_client >=0.21.0,<1.0
- pydantic_settings >=2.6.1,<3.0
- uvicorn [standard]>=0.32.1,<1.0
- vllm >=0.6.4.post1,<1.0
requirements.txt
pypi
- fastapi ==0.115.5
- jsonschema ==4.23.0
- numpy ==1.26.4
- prometheus_client ==0.21.0
- pydantic-settings ==2.6.1
- uvicorn ==0.32.1
- vllm ==0.6.4.post1
setup.py
pypi