Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-07-10 04:22:33 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
directory
modelscope/requirements/server.txt

4 lines
30 B
Plaintext
Raw Permalink Normal View History

支持modelscope直接拉起推理服务 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14702876 * add inference server code * add server requirement * fix import issue * debug * add command line * add llmpipeline support * modify port to int * add serer usage * remove unused code * fix lint issue * add inference server code * upgrade env to VLLM_USE_MODELSCOPE
2023-11-29 17:37:56 +08:00
fastapi
sse-starlette
uvicorn
Reference in New Issue Copy Permalink