Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-24 20:19:51 +01:00
Code Issues Packages Projects Releases Wiki Activity
Files
streaming
modelscope/requirements/server.txt

4 lines
30 B
Plaintext
Raw Permalink Normal View History

支持modelscope直接拉起推理服务 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14702876 * add inference server code * add server requirement * fix import issue * debug * add command line * add llmpipeline support * modify port to int * add serer usage * remove unused code * fix lint issue * add inference server code * upgrade env to VLLM_USE_MODELSCOPE
2023-11-29 17:37:56 +08:00
fastapi
sse-starlette
uvicorn
Reference in New Issue Copy Permalink