mulin.lyh
|
6c7fca8307
|
支持modelscope直接拉起推理服务
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14702876
* add inference server code
* add server requirement
* fix import issue
* debug
* add command line
* add llmpipeline support
* modify port to int
* add serer usage
* remove unused code
* fix lint issue
* add inference server code
* upgrade env to VLLM_USE_MODELSCOPE
|
2023-11-29 17:37:56 +08:00 |
|