Files
modelscope/requirements
mulin.lyh 6c7fca8307 支持modelscope直接拉起推理服务
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14702876

* add inference server code

* add server requirement

* fix import issue

* debug

* add command line

* add llmpipeline support

* modify port to int

* add serer usage

* remove unused code

* fix lint issue

* add inference server code

* upgrade env to VLLM_USE_MODELSCOPE
2023-11-29 17:37:56 +08:00
..
2023-08-30 15:04:43 +08:00
2023-11-17 10:46:58 +08:00
2023-08-29 17:47:59 +08:00
up
2022-11-01 17:44:37 +08:00
2023-11-27 13:56:33 +08:00
2022-07-20 20:43:42 +08:00