mulin.lyh 6c7fca8307 支持modelscope直接拉起推理服务 ...

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14702876

* add inference server code

* add server requirement

* fix import issue

* debug

* add command line

* add llmpipeline support

* modify port to int

* add serer usage

* remove unused code

* fix lint issue

* add inference server code

* upgrade env to VLLM_USE_MODELSCOPE

2023-11-29 17:37:56 +08:00

0 lines

0 B

Python

Raw Blame History

The file is empty.