mirror of
https://github.com/modelscope/modelscope.git
synced 2025-12-22 19:19:21 +01:00
33bd74a7be
添加QWen 7b base模型和chat模型及相关pipelines Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235 * add qwen 7b base and chat * fix logger * update examples, lint test * add unittest for qwen base and chat * rename qwen to qwen-7b * resolve imports and add a registry to text-generation * reset load model from pretrained * fix precheck * skip qwen test case now * remove strange file
6 lines
168 B
Bash
6 lines
168 B
Bash
CUDA_VISIBLE_DEVICES=0,1 \
|
|
python llm_infer.py \
|
|
--model_type qwen-7b \
|
|
--ckpt_path "runs/qwen-7b/vx_xxx/output_best/pytorch_model.bin" \
|
|
--eval_human true
|