scan_cache/examples/pytorch/llm/run_infer.sh

CUDA_VISIBLE_DEVICES=0,1 \
python llm_infer.py \
    --model_type polylm-13b \
    --ckpt_path "runs/polylm-13b/v0-20230802-172425/output_best/pytorch_model.bin" \
    --eval_human true
add qwen 7b base and chat 添加QWen 7b base模型和chat模型及相关pipelines Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235 * add qwen 7b base and chat * fix logger * update examples, lint test * add unittest for qwen base and chat * rename qwen to qwen-7b * resolve imports and add a registry to text-generation * reset load model from pretrained * fix precheck * skip qwen test case now * remove strange file 2023-08-02 09:25:21 +08:00			`CUDA_VISIBLE_DEVICES=0,1 \`
support llama2 (#393) * Unify sft and infer code into a single file * update llama2 sft infer 2023-07-19 17:34:27 +08:00			`python llm_infer.py \`
[to #42322933] Add polylm lora trainer to modelscope Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13509769 * [to #42322933] Add polylm lora trainer to modelscope 2023-08-10 20:57:47 +08:00			`--model_type polylm-13b \`
			`--ckpt_path "runs/polylm-13b/v0-20230802-172425/output_best/pytorch_model.bin" \`
support llama2 (#393) * Unify sft and infer code into a single file * update llama2 sft infer 2023-07-19 17:34:27 +08:00			`--eval_human true`