Files
modelscope/examples/pytorch/llm/run_infer.sh

6 lines
163 B
Bash
Raw Normal View History

python llm_infer.py \
--device 0 \
--model_type llama2-7b \
--ckpt_fpath "runs/llama2-7b/vx_xxx/output_best/pytorch_model.bin" \
--eval_human true