examples/pytorch/llm/run_sft.sh

CUDA_VISIBLE_DEVICES=0,1 \
python llm_sft.py \
    --model_type qwen-7b \
    --output_dir runs \
    --dataset alpaca-en,alpaca-zh \
    --dataset_sample 20000
add qwen 7b base and chat 添加QWen 7b base模型和chat模型及相关pipelines Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235 * add qwen 7b base and chat * fix logger * update examples, lint test * add unittest for qwen base and chat * rename qwen to qwen-7b * resolve imports and add a registry to text-generation * reset load model from pretrained * fix precheck * skip qwen test case now * remove strange file 2023-08-02 09:25:21 +08:00			`CUDA_VISIBLE_DEVICES=0,1 \`
			`python llm_sft.py \`
			`--model_type qwen-7b \`
			`--output_dir runs \`
support openbuddy-llama2-13b (#416) 2023-07-26 18:12:55 +08:00			`--dataset alpaca-en,alpaca-zh \`
add qwen 7b base and chat 添加QWen 7b base模型和chat模型及相关pipelines Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235 * add qwen 7b base and chat * fix logger * update examples, lint test * add unittest for qwen base and chat * rename qwen to qwen-7b * resolve imports and add a registry to text-generation * reset load model from pretrained * fix precheck * skip qwen test case now * remove strange file 2023-08-02 09:25:21 +08:00			`--dataset_sample 20000`