examples/pytorch/llm/run_sft.sh

CUDA_VISIBLE_DEVICES=0,1 \
python llm_sft.py \
    --model_type polylm-13b \
    --output_dir runs \
    --dataset alpaca-en,alpaca-zh,alpaca-multi \
    --dataset_sample 20000
add qwen 7b base and chat 添加QWen 7b base模型和chat模型及相关pipelines Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235 * add qwen 7b base and chat * fix logger * update examples, lint test * add unittest for qwen base and chat * rename qwen to qwen-7b * resolve imports and add a registry to text-generation * reset load model from pretrained * fix precheck * skip qwen test case now * remove strange file 2023-08-02 09:25:21 +08:00			`CUDA_VISIBLE_DEVICES=0,1 \`
			`python llm_sft.py \`
[to #42322933] Add polylm lora trainer to modelscope Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13509769 * [to #42322933] Add polylm lora trainer to modelscope 2023-08-10 20:57:47 +08:00			`--model_type polylm-13b \`
add qwen 7b base and chat 添加QWen 7b base模型和chat模型及相关pipelines Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235 * add qwen 7b base and chat * fix logger * update examples, lint test * add unittest for qwen base and chat * rename qwen to qwen-7b * resolve imports and add a registry to text-generation * reset load model from pretrained * fix precheck * skip qwen test case now * remove strange file 2023-08-02 09:25:21 +08:00			`--output_dir runs \`
[to #42322933] add truct remote code for polylm Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13628684 * add truct remote code for polylm * [to #42322933] add truct remote code for polylm * [to #42322933] add truct remote code for polylm 2023-08-14 15:37:42 +08:00			`--dataset alpaca-en,alpaca-zh,alpaca-multi \`
add qwen 7b base and chat 添加QWen 7b base模型和chat模型及相关pipelines Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235 * add qwen 7b base and chat * fix logger * update examples, lint test * add unittest for qwen base and chat * rename qwen to qwen-7b * resolve imports and add a registry to text-generation * reset load model from pretrained * fix precheck * skip qwen test case now * remove strange file 2023-08-02 09:25:21 +08:00			`--dataset_sample 20000`