Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-21 10:39:24 +01:00
Code Issues Packages Projects Releases Wiki Activity
Files
6f963d01868b988a98e5bb2201b2f7251a5b1345
modelscope/examples/pytorch/text_classification/run_train.sh

24 lines
784 B
Bash
Raw Normal View History

update training args Based on feat/0131/nlp_args branch, the original code review: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11408570 Support for running finetuning from the command line with training args, Compatible with the configuration optimization.
2023-02-10 05:32:21 +00:00
PYTHONPATH=. python examples/pytorch/text_classification/finetune_text_classification.py \
modify examples text_classification, text_generation, token_classification for improved trainer 1.text_classification/run_train.sh 2.text_generation/run_train_mt5.sh, run_train_palm.sh 3.token_classification/finetune_token_classification.py, run_train_mgeo.sh, run_train_structbert.sh above files were modified to adapt to improved trainer Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12629010
2023-05-16 14:32:43 +08:00
--task 'text-classification' \
update training args Based on feat/0131/nlp_args branch, the original code review: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11408570 Support for running finetuning from the command line with training args, Compatible with the configuration optimization.
2023-02-10 05:32:21 +00:00
--model 'damo/nlp_structbert_backbone_base_std' \
Support FlexTrain and update the structure of trainer 1. Refactor training_args 2. Refactor hooks 3. Add train_id for push_to_hub 4. Support both output_dir/output_sub_dir for checkpoint_hooks 5. Support copy when hardlink fails when checkpointing 6. Support mixed dataset config file as a CLI argument 7. Add eval txt in output folder Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12384253 * support the ignorance of file pattern
2023-05-13 12:12:04 +08:00
--train_dataset_name 'clue' \
add model revision in training_args and modify dataset loading in finetune text classification 1.add parameter model_revision in training_args.py. 2.add parameter model_revision in kwargs for finetune_text_classification.py and finetune_text_generation.py. 3.modify dataset loading in finetune_text_classification.py for flex training. Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12869552 * add model revision in training_args and modify dataset loading in finetune text classification
2023-06-08 19:36:05 +08:00
--val_dataset_name 'clue' \
Support FlexTrain and update the structure of trainer 1. Refactor training_args 2. Refactor hooks 3. Add train_id for push_to_hub 4. Support both output_dir/output_sub_dir for checkpoint_hooks 5. Support copy when hardlink fails when checkpointing 6. Support mixed dataset config file as a CLI argument 7. Add eval txt in output folder Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12384253 * support the ignorance of file pattern
2023-05-13 12:12:04 +08:00
--train_subset_name 'tnews' \
add model revision in training_args and modify dataset loading in finetune text classification 1.add parameter model_revision in training_args.py. 2.add parameter model_revision in kwargs for finetune_text_classification.py and finetune_text_generation.py. 3.modify dataset loading in finetune_text_classification.py for flex training. Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12869552 * add model revision in training_args and modify dataset loading in finetune text classification
2023-06-08 19:36:05 +08:00
--val_subset_name 'tnews' \
--train_split 'train' \
--val_split 'validation' \
update training args Based on feat/0131/nlp_args branch, the original code review: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11408570 Support for running finetuning from the command line with training args, Compatible with the configuration optimization.
2023-02-10 05:32:21 +00:00
--first_sequence 'sentence' \
add model revision in training_args and modify dataset loading in finetune text classification 1.add parameter model_revision in training_args.py. 2.add parameter model_revision in kwargs for finetune_text_classification.py and finetune_text_generation.py. 3.modify dataset loading in finetune_text_classification.py for flex training. Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12869552 * add model revision in training_args and modify dataset loading in finetune text classification
2023-06-08 19:36:05 +08:00
--label label \
update training args Based on feat/0131/nlp_args branch, the original code review: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11408570 Support for running finetuning from the command line with training args, Compatible with the configuration optimization.
2023-02-10 05:32:21 +00:00
--preprocessor 'sen-cls-tokenizer' \
modify examples text_classification, text_generation, token_classification for improved trainer 1.text_classification/run_train.sh 2.text_generation/run_train_mt5.sh, run_train_palm.sh 3.token_classification/finetune_token_classification.py, run_train_mgeo.sh, run_train_structbert.sh above files were modified to adapt to improved trainer Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12629010
2023-05-16 14:32:43 +08:00
--use_model_config True \
--max_epochs 1 \
add model revision in training_args and modify dataset loading in finetune text classification 1.add parameter model_revision in training_args.py. 2.add parameter model_revision in kwargs for finetune_text_classification.py and finetune_text_generation.py. 3.modify dataset loading in finetune_text_classification.py for flex training. Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12869552 * add model revision in training_args and modify dataset loading in finetune text classification
2023-06-08 19:36:05 +08:00
--per_device_train_batch_size 16 \
--per_device_eval_batch_size 16 \
--eval_interval 100 \
--eval_strategy by_step \
--work_dir './tmp' \
--train_data_worker 0 \
--eval_data_worker 0 \
--lr 1e-5 \
modify examples text_classification, text_generation, token_classification for improved trainer 1.text_classification/run_train.sh 2.text_generation/run_train_mt5.sh, run_train_palm.sh 3.token_classification/finetune_token_classification.py, run_train_mgeo.sh, run_train_structbert.sh above files were modified to adapt to improved trainer Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12629010
2023-05-16 14:32:43 +08:00
--eval_metrics 'seq-cls-metric' \
Reference in New Issue Copy Permalink