7 Commits

Author	SHA1	Message	Date
zsl01670416	9926ad685b	support getting labels from dataset in sbert text classification and building dataset from file in chatglm-6b ... 1.Add getting labels from dataset in "text_classificationfinetune_text_classification.py" to simplify user's operation in flex training. Parameters "--num_labels" and "--labels" were removed in "run_train.sh". 2.In "chatglm6b / finetune.py", building dataset from file is necessary to support flex training. Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13382745 * support getting labels from dataset in sbert text classification and building dataset from file in chatglm-6b * support getting labels from dataset in sbert text classification and building dataset from file in chatglm-6b * remove repetitive labels in a concise manner of using set * reserve parameter labels in finetune_text_classification * Merge branch 'master' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib reserve parameter labels in finetune_text_classification * Merge branch 'support_text_cls_labels_chatglm_json' reserve parameter labels in finetune_text_classification	2023-07-25 19:02:32 +08:00
zsl01670416	2a2cc594eb	Merge branch 'maas_flex_train_dev' modify finetune_text_classification for arguments collision between eval_strategy and by_e...	2023-06-30 19:04:14 +08:00
zsl01670416	75c90d8a98	add model revision in training_args and modify dataset loading in finetune text classification ... 1.add parameter model_revision in training_args.py. 2.add parameter model_revision in kwargs for finetune_text_classification.py and finetune_text_generation.py. 3.modify dataset loading in finetune_text_classification.py for flex training. Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12869552 * add model revision in training_args and modify dataset loading in finetune text classification	2023-06-08 19:36:05 +08:00
zsl01670416	71a80173e5	modify examples text_classification, text_generation, token_classification for improved trainer ... 1.text_classification/run_train.sh 2.text_generation/run_train_mt5.sh, run_train_palm.sh 3.token_classification/finetune_token_classification.py, run_train_mgeo.sh, run_train_structbert.sh above files were modified to adapt to improved trainer Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12629010	2023-05-16 14:32:43 +08:00
hemu.zp	5804ad2dc1	update multi_modal_embedding example ... Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12626062	2023-05-16 14:31:26 +08:00
yuze.zyz	febc0365de	Support FlexTrain and update the structure of trainer ... 1. Refactor training_args 2. Refactor hooks 3. Add train_id for push_to_hub 4. Support both output_dir/output_sub_dir for checkpoint_hooks 5. Support copy when hardlink fails when checkpointing 6. Support mixed dataset config file as a CLI argument 7. Add eval txt in output folder Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12384253 * support the ignorance of file pattern	2023-05-13 12:12:04 +08:00
hemu.zp	82482b3e96	update training args ... Based on feat/0131/nlp_args branch, the original code review: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11408570 Support for running finetuning from the command line with training args, Compatible with the configuration optimization.	2023-02-10 05:32:21 +00:00