6 Commits

Author SHA1 Message Date
zsl01670416
75c90d8a98 add model revision in training_args and modify dataset loading in finetune text classification
1.add parameter model_revision in training_args.py.
2.add parameter model_revision in kwargs for finetune_text_classification.py and finetune_text_generation.py.
3.modify dataset loading in finetune_text_classification.py for flex training.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12869552
* add model revision in training_args and modify dataset loading in finetune text classification
2023-06-08 19:36:05 +08:00
yuze.zyz
d38fa563a8 Re commit lossing files for flextrain
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12674746
2023-05-19 10:48:33 +08:00
hemu.zp
5804ad2dc1 update multi_modal_embedding example
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12626062
2023-05-16 14:31:26 +08:00
yuze.zyz
febc0365de Support FlexTrain and update the structure of trainer
1. Refactor training_args
2. Refactor hooks
3. Add train_id for push_to_hub
4. Support both output_dir/output_sub_dir for checkpoint_hooks
5. Support copy when hardlink fails when checkpointing
6. Support mixed dataset config file as a CLI argument
7. Add eval txt in output folder
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12384253
* support the ignorance of file pattern
2023-05-13 12:12:04 +08:00
hemu.zp
f0d69c2aa4 Add palm example
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12259265
2023-04-10 14:55:44 +08:00
hemu.zp
eecdd90412 add finetune_text_generation
1. Add TrainingArgs and cli call form for text generation task
2. Fix dp+tp finetune bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11929345
2023-03-10 15:08:56 +08:00