Commit Graph

4 Commits

Author SHA1 Message Date
hemu.zp
ceeb85f10f [to #42322933] Support multi-machine data and tensor parallel finetuning
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11682479
2023-02-28 18:47:17 +08:00
hemu.zp
a277b343af [to #42322933] Add beam search and pair finetune for GPT-3
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11397726

* test finetune weather

* support ppl and generation metrics
2023-01-11 22:04:11 +08:00
jerry.lp
906fa673b4 add gpt-moe model for modelscope finetune
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11085918
2022-12-17 05:52:57 +08:00
hemu.zp
941dbe75cf [to #42322933] Add GPT-3 tensor parallel finetuning
Add GPT-3 tensor parallel finetuning, adjust some distributed codes to make tensor and data parallel compatible.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10949507
2022-12-05 10:01:32 +08:00