Commit Graph

1636 Commits

Author SHA1 Message Date
suluyana
9ff4ab1cd8 fix format 2023-05-14 19:50:01 +08:00
suluyana
bf69a8e948 fix nccl timeout 2023-05-14 19:30:14 +08:00
suluyana
95985e391f update config 2023-05-10 20:46:30 +08:00
suluyana
0179368f7b feat: llama training & update deepspeed hook 2023-05-10 16:51:26 +08:00
Xu Wenqing
e8bca5a11e Set default topk when num_classes < 5 (#269)
* set default topk when num_classes < 6

* add comments

* format changes with yapf

---------

Co-authored-by: Xu Wenqing <xwq391974@alibaba-inc.com>
2023-04-18 20:30:13 +08:00
Firmament-cyou
e841261557 Merge pull request #275 from modelscope/master-merge-internal2023-0417
Master merge internal2023 0417
2023-04-17 15:01:30 +08:00
zhifu.gzf
a40c6f452e support funasr for mac
增加asr pipeline对于mac支持,在mac上自测没问题
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12341467
2023-04-17 10:17:55 +08:00
hemu.zp
4f300c8632 Fix generate for ModelForTextGeneration
Separate the `generate` function, no longer use the implementation in the transformers library to avoid error due to transformers version upgrades.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12340643
2023-04-16 02:05:41 +08:00
hemu.zp
b3e7eca817 lmit mmdet version
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12339472
2023-04-15 17:08:55 +08:00
yuze.zyz
2650d37094 Fix the log level and return value of push_to_hub
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12338218
2023-04-15 16:42:35 +08:00
hemu.zp
a4bafd8b25 Add requirements for jsonplus
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12331254
2023-04-14 14:05:36 +08:00
zhangzhicheng.zzc
04e8ddc41e fix update ast not remove origin information
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12319197
2023-04-13 16:10:07 +08:00
hehong.chh
10101e08aa skip FidDialogueTest temporarily, due to the model is set to non-public
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12315621
2023-04-13 13:27:25 +08:00
yuze.zyz
87c30bc711 Merge branch master-merge-github-0413 into master
Title: Merge branch 'master-github' into master-merge-github-0413 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12313282
2023-04-13 11:11:05 +08:00
hemu
9f2f1c066a change file names 2023-04-13 10:41:18 +08:00
hemu
672f25266f Merge branch 'master-github' into master-merge-github-0413 2023-04-13 10:32:01 +08:00
slin000111
92d7eae5b9 add token classification example and gpt3 one layer test (#268) 2023-04-13 10:21:00 +08:00
yuze.zyz
d48e436ae2 [Bug Fix] Fix losing files
1. Recommit and merge losing files on push-to-hub feature
2. Fix a failure to build a int tensor with float values
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12308629
2023-04-13 10:08:23 +08:00
zhangzhicheng.zzc
afdea20e39 plugin support trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12311477
* add plugin import before build trainer
2023-04-13 10:06:44 +08:00
hemu.zp
4e78f611e6 Add sortedcontainers to requirements
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12310786
2023-04-12 22:26:56 +08:00
zhangzhicheng.zzc
522b2ed08f plugin add modelscope source
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12306018
2023-04-12 20:38:13 +08:00
yuze.zyz
1f95021bc4 bump master version to 1.5.0 2023-04-12 19:33:46 +08:00
hemu.zp
7b4a0ea02c Merge branch master-merge-github-0412 into master
Title: Merge branch 'master-merge-github-0412' into master 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12304662
2023-04-12 19:16:11 +08:00
hemu.zp
aa561a1818 Support split and merge for megatron_base model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12288423
2023-04-12 16:23:35 +08:00
hemu
305006e18a Merge branch 'master-github' into master-merge-github-0412 2023-04-12 15:51:20 +08:00
chaojie.mcj
283517de08 add efficient tunner modules 2023-04-11 22:26:13 +08:00
shouzhou.bx
467b782799 [to 4.15] add pedestrian attribute recognition model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12288506
2023-04-11 20:46:02 +08:00
xianzhe.xxz
2fe3812f98 add compatibility for torchvision>0.10.0
add compatibility for torchvision>0.10.0
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12292460
2023-04-11 19:59:59 +08:00
yuze.zyz
2c15888084 update test data 2023-04-11 19:33:27 +08:00
yuze.zyz
fb97399ab7 update test data 2023-04-11 18:01:35 +08:00
ly261666
dbdb8c4dca modify face_base_process
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12282698
2023-04-11 15:34:03 +08:00
ly261666
5f6cdf6814 [to #42322933] add damofd model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12261061
2023-04-11 11:08:59 +08:00
tastelikefeet
30b434e95b Add llama to mslib from hf (#254) 2023-04-11 10:17:46 +08:00
hemu.zp
9940994d72 Add multi-modal embedding example for CLIP
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12251820
2023-04-11 10:12:11 +08:00
ly261666
509631ca3b fix face issue:
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12256380
2023-04-10 20:32:43 +08:00
hehong.chh
48fecacf61 fid_dialouge_pipeline新增3.7B模型,修复一些bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12270307
2023-04-10 20:30:44 +08:00
wucong.lyb
fd83ffc0fa modify timestamp config && add function for update_local_model
修改时间戳模型自由组合的参数配置;支持model设置为本地路径时通过参数”update_model“更新模型;
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12261036

    * modify timestamp args

* add update_local_model function

* fix src_path is same with dst_path

* change funasr version
2023-04-10 19:54:11 +08:00
yuze.zyz
4040320346 push to hub
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12235855
2023-04-10 18:17:52 +08:00
hemu.zp
dd16c11f2a Add token classification example for MGeo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12259147
2023-04-10 17:08:35 +08:00
tongmu.wh
41da5d8e90 add speaker model cam++ for speaker verification task damo/speech_campplus_sv_en_voxceleb_16k
说话人识别的新模型,模型库已创建在https://modelscope.cn/models/damo/speech_campplus_sv_en_voxceleb_16k/summary
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12180950
2023-04-10 16:27:13 +08:00
hemu.zp
f0d69c2aa4 Add palm example
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12259265
2023-04-10 14:55:44 +08:00
mushenL
0ef195611a New head support for XlmRoberta model (#259) 2023-04-10 13:44:31 +08:00
tastelikefeet
203a565a39 Fix keep printing warnings in pipeline (#251) 2023-04-10 11:30:40 +08:00
Clark
27c1bfadde Fix unused tensorflow import (#249) 2023-04-10 11:11:55 +08:00
yuze.zyz
3a0e512354 Merge branch master-merge-github0406 into master
Title: Merge github to gitlab 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12241110
2023-04-10 10:49:56 +08:00
tastelikefeet
4ecdac5342 compatible with transformers latest version (#246) 2023-04-10 10:42:41 +08:00
chenxujun
94eeaffbf4 Fix some words (#261) 2023-04-10 10:16:59 +08:00
yuze.zyz
1eb0786895 Merge branch 'master' into master-merge-github0406
* master:
  speech kws nearfield training add gradient accumulation config
  add canmt translation model  damo/nlp_canmt_translation_zh2en_large
  [to #41669377] fix import missing
2023-04-09 23:53:37 +08:00
zhangzhicheng.zzc
6cf4867128 bug fixed in plugin
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12261613
2023-04-09 23:49:23 +08:00
tastelikefeet
6dd94ff2bc add first case for gpt3 test (#236) 2023-04-09 21:46:48 +08:00