Commit Graph

1638 Commits

Author SHA1 Message Date
xingjun.wxj
92f7c66d12 Add progress bar and fix cache dir issue
1. Add progress bar for dataframe apply when downloading data files.
2. Fix cache data files issue
3. Refine _prepare_and_download() func

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12408412
* add progress bar and fix cache dir

* add progress bar and fix cache dir

* refine code
2023-04-21 13:49:17 +08:00
bin.xue
dd4299e0c8 [to #42322933] add DFSMN model to far field KWS
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12334627
* feat: set stream mode in constructor

* fix: commit model file

* doc: add more information about DFSMN

* fix: seperation model evaluate returns None in speechbrain whose version < 0.5.12
2023-04-20 22:45:07 +08:00
guangpan.cd
8debc432cf Quick fix to ChineseStableDiffusion meta tensor bug.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12382517
* Quick fix to ChineseStableDiffusion meta tensor bug.
2023-04-19 17:11:25 +08:00
mulin.lyh
8ea82e6f6d * add lfs append 2023-04-18 20:32:11 +08:00
xingjun.wxj
976bdf4ebc Add virgo hub
1. Add Hubs.virgo in MsDataset.load()
2. Add VirgoDownloader pipeline
3. Add auth for virgo hub.
4. Add other utils.
5. cherry-pick from https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12352198?file=8c317278a40b19fe76825fb749e768fdbfd6a711

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12351633
2023-04-18 17:01:43 +08:00
shuying.shu
a355eefbd4 fix OOM for bassl
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12354474
2023-04-18 14:43:09 +08:00
biwen.lbw
3033e54d5e update test data
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12355868
* update test data
2023-04-18 14:42:09 +08:00
liugao.lg
4225048dbf provide allow_remote
优化模版文件,提升独立repo接入成功率,降低用户阅读文档带来的歧义
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12354329
* provide allow_remote
2023-04-18 14:41:51 +08:00
zhifu.gzf
a40c6f452e support funasr for mac
增加asr pipeline对于mac支持,在mac上自测没问题
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12341467
2023-04-17 10:17:55 +08:00
hemu.zp
4f300c8632 Fix generate for ModelForTextGeneration
Separate the `generate` function, no longer use the implementation in the transformers library to avoid error due to transformers version upgrades.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12340643
2023-04-16 02:05:41 +08:00
hemu.zp
b3e7eca817 lmit mmdet version
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12339472
2023-04-15 17:08:55 +08:00
yuze.zyz
2650d37094 Fix the log level and return value of push_to_hub
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12338218
2023-04-15 16:42:35 +08:00
hemu.zp
a4bafd8b25 Add requirements for jsonplus
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12331254
2023-04-14 14:05:36 +08:00
zhangzhicheng.zzc
04e8ddc41e fix update ast not remove origin information
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12319197
2023-04-13 16:10:07 +08:00
hehong.chh
10101e08aa skip FidDialogueTest temporarily, due to the model is set to non-public
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12315621
2023-04-13 13:27:25 +08:00
yuze.zyz
87c30bc711 Merge branch master-merge-github-0413 into master
Title: Merge branch 'master-github' into master-merge-github-0413 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12313282
2023-04-13 11:11:05 +08:00
hemu
9f2f1c066a change file names 2023-04-13 10:41:18 +08:00
hemu
672f25266f Merge branch 'master-github' into master-merge-github-0413 2023-04-13 10:32:01 +08:00
slin000111
92d7eae5b9 add token classification example and gpt3 one layer test (#268) 2023-04-13 10:21:00 +08:00
yuze.zyz
d48e436ae2 [Bug Fix] Fix losing files
1. Recommit and merge losing files on push-to-hub feature
2. Fix a failure to build a int tensor with float values
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12308629
2023-04-13 10:08:23 +08:00
zhangzhicheng.zzc
afdea20e39 plugin support trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12311477
* add plugin import before build trainer
2023-04-13 10:06:44 +08:00
hemu.zp
4e78f611e6 Add sortedcontainers to requirements
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12310786
2023-04-12 22:26:56 +08:00
zhangzhicheng.zzc
522b2ed08f plugin add modelscope source
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12306018
2023-04-12 20:38:13 +08:00
yuze.zyz
1f95021bc4 bump master version to 1.5.0 2023-04-12 19:33:46 +08:00
hemu.zp
7b4a0ea02c Merge branch master-merge-github-0412 into master
Title: Merge branch 'master-merge-github-0412' into master 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12304662
2023-04-12 19:16:11 +08:00
hemu.zp
aa561a1818 Support split and merge for megatron_base model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12288423
2023-04-12 16:23:35 +08:00
hemu
305006e18a Merge branch 'master-github' into master-merge-github-0412 2023-04-12 15:51:20 +08:00
chaojie.mcj
283517de08 add efficient tunner modules 2023-04-11 22:26:13 +08:00
shouzhou.bx
467b782799 [to 4.15] add pedestrian attribute recognition model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12288506
2023-04-11 20:46:02 +08:00
xianzhe.xxz
2fe3812f98 add compatibility for torchvision>0.10.0
add compatibility for torchvision>0.10.0
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12292460
2023-04-11 19:59:59 +08:00
yuze.zyz
2c15888084 update test data 2023-04-11 19:33:27 +08:00
yuze.zyz
fb97399ab7 update test data 2023-04-11 18:01:35 +08:00
ly261666
dbdb8c4dca modify face_base_process
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12282698
2023-04-11 15:34:03 +08:00
ly261666
5f6cdf6814 [to #42322933] add damofd model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12261061
2023-04-11 11:08:59 +08:00
tastelikefeet
30b434e95b Add llama to mslib from hf (#254) 2023-04-11 10:17:46 +08:00
hemu.zp
9940994d72 Add multi-modal embedding example for CLIP
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12251820
2023-04-11 10:12:11 +08:00
ly261666
509631ca3b fix face issue:
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12256380
2023-04-10 20:32:43 +08:00
hehong.chh
48fecacf61 fid_dialouge_pipeline新增3.7B模型,修复一些bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12270307
2023-04-10 20:30:44 +08:00
wucong.lyb
fd83ffc0fa modify timestamp config && add function for update_local_model
修改时间戳模型自由组合的参数配置;支持model设置为本地路径时通过参数”update_model“更新模型;
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12261036

    * modify timestamp args

* add update_local_model function

* fix src_path is same with dst_path

* change funasr version
2023-04-10 19:54:11 +08:00
yuze.zyz
4040320346 push to hub
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12235855
2023-04-10 18:17:52 +08:00
hemu.zp
dd16c11f2a Add token classification example for MGeo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12259147
2023-04-10 17:08:35 +08:00
tongmu.wh
41da5d8e90 add speaker model cam++ for speaker verification task damo/speech_campplus_sv_en_voxceleb_16k
说话人识别的新模型,模型库已创建在https://modelscope.cn/models/damo/speech_campplus_sv_en_voxceleb_16k/summary
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12180950
2023-04-10 16:27:13 +08:00
hemu.zp
f0d69c2aa4 Add palm example
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12259265
2023-04-10 14:55:44 +08:00
mushenL
0ef195611a New head support for XlmRoberta model (#259) 2023-04-10 13:44:31 +08:00
tastelikefeet
203a565a39 Fix keep printing warnings in pipeline (#251) 2023-04-10 11:30:40 +08:00
Clark
27c1bfadde Fix unused tensorflow import (#249) 2023-04-10 11:11:55 +08:00
yuze.zyz
3a0e512354 Merge branch master-merge-github0406 into master
Title: Merge github to gitlab 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12241110
2023-04-10 10:49:56 +08:00
tastelikefeet
4ecdac5342 compatible with transformers latest version (#246) 2023-04-10 10:42:41 +08:00
chenxujun
94eeaffbf4 Fix some words (#261) 2023-04-10 10:16:59 +08:00
yuze.zyz
1eb0786895 Merge branch 'master' into master-merge-github0406
* master:
  speech kws nearfield training add gradient accumulation config
  add canmt translation model  damo/nlp_canmt_translation_zh2en_large
  [to #41669377] fix import missing
2023-04-09 23:53:37 +08:00