Commit Graph

1642 Commits

Author SHA1 Message Date
bin.xue
6d68f0ea64 [to #42322933] add ONNX exporter for ans dfsmn 2023-04-28 10:33:32 +08:00
chenyafeng.cyf
93f73a26e7 add rdino model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12406691
2023-04-26 11:18:28 +08:00
zhangzhicheng.zzc
1719ecad03 stable diffusion allow postprocess kwargs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12418063
* stable diffusion allow postprocess kwargs
2023-04-21 18:34:29 +08:00
yuanzhi.zyz
b19cc13ca7 update ocr_reco
1. 增加本地lmdb输入的接口;
2. finetune后模型的keys有prefix,导致不能直接读取,已在model初始化时统一替换;
3. 添加各个模型的cpu和gpu测试。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12256669
* add local_lmdb read
2023-04-21 15:05:16 +08:00
xingjun.wxj
92f7c66d12 Add progress bar and fix cache dir issue
1. Add progress bar for dataframe apply when downloading data files.
2. Fix cache data files issue
3. Refine _prepare_and_download() func

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12408412
* add progress bar and fix cache dir

* add progress bar and fix cache dir

* refine code
2023-04-21 13:49:17 +08:00
bin.xue
dd4299e0c8 [to #42322933] add DFSMN model to far field KWS
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12334627
* feat: set stream mode in constructor

* fix: commit model file

* doc: add more information about DFSMN

* fix: seperation model evaluate returns None in speechbrain whose version < 0.5.12
2023-04-20 22:45:07 +08:00
guangpan.cd
8debc432cf Quick fix to ChineseStableDiffusion meta tensor bug.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12382517
* Quick fix to ChineseStableDiffusion meta tensor bug.
2023-04-19 17:11:25 +08:00
mulin.lyh
8ea82e6f6d * add lfs append 2023-04-18 20:32:11 +08:00
xingjun.wxj
976bdf4ebc Add virgo hub
1. Add Hubs.virgo in MsDataset.load()
2. Add VirgoDownloader pipeline
3. Add auth for virgo hub.
4. Add other utils.
5. cherry-pick from https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12352198?file=8c317278a40b19fe76825fb749e768fdbfd6a711

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12351633
2023-04-18 17:01:43 +08:00
shuying.shu
a355eefbd4 fix OOM for bassl
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12354474
2023-04-18 14:43:09 +08:00
biwen.lbw
3033e54d5e update test data
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12355868
* update test data
2023-04-18 14:42:09 +08:00
liugao.lg
4225048dbf provide allow_remote
优化模版文件,提升独立repo接入成功率,降低用户阅读文档带来的歧义
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12354329
* provide allow_remote
2023-04-18 14:41:51 +08:00
zhifu.gzf
a40c6f452e support funasr for mac
增加asr pipeline对于mac支持,在mac上自测没问题
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12341467
2023-04-17 10:17:55 +08:00
hemu.zp
4f300c8632 Fix generate for ModelForTextGeneration
Separate the `generate` function, no longer use the implementation in the transformers library to avoid error due to transformers version upgrades.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12340643
2023-04-16 02:05:41 +08:00
hemu.zp
b3e7eca817 lmit mmdet version
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12339472
2023-04-15 17:08:55 +08:00
yuze.zyz
2650d37094 Fix the log level and return value of push_to_hub
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12338218
2023-04-15 16:42:35 +08:00
hemu.zp
a4bafd8b25 Add requirements for jsonplus
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12331254
2023-04-14 14:05:36 +08:00
zhangzhicheng.zzc
04e8ddc41e fix update ast not remove origin information
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12319197
2023-04-13 16:10:07 +08:00
hehong.chh
10101e08aa skip FidDialogueTest temporarily, due to the model is set to non-public
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12315621
2023-04-13 13:27:25 +08:00
yuze.zyz
87c30bc711 Merge branch master-merge-github-0413 into master
Title: Merge branch 'master-github' into master-merge-github-0413 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12313282
2023-04-13 11:11:05 +08:00
hemu
9f2f1c066a change file names 2023-04-13 10:41:18 +08:00
hemu
672f25266f Merge branch 'master-github' into master-merge-github-0413 2023-04-13 10:32:01 +08:00
slin000111
92d7eae5b9 add token classification example and gpt3 one layer test (#268) 2023-04-13 10:21:00 +08:00
yuze.zyz
d48e436ae2 [Bug Fix] Fix losing files
1. Recommit and merge losing files on push-to-hub feature
2. Fix a failure to build a int tensor with float values
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12308629
2023-04-13 10:08:23 +08:00
zhangzhicheng.zzc
afdea20e39 plugin support trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12311477
* add plugin import before build trainer
2023-04-13 10:06:44 +08:00
hemu.zp
4e78f611e6 Add sortedcontainers to requirements
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12310786
2023-04-12 22:26:56 +08:00
zhangzhicheng.zzc
522b2ed08f plugin add modelscope source
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12306018
2023-04-12 20:38:13 +08:00
yuze.zyz
1f95021bc4 bump master version to 1.5.0 2023-04-12 19:33:46 +08:00
hemu.zp
7b4a0ea02c Merge branch master-merge-github-0412 into master
Title: Merge branch 'master-merge-github-0412' into master 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12304662
2023-04-12 19:16:11 +08:00
hemu.zp
aa561a1818 Support split and merge for megatron_base model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12288423
2023-04-12 16:23:35 +08:00
hemu
305006e18a Merge branch 'master-github' into master-merge-github-0412 2023-04-12 15:51:20 +08:00
chaojie.mcj
283517de08 add efficient tunner modules 2023-04-11 22:26:13 +08:00
shouzhou.bx
467b782799 [to 4.15] add pedestrian attribute recognition model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12288506
2023-04-11 20:46:02 +08:00
xianzhe.xxz
2fe3812f98 add compatibility for torchvision>0.10.0
add compatibility for torchvision>0.10.0
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12292460
2023-04-11 19:59:59 +08:00
yuze.zyz
2c15888084 update test data 2023-04-11 19:33:27 +08:00
yuze.zyz
fb97399ab7 update test data 2023-04-11 18:01:35 +08:00
ly261666
dbdb8c4dca modify face_base_process
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12282698
2023-04-11 15:34:03 +08:00
ly261666
5f6cdf6814 [to #42322933] add damofd model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12261061
2023-04-11 11:08:59 +08:00
tastelikefeet
30b434e95b Add llama to mslib from hf (#254) 2023-04-11 10:17:46 +08:00
hemu.zp
9940994d72 Add multi-modal embedding example for CLIP
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12251820
2023-04-11 10:12:11 +08:00
ly261666
509631ca3b fix face issue:
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12256380
2023-04-10 20:32:43 +08:00
hehong.chh
48fecacf61 fid_dialouge_pipeline新增3.7B模型,修复一些bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12270307
2023-04-10 20:30:44 +08:00
wucong.lyb
fd83ffc0fa modify timestamp config && add function for update_local_model
修改时间戳模型自由组合的参数配置;支持model设置为本地路径时通过参数”update_model“更新模型;
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12261036

    * modify timestamp args

* add update_local_model function

* fix src_path is same with dst_path

* change funasr version
2023-04-10 19:54:11 +08:00
yuze.zyz
4040320346 push to hub
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12235855
2023-04-10 18:17:52 +08:00
hemu.zp
dd16c11f2a Add token classification example for MGeo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12259147
2023-04-10 17:08:35 +08:00
tongmu.wh
41da5d8e90 add speaker model cam++ for speaker verification task damo/speech_campplus_sv_en_voxceleb_16k
说话人识别的新模型,模型库已创建在https://modelscope.cn/models/damo/speech_campplus_sv_en_voxceleb_16k/summary
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12180950
2023-04-10 16:27:13 +08:00
hemu.zp
f0d69c2aa4 Add palm example
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12259265
2023-04-10 14:55:44 +08:00
mushenL
0ef195611a New head support for XlmRoberta model (#259) 2023-04-10 13:44:31 +08:00
tastelikefeet
203a565a39 Fix keep printing warnings in pipeline (#251) 2023-04-10 11:30:40 +08:00
Clark
27c1bfadde Fix unused tensorflow import (#249) 2023-04-10 11:11:55 +08:00