Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-24 12:10:09 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,771 Commits 267 Branches 107 Tags
fix/scan_cache_log
Commit Graph

1182 Commits

Author SHA1 Message Date
hejunjie.hjj
1cd67ef060 [to #42322933] add cvpr23 fastinst model 2023-05-12 17:51:00 +08:00
xingjun.wang
92270f5f23 ok Merge branch 'dev/merge_github_master_0512' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into dev/merge_github_master_0512 2023-05-12 17:32:46 +08:00
xingjun.wxj
e630621599 Virgo SDK supports odps data source 
1. Support ODPS datasource for virgo sdk.
2. Adapt "inner_url" parser for single-modal and multi-modal datasets.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12583695

* add virgo sdk odps data

* refine virgo sdk args and odps fetch batch data pipeline

* add inner import for odps

* del import VirgoDataset in MsDataset

* fix import VirgoDataset

* support inner url downloading

* refine dataset.py and maxcompute_utils.py

* add ut for virgo odps data batch

* reset unifold ut level as 1

* refine virgo batch data
 2023-05-12 17:27:19 +08:00
xingjun.wxj
cafc90da21 Fix master UT on level0 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12599393

* reset ut level for test_run_with_model_name_for_unite_large and test_run_with_model_name_for_unite_base

* fix master UT for level0

* update EasyCVFace2DKeypointsPipelineTest skip info
 2023-05-12 17:25:32 +08:00
xingjun.wang
0cf0ac2112 merge master 2023-05-12 17:13:10 +08:00
wangmeng.xwm
f0d519219f add clip_interrogator 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12388571

* init commit of clip_interrogator

* fix format

* fix environment dependencies

* fix backend.mps

* fix test image path

* add model introduction and paper link

* add comment example for pipeline, fix device control
 2023-05-12 16:06:52 +08:00
wanyu.wy
58df448182 Add trainer for UniTE 2023-05-11 14:41:08 +08:00
mulin.lyh
7b14a0e11f Pipeline input, output and parameter normalization. 2023-05-11 11:20:01 +08:00
hehong.chh
b80c13036f fix bug: hypotheses did't init in cpu device、make fid_dialogue_test available 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12406082
 2023-05-10 11:10:31 +08:00
Li Tong
626b60e8c2 fix issue: Batch and single are not uniform #215 (#258) 
* fix issue: Batch and single are not uniform #215, https://github.com/modelscope/modelscope/issues/215

* remove extra code

* fix bug

* update test

---------

Co-authored-by: ezeli.lt <ezeli.lt@alibaba-inc.com>
Co-authored-by: hemu <hemu.zp@alibaba-inc.com>
 2023-05-10 10:49:54 +08:00
ly261666
bdd282a127 [to #42322933] add transface model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12568301
 2023-05-10 01:04:10 +08:00
jiangnana.jnn
46072898da remove easycv codes, plugin access 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11965727

* remove easycv codes

* fix custome msdatasets import and remove metainfo

* fix pipeline imports

* fix pre-check

* fix models import

* fix pre-check

* merge master
 2023-05-09 17:58:01 +08:00
bin.xue
6d68f0ea64 [to #42322933] add ONNX exporter for ans dfsmn 2023-04-28 10:33:32 +08:00
chenyafeng.cyf
93f73a26e7 add rdino model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12406691
 2023-04-26 11:18:28 +08:00
yuanzhi.zyz
b19cc13ca7 update ocr_reco 
1. 增加本地lmdb输入的接口；
2. finetune后模型的keys有prefix，导致不能直接读取，已在model初始化时统一替换；
3. 添加各个模型的cpu和gpu测试。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12256669
* add local_lmdb read
 2023-04-21 15:05:16 +08:00
xingjun.wxj
92f7c66d12 Add progress bar and fix cache dir issue 
1. Add progress bar for dataframe apply when downloading data files.
2. Fix cache data files issue
3. Refine _prepare_and_download() func

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12408412
* add progress bar and fix cache dir

* add progress bar and fix cache dir

* refine code
 2023-04-21 13:49:17 +08:00
bin.xue
dd4299e0c8 [to #42322933] add DFSMN model to far field KWS 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12334627
* feat: set stream mode in constructor

* fix: commit model file

* doc: add more information about DFSMN

* fix: seperation model evaluate returns None in speechbrain whose version < 0.5.12
 2023-04-20 22:45:07 +08:00
mulin.lyh
8ea82e6f6d * add lfs append 2023-04-18 20:32:11 +08:00
xingjun.wxj
976bdf4ebc Add virgo hub 
1. Add Hubs.virgo in MsDataset.load()
2. Add VirgoDownloader pipeline
3. Add auth for virgo hub.
4. Add other utils.
5. cherry-pick from https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12352198?file=8c317278a40b19fe76825fb749e768fdbfd6a711

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12351633
 2023-04-18 17:01:43 +08:00
hemu.zp
4f300c8632 Fix generate for ModelForTextGeneration 
Separate the `generate` function, no longer use the implementation in the transformers library to avoid error due to transformers version upgrades.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12340643
 2023-04-16 02:05:41 +08:00
yuze.zyz
2650d37094 Fix the log level and return value of push_to_hub 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12338218
 2023-04-15 16:42:35 +08:00
zhangzhicheng.zzc
04e8ddc41e fix update ast not remove origin information 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12319197
 2023-04-13 16:10:07 +08:00
hehong.chh
10101e08aa skip FidDialogueTest temporarily, due to the model is set to non-public 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12315621
 2023-04-13 13:27:25 +08:00
hemu
672f25266f Merge branch 'master-github' into master-merge-github-0413 2023-04-13 10:32:01 +08:00
slin000111
92d7eae5b9 add token classification example and gpt3 one layer test (#268) 2023-04-13 10:21:00 +08:00
hemu.zp
7b4a0ea02c Merge branch master-merge-github-0412 into master 
Title: Merge branch 'master-merge-github-0412' into master 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12304662
 2023-04-12 19:16:11 +08:00
hemu.zp
aa561a1818 Support split and merge for megatron_base model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12288423
 2023-04-12 16:23:35 +08:00
hemu
305006e18a Merge branch 'master-github' into master-merge-github-0412 2023-04-12 15:51:20 +08:00
chaojie.mcj
283517de08 add efficient tunner modules 2023-04-11 22:26:13 +08:00
shouzhou.bx
467b782799 [to 4.15] add pedestrian attribute recognition model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12288506
 2023-04-11 20:46:02 +08:00
ly261666
5f6cdf6814 [to #42322933] add damofd model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12261061
 2023-04-11 11:08:59 +08:00
ly261666
509631ca3b fix face issue: 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12256380
 2023-04-10 20:32:43 +08:00
hehong.chh
48fecacf61 fid_dialouge_pipeline新增3.7B模型，修复一些bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12270307
 2023-04-10 20:30:44 +08:00
yuze.zyz
4040320346 push to hub 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12235855
 2023-04-10 18:17:52 +08:00
tongmu.wh
41da5d8e90 add speaker model cam++ for speaker verification task damo/speech_campplus_sv_en_voxceleb_16k 
说话人识别的新模型，模型库已创建在https://modelscope.cn/models/damo/speech_campplus_sv_en_voxceleb_16k/summary
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12180950
 2023-04-10 16:27:13 +08:00
yuze.zyz
1eb0786895 Merge branch 'master' into master-merge-github0406 
* master:
  speech kws nearfield training add gradient accumulation config
  add canmt translation model  damo/nlp_canmt_translation_zh2en_large
  [to #41669377] fix import missing
 2023-04-09 23:53:37 +08:00
tastelikefeet
6dd94ff2bc add first case for gpt3 test (#236) 2023-04-09 21:46:48 +08:00
xiaoyi.zp
63d5493962 add canmt translation model damo/nlp_canmt_translation_zh2en_large 
* add canmt translation model
 * add args for decode
 * change nlp_canmt_translation_zh2en_large damo
 * merge master
 * set default model for canmt

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12079906
 2023-04-07 14:37:18 +08:00
yuze.zyz
7b7e772a9f Merge branch 'master-github' into master-merge-github0406 2023-04-06 15:15:37 +08:00
biwen.lbw
9ec8f14f6f update face reconstruction to HRN(CVPR2023) 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12161605

* update to HRN

* update test image

* update results format

* delete useless code & change header

* add comment

* reorganize code
 2023-04-06 14:03:27 +08:00
mulin.lyh
4bae2cf823 temporarily skip hub case 2023-04-04 11:08:19 +08:00
mulin.lyh
af641f7838 temporarily skip hub cases 2023-04-04 06:41:13 +08:00
Zhicheng Zhang
92acca0629 Feat/plugin update (#241) 
* reload pkg resources after installed

* add version test in order to install correct version

* install only uninstalled package from requirements

* support get module name from distribution

* bug fixed

---------

Co-authored-by: Zhicheng Zhang <zhangzhicheng.zzc@alibaba-inc.com>
 2023-03-30 09:00:49 +08:00
kangxiaoyang.kxy
d2fde9248c update image colorization metric 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12073952

* update image colorization metric

* update documentation strings
 2023-03-28 15:14:10 +08:00
wenmeng.zwm
0e9f218f26 Merge branch merge_master_github_0321 into master 
Title: Merge master github to gitlab 

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12064776
 2023-03-23 21:28:55 +08:00
jiangnana.jnn
6f9d59f469 fix jsonplus, support ndarray 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12056076

* fix jsonplus

* add unittest

* fix json dump np float
 2023-03-21 18:10:10 +08:00
tastelikefeet
d3cec46655 Fix faq tests (#217) 2023-03-20 21:16:57 +08:00
xingjun.wxj
4e77f654f5 backward compatible with to_task_dataset function in adaseq repo 
1. backward compatible with to_task_dataset function for DefaultTrainer in adaseq repo
2. fix registry issue for RedsImageDeblurringDataset and GoproImageDeblurringDataset
3. add ut TestCustomDatasetsCompatibility
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11981956
 2023-03-14 18:34:44 +08:00
lllcho.lc
38bcd54ee4 fix bug for install detecron2 
从github安装库有时会因为网络问题导致失败，故改成gitee
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11945563
 2023-03-10 15:14:21 +08:00
yzhao
c505c6027e Merge branch 'master-merge-github20230310' 2023-03-10 14:58:34 +08:00