Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 12:39:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
992 Commits 263 Branches 106 Tags
2a8e6531692b247b73e9dcbd3c0293d8b779cccc
Commit Graph

992 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
mulin.lyh
2a8e653169 [to #46408569]fix: pipeline and trainer user-agent add not replacement. 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10890156

    * [to #46408569]fix: pipeline and trainer user-agent add not replacement.
 2022-11-28 19:45:58 +08:00
wenmeng.zwm
3b78421236 fix: torch.concat compatibility with torch1.8 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10885659
 2022-11-28 19:24:34 +08:00
qianmu.ywh
fc6d0c64bc add image_depth_estimation: model, pipeline, test 
接入图像深度估计模型，新增model、pipeline、test
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10857764
 2022-11-28 18:00:48 +08:00
shiyi.zxh
b386a4ee50 adapt to different wav input 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10886461
 2022-11-28 17:48:10 +08:00
mulin.lyh
a4c36a2920 [to #46273042]feat: pipeline trainer stat information from snapshot_download 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10837490
 2022-11-28 15:06:03 +08:00
Yingda Chen
d5ee8aa66d move long-running test to level 2 2022-11-28 13:50:28 +08:00
shichen.fsc
acb8d36699 [to #42322933] add extractive-summarization and topic-segmentation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10856839
 2022-11-25 19:29:02 +08:00
jiangyu.xzy
2b62084146 add funasr based asr inference 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10868583
 2022-11-25 17:49:24 +08:00
xingjun.wxj
7b167861a4 [to #42322933] add features for alimeeting competition dataset 
1. add ExternalDataset methods for csv/txt/json/jsonl files on the oss storage
2. add user-define delimiter for csv in meta.
3. supports internal dataset
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib
 2022-11-25 17:48:19 +08:00
bin.xue
1969c3a1db test: add new demo data 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10872422
 2022-11-25 17:31:59 +08:00
shiyi.zxh
7661470350 ofa增加asr任务 
ofa增加asr任务infer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10761019
 2022-11-25 12:16:33 +08:00
Yingda Chen
f5e84a5149 modifiy copyright header 2022-11-25 09:44:01 +08:00
lulu.lcq
ff171500bb [to #42322933] add dpm-solver for diffusion models 
为diffusion模型加入dpm solver支持，相比ddim scheduler快2～6倍。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10826722
 2022-11-25 09:42:48 +08:00
mulin.lyh
24b12698aa [to #46342279]fix: fix some time test_skin_retouching.py failed 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10851834

    * [to #46342279]fix: fix some time test_skin_retouching.py failed
 2022-11-24 16:05:36 +08:00
mulin.lyh
70deb0190b [to #46289830]feat: hub sdk support retry and continue-download after error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10814720
 2022-11-24 15:01:24 +08:00
zhangzhicheng.zzc
7fc49e5fa0 support table recognition task 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10773667
 2022-11-24 14:49:58 +08:00
wenmeng.zwm
7c0d7f872c [to 43878347] support batch inference in pipeline 
It is recommented that each pipleine should implement `_batch`  to make a list of preprocessed data into a batched data dict.

Then  by paasing batch_size=n  we can use batch inference in pipline, for example
```python
img_captioning = pipeline(
            Tasks.image_captioning,
            model='damo/ofa_image-caption_coco_large_en')

results = img_captioning(
            [{
                'image': 'data/test/images/image_captioning.png'
            } for _ in range(6)],
            batch_size=2)
```

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10051193
 2022-11-24 14:31:00 +08:00
wendi.hwd
ff55bd9436 support camouflaged-detection 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10834768
 2022-11-24 10:24:05 +08:00
liugao.lg
31689a0139 merge master& add multi-gpu for ofa 
新增对ofa多GPU训练的支持
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10838906
 2022-11-23 19:08:39 +08:00
xianzhe.xxz
9da5091d4d add damoyolo-t & damoyolo-m 
1. add damoyolo-t & damoyolo-m models
2. fix the configuration overlap error
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10816561
 2022-11-23 09:27:16 +08:00
zhangzhicheng.zzc
5f719e542b [to #42322933] add nlp/addr/structure and update token classificaiton related method 2022-11-21 16:14:53 +08:00
Yingda Chen
0451b3d3cb rename some constants 2022-11-18 13:17:30 +08:00
yingda.chen
9ad831f5c1 revert stat collection 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10780767
 2022-11-17 23:54:32 +08:00
mulin.lyh
f1ef4d8d9f [to #46219277]fix pre-commit pycqa flake8 to github 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10778739

    * [to #46219277]fix pre-commit pycqa flake8 to github
 2022-11-17 21:02:14 +08:00
leyuan.hjy
1a127ed997 fix outputs none 
fix 输出为空的情况
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10725840
 2022-11-17 18:11:40 +08:00
zhangzhicheng.zzc
ed9d2b5436 bug fixed in token classification postprecessor 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10763022

    * [fix sequence labeling postprocess bug]
 2022-11-17 18:11:04 +08:00
mulin.lyh
90a5efa1c2 [to #46106568]feat: parallel run ci case 2022-11-17 08:51:23 +08:00
shuying.shu
10926a06d4 fix bug for downloading hugging face pretrained model http error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10750369
 2022-11-16 20:30:03 +08:00
bin.xue
3798677395 [to #42322933] bug fix: deadlock when setting the thread number up to 90 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10743508

* fix: load model directly from .pth
 2022-11-16 18:39:40 +08:00
james.wjg
541e460f8b add support for cv/language_guided_video_summarization 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10636269
 2022-11-16 15:20:26 +08:00
wenmeng.zwm
e5980492a1 make mglm isolated test because mpu init problem 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10728515

    * make mglm isolated test because mpu init problem
 2022-11-15 13:39:41 +08:00
xiangpeng.wxp
d6ea41fb70 [to #42322933] solve memory error for translation finetune 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10713843

    * [to #42322933] solve memory error for translation finetune
 2022-11-14 20:31:29 +08:00
yingda.chen
4e4faa9a30 specifiy file encoding when open text for read 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10708723
 2022-11-14 14:16:08 +08:00
huizheng.hz
2fe5203571 reduce image denoising test time 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10712244
 2022-11-14 12:30:36 +08:00
yingda.chen
e970a6eb43 move opencv dependency from framwork to cv 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10708368
 2022-11-12 20:09:48 +08:00
mulin.lyh
c6e575458a [to #45878116]feat: run linter test first 
提高ci效率，先跑linter，linter错误先报漏出来，不用合并release
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10596907

    * [to #45878116]feat: run linter test first
 2022-11-11 16:19:14 +08:00
mulin.lyh
eb37921ad6 [to #45915958]feat: v1.0.2 docker file update, add deepspeed, apex, uncore 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10617428
 2022-11-11 11:03:00 +08:00
zfm104435
08327d5af9 在modelscope 基础镜像中添加 jupyter lab 插件，支持静默关闭功能 
在modelscope 基础镜像中添加 jupyter lab 插件，用于收集用户在notebook 中的鼠标、键盘事件，来支持静默关闭功能。
主要改变如下：
1. 新增jupyterlab_active_log 插件的源码和编译后的文件
2. 修改Dockerfile.ubuntu 文件，将上述源码文件拷贝的jupyter的插件目录中。
3. 修改pip和conda 的镜像地址为阿里云的
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10690152
 2022-11-10 22:10:13 +08:00
shuying.shu
085acc64c8 fix bug and change unittest mode 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10680402
 2022-11-10 13:09:56 +08:00
caorongyu.cry
e2a9695f93 [to #42322933] add synonym 
主要做了如下修改：
1. 加入了同义词词典
2. 对SQL进行后处理，如果包含排序，则将空列转化成Primary列
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10670121
 2022-11-08 22:20:03 +08:00
hemu.zp
0f0fdcae6f [to #42322933] Fix bug for mplug evaluation 
修复了 mplug evaluation 使用了错误的 metrics 的问题，将部分中文处理代码独立到 utils 中，为 mplug 添加 trainer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10612875
 2022-11-08 17:58:03 +08:00
Yingda Chen
57499c248c [to #42322933] update readme 2022-11-08 16:06:03 +08:00
zhangzhicheng.zzc
d3519bcbca [to #42322933]token preprocess bug fix 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10608664
 2022-11-08 15:42:08 +08:00
hemu.zp
dc1b88b396 [to #42322933] Fix bug for distributed gpt3 
修复 Pipeline 更新后 DistributedGPT3Pipeline 出现的报错
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10614071
 2022-11-08 14:05:01 +08:00
yingda.chen
fa974fdc27 Merge branch ofa/task_finetune into master 
Title: [to #42322933]add finetune & merge master 

新增ofa其它任务的finetune能力
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10656541
 2022-11-08 13:01:22 +08:00
翎航
fd4276ad1a add five finetune task & merge master 2022-11-08 10:57:22 +08:00
翎航
3534970709 add five finetune task & merge master 2022-11-08 10:39:59 +08:00
翎航
a02b2409d8 add five finetune task & merge master 2022-11-08 10:39:45 +08:00
翎航
04377cfd79 Merge branch 'master' into tmp 
the new master
 2022-11-08 10:36:27 +08:00
yingda.chen
69d41ee413 Merge branch feat/fix_lazy_import_bug_in_text_cls_pipeline into master 
Title: [to #42322933] Fix lazy importing problem in text classification pipeline 

1.  Fix lazy importing problem in text classification pipeline
2.  Ignore some regressing discrepancies caused by variable versions of transformers
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10614286
 2022-11-08 10:07:15 +08:00