Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 12:39:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
987 Commits 263 Branches 106 Tags
d5ee8aa66d4ea6c42f463a9db3a6f198c2ecc3fc
Commit Graph

987 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Yingda Chen
d5ee8aa66d move long-running test to level 2 2022-11-28 13:50:28 +08:00
shichen.fsc
acb8d36699 [to #42322933] add extractive-summarization and topic-segmentation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10856839
 2022-11-25 19:29:02 +08:00
jiangyu.xzy
2b62084146 add funasr based asr inference 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10868583
 2022-11-25 17:49:24 +08:00
xingjun.wxj
7b167861a4 [to #42322933] add features for alimeeting competition dataset 
1. add ExternalDataset methods for csv/txt/json/jsonl files on the oss storage
2. add user-define delimiter for csv in meta.
3. supports internal dataset
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib
 2022-11-25 17:48:19 +08:00
bin.xue
1969c3a1db test: add new demo data 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10872422
 2022-11-25 17:31:59 +08:00
shiyi.zxh
7661470350 ofa增加asr任务 
ofa增加asr任务infer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10761019
 2022-11-25 12:16:33 +08:00
Yingda Chen
f5e84a5149 modifiy copyright header 2022-11-25 09:44:01 +08:00
lulu.lcq
ff171500bb [to #42322933] add dpm-solver for diffusion models 
为diffusion模型加入dpm solver支持，相比ddim scheduler快2～6倍。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10826722
 2022-11-25 09:42:48 +08:00
mulin.lyh
24b12698aa [to #46342279]fix: fix some time test_skin_retouching.py failed 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10851834

    * [to #46342279]fix: fix some time test_skin_retouching.py failed
 2022-11-24 16:05:36 +08:00
mulin.lyh
70deb0190b [to #46289830]feat: hub sdk support retry and continue-download after error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10814720
 2022-11-24 15:01:24 +08:00
zhangzhicheng.zzc
7fc49e5fa0 support table recognition task 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10773667
 2022-11-24 14:49:58 +08:00
wenmeng.zwm
7c0d7f872c [to 43878347] support batch inference in pipeline 
It is recommented that each pipleine should implement `_batch`  to make a list of preprocessed data into a batched data dict.

Then  by paasing batch_size=n  we can use batch inference in pipline, for example
```python
img_captioning = pipeline(
            Tasks.image_captioning,
            model='damo/ofa_image-caption_coco_large_en')

results = img_captioning(
            [{
                'image': 'data/test/images/image_captioning.png'
            } for _ in range(6)],
            batch_size=2)
```

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10051193
 2022-11-24 14:31:00 +08:00
wendi.hwd
ff55bd9436 support camouflaged-detection 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10834768
 2022-11-24 10:24:05 +08:00
liugao.lg
31689a0139 merge master& add multi-gpu for ofa 
新增对ofa多GPU训练的支持
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10838906
 2022-11-23 19:08:39 +08:00
xianzhe.xxz
9da5091d4d add damoyolo-t & damoyolo-m 
1. add damoyolo-t & damoyolo-m models
2. fix the configuration overlap error
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10816561
 2022-11-23 09:27:16 +08:00
zhangzhicheng.zzc
5f719e542b [to #42322933] add nlp/addr/structure and update token classificaiton related method 2022-11-21 16:14:53 +08:00
Yingda Chen
0451b3d3cb rename some constants 2022-11-18 13:17:30 +08:00
yingda.chen
9ad831f5c1 revert stat collection 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10780767
 2022-11-17 23:54:32 +08:00
mulin.lyh
f1ef4d8d9f [to #46219277]fix pre-commit pycqa flake8 to github 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10778739

    * [to #46219277]fix pre-commit pycqa flake8 to github
 2022-11-17 21:02:14 +08:00
leyuan.hjy
1a127ed997 fix outputs none 
fix 输出为空的情况
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10725840
 2022-11-17 18:11:40 +08:00
zhangzhicheng.zzc
ed9d2b5436 bug fixed in token classification postprecessor 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10763022

    * [fix sequence labeling postprocess bug]
 2022-11-17 18:11:04 +08:00
mulin.lyh
90a5efa1c2 [to #46106568]feat: parallel run ci case 2022-11-17 08:51:23 +08:00
shuying.shu
10926a06d4 fix bug for downloading hugging face pretrained model http error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10750369
 2022-11-16 20:30:03 +08:00
bin.xue
3798677395 [to #42322933] bug fix: deadlock when setting the thread number up to 90 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10743508

* fix: load model directly from .pth
 2022-11-16 18:39:40 +08:00
james.wjg
541e460f8b add support for cv/language_guided_video_summarization 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10636269
 2022-11-16 15:20:26 +08:00
wenmeng.zwm
e5980492a1 make mglm isolated test because mpu init problem 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10728515

    * make mglm isolated test because mpu init problem
 2022-11-15 13:39:41 +08:00
xiangpeng.wxp
d6ea41fb70 [to #42322933] solve memory error for translation finetune 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10713843

    * [to #42322933] solve memory error for translation finetune
 2022-11-14 20:31:29 +08:00
yingda.chen
4e4faa9a30 specifiy file encoding when open text for read 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10708723
 2022-11-14 14:16:08 +08:00
huizheng.hz
2fe5203571 reduce image denoising test time 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10712244
 2022-11-14 12:30:36 +08:00
yingda.chen
e970a6eb43 move opencv dependency from framwork to cv 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10708368
 2022-11-12 20:09:48 +08:00
mulin.lyh
c6e575458a [to #45878116]feat: run linter test first 
提高ci效率，先跑linter，linter错误先报漏出来，不用合并release
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10596907

    * [to #45878116]feat: run linter test first
 2022-11-11 16:19:14 +08:00
mulin.lyh
eb37921ad6 [to #45915958]feat: v1.0.2 docker file update, add deepspeed, apex, uncore 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10617428
 2022-11-11 11:03:00 +08:00
zfm104435
08327d5af9 在modelscope 基础镜像中添加 jupyter lab 插件，支持静默关闭功能 
在modelscope 基础镜像中添加 jupyter lab 插件，用于收集用户在notebook 中的鼠标、键盘事件，来支持静默关闭功能。
主要改变如下：
1. 新增jupyterlab_active_log 插件的源码和编译后的文件
2. 修改Dockerfile.ubuntu 文件，将上述源码文件拷贝的jupyter的插件目录中。
3. 修改pip和conda 的镜像地址为阿里云的
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10690152
 2022-11-10 22:10:13 +08:00
shuying.shu
085acc64c8 fix bug and change unittest mode 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10680402
 2022-11-10 13:09:56 +08:00
caorongyu.cry
e2a9695f93 [to #42322933] add synonym 
主要做了如下修改：
1. 加入了同义词词典
2. 对SQL进行后处理，如果包含排序，则将空列转化成Primary列
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10670121
 2022-11-08 22:20:03 +08:00
hemu.zp
0f0fdcae6f [to #42322933] Fix bug for mplug evaluation 
修复了 mplug evaluation 使用了错误的 metrics 的问题，将部分中文处理代码独立到 utils 中，为 mplug 添加 trainer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10612875
 2022-11-08 17:58:03 +08:00
Yingda Chen
57499c248c [to #42322933] update readme 2022-11-08 16:06:03 +08:00
zhangzhicheng.zzc
d3519bcbca [to #42322933]token preprocess bug fix 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10608664
 2022-11-08 15:42:08 +08:00
hemu.zp
dc1b88b396 [to #42322933] Fix bug for distributed gpt3 
修复 Pipeline 更新后 DistributedGPT3Pipeline 出现的报错
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10614071
 2022-11-08 14:05:01 +08:00
yingda.chen
fa974fdc27 Merge branch ofa/task_finetune into master 
Title: [to #42322933]add finetune & merge master 

新增ofa其它任务的finetune能力
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10656541
 2022-11-08 13:01:22 +08:00
翎航
fd4276ad1a add five finetune task & merge master 2022-11-08 10:57:22 +08:00
翎航
3534970709 add five finetune task & merge master 2022-11-08 10:39:59 +08:00
翎航
a02b2409d8 add five finetune task & merge master 2022-11-08 10:39:45 +08:00
翎航
04377cfd79 Merge branch 'master' into tmp 
the new master
 2022-11-08 10:36:27 +08:00
yingda.chen
69d41ee413 Merge branch feat/fix_lazy_import_bug_in_text_cls_pipeline into master 
Title: [to #42322933] Fix lazy importing problem in text classification pipeline 

1.  Fix lazy importing problem in text classification pipeline
2.  Ignore some regressing discrepancies caused by variable versions of transformers
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10614286
 2022-11-08 10:07:15 +08:00
翎航
eb82ba9c6f add finetune & merge master 2022-11-07 20:30:18 +08:00
翎航
0418786cbe add five task finetune 2022-11-07 20:23:17 +08:00
yingda.chen
adc7b95273 Merge branch cv/fix_3d_body_keypoints into master 
Title: [to #42322933]修复特殊测试视频导致人体检测失败，返回视频路径失败的问题 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10640171
 2022-11-07 13:19:28 +08:00
hanyuan.chy
292a75f5cd Merge remote-tracking branch 'origin/master' into cv/fix_3d_body_keypoints 2022-11-04 09:33:47 +00:00
hanyuan.chy
26db21d57d fix output video path when person detect failed. 2022-11-04 09:33:09 +00:00