Commit Graph

666 Commits

Author SHA1 Message Date
行嗔
dbf022efe8 caption finetune done, add belu 2022-09-30 17:44:35 +08:00
行嗔
2fac8e0f76 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-09-30 15:49:41 +08:00
行嗔
ac653594d8 caption finetune done, need add belu 2022-09-30 15:49:21 +08:00
wenmeng.zwm
8be4848de5 [to #44902165] bump version to 0.4.7 2022-09-30 10:18:33 +08:00
wenmeng.zwm
97ffa3a8d2 [to #44902165] update easycv version
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10308804
2022-09-30 10:14:53 +08:00
wenmeng.zwm
af3ae44769 [to #44902165] bump version to 0.4.6 2022-09-29 17:34:39 +08:00
行嗔
a799dd237d remove ofa_file_dataset 2022-09-29 15:26:20 +08:00
行嗔
993b944b65 update 2022-09-28 16:54:41 +08:00
行嗔
a0c57e1538 Merge remote-tracking branch 'origin/master' into ofa/finetune 2022-09-28 16:03:04 +08:00
行嗔
3b09d848ce update 2022-09-28 16:02:28 +08:00
chaojie.mcj
0e52a20d28 [to #42322933]update license
以下算法进行了header变更:
modelscope.models.cv.cmdssl_video_embedding
modelscope.models.cv.action_recognition 
modelscope.models.cv.animal_recognition
modelscope.models.multi_modal.multi_stage_diffusion
modelscope.models.multi_modal.gemm

modelscope.pipelines.cv.live_category_pipeline
modelscope.pipelines.cv.video_category_pipeline
modelscope.models.cv.image_to_image_translation
modelscope.models.cv.image_to_image_generation

modelscope.models.cv.video_inpainting
modelscope.models.multi_modal.diffusion
modelscope.models.multi_modal.team
modelscope.models.cv.shop_segmentation
modelscope.models.cv.text_driven_segmentation
modelscope.models.cv.action_recognition 


modelscope.models.cv.face_emotion
modelscope.models.cv.hand_static
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10268474
2022-09-28 14:30:37 +08:00
mulin.lyh
c51b74c2ea [to #45220645]fix: fix ffmpeg mp4 encoder bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10284398

    * [to #45220645]fix: fix ffmpeg mp4 encoder bug
2022-09-28 13:36:09 +08:00
Yingda Chen
11b33164c3 [to #42322933] disable t5 test temporarily 2022-09-28 09:26:44 +08:00
hemu.zp
a3598f8d8c [to #42322933] Fix rouge metrics for chinese text
修复 TextGenerationMetric 中 Rouge 指标计算中文时结果不正确的问题

为文本生成添加 BLEU 指标
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10254323
2022-09-27 23:24:58 +08:00
tianchu.gtc
3d41d6d620 [to #42322933] fix seg4demo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10189886
2022-09-27 23:22:46 +08:00
ly261666
91231b3c15 [to #42322933]add copyright on mogface,retinaface,mtcnn,ulfd pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10266086
2022-09-27 23:09:13 +08:00
zhangzhicheng.zzc
d721fabb34 [to #42322933]bert with sequence classification / token classification/ fill mask refactor
1.新增支持原始bert模型(非easynlp的 backbone prefix版本)
2.支持bert的在sequence classification/fill mask /token classification上的backbone head形式
3.统一了sequence classification几个任务的pipeline到一个类
4.fill mask 支持backbone head形式
5.token classification的几个子任务(ner,word seg, part of speech)的preprocessor 统一到了一起TokenClassificationPreprocessor
6. sequence classification的几个子任务(single classification, pair classification)的preprocessor 统一到了一起SequenceClassificationPreprocessor
7. 改动register中 cls的group_key 赋值位置,之前的group_key在多个decorators的情况下,会被覆盖,obj_cls的group_key信息不正确
8. 基于backbone head形式将 原本group_key和 module同名的情况尝试做调整,如下在modelscope/pipelines/nlp/sequence_classification_pipeline.py 中 
原本
 @PIPELINES.register_module(
    Tasks.sentiment_classification, module_name=Pipelines.sentiment_classification)
改成
@PIPELINES.register_module(
    Tasks.text_classification, module_name=Pipelines.sentiment_classification)
相应的configuration.json也有改动,这样的改动更符合任务和pipline(子任务)的关系。
8. 其他相应改动为支持上述功能
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10041463
2022-09-27 23:08:33 +08:00
tingwei.gtw
372adb3936 [to #42322933] support hand-static model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10244616
2022-09-27 23:04:38 +08:00
yuze.zyz
357a233ee3 [to #42322933] fix bug: checkpoint hook and bestckpthook exists at the same time
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10227608
2022-09-27 23:03:00 +08:00
lanjinpeng.ljp
744c84c893 output timestamps for video-single-object-tracking demo service
830版本 video-single-object-tracking demo需要输出timestamps信息
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10278969
2022-09-27 22:19:14 +08:00
wendi.hwd
939a9f2322 [to #42322933]fix commits
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10272768
2022-09-27 22:17:41 +08:00
shuying.shu
b98114367b [to #42322933]add timestamp for movie scene segmentation output
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10269467

    * add timestamp for movie scene segmentation output
2022-09-27 22:15:24 +08:00
jiaqi.sjq
e90ff9e479 [to #42322933] tts sambert am changs from tensorfow to PyTorch and add licenses
* [to #41669377] docs and tools refinement and release 

1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
2022-09-27 22:09:30 +08:00
wendi.hwd
26df8f1988 [to #42322933]add semantic-segmentation task output is numpy mask for demo-service
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10265856
2022-09-27 15:01:05 +08:00
wenmeng.zwm
c8be0e8b78 [to #44902165] remove device placement for image cartoon to avoid full gpu memory usage
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10260495
2022-09-27 09:45:19 +08:00
yuze.zyz
c498d88d48 [to #42322933] add license declaration
1. add license declaration
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10216802
2022-09-26 17:38:13 +08:00
wenmeng.zwm
65cce5b997 [to #44902165] bump version to 0.4.5 2022-09-26 16:13:11 +08:00
leyuan.hjy
f844f73b03 [to #42322933]修复nano模型初始化/增加文件copyright信息
修复nano模型初始化/增加文件copyright信息
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10247456
2022-09-26 15:52:03 +08:00
tianchu.gtc
bd4127bc27 [to #42322933]segformer 接入demo接口更改
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10253628
2022-09-26 15:49:35 +08:00
shuying.shu
b876839d51 [to #42322933]adjust output form
adjust output form for movie scene segmentation demo

 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10244194
2022-09-26 14:03:35 +08:00
hanyuan.chy
4dbdc45963 test(data): add test data
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10246518
2022-09-26 13:23:32 +08:00
zhangzhicheng.zzc
5e4894870b [to #42322933]add t5 model / text2text generation task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10191736

    * add T5 for generation
2022-09-26 12:23:28 +08:00
myf272609
047904ef73 [to #42322933] fix init issues for multi-style cartoon models
1. 修复多风格模型pipeline初始化问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10249429
2022-09-26 11:55:06 +08:00
行嗔
537827e5a1 Merge remote-tracking branch 'origin/master' into ofa/finetune
# Conflicts:
#	modelscope/models/multi_modal/ofa_for_all_tasks.py
#	modelscope/msdatasets/ms_dataset.py
#	modelscope/trainers/utils/inference.py
2022-09-25 16:35:08 +08:00
行嗔
d979b90439 Merge branch 'master' into ofa/finetune
# Conflicts:
#	modelscope/preprocessors/multi_modal.py
#	modelscope/trainers/trainer.py
#	tests/pipelines/test_ofa_tasks.py
2022-09-25 16:28:26 +08:00
pengyu.lpy
3ed0c9c8d8 [to #42322933] relax un-determinsitic test validation constraints
放松了tests/pipelines/easycv_pipelines/test_segmentation_pipeline.py里面对于识别非determinsitic的校验条件,一方便后续模型更新
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10245940
2022-09-24 17:58:42 +08:00
hemu.zp
69f8928dd2 [to #42322933] Replace mplug input 'question' with 'text'
mplug 相关任务 pipeline 输入字段统一为 'image' + 'text'
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10236282
2022-09-23 15:54:17 +08:00
feiwu.yfw
b4cff7cc31 [to #44842128] 修复MsDataset torch场景
1、to_torch_dataset时支持保留原数据类型
2、替换orch.utils.data.IterableDataset为torch.utils.data.Dataset,支持分布式训练和shuffle。后续等streaming数据加载方式支持后再引入IterableDataset
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10214102
2022-09-23 15:27:05 +08:00
shuying.shu
a22a4e9a3a [to #42322933]add license header
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10222223
2022-09-23 09:38:55 +08:00
bin.xue
470a1989bc [to #42322933] feat: far field KWS accept mono audio for online demo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10211100
2022-09-22 23:01:14 +08:00
wendi.hwd
f4044f14fd cv/cvdet_lic_add file licence
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10214336
2022-09-22 22:54:59 +08:00
hejunjie.hjj
dc2cf3c2dc [to #42322933] add license header
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10231619
2022-09-22 22:54:00 +08:00
wenmeng.zwm
1c66f2a9d7 [to #44902165] bump version to 0.4.4 2022-09-22 18:10:06 +08:00
jiangnana.jnn
376ba9fef9 [to #42322933]update easycv pipelines
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10208603

    * update easycv pipelines
2022-09-22 15:15:29 +08:00
Yingda Chen
4bc188173e [to #42322933] fix typo 2022-09-22 09:29:41 +08:00
lingcai.wl
01c8735efa [to #44657982] update demo utils
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10208690
2022-09-22 09:24:30 +08:00
lllcho.lc
4e00a325ad [to #42322933] add license
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10202082
2022-09-21 19:42:07 +08:00
yichang.zyc
b537bb8c27 fix vg return value
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10207239
2022-09-21 18:57:34 +08:00
jiangnana.jnn
1794e08af7 fix dist training
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10185634

    * fix dist training
2022-09-21 17:47:50 +08:00
行嗔
5d83f62312 mnli finetune done 2022-09-21 15:52:10 +08:00