Commit Graph

440 Commits

Author SHA1 Message Date
ashui.cbh
8ce641fd0c [to #42322933]create utils/cv/heatmap
根据反馈 将用到的util_func 放入modelscope/utils/cv 下
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9759481
2022-08-15 18:14:11 +08:00
ashui.cbh
c2edc29776 [to #42322933] support crowd-counting
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9728416
2022-08-12 17:46:42 +08:00
mulin.lyh
c57c91c359 [to #44031139]fix: fix hub ci case delete test project failure
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9736416

    * [to #44031139]fix: fix hub ci case delete test project failure
2022-08-12 13:56:47 +08:00
piaoyu.lxy
2dc3286524 [to #42322933] add conversational_text_to_sql pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9580066
2022-08-11 11:19:11 +08:00
yaoxiong.hyx
69c57e0f55 [to #42322933]support ocr_recognition
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9592902
2022-08-10 16:42:09 +08:00
Yingda Chen
df6bb3deaf [to #42322933] update tts model id 2022-08-10 15:42:48 +08:00
ly119399
16139cefb6 [to #42322933] modify space task name 2022-08-10 14:27:47 +08:00
hemu.zp
59c5dd8dfe [to #42322933] remove sep token at the end of tokenizer output
generate 时去除 tokenizer 输出结尾的 sep,修复 gpt3 模型目前续写内容与上文无关的 bug
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9696570
2022-08-10 13:46:23 +08:00
shouzhou.bx
ac1ba2a0e0 [to #42322933]bugfix : add PIL image type support and model.to(devices) for body_2d_keypoints ipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9684583
2022-08-09 18:07:09 +08:00
mulin.lyh
3272b2755c [to #43909247]fix: access token in code, move to environment
move access token to environment variable.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9681287

    * [to #43909247]fix: access token in code, move to environment
2022-08-09 17:46:56 +08:00
dangwei.ldw
5fcb8e2342 [to #42322933]fix onnx thread error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9669460

    * fix onnx thread error
2022-08-09 17:46:24 +08:00
yichang.zyc
5cbd9ff8fd [to #42322933]replace clip modelid
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9691512
2022-08-09 17:31:30 +08:00
yingda.chen
5ea690d743 [to #42322933]split text generation tests
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9684735

    * split test generation tests
2022-08-09 17:01:53 +08:00
mulin.lyh
578f82e501 [to #43887377]fix: sdk api concurrent call snapshort download file will conflict
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9672696

    * [to #43887377]fix: sdk api concurrent call snapshort download file  will conflict
2022-08-08 17:19:30 +08:00
xiachen.wyh
78a32fed06 [to #42322933] cv/tinynas/classification
由于 在 系列方法 命名上有调整,将  lightnas 统一改为 tinynas

之前有一次提交,对应的 code review 为:https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9578861

现将 上面的的意见已统一修复,并重新  切换到  cv/tinynas/classification 分支上 进行重新 提交审核
之前 cv/lightnas/classification 已废弃
请悉知~
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9663300
2022-08-08 15:16:14 +08:00
shichen.fsc
42de490c21 [to #42322933] bugfix: kws pipeline tasks name change auto-speech-recognition to keyword-spotting
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9667657
2022-08-08 13:56:02 +08:00
xiangpeng.wxp
d36002d6b9 create the latest nlp_translation_finetune
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9662707
2022-08-06 23:17:21 +08:00
zhangzhicheng.zzc
0874089f6c change sentiment-classification branch
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9662406

    * bug fix for nlp backbone-head trainers
2022-08-06 22:00:26 +08:00
bin.xue
aef3fa34bd [to #42322933] feat: omit pipeline name in test
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9662192
2022-08-06 12:35:38 +08:00
yingda.chen
45620dbc7f [to #42322933]clean up test level
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9662182

    * clean up test level
2022-08-06 12:22:17 +08:00
xiangpeng.wxp
a41de5e80e [to #42322933]Merge request from 鹏程:nlp_translation_finetune
* csanmt finetune wxp
2022-08-05 23:48:46 +08:00
jiangnana.jnn
6f5b864735 [to #43850241] fix unittest
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9660779

    * fix unittest
2022-08-05 18:39:59 +08:00
yanheng.wyh
4cb1dbdaf3 [to #42322933]fix: animal recognition and general recognition and reove rfconv
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9477652
2022-08-05 17:28:48 +08:00
yuze.zyz
794e277270 [to #42322933] Fix problem in ws
1. remove comments 
2. fix a bug that ws assert failure for english input
3. add an english input test for ws
3. remove a test case which the dataset can not be visited by outer website
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9657140
2022-08-05 16:18:29 +08:00
ly119399
4af5ae52ce [to #43259593] task_oriented_conversation model hub use master branch
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9652513
2022-08-05 14:01:01 +08:00
shouzhou.bx
79d602a1da [to #42322933] bugfix:move input human_deteciton pipeline into body_2d_detection init
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9653099
2022-08-05 12:33:46 +08:00
yuxiang.tyx
d38f9f442b [to #42322933] move input face_deteciton pipeline into face_recognition init
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9652773

    * move input face_deteciton pipeline into face_recognition init
2022-08-05 12:32:52 +08:00
shouzhou.bx
cb1aa66a49 [to #43259593]cv:add human pose eastimation to maas-lib
add human pose eastimation to maas-lib v3
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9491970
2022-08-04 23:34:48 +08:00
yuze.zyz
845cc869ca [to #42322933] Redo an unmerged CR:https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9427959
1. Redo a CR in current code
2. Refactor sbert's model configs
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9643861
2022-08-04 17:54:40 +08:00
yichang.zyc
32c2adb650 [to #42322933] fix: vqa demo适配无preprocessor 和 相关问题 cr:https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9638497
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9638497
2022-08-04 17:24:44 +08:00
pangda
55dfa0a856 [to #42322933] update ner default model & fix tokenizer bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9627744
2022-08-04 16:11:22 +08:00
menrui.mr
cd577f8ba0 [to #42322933] Add ofa-text-to-image-synthesis to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9590940
2022-08-04 15:33:31 +08:00
Yingda Chen
b854303c25 [to #42322933] fix typo 2022-08-04 14:59:14 +08:00
zhangzhicheng.zzc
9d0b38b4e4 [to #42322933] lazy load on trainer 2022-08-04 14:07:14 +08:00
shichen.fsc
c663dd8cf6 [to #42322933] add pcm-bytes supported for KWS
kws增加pcm bytes数据类型的支持
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9635439
2022-08-04 11:49:26 +08:00
hemu.zp
75da5fd344 [to #42322933] Remove beta revision
移除测试中 damo/nlp_palm2.0_text-generation_english-base beta 分支的使用
2022-08-04 10:54:28 +08:00
hemu.zp
56c3cd03a9 [to #42322933] Fix bug for TextGenerationPreprocessor
1. 修复 TextGenerationPreprocessor 中 padding 设置为 True 导致输入序列长度不同时训练报错的 bug
2. 将 vqa pipeline 的输入从 image_path 调整为 Image.Image 类型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9630285
2022-08-04 09:30:53 +08:00
ly119399
8246174104 [to #43627720] pipeline task_oriented_conversation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9608407
2022-08-04 09:10:15 +08:00
yichang.zyc
cb12a7c6f8 [to #42322933] fea: support Chinese, eg: visual-grounding https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9627026
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9627026
2022-08-03 21:25:16 +08:00
yuze.zyz
064f1041a9 [to #42322933] Refine the nlp examples of finetuning
1. Refine the nlp finetune examples
2. Remove some useless code
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9631158
2022-08-03 20:31:10 +08:00
yuze.zyz
21fa71baf0 [to #42322933] add/refactor nlp models source code and finetune
1. add sbert,veco,palm,space source code
2. support sbert sequence classification, token classification finetune
3. support veco sequence classification finetune
4. support palm nlg finetune
evaluation result: https://sheet.alibaba-inc.com/#/sheet/f7fdcc7f22bd5105 sheet:Maas
5. add ut for finetunes
6. add veco's taskdataset processor
7. add a common trainer for nlp, and a specific trainer for veco
8. merge some duplicate codes of models, preprocessors, pipelines
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9574105

    * add basic class of hook&metrics

* pre-commit passed

* change some comments

* pre commit passed

* 1. remove accuracy's groups 2. remove useless hooks 3. simplify priorities

* pre-commit passed

* fix a comment

* Merge branch 'master' into finetune_hooks_metrics

# Conflicts:
#	modelscope/metainfo.py

* pre-commit passed

* add basic class of hook&metrics

* pre-commit passed

* change some comments

* pre commit passed

* 1. remove accuracy's groups 2. remove useless hooks 3. simplify priorities

* pre-commit passed

* fix a comment

* Merge branch 'feat/finetune' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into feat/finetune

* mv hooks related to modelscope/trainers/hooks

* mv priority back

* add torch mdoel base and test

* update hooks, trainer, import_util

* add torch epoch based trainer and dis utils

* add hooks

* fix warmup

* format code stype and fix warmup and add warmup unittest

* fix impls

* pre-commit check passed

* update hook and add EpochBasedTrainer

* add trainer unittest

* Merge branch 'feat/add_hooks' into feat/add_task

# Conflicts:
#	modelscope/models/base_torch.py
#	modelscope/trainers/hooks/hook.py
#	modelscope/trainers/trainer.py

* update unittest name

* rewrite taskdataset to trainer

* fix trainer and add unittest

* add unittest

* code: run to forward

* run through... but ugly code

* arrange some cls

* fix some errs

* revert some mistakes

* init check in

* Merge branch 'feat/add_hooks' into feat/add_task

# Conflicts:
#	modelscope/trainers/trainer.py

* test with bigger epoch and size

* add the default metrics class

* move build metrics code to a method

* merge add_task

* merge origin add_task

* add device initialization

* remove preprocessor arg for bool

* add task models

* move metric collect logic to metrics class

* pre-commit passed

* fix cr comments

* precommit passed

* add task models

* Merge remote-tracking branch 'origin/feat/add_task' into feat/backbone_head

* add comment

* change comment formats.

* fix comments

* fix ut bug

* fix comments

* add wrapper check

* fix comments

* pre commit passed

* fix cr comments

* solve a loop import problem

* fix ut bug

* fix ut errors

* change dummydataset to msdataset

* precommit passed

* merge add task

* backbone-head is build, model is not correctly loaded

* model load states matched

* result matched

* lint

* add veco/palm_v2 code

* merge master

* merge master success running

* add repr model name level

* Merge branch 'feat/veco_palm' into feat/finetune_sbert_veco

* model test for training

* add token-classification metric add formal ut

* fix running bug

* finetune and pipeline are working with backbone-head

* add nli

* add missing code

* finetune and pipeline are working with backbone-head

* Merge branch 'feat/backbone_head' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/backbone_head

* add a test repo for pr

* remove merge conflicted file

* remove merge conflicted file 1

* lint check

* import error

* none type bug fix

* forward input unpacking or dict bug

* move head into models, add build_backbone with registry, no base method

* merge master

* feat: 1. add interleave dataset method 2. support multiple dataset in trainer.build_dataset 3. support 3 sub tasks in sequence_classification task

* unfinished

* update the task model structure in NLP field

* merge master

* update by comments

* keep the default model id as current on production

* unfinished

* unfinished

* veco can run

* Merge remote-tracking branch 'origin/master' into feat/backbone_head

* add taskmodel for module management

* remove forward_input_is_dict

* unfinished

* token classification started

* update base model structure

* move space to backbone

* remove 'type' in build_from_cfg method

* test update

* bug fix

* on tesing, mess code

* Merge branch 'feat/backbone_head' into feat/refactor_nlp_730

# Conflicts:
#	modelscope/metrics/builder.py
#	modelscope/models/__init__.py
#	modelscope/models/nlp/__init__.py
#	modelscope/preprocessors/nlp.py
#	modelscope/trainers/trainer.py
#	requirements/multi-modal.txt

* add missing merge

* add sofa source code

* refactor

* add veco task dataset

* add veco task dataset

* pre-commit passed

* fix bug of log

* add some features

* merge master

* bug fix

* refine nlp models

* fix the training error

* unfinished

* refactor pipeline

* Merge branch 'feat/backbone_head' into feat/refactor_nlp_730

# Conflicts:
#	modelscope/metrics/builder.py
#	modelscope/models/nlp/__init__.py
#	modelscope/models/nlp/backbones/structbert/modeling_sbert.py
#	modelscope/models/nlp/palm_v2/palm_for_text_generation.py
#	modelscope/preprocessors/base.py
#	modelscope/preprocessors/nlp.py
#	modelscope/trainers/trainer.py

* Merge commit 'ab04ceafc5453ce7daa9aa09e37a55f703072a10' into feat/refactor_nlp_730

# Conflicts:
#	modelscope/metainfo.py
#	modelscope/metrics/builder.py
#	modelscope/models/__init__.py
#	modelscope/models/base/base_torch_model.py
#	modelscope/models/nlp/__init__.py
#	modelscope/models/nlp/backbones/space/model/intent_unified_transformer.py
#	modelscope/models/nlp/backbones/space/model/model_base.py
#	modelscope/models/nlp/palm_v2/palm_for_text_generation.py
#	modelscope/models/nlp/sbert_for_sequence_classification.py
#	modelscope/models/nlp/sequence_classification.py
#	modelscope/models/nlp/space/__init__.py
#	modelscope/models/nlp/space_for_dialog_intent_prediction.py
#	modelscope/models/nlp/space_for_dialog_modeling.py
#	modelscope/models/nlp/space_for_dialog_state_tracking.py
#	modelscope/models/nlp/task_model.py
#	modelscope/pipelines/nlp/sentiment_classification_pipeline.py
#	modelscope/preprocessors/base.py
#	modelscope/preprocessors/nlp.py
#	modelscope/trainers/trainer.py

* revert changes

* unify sentnece classification postprocess

* revert some changes, move some model files

* pipeline first case run through

* ws pipeline passed

* Merge branch 'feat/refactor_nlp_730' into feat/finetune_sbert_veco

* finetune

* revert code

* revert some code

* ws finetune started, only the accuracy is weird

* Merge branch 'feat/veco_taskdataset' into feat/finetune_sbert_veco

# Conflicts:
#	modelscope/task_datasets/veco_dataset.py
#	tests/taskdataset/test_veco_dataset.py

* veco+nli finetune started

* Merge branch 'master' into feat/finetune_sbert_veco

# Conflicts:
#	modelscope/models/nlp/sbert_for_sequence_classification.py
#	modelscope/models/nlp/sbert_for_token_classification.py
#	modelscope/models/nlp/sbert_for_zero_shot_classification.py
#	modelscope/models/nlp/space/space_for_dialog_intent_prediction.py
#	modelscope/models/nlp/space/space_for_dialog_modeling.py
#	modelscope/trainers/trainer.py

* add trainer for nlp

* trainer: dataset params passed into preprocessor

* test passed by nlptrainer

* fix some bugs

* fix some bugs

* add backbone/head subclass

* fix regression bugs

* fix bug in token-cls finetune

* support cfg modification

* fix bug

* fix bug

* update requirements

* add some comments and fix some t

* add some comments and revert a argument

* split to two test files

* revert code

* fixbug in precessor

(cherry picked from commit 7a648d096ef8500c694d3255dabe29e6f4bfc3e5)

* fix ut bug

* support sbert models

* unfinished

* Merge branch 'feat/finetune_sbert_veco' into sly_tmp_veco_finetune

# Conflicts:
#	tests/trainers/test_finetune_sequence_classification.py

* fixbug in veco

* fix bug

* fixbug

* correct running params

* remove useless files

* add palm finetuning with cnn_dailymail dataset

* copy space model from sofa

* Merge branch 'feat/finetune_sbert_veco' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into feat/finetune_sbert_veco

* Merge branch 'master' into feat/finetune_sbert_veco

# Conflicts:
#	modelscope/metrics/__init__.py
#	modelscope/models/__init__.py
#	modelscope/models/nlp/__init__.py
#	modelscope/models/nlp/backbones/__init__.py
#	modelscope/models/nlp/backbones/structbert/modeling_sbert.py
#	modelscope/models/nlp/heads/__init__.py
#	modelscope/models/nlp/masked_language.py
#	modelscope/models/nlp/palm_v2/palm_for_text_generation.py
#	modelscope/models/nlp/sbert_for_nli.py
#	modelscope/models/nlp/sbert_for_sentence_similarity.py
#	modelscope/models/nlp/sbert_for_sentiment_classification.py
#	modelscope/models/nlp/sbert_for_sequence_classification.py
#	modelscope/models/nlp/sbert_for_token_classification.py
#	modelscope/models/nlp/sbert_for_zero_shot_classification.py
#	modelscope/models/nlp/sequence_classification.py
#	modelscope/models/nlp/space/space_for_dialog_intent_prediction.py
#	modelscope/models/nlp/space/space_for_dialog_modeling.py
#	modelscope/models/nlp/space/space_for_dialog_state_tracking.py
#	modelscope/models/nlp/structbert/adv_utils.py
#	modelscope/models/nlp/structbert/configuration_sbert.py
#	modelscope/models/nlp/task_models/task_model.py
#	modelscope/pipelines/__init__.py
#	modelscope/pipelines/nlp/__init__.py
#	modelscope/pipelines/nlp/fill_mask_pipeline.py
#	modelscope/pipelines/nlp/named_entity_recognition_pipeline.py
#	modelscope/pipelines/nlp/nli_pipeline.py
#	modelscope/pipelines/nlp/sentence_similarity_pipeline.py
#	modelscope/pipelines/nlp/sentiment_classification_pipeline.py
#	modelscope/pipelines/nlp/text_generation_pipeline.py
#	modelscope/pipelines/nlp/word_segmentation_pipeline.py
#	modelscope/pipelines/nlp/zero_shot_classification_pipeline.py
#	modelscope/preprocessors/nlp.py
#	modelscope/task_datasets/__init__.py
#	modelscope/trainers/trainer.py
#	modelscope/trainers/utils/inference.py
#	modelscope/utils/file_utils.py
#	requirements/nlp.txt
#	tests/pipelines/test_nli.py
#	tests/pipelines/test_sentence_similarity.py
#	tests/pipelines/test_sentiment_classification.py

* fix imports

* mark backbone in their own modeling

* pre-commit check passed

* pre-commit passed, remove roberta model

* fix a bug in ast import

* skip all finetune uts

* fix bugs

* pre-commit passed

* bug fixed

* bug fixed

* bug fixed

* bug fixed

* fix ut bug

* fix bug

* fix ut bug

* fix bug

* fix bug

* fixbugs

* fixbug

* revert veco

* revert veco because of core dump

* fix palm bug

* revert veco

* revert mistaken code

* add a test print

* pre-commit check

* test exception

* add test code

* for test

* fix bug and test

* remove test code

* remove useless file

* 1. fix some bugs 2. add backbone ut

* Merge branch 'master' into feat/finetune_refactor_730

# Conflicts:
#	modelscope/metainfo.py
#	modelscope/metrics/sequence_classification_metric.py
#	modelscope/models/nlp/__init__.py
#	modelscope/models/nlp/task_models/task_model.py
#	modelscope/preprocessors/__init__.py
#	modelscope/preprocessors/nlp.py
#	modelscope/trainers/trainer.py
#	modelscope/trainers/utils/inference.py
#	modelscope/utils/file_utils.py
#	tests/trainers/test_trainer_with_nlp.py

* pre-commit passed

* revert files

* increase test level

* unregister models

* fix bugs

* fix cr comments

* fix bug in backbone-head

* add sbert backbone

* fix bug

* add test for token-cls-metric

* pre-commit passed

* fix ut comments

* revert normal tokenizer to fast tokenizer

* Merge branch 'master' into feat/finetune_refactor_730

# Conflicts:
#	modelscope/models/nlp/__init__.py
#	modelscope/models/nlp/backbones/__init__.py
#	modelscope/models/nlp/backbones/structbert/__init__.py
#	modelscope/models/nlp/masked_language.py
#	modelscope/models/nlp/palm_v2/palm_for_text_generation.py
#	modelscope/models/nlp/sbert_for_sequence_classification.py
#	modelscope/models/nlp/sbert_for_token_classification.py
#	modelscope/models/nlp/sbert_for_zero_shot_classification.py
#	modelscope/pipelines/nlp/text_generation_pipeline.py
#	modelscope/preprocessors/nlp.py
#	modelscope/trainers/trainer.py
#	modelscope/trainers/utils/inference.py

* fix merge bugs

* pre commit passed

* fix bug

* fix bug

* fix bug

* fix bug from master

* add print

* fix ut bug

* fix bug

* Merge branch 'master' into feat/finetune_refactor_730

* skip task model test
2022-08-03 18:38:41 +08:00
biwen.lbw
9e28cfcd90 add skin retouching
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9442509
2022-08-03 16:08:25 +08:00
zhanning.gzn
3439a55f24 [to #42322933] Change image-classification-imagenet/dailylife tasks to image-classification task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9597706
2022-08-02 22:24:28 +08:00
yichang.zyc
9db97366eb [to #42322933] fix sample collate bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9615938

    * add init and make demo compatible

* make demo compatible

* fix comments

* add distilled ut

* Merge remote-tracking branch 'origin/master' into ofa/bug_fix

* fix sample collate bug

* Merge remote-tracking branch 'origin/master' into ofa/bug_fix

# Conflicts:
#	tests/pipelines/test_ofa_tasks.py

* Merge remote-tracking branch 'origin/master' into ofa/bug_fix

* fix sample collate bug
2022-08-02 22:17:00 +08:00
xuangen.hlh
a3c460b139 [to #42322933]rename imagen to diffusion
出于可能法务风险,将复现的Google 「Imagen」算法重命名为「diffusion」。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9608897
2022-08-02 22:15:45 +08:00
shichen.fsc
e134254c6c [to #42322933] add foreign language supported, and audio data resample -- asr inference
asr推理增加对其他外文的支持,包括计算wer。
增加对音频重采样,根据传入音频的采样率和当前模型支持的采样率,在easyasr内部完成重采样。注意,输入数据为pcm时,需要同时传入pcm的sample rate,否则当成16K。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9580609
2022-08-02 21:52:39 +08:00
baiguan.yt
3f7a5c8279 [to #42322933]人像增强
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9590794
2022-08-02 21:33:32 +08:00
yuze.zyz
7d348b9ae8 [to #42322933] change dummy dataset to msdataset
1. change dummy dataset to msdataset
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9586561

    * change dummpy dataset to msdataset

* add pre-commit ignore

* Merge commit 'e93339ea877b93fa0c1b9ebfeee8877f78facb0e' into feat/ms_dataset_case

* Merge commit '34840fc5d8a8ee8cd1278efea913d42db522f9c8' into feat/ms_dataset_case

* remove useless ip hosts.

* Merge commit '47dda0a5f9b4b4466177d9acae097a53f8bea8f7' into feat/ms_dataset_case

* Merge commit '21de1e7db035843c6c2caccf382a6e4f7071f96b' into feat/ms_dataset_case
2022-08-02 21:07:47 +08:00
yichang.zyc
21de1e7db0 [to #42322933] add init and make demo compatible link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9606656
add init and make demo compatible
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9606656

    * add init and make demo compatible

* make demo compatible

* fix comments

* add distilled ut

* Merge remote-tracking branch 'origin/master' into ofa/bug_fix
2022-08-02 20:42:13 +08:00
wenmeng.zwm
7798a6250a [to #43112692] stardarized task name and output
1. task name and output definition: [link](https://alidocs.dingtalk.com/i/nodes/KOEmgBoGwD78vd2bAry3VndLerP9b30a?nav=spaces&navQuery=spaceId%3Dnb9XJNlZxbgrOXyA&iframeQuery=utm_source%3Dportal%26utm_medium%3Dportal_space_file_tree)

2. rearrange task definition and add more outputs definition for tasks

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9585469
2022-08-02 20:21:05 +08:00