Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-24 20:19:51 +01:00
Code Issues Packages Projects Releases Wiki Activity
270 Commits 267 Branches 107 Tags
v0.2.3
Commit Graph

175 Commits

Author SHA1 Message Date
shichen.fsc
f14fa82d6f [to #42322933] Fix remove useless Tasks.key_word_spotting 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9303027
 2022-07-07 17:28:32 +08:00
wenmeng.zwm
b8f102db03 fix several small problems for v0.2 
* rename name of whl to modelscope
* auto install all requirements when running citest
* auto download dynamic lib for aec pipeline
* fix setup.py  audio extras not set
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9297825
 2022-07-07 17:28:26 +08:00
zhangzhicheng.zzc
df42427ae0 [to #42322933] nlp preprocessor refactor 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9269314

    * init

* token to ids

* add model

* model forward ready

* add intent

* intent preprocessor ready

* intent success

* merge master

* test with model hub

* add flake8

* update

* update

* update

* Merge branch 'master' into nlp/space/gen

* delete file about gen

* init

* fix flake8 bug

* [to #42322933] init

* bug fix

* [to #42322933] init

* update pipeline registry info

* Merge remote-tracking branch 'origin/master' into feat/nli

* [to #42322933] init

* [to #42322933] init

* modify forward

* [to #42322933] init

* generation ready

* init

* Merge branch 'master' into feat/zero_shot_classification

# Conflicts:
#	modelscope/preprocessors/__init__.py

* [to #42322933] bugfix

* [to #42322933] pre commit fix

* fill mask

* registry multi models on model and pipeline

* add tests

* test level >= 0

* local gen ready

* merge with master

* dialog modeling ready

* fix comments: rename and refactor AliceMindMLM; adjust pipeline

* space intent and modeling(generation) are ready

* bug fix

* add dep

* add dep

* support dst data processor

* merge with nlp/space/dst

* merge with master

* Merge remote-tracking branch 'origin' into feat/fill_mask

Conflicts:
	modelscope/models/nlp/__init__.py
	modelscope/pipelines/builder.py
	modelscope/pipelines/outputs.py
	modelscope/preprocessors/nlp.py
	requirements/nlp.txt

* merge with master

* merge with master 2/2

* fix comments

* fix isort for pre-commit check

* allow params pass to pipeline's __call__ method

* Merge remote-tracking branch 'origin/master' into feat/zero_shot_classification

* merge with nli task

* merge with sentiment_classification

* merge with zero_shot_classfication

* merge with fill_mask

* merge with space

* merge with master head

* Merge remote-tracking branch 'origin' into feat/fill_mask

Conflicts:
	modelscope/utils/constant.py

* fix: pipeline module_name from model_type to 'fill_mask' & fix merge bug

* unfiinished change

* fix bug

* unfinished

* unfinished

* revise modelhub dependency

* Merge branch 'feat/nlp_refactor' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/nlp_refactor

* add eval() to pipeline call

* add test level

* ut run passed

* add default args

* tmp

* merge master

* all ut passed

* remove an useless enum

* revert a mis modification

* revert a mis modification

* Merge commit 'ace8af92465f7d772f035aebe98967726655f12c' into feat/nlp

* commit 'ace8af92465f7d772f035aebe98967726655f12c':
  [to #42322933] Add cv-action-recongnition-pipeline to maas lib
  [to #42463204]  support Pil.Image for image_captioning_pipeline
  [to #42670107] restore pydataset test
  [to #42322933] add create if not exist and add(back) create model example         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
  [to #41474818]fix: fix errors in task name definition

# Conflicts:
#	modelscope/pipelines/builder.py
#	modelscope/utils/constant.py

* Merge branch 'feat/nlp' into feat/nlp_refactor

* feat/nlp:
  [to #42322933] Add cv-action-recongnition-pipeline to maas lib
  [to #42463204]  support Pil.Image for image_captioning_pipeline
  [to #42670107] restore pydataset test
  [to #42322933] add create if not exist and add(back) create model example         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
  [to #41474818]fix: fix errors in task name definition

# Conflicts:
#	modelscope/pipelines/builder.py

* fix compile bug

* refactor space

* Merge branch 'feat/nlp_refactor' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/nlp_refactor

* Merge remote-tracking branch 'origin' into feat/fill_mask

* fix

* pre-commit lint

* lint file

* lint file

* lint file

* update modelhub dependency

* lint file

* ignore dst_processor temporary

* solve comment: 1. change MaskedLMModelBase to MaskedLanguageModelBase 2. remove a useless import

* recommit

* remove MaskedLanguageModel from __all__

* Merge commit '1a0d4af55a2eee69d89633874890f50eda8f8700' into feat/nlp_refactor

* commit '1a0d4af55a2eee69d89633874890f50eda8f8700':
  [to #42322933] test level check         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9143809
  [to #42322933] update nlp models name in metainfo         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9134657

# Conflicts:
#	modelscope/metainfo.py

* update

* revert pipeline params update

* remove zeroshot

* update sequence classfication outpus

* merge with fill mask

* Merge remote-tracking branch 'origin' into feat/fill_mask

* fix

* fix flake8 warning of dst

* Merge remote-tracking branch 'origin/feat/fill_mask' into feat/nlp

* merge with master

* remove useless test.py

* Merge remote-tracking branch 'origin/master' into feat/nlp

* remove unformatted space trainer

* revise based on comment except chinease comment

* skip ci blocking

* translation pipeline

* csanmt model for translation pipeline

* update

* update

* update builder.py

* change Chinese notes of space3.0 into English

* translate chinese comment to english

* add space to metainfo

* update casnmt_translation

* update csanmt transformer

* merge with master

* update csanmt translation

* update lint

* update metainfo.py

* Update translation_pipeline.py

* Update builder.py

* fix: 1. make csanmt derived from Model 2. add kwargs to prevent from call error

* pre-commit check

* temp exclue flake8

* temp ignore translation files

* fix bug

* pre-commit passed

* fixbug

* fixbug

* revert pre commit ignorance

* pre-commit passed

* fix bug

* merge with master

* add missing setting

* merge with master

* add outputs

* modify test level

* modify chinese comment

* remove useless doc

* space outputs normalization

* Merge remote-tracking branch 'origin/master' into nlp/translation

* update translation_pipeline.py

* Merge remote-tracking branch 'origin/master' into feat/nlp

* Merge remote-tracking branch 'origin/master' into nlp/translation

* add new __init__ method

* add new __init__ method

* update output format

* Merge remote-tracking branch 'origin/master' into feat/nlp

* update output format

* merge with master

* merge with nlp/translate

* update the translation comment

* update the translation comment

* Merge branch 'nlp/translation' into feat/nlp

* Merge remote-tracking branch 'origin/master' into feat/nlp

* Merge remote-tracking branch 'origin/master' into feat/nlp

* nlp preprocessor refactor

* add get_model_type in util.hub

* update the default preprocessor args

* update the fill mask preprocessor

* bug typo fixed
 2022-07-06 14:11:34 +08:00
jiaqi.sjq
a84c80cd57 [to #9285266] tts pipeline using model id params 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9285266
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9285266
 2022-07-06 13:23:33 +08:00
shichen.fsc
793b35d56d [to #42322933] kws model fast use 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9281691
 2022-07-06 13:23:17 +08:00
xuangen.hlh
38a4a4fdb1 [to #42322933] Update cv-person-image-cartoon-pipeline to maas lib 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9268865
 2022-07-06 09:18:25 +08:00
bin.xue
3cbc04c6f6 [to #43003827] update url of aec lib 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9276877

    * update url of aec lib
 2022-07-05 19:50:55 +08:00
智丞
1bcdc05fb8 merge with master 2022-07-04 17:34:16 +08:00
ly103369
d74e644aaf [to #42322933] Add cv_r2p1d_video_embedding to maas lib 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9246462
 2022-07-04 16:05:52 +08:00
yingda.chen
d78d944246 [to #42322933] support text to image synthesis default model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9253639
 2022-07-04 14:21:22 +08:00
智丞
86eb56e939 Merge remote-tracking branch 'origin/master' into nlp/space/dst 2022-07-04 13:49:14 +08:00
智丞
154c61fc25 add test cases 2022-07-04 13:48:54 +08:00
yingda.chen
a60d675d25 [to #42322933]formalize test data storage 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9251871
 2022-07-04 12:11:12 +08:00
智丞
5002c46a4e merge with master 2022-07-04 10:43:44 +08:00
zhangzhicheng.zzc
e691585e15 [to #42322933]添加nlp translation pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9198181
 2022-07-04 10:28:38 +08:00
Yingda Chen
059c8fd248 [to #42322933] do not run imagen on gated for now 2022-07-03 10:36:30 +08:00
智丞
0ca1877cef Merge remote-tracking branch 'origin/master' into nlp/space/dst 2022-07-02 22:02:47 +08:00
智丞
54122b2dab merge with master 2022-07-02 21:58:42 +08:00
xuangen.hlh
62f1e76ff8 [to #42322933] Add cv_imagen_text-to-image-synthesis_tiny to maas lib 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9242667
 2022-07-02 15:47:25 +08:00
zhangzhicheng.zzc
5b98cc1513 [to #42322933]新增：nli，sentiment_classification，dialog_intent，dialog_modeling 
添加了，nli，sentiment_classification， dialog_intent, dialog_modeling几个pipeline。同时加入了nlp里面sequence classification一些简单的抽象。
去掉了zero_shot_classification
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9159089
 2022-07-01 23:13:03 +08:00
yingda.chen
0260b89431 [to #42322933] unified output keys 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9240440
 2022-07-01 18:29:34 +08:00
wenmeng.zwm
bb57020daa [to #42362425] remove add module to default group 
![](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/29212/25464477278968069/image.png)

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9229852
 2022-07-01 17:27:55 +08:00
wenmeng.zwm
8e51a073a6 [to #42966122] requirements enchanment and self-host repo support 
* add self-hosted repo:
* add extra requirements for different field and reduce necessary requirements
* update docker file with so required by audio
* add requirements checker which will be used later when implement lazy import
* remove repeated requirements and replace opencv-python-headless with opencv-python

example usage:
```shell
pip install model_scope[all] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[cv] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[nlp] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[audio] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[multi-modal] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html

```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9211383
 2022-07-01 16:38:06 +08:00
shichen.fsc
40cb1043b8 [to #42322933] add customized keywords setting for KWS 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9200613

    * [Add] add KWS code

    * [Fix] fix kws warning

    * [Add] add ROC for KWS

    * [Update] add some code check

    * [Update] refactor kws code, bug fix

    * [Add] add customized keywords setting for KWS

    * [Add] add data/test/audios for KWS
 2022-06-30 22:40:38 +08:00
ly119399
9e1c7d54d5 Merge branch 'master' into nlp/space/dst 2022-06-30 19:12:06 +08:00
yanheng.wyh
5fc8b3c9ab [to #42322933] upate animal recognition model name 2022-06-30 17:46:31 +08:00
ly119399
d9cedf2632 update dst 2022-06-30 16:34:17 +08:00
智丞
1307b52699 space outputs normalization 2022-06-30 16:05:09 +08:00
ly119399
82f8d2aefd dst test ready 2022-06-30 15:59:46 +08:00
ly119399
94522aa721 Merge remote-tracking branch 'origin' into nlp/space/dst 2022-06-30 15:24:59 +08:00
ly119399
bcbb4c02e5 merge feat/nlp 2022-06-30 15:19:58 +08:00
ly119399
99772b1acc modify test level 2022-06-30 14:45:41 +08:00
mulin.lyh
c2ae3de640 [to #42879757 #42887254]fix: Repository initialize lfs after clone, add download times counter 
Repository在clone后执行 git lfs install初始化lfs支持，下载技术添加到header里
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9204291

    * [to #42879757 #42887254]fix: Repository initialize lfs after clone, add download times counter
 2022-06-30 14:27:53 +08:00
ly119399
433ae05ba8 modify model name 2022-06-30 14:24:56 +08:00
智丞
dadc07f492 merge with master 2022-06-30 14:15:17 +08:00
ly119399
f63c37fc1f add test case 2022-06-30 14:09:29 +08:00
ly119399
d422510158 fix bug 2022-06-30 11:17:38 +08:00
ly119399
4cfc4b43a0 merge feat/nlp 2022-06-29 22:27:52 +08:00
ly119399
a52b75c9c1 update dst conf 2022-06-29 21:57:50 +08:00
ly119399
7b23a6ae94 dst loacl ready 2022-06-29 21:21:16 +08:00
ly119399
ef2ba806ea test case ready 2022-06-29 16:35:19 +08:00
hemu.zp
fabea5604e [to #42322933] Add MPLUG model 
添加 MPLUG 模型的 visual question answering 任务 pipeline

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9182119
 2022-06-29 11:08:34 +08:00
zhangzhicheng.zzc
576b7cffb1 [to #42322933] add pipeline params for preprocess and forward & zeroshot classification 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9180863
 2022-06-29 09:12:59 +08:00
mulin.lyh
0d17eb5b39 [to #42849800 #42822853 #42822836 #42822791 #42822717 #42820011]fix: bug test bugs 
修复测试bug
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9186775

    * [to #42849800 #42822853 #42822836 #42822791 #42822717 #42820011]fix: test bugs
 2022-06-28 21:12:15 +08:00
feiwu.yfw
5da470fd5d [to #42791465, #42779255, #42777959, #42757844, #42756050, #42746916, #42743595, #42791863] fix: fix msdataset 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9174075

* fix msdataset
 2022-06-28 20:40:57 +08:00
智丞
c2afb63b1e merge with master 2022-06-28 16:23:53 +08:00
ly119399
3bfb5948e2 merge feat/nlp 2022-06-28 16:07:22 +08:00
ly119399
760dcf0247 space dst pipeline is ready, but model's result is wrong 2022-06-28 16:02:44 +08:00
bin.xue
04b7eba285 [to #42322933] Merge ANS pipeline into master 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9178339

    * refactor: move aec models to audio/aec

* refactor: move aec models to audio/aec

* refactor: move aec models to audio/aec

* refactor: move aec models to audio/aec

* feat: add unittest for ANS pipeline

* Merge branch 'master' into dev/ans

* add new SoundFile to audio dependency

* Merge branch 'master' into dev/ans

* use ANS pipeline name from metainfo

* Merge branch 'master' into dev/ans

* chore: update docstring of ANS module

* Merge branch 'master' into dev/ans

* refactor: use names from metainfo

* refactor: enable ans unittest

* refactor: add more log message in unittest
 2022-06-28 14:41:08 +08:00
suluyan.sly
a7c1cd0fc9 [to #42322933]feat: add nlp-chinese-bert-fill-mask-pipeline to maas_lib 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9155437
 2022-06-28 14:34:16 +08:00