Commit Graph

732 Commits

Author SHA1 Message Date
Yingda Chen
8153a96409 merge master 2022-06-23 10:31:55 +08:00
Yingda Chen
602dfcd508 tmp 2022-06-23 10:29:07 +08:00
yongfei.zyf
ace8af9246 [to #42322933] Add cv-action-recongnition-pipeline to maas lib
达摩行为识别合入maas lib
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9134444
2022-06-23 10:22:43 +08:00
lingcai.wl
2019315c54 [to #42463204] support Pil.Image for image_captioning_pipeline 2022-06-22 23:54:38 +08:00
feiwu.yfw
b8ba35bd27 [to #42670107] restore pydataset test
* pydataset unitest
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9132896
2022-06-22 22:01:25 +08:00
雨泓
96e25be7d2 add default args 2022-06-22 21:54:41 +08:00
雨泓
3987a3bf7d ut run passed 2022-06-22 21:51:29 +08:00
智丞
1009d54d22 add test level 2022-06-22 20:49:42 +08:00
雨泓
67a8440de5 add eval() to pipeline call 2022-06-22 20:34:17 +08:00
智丞
ae9a7f9a5b Merge branch 'feat/nlp_refactor' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/nlp_refactor 2022-06-22 20:14:24 +08:00
智丞
c63107c500 revise modelhub dependency 2022-06-22 20:14:03 +08:00
雨泓
63695d6743 unfinished 2022-06-22 20:13:41 +08:00
雨泓
31c774936b unfinished 2022-06-22 19:05:37 +08:00
yingda.chen
8400ca1fc7 [to #42322933] add create if not exist and add(back) create model example
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
2022-06-22 18:39:08 +08:00
suluyan
9e846b8fc0 fix bug 2022-06-22 17:31:52 +08:00
雨泓
c5693f2a84 unfiinished change 2022-06-22 17:11:18 +08:00
suluyan
e43e5930f4 fix: pipeline module_name from model_type to 'fill_mask' & fix merge bug 2022-06-22 16:53:12 +08:00
suluyan
e50e0e0fd1 Merge remote-tracking branch 'origin' into feat/fill_mask
Conflicts:
	modelscope/utils/constant.py
2022-06-22 16:27:50 +08:00
luoyiyun.lyy
849410e107 [to #41474818]fix: fix errors in task name definition
修改constant.py中task name定义的错误
- sentence-similarity重复定义
- fill-mask多加了一个空格
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9125956

    * [to #41474818]fix: fix errors in task name definition
2022-06-22 15:49:58 +08:00
智丞
5fdfb9e5b7 merge with master head 2022-06-22 14:23:07 +08:00
wenmeng.zwm
e288cf076e [to #42362853] refactor pipeline and standardize module_name
* using get_model to validate hub path 
* support reading pipeline info from configuration file
* add metainfo const
* update model type and pipeline type and fix UT
* relax requimrent for protobuf
* skip two dataset tests due to temporal failure
 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9118154
2022-06-22 14:15:32 +08:00
智丞
4dfab005ca merge with space 2022-06-22 11:32:56 +08:00
智丞
17e6a3d41d merge with fill_mask 2022-06-22 11:30:03 +08:00
智丞
bcbe079290 merge with zero_shot_classfication 2022-06-22 11:28:22 +08:00
智丞
8853b0dff1 merge with sentiment_classification 2022-06-22 11:25:23 +08:00
智丞
28fe91c8fd merge with nli task 2022-06-22 11:17:51 +08:00
智丞
88ee08c5dd Merge remote-tracking branch 'origin/master' into feat/zero_shot_classification 2022-06-21 20:36:25 +08:00
智丞
8ae2e46ad3 allow params pass to pipeline's __call__ method 2022-06-21 20:36:17 +08:00
mulin.lyh
76c6ff6329 [to #42675838]merge model hub code
合并model hub 代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9096493
2022-06-21 20:04:25 +08:00
suluyan
62c2877b60 fix isort for pre-commit check 2022-06-21 16:30:22 +08:00
suluyan
b049f17f54 fix comments 2022-06-21 15:52:22 +08:00
智丞
fcc5740238 merge with master 2/2 2022-06-21 15:49:08 +08:00
智丞
c8ccfe0a2c merge with master 2022-06-21 15:37:13 +08:00
suluyan
cf75f2aeec Merge remote-tracking branch 'origin' into feat/fill_mask
Conflicts:
	modelscope/models/nlp/__init__.py
	modelscope/pipelines/builder.py
	modelscope/pipelines/outputs.py
	modelscope/preprocessors/nlp.py
	requirements/nlp.txt
2022-06-21 15:33:24 +08:00
zhangzhicheng.zzc
7a175ee9b3 [to #42322933]move tts dependency to local
requirements/audio.txt
中依赖存在两个问题:
1. torch/tensorflow版本写死
2. 两个whl包是linux环境下才可安装,进而whl包安装的package要在mac上忽略的话,代码中必须把相应package放到local中引用

上面两个问题在linux环境中的测试用例是可以通过的。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9103904

    * move tts dependency to local
2022-06-21 14:06:09 +08:00
xixing.tj
968e660235 [to #42322933] create ocr_detection task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8967432

* create ocr_detection task

* replace c++ nms with python version

* replace c++ decoder with python version

* add requirements for ocr_detection
2022-06-21 11:56:52 +08:00
yichang.zyc
a2cf3d619e [to #42322933]update ofa caption model
将caption pipeline的实现从pipeline下沉到model,并拆解preprocessor
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9081211

    * [to #41669377] docs and tools refinement and release 

1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307

* [to #41669377] add pipeline tutorial and fix bugs 

1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301

* refine doc

* refine doc

* upload ofa for caption(with source code but not whl)

* remove data in gitignore

* append uncommitted data dir in ofa

* remove ofa_dir , use ofa.whl instead.

* update BPE

* rollback changes used in debugging.

* Merge branch 'master' into ofa/image_caption

# Conflicts:
#	docs/README.md
#	docs/source/conf.py
#	docs/source/index.rst
#	docs/source/tutorials/pipeline.md
#	maas_lib/models/nlp/sequence_classification_model.py
#	maas_lib/pipelines/builder.py
#	maas_lib/version.py
#	setup.py
#	tests/pipelines/test_text_classification.py

* 1. fix a bug in pipelines/builder.py.
2. modify model_path to model in image_captioning.py.

* 1. rename test_image_captioning.py.

* format all files using pre-commit.

* add fairseq in requirements.txt

* add fairseq in requirements.txt

* change fairseq path to git repo to a whl on oss in ofa.txt.

* change module_name to 'ofa'

* Merge remote-tracking branch 'origin/master' into ofa/image_caption

# Conflicts:
#	maas_lib/pipelines/builder.py

* optim requirements for ofa / refine image_captioning.py

* uncommited change.

* feat: Fix confilct, auto commit by WebIDE

* Merge remote-tracking branch 'origin/master' into ofa/image_caption

# Conflicts:
#	maas_lib/pipelines/multi_modal/__init__.py
#	modelscope/pipelines/multi_modal/image_captioning.py
#	tests/pipelines/test_image_captioning.py

* merge master

* merge master

* merge master

* rename

* Merge remote-tracking branch 'origin/master' into ofa/nlu

* add caption model

* Merge remote-tracking branch 'origin/master' into ofa/nlu

* update ofa caption model

* fix some typo, update unittest

* use local test image

* use local test image

* refactor, ofa -> multi_model

* merge master

* 删除 image_caption_pipeline.py
2022-06-21 11:48:49 +08:00
feiwu.yfw
c7238a470b [to #42670107]pydataset fetch data from datahub
* pydataset fetch data from datahub
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9060856
2022-06-21 11:10:28 +08:00
智丞
05ac2b15d1 merge with master 2022-06-20 21:39:52 +08:00
智丞
7b20e96af2 merge with nlp/space/dst 2022-06-20 21:39:17 +08:00
智丞
42d0142c00 support dst data processor 2022-06-20 21:36:58 +08:00
bin.xue
97a0087976 [to #42322933]语音使用local import避免其他任务加载torchaudio
feat: local import torchaudio
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9097950

    * feat: local import torchaudio
2022-06-20 20:30:27 +08:00
ly119399
c6cf0d20c5 add dep 2022-06-20 17:35:53 +08:00
jiaqi.sjq
b1490bfd7f [to #9061073] feat: merge tts to master
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9061073
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9061073

    * [to #41669377] docs and tools refinement and release 

1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307

* [to #41669377] add pipeline tutorial and fix bugs 

1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301

* refine doc

* refine doc

* merge remote release/0.1 and fix conflict

* Merge branch 'release/0.1' into 'nls/tts'

Release/0.1



See merge request !1700968

* [Add] add tts preprocessor without requirements. finish requirements build later

* [Add] add requirements and frd submodule

* [Fix] remove models submodule

* [Add] add am module

* [Update] update am and vocoder

* [Update] remove submodule

* [Update] add models

* [Fix] fix init error

* [Fix] fix bugs with tts pipeline

* merge master

* [Update] merge from master

* remove frd subdmoule and using wheel from oss

* change scripts

* [Fix] fix bugs in am and vocoder

* [Merge] merge from master

* Merge branch 'master' into nls/tts

* [Fix] fix bugs

* [Fix] fix pep8

* Merge branch 'master' into nls/tts

* [Update] remove hparams and import configuration from kwargs

* Merge branch 'master' into nls/tts

* upgrade tf113 to tf115

* Merge branch 'nls/tts' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into nls/tts

* add multiple versions of ttsfrd

* merge master

* [Fix] fix cr comments

* Merge branch 'master' into nls/tts

* [Fix] fix cr comments 0617

* Merge branch 'master' into nls/tts

* [Fix] remove comment out codes

* [Merge] merge from master

* [Fix] fix crash for incompatible tf and pytorch version, and frd using zip file resource

* Merge branch 'master' into nls/tts

* [Add] add cuda support
2022-06-20 17:23:11 +08:00
ly119399
b812cb78c9 add dep 2022-06-20 17:10:54 +08:00
ly119399
6f8910dbcb bug fix 2022-06-20 16:49:32 +08:00
ly119399
d0b33eade8 space intent and modeling(generation) are ready 2022-06-20 16:39:21 +08:00
suluyan
c7a19c9c1f fix comments: rename and refactor AliceMindMLM; adjust pipeline 2022-06-20 16:17:31 +08:00
ly119399
c99f3a9b8c dialog modeling ready 2022-06-20 16:03:50 +08:00
hemu.zp
99fb503695 [to #42322933] Add Palm2.0 model.
接入支持中英文的 Palm2.0 模型,复用 text-generation-pipeline

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9066550
2022-06-20 16:00:31 +08:00