Commit Graph

732 Commits

Author SHA1 Message Date
yingda.chen
c4b6a23bc9 [to #42322933] unify naming for model and pipeline files
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9083378
2022-06-20 10:54:00 +08:00
智丞
856bd858fd merge with master 2022-06-19 16:55:57 +08:00
bin.xue
31498c1d6a [to #41669377] add speech AEC pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8973072

    * [to #41669377] docs and tools refinement and release 

1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version

Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307

* [to #41669377] add pipeline tutorial and fix bugs 

1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301

* refine doc

* feat: add audio aec pipeline and preprocessor

* feat: add audio aec model classes

* feat: add audio aec loss functions

* refactor:delete no longer used loss function

* [to #42281043] support kwargs in pipeline 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8949062
* support kwargs in pipeline

* update develop doc with CR instruction

* Merge branch 'release/0.1' into dev/aec

* style: reformat code by pre-commit tools

* feat:support maas_lib pipeline auto downloading model

* test:add aec test case as sample code

* feat:aec pipeline use config from maashub

* feat:aec pipeline use feature parameters from maashub

* update setup.cfg to disable PEP8 rule W503 in flake8 and yapf

* format:fix double quoted strings, indent issues and optimize import

* refactor:extract some constant in aec pipeline

* refactor: delete no longer used  __main__ statement

* chore:change all Chinese comments to English

* fix: change file name style to lower case

* refactor: rename model name

* feat:load C++ .so from LD_LIBRARY_PATH

* feat:register PROPROCESSOR for LinearAECAndFbank

* refactory:move aec process from postprocess() to forward() and update comments

* refactory:add more readable error message when audio sample rate is not 16000

* fix: package maas_lib renamed to modelscope in import statement

* feat: optimize the error message of audio layer classes

* format: delete empty lines

* refactor: rename audio preprocessor and optimize error message

* refactor: change aec model id to damo/speech_dfsmn_aec_psm_16k

* refactor: change sample audio file url to public oss

* Merge branch 'master' into dev/aec

* feat: add output info for aec pipeline

* fix: normalize output audio data to [-1.0, 1.0]

* refactor:use constant from ModelFile

* feat: AEC pipeline can use c++ lib in current working directory and the test will download it

* fix: c++ downloading should work wherever test is triggerd
2022-06-17 19:56:11 +08:00
wenmeng.zwm
201922d33d [to #42461396] add git-lfs support and mv test data to git-lfs 2022-06-17 19:33:15 +08:00
ly119399
caadf4a39d local gen ready 2022-06-17 14:04:28 +08:00
zhangzhicheng.zzc
eb3209a79a [to #42322933]中文分词
chinese word segmentation
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9051491

    * add word segmentation

* Merge branch 'master' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib

* test with model hub

* merge with master

* update some description and test levels

* adding purge logic in test

* merge with master

* update variables definition

* generic word segmentation model as token classification model

* add output check
2022-06-17 14:00:31 +08:00
suluyan
bb5a40ad8c test level >= 0 2022-06-17 11:54:42 +08:00
yingda.chen
ad8e080e37 [to #42322933] refactor model name
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9068994
2022-06-17 10:25:54 +08:00
suluyan
3aa1a70ac8 add tests 2022-06-17 00:36:25 +08:00
智丞
951077c729 registry multi models on model and pipeline 2022-06-16 20:23:15 +08:00
suluyan
953e8ffbfa fill mask 2022-06-16 19:34:36 +08:00
易相
2c77fba805 [to #42322933] pre commit fix 2022-06-16 15:21:33 +08:00
易相
98b6c62654 [to #42322933] bugfix 2022-06-16 15:21:33 +08:00
易相
c16c7c2efc Merge branch 'master' into feat/zero_shot_classification
# Conflicts:
#	modelscope/preprocessors/__init__.py
2022-06-16 14:52:50 +08:00
易相
34db19131f init 2022-06-16 14:52:03 +08:00
ly119399
3c687c9f37 generation ready 2022-06-16 14:34:51 +08:00
wenmeng.zwm
4f7928bb6e [to #42362853] formalize the output of pipeline and make pipeline reusable
* format pipeline output and check it
* fix UT
* add docstr to clarify the difference between model.postprocess and pipeline.postprocess

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9051405
2022-06-16 11:15:09 +08:00
zhangzhicheng.zzc
ba471d4492 [to #42322933]sentence-similarity
Adding the new task of sentence_similarity, in which the model is the sofa version of structbert
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9016402

    * sbert-sentence-similarity

* [to #42322933] pip8

* merge with master for file dirs  update

* add test cases

* pre-commit lint check

* remove useless file

* download models again~

* skip time consuming test case

* update for pr reviews

* merge with master

* add test level

* reset test level to env level

* [to #42322933] init

* [to #42322933] init

* adding purge logic in test

* merge with head

* change test level

* using sequence classification processor for similarity
2022-06-15 23:35:12 +08:00
lingcai.wl
d983bdfc8e [to #42463204] support Pil.Image for image_captioning
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9049211
2022-06-15 18:37:40 +08:00
fubang.zfb
48da1619a7 [to #42322933] init 2022-06-15 17:07:04 +08:00
ly119399
b1948cd81c modify forward 2022-06-15 16:23:57 +08:00
wenmeng.zwm
c59833c7ee [to #42461396] feat: test_level support
* add test level support
* update develop doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9021354
2022-06-15 14:53:49 +08:00
yingda.chen
d7112be056 [to #42510875]use sphinx book theme
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9042850
2022-06-15 14:07:57 +08:00
yingda.chen
5786b9a0a1 [to #42322933]formalize image matting
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9019685
2022-06-15 14:06:53 +08:00
wenmeng.zwm
b4fc38e1b9 [to #42461396] add Pillow version constraint and update hub version
1.  use Pillow >= 6.2.0
2. change skip test msg for image caption
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9041194
2022-06-15 11:43:52 +08:00
wenmeng.zwm
67086e26f9 [to #42362932] feat: docker_support
* add dockerfile
* uninstall opencv-python-headless
* update develop doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9020302
2022-06-14 16:29:12 +08:00
思宏
7140cdb670 [to #42322933] init 2022-06-14 13:58:43 +08:00
思宏
cf112dbbf7 [to #42322933] init 2022-06-14 11:45:05 +08:00
智丞
46fca87f2a Merge remote-tracking branch 'origin/master' into feat/nli 2022-06-14 09:28:11 +08:00
智丞
753b98f526 update pipeline registry info 2022-06-14 09:27:38 +08:00
思宏
314082810e [to #42322933] init 2022-06-13 20:24:31 +08:00
wenmeng.zwm
8a030ead72 [to #42362853] feat: rename config to configuration and remove repeated task fileds
1. rename maas_config to configuration
2. remove task field image and video, using cv instead

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9010802
2022-06-13 19:44:34 +08:00
ly119399
e4f2bdce54 bug fix 2022-06-13 19:03:37 +08:00
wenmeng.zwm
3a78e32eb2 Revert "[to #42322933]formalize image matting"
This reverts commit de3ea0db54.
2022-06-13 18:30:29 +08:00
思宏
62d98c0273 [to #42322933] init 2022-06-13 17:30:48 +08:00
ly119399
ddd0c325a9 fix flake8 bug 2022-06-13 17:21:05 +08:00
思宏
414c0c1b3c init 2022-06-13 16:56:30 +08:00
ly119399
a09fec6c56 delete file about gen 2022-06-13 16:46:59 +08:00
ly119399
ccbbd959a7 Merge branch 'master' into nlp/space/gen 2022-06-13 16:43:48 +08:00
ly119399
85081fb3b4 update 2022-06-13 16:22:59 +08:00
Yingda Chen
de3ea0db54 [to #42322933]formalize image matting 2022-06-13 15:19:30 +08:00
yingda.chen
b31c86aa0e [to #42409340] add hub specifier
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9005038
2022-06-13 14:15:54 +08:00
ly119399
605db5b0e2 update 2022-06-12 23:39:05 +08:00
ly119399
c400684327 update 2022-06-12 23:31:45 +08:00
ly119399
55f8bb9769 add flake8 2022-06-12 23:28:09 +08:00
ly119399
46c2dcc27d test with model hub 2022-06-12 23:27:26 +08:00
ly119399
e683a2d4cd merge master 2022-06-12 14:55:32 +08:00
ly119399
c6ec7f2fa4 intent success 2022-06-12 14:14:26 +08:00
wenmeng.zwm
76bc51eadd [to #42362853] support multimodel in pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8997599
2022-06-10 16:22:28 +08:00
yingda.chen
3c1ec035fd [to #42322933] refine cartoon model and add model op utitlity
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8993758
2022-06-10 12:56:44 +08:00