将caption pipeline的实现从pipeline下沉到model，并拆解preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9081211
* [to #41669377] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
* [to #41669377] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301
* refine doc
* refine doc
* upload ofa for caption(with source code but not whl)
* remove data in gitignore
* append uncommitted data dir in ofa
* remove ofa_dir , use ofa.whl instead.
* update BPE
* rollback changes used in debugging.
* Merge branch 'master' into ofa/image_caption
# Conflicts:
# docs/README.md
# docs/source/conf.py
# docs/source/index.rst
# docs/source/tutorials/pipeline.md
# maas_lib/models/nlp/sequence_classification_model.py
# maas_lib/pipelines/builder.py
# maas_lib/version.py
# setup.py
# tests/pipelines/test_text_classification.py
* 1. fix a bug in pipelines/builder.py.
2. modify model_path to model in image_captioning.py.
* 1. rename test_image_captioning.py.
* format all files using pre-commit.
* add fairseq in requirements.txt
* add fairseq in requirements.txt
* change fairseq path to git repo to a whl on oss in ofa.txt.
* change module_name to 'ofa'
* Merge remote-tracking branch 'origin/master' into ofa/image_caption
# Conflicts:
# maas_lib/pipelines/builder.py
* optim requirements for ofa / refine image_captioning.py
* uncommited change.
* feat: Fix confilct, auto commit by WebIDE
* Merge remote-tracking branch 'origin/master' into ofa/image_caption
# Conflicts:
# maas_lib/pipelines/multi_modal/__init__.py
# modelscope/pipelines/multi_modal/image_captioning.py
# tests/pipelines/test_image_captioning.py
* merge master
* merge master
* merge master
* rename
* Merge remote-tracking branch 'origin/master' into ofa/nlu
* add caption model
* Merge remote-tracking branch 'origin/master' into ofa/nlu
* update ofa caption model
* fix some typo, update unittest
* use local test image
* use local test image
* refactor, ofa -> multi_model
* merge master
* 删除 image_caption_pipeline.py
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8973072
* [to #41669377] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
* [to #41669377] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301
* refine doc
* feat: add audio aec pipeline and preprocessor
* feat: add audio aec model classes
* feat: add audio aec loss functions
* refactor:delete no longer used loss function
* [to #42281043] support kwargs in pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8949062
* support kwargs in pipeline
* update develop doc with CR instruction
* Merge branch 'release/0.1' into dev/aec
* style: reformat code by pre-commit tools
* feat:support maas_lib pipeline auto downloading model
* test:add aec test case as sample code
* feat:aec pipeline use config from maashub
* feat:aec pipeline use feature parameters from maashub
* update setup.cfg to disable PEP8 rule W503 in flake8 and yapf
* format:fix double quoted strings, indent issues and optimize import
* refactor:extract some constant in aec pipeline
* refactor: delete no longer used __main__ statement
* chore:change all Chinese comments to English
* fix: change file name style to lower case
* refactor: rename model name
* feat:load C++ .so from LD_LIBRARY_PATH
* feat:register PROPROCESSOR for LinearAECAndFbank
* refactory:move aec process from postprocess() to forward() and update comments
* refactory:add more readable error message when audio sample rate is not 16000
* fix: package maas_lib renamed to modelscope in import statement
* feat: optimize the error message of audio layer classes
* format: delete empty lines
* refactor: rename audio preprocessor and optimize error message
* refactor: change aec model id to damo/speech_dfsmn_aec_psm_16k
* refactor: change sample audio file url to public oss
* Merge branch 'master' into dev/aec
* feat: add output info for aec pipeline
* fix: normalize output audio data to [-1.0, 1.0]
* refactor:use constant from ModelFile
* feat: AEC pipeline can use c++ lib in current working directory and the test will download it
* fix: c++ downloading should work wherever test is triggerd
Adding the new task of sentence_similarity, in which the model is the sofa version of structbert
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9016402
* sbert-sentence-similarity
* [to #42322933] pip8
* merge with master for file dirs update
* add test cases
* pre-commit lint check
* remove useless file
* download models again~
* skip time consuming test case
* update for pr reviews
* merge with master
* add test level
* reset test level to env level
* [to #42322933] init
* [to #42322933] init
* adding purge logic in test
* merge with head
* change test level
* using sequence classification processor for similarity
1. add OFA whl for image caption pipeline
2. fix a bug in pipelines/builder.py
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8930942
* [to #41669377] docs and tools refinement and release
1. add build_doc linter script
2. add sphinx-docs support
3. add development doc and api doc
4. change version to 0.1.0 for the first internal release version
Link: https://code.aone.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8775307
* [to #41669377] add pipeline tutorial and fix bugs
1. add pipleine tutorial
2. fix bugs when using pipeline with certain model and preprocessor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8814301
* refine doc
* refine doc
* upload ofa for caption(with source code but not whl)
* remove data in gitignore
* append uncommitted data dir in ofa
* remove ofa_dir , use ofa.whl instead.
* update BPE
* rollback changes used in debugging.
* Merge branch 'master' into ofa/image_caption
# Conflicts:
# docs/README.md
# docs/source/conf.py
# docs/source/index.rst
# docs/source/tutorials/pipeline.md
# maas_lib/models/nlp/sequence_classification_model.py
# maas_lib/pipelines/builder.py
# maas_lib/version.py
# setup.py
# tests/pipelines/test_text_classification.py
* 1. fix a bug in pipelines/builder.py.
2. modify model_path to model in image_captioning.py.
* 1. rename test_image_captioning.py.
* format all files using pre-commit.
* add fairseq in requirements.txt
* add fairseq in requirements.txt
* change fairseq path to git repo to a whl on oss in ofa.txt.
* change module_name to 'ofa'
* Merge remote-tracking branch 'origin/master' into ofa/image_caption
# Conflicts:
# maas_lib/pipelines/builder.py
* optim requirements for ofa / refine image_captioning.py
* uncommited change.
* feat: Fix confilct, auto commit by WebIDE
1. refine quick start and pipeline doc
2. remove tf pytorch easynlp from requirements
3. lazy import for torch and tensorflow
4. test successfully on linux and mac intel cpu
5. update api doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8882373
* add trainer interface
* add trainer script
* add model init support for pipelineadd pipeline tutorial and fix bugs
* add text classification evaluation to maas lib
* add quickstart and prepare env doc
* relax requirements for torch and sentencepiece
* merge release/0.1 and fix conflict
* modelhub support for model and pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8868339
