Commit Graph

70 Commits

Author SHA1 Message Date
yingda.chen
6e9dcc6327 [to #42322933]numpy version
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9598631
2022-08-02 10:37:40 +08:00
dangwei.ldw
e93339ea87 [to #42322933]Merge request from 仲理:feat/product_feature
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9515599
2022-08-01 17:53:22 +08:00
wenmeng.zwm
34acc596e1 [to #43115513] fix module path error for ast and add numpy<=1.18
1. fix module path error,   if code path contains multiple `modelscope` str,  use the last one as the start position of  modelscope source direcotry
2. add numpy version constraint <=1.18
3. add __init__.py to models/cv/image_to_image_translation
4. split audio requirements from all

 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9587929
2022-08-01 15:42:58 +08:00
feiwu.yfw
743e876981 [to #43660556] msdataset数据集加载
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9552632

* load csv dataset from modelscoop
2022-07-29 12:22:48 +08:00
wendi.hwd
674e625e7c [to #42322933]cv_det_branch_to_master
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9490080
2022-07-29 11:48:51 +08:00
klayzhang.zb
ca4b5b2565 [to #42322933][NLP] Add text error correction task
NLP新增文本纠错任务
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9540716
2022-07-28 23:01:28 +08:00
bin.xue
e3bffedb87 [to #42322933] aec pipeline修改C++库依赖到MinDAEC
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9563105

    * use MinDAEC instead of cdll

* feat: ANS pipeline can accept bytes as input and adjust processing order to reduce the amount of computation
2022-07-28 22:59:57 +08:00
wenmeng.zwm
590d531484 [to #43115513] requirements refine and preparation for v0.3 release
*  remove tensorflow numpy from audio requirements
*  add audio requirements to all
* auto set model to eval model for pipeline
*  add audio requirement check hint for easyasr and kwsbp
*  fix docs build error

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9561021
2022-07-28 22:04:18 +08:00
wenmeng.zwm
d55525bfb6 [to #43112771] requirements check and lazy import support 2022-07-27 17:29:16 +08:00
shichen.fsc
5ac448f5c7 [to #42322933] simplify asr inference code, and remove disk-write behavior
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9410174
2022-07-27 14:49:24 +08:00
mulin.lyh
a7ffa7f6ce [to #43588165]fix: nlp case github connection broken
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9528871

    * [to #43588165]fix: nlp case github connection broken
2022-07-27 11:00:40 +08:00
mulin.lyh
fc90bf0d1a [to #43554786]fix: test error is not detected in gate test, protobuf version to (3, 3.21.0) for tensorflow
限制protobuf版本,修复单元测试有error返回值为0问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9510263

    * fix test error is not detected in gate test, protobuf version to (3, 3.21.0)
2022-07-26 10:57:16 +08:00
shichen.fsc
b3b950e616 [to #42322933] simplify kws code, and remove disk-write behavior
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9491681
2022-07-25 22:37:15 +08:00
Yingda Chen
badc91aafa Revert "[to #43259593]chore: update cv requirements (更新cv侧统计的依赖项) "
This reverts commit bab28ae3fa.
2022-07-25 13:50:18 +08:00
liangting.zl
bab28ae3fa [to #43259593]chore: update cv requirements (更新cv侧统计的依赖项)
[依赖收集及列表](https://yuque.antfin.com/docs/share/59d1f42c-e061-4e73-903f-0af053a03627#XXbRB)
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9456258
2022-07-25 13:31:36 +08:00
hemu.zp
ab04ceafc5 [to #42322933] set rouge_score version
2022/7/22 更新的 rouge_socre 0.0.7 版本存在 import 报错的问题,暂时将 rouge_score 库版本设置为 <= 0.0.4
2022-07-22 18:22:43 +08:00
yingda.chen
dbb450932d [to #42322933] clean requirment
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9458816
2022-07-20 20:43:42 +08:00
hemu.zp
0b7b964226 [to #42322933] Add palm finetuning
Palm 模型支持 finetuning
2022-07-20 16:36:11 +08:00
mulin.lyh
69047b99ae [to #43387011]feat: ci test to new host and running in docker
ci 测试迁移新的机器,并且在容器中运行,减小互相干扰的可能
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9427096

    * add docker ci script
2022-07-20 11:49:05 +08:00
ly119399
40b1a9566d [to #42322933] remove dependency en_core_web_sm from nlp.txt
将nlp.txt中的en_core_web_sm依赖删除,在代码中下载响应的依赖
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9432253
2022-07-19 22:39:54 +08:00
wenmeng.zwm
e62cd756df [to #42322933] relax requirements
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9407594
2022-07-18 17:52:14 +08:00
jiaqi.sjq
a17f29ce54 [to #42322933] Update tts task inputs
Refactor tts task inputs
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9412937
2022-07-18 17:50:59 +08:00
shichen.fsc
d7c780069f [to #42322933] add asr inference with pytorch(espnet framework)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9273537
2022-07-11 16:48:47 +08:00
jiaqi.sjq
d313c440c4 [to #9303837] Merge frontend am and vocoder into one model card
Merge frontend, am and vocoder model card into one model card.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9303837
2022-07-08 14:26:18 +08:00
wenmeng.zwm
9f1ad5da80 fix several small problems for v0.2
* rename name of whl to modelscope
* auto install all requirements when running citest
* auto download dynamic lib for aec pipeline
* fix setup.py  audio extras not set
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9297825
2022-07-07 16:40:11 +08:00
wenmeng.zwm
274cf6ffa9 [to #42362425] fix audio_requirement and refine quickstart, changelog doc
* make audio requirements optional
 * add changelog for version v0.2
 * add numpy constraint for compatibility with tensorflow1.15
 * update faq
 * fix nlp requiring tensorflow
 * add torchvision to multimodal dependency
 * bump version from 0.2.1 to 0.2.2
 * add warning msg when tensorflow is not installed
 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9268278
2022-07-05 21:44:33 +08:00
智丞
e5f99bc6d0 update requirements/nlp 2022-07-03 10:39:17 +08:00
智丞
54122b2dab merge with master 2022-07-02 21:58:42 +08:00
zhangzhicheng.zzc
5b98cc1513 [to #42322933]新增:nli,sentiment_classification,dialog_intent,dialog_modeling
添加了,nli,sentiment_classification, dialog_intent, dialog_modeling几个pipeline。同时加入了nlp里面sequence classification一些简单的抽象。
去掉了zero_shot_classification
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9159089
2022-07-01 23:13:03 +08:00
wenmeng.zwm
8e51a073a6 [to #42966122] requirements enchanment and self-host repo support
* add self-hosted repo:
* add extra requirements for different field and reduce necessary requirements
* update docker file with so required by audio
* add requirements checker which will be used later when implement lazy import
* remove repeated requirements and replace opencv-python-headless with opencv-python

example usage:
```shell
pip install model_scope[all] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[cv] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[nlp] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[audio] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[multi-modal] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html

```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9211383
2022-07-01 16:38:06 +08:00
ly119399
90c5e18183 update requirement 2022-06-30 19:28:33 +08:00
hemu.zp
a03106172f [to #42322933] Update sofa version 1.0.4.2
更新 sofa 到 1.0.4.2 版本,解决 palm 模型无法并行的 bug
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9217921
2022-06-30 15:35:59 +08:00
ly119399
4cfc4b43a0 merge feat/nlp 2022-06-29 22:27:52 +08:00
hemu.zp
fabea5604e [to #42322933] Add MPLUG model
添加 MPLUG 模型的 visual question answering 任务 pipeline

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9182119
2022-06-29 11:08:34 +08:00
bin.xue
04b7eba285 [to #42322933] Merge ANS pipeline into master
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9178339

    * refactor: move aec models to audio/aec

* refactor: move aec models to audio/aec

* refactor: move aec models to audio/aec

* refactor: move aec models to audio/aec

* feat: add unittest for ANS pipeline

* Merge branch 'master' into dev/ans

* add new SoundFile to audio dependency

* Merge branch 'master' into dev/ans

* use ANS pipeline name from metainfo

* Merge branch 'master' into dev/ans

* chore: update docstring of ANS module

* Merge branch 'master' into dev/ans

* refactor: use names from metainfo

* refactor: enable ans unittest

* refactor: add more log message in unittest
2022-06-28 14:41:08 +08:00
ly119399
80461600f7 merge nlp 2022-06-25 13:44:31 +08:00
智丞
6741bc5afd merge with master 2022-06-24 15:12:39 +08:00
jiaqi.sjq
4a3f22259f * Relax version requirements in audio.txt
* Fix bugs in ttsfrd which may cause text-to-speech break disappear and upgrade it to version 0.0.2
* other fix to make ut pass
2022-06-24 12:05:01 +08:00
suluyan.sly
0286dd45cc [to #42322933] Add nlp-structbert/veco-fill-mask-pipeline to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9069107
2022-06-24 10:12:16 +08:00
雨泓
c74a252b6c Merge commit 'ace8af92465f7d772f035aebe98967726655f12c' into feat/nlp
* commit 'ace8af92465f7d772f035aebe98967726655f12c':
  [to #42322933] Add cv-action-recongnition-pipeline to maas lib
  [to #42463204]  support Pil.Image for image_captioning_pipeline
  [to #42670107] restore pydataset test
  [to #42322933] add create if not exist and add(back) create model example         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
  [to #41474818]fix: fix errors in task name definition

# Conflicts:
#	modelscope/pipelines/builder.py
#	modelscope/utils/constant.py
2022-06-23 11:26:44 +08:00
yongfei.zyf
ace8af9246 [to #42322933] Add cv-action-recongnition-pipeline to maas lib
达摩行为识别合入maas lib
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9134444
2022-06-23 10:22:43 +08:00
智丞
5fdfb9e5b7 merge with master head 2022-06-22 14:23:07 +08:00
wenmeng.zwm
e288cf076e [to #42362853] refactor pipeline and standardize module_name
* using get_model to validate hub path 
* support reading pipeline info from configuration file
* add metainfo const
* update model type and pipeline type and fix UT
* relax requimrent for protobuf
* skip two dataset tests due to temporal failure
 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9118154
2022-06-22 14:15:32 +08:00
智丞
4dfab005ca merge with space 2022-06-22 11:32:56 +08:00
智丞
17e6a3d41d merge with fill_mask 2022-06-22 11:30:03 +08:00
mulin.lyh
76c6ff6329 [to #42675838]merge model hub code
合并model hub 代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9096493
2022-06-21 20:04:25 +08:00
suluyan
cf75f2aeec Merge remote-tracking branch 'origin' into feat/fill_mask
Conflicts:
	modelscope/models/nlp/__init__.py
	modelscope/pipelines/builder.py
	modelscope/pipelines/outputs.py
	modelscope/preprocessors/nlp.py
	requirements/nlp.txt
2022-06-21 15:33:24 +08:00
xixing.tj
968e660235 [to #42322933] create ocr_detection task
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/8967432

* create ocr_detection task

* replace c++ nms with python version

* replace c++ decoder with python version

* add requirements for ocr_detection
2022-06-21 11:56:52 +08:00
智丞
05ac2b15d1 merge with master 2022-06-20 21:39:52 +08:00
ly119399
c6cf0d20c5 add dep 2022-06-20 17:35:53 +08:00