Commit Graph

101 Commits

Author SHA1 Message Date
mulin.lyh
e7cb20614f [to #43019862]feat: remove gitlab address
去掉gitlab地址配置
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9256404

    * remove gitlab address
2022-07-04 20:12:31 +08:00
ly103369
d74e644aaf [to #42322933] Add cv_r2p1d_video_embedding to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9246462
2022-07-04 16:05:52 +08:00
yingda.chen
d78d944246 [to #42322933] support text to image synthesis default model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9253639
2022-07-04 14:21:22 +08:00
yongfei.zyf
82e222ed14 [to #42322933] Add cv-action-recongnition-pipeline run inference with the cpu
行为识别推理同时支持CPU和GPU
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9253438
2022-07-04 14:03:24 +08:00
yingda.chen
a60d675d25 [to #42322933]formalize test data storage
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9251871
2022-07-04 12:11:12 +08:00
zhangzhicheng.zzc
e691585e15 [to #42322933]添加nlp translation pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9198181
2022-07-04 10:28:38 +08:00
Yingda Chen
059c8fd248 [to #42322933] do not run imagen on gated for now 2022-07-03 10:36:30 +08:00
xuangen.hlh
62f1e76ff8 [to #42322933] Add cv_imagen_text-to-image-synthesis_tiny to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9242667
2022-07-02 15:47:25 +08:00
zhangzhicheng.zzc
5b98cc1513 [to #42322933]新增:nli,sentiment_classification,dialog_intent,dialog_modeling
添加了,nli,sentiment_classification, dialog_intent, dialog_modeling几个pipeline。同时加入了nlp里面sequence classification一些简单的抽象。
去掉了zero_shot_classification
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9159089
2022-07-01 23:13:03 +08:00
yingda.chen
0260b89431 [to #42322933] unified output keys
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9240440
2022-07-01 18:29:34 +08:00
huangjun.hj
31b203acfb * [to #42322933] refine quick_start.md and pipeline.md 2022-07-01 17:35:56 +08:00
wenmeng.zwm
bb57020daa [to #42362425] remove add module to default group
![](https://cn-hangzhou.oss-cdn.aliyun-inc.com/git/force/uploads/comment/29212/25464477278968069/image.png)

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9229852
2022-07-01 17:27:55 +08:00
wenmeng.zwm
8e51a073a6 [to #42966122] requirements enchanment and self-host repo support
* add self-hosted repo:
* add extra requirements for different field and reduce necessary requirements
* update docker file with so required by audio
* add requirements checker which will be used later when implement lazy import
* remove repeated requirements and replace opencv-python-headless with opencv-python

example usage:
```shell
pip install model_scope[all] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[cv] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[nlp] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[audio] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html
pip install model_scope[multi-modal] -f https://pai-vision-data-hz.oss-cn-zhangjiakou.aliyuncs.com/release/maas/repo.html

```
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9211383
2022-07-01 16:38:06 +08:00
yingda.chen
9c72c06e0b [to #42322933] merge hub api for model and dataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9233644
2022-07-01 11:29:33 +08:00
shichen.fsc
40cb1043b8 [to #42322933] add customized keywords setting for KWS
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9200613

    * [Add] add KWS code

    * [Fix] fix kws warning

    * [Add] add ROC for KWS

    * [Update] add some code check

    * [Update] refactor kws code, bug fix

    * [Add] add customized keywords setting for KWS

    * [Add] add data/test/audios for KWS
2022-06-30 22:40:38 +08:00
yichang.zyc
12cc394a95 [to #42322933] use gpu when available
ofa/caption 增加feature, 如果有gpu默认使用gpu
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9228113
2022-06-30 18:34:20 +08:00
yanheng.wyh
5fc8b3c9ab [to #42322933] upate animal recognition model name 2022-06-30 17:46:31 +08:00
hemu.zp
a03106172f [to #42322933] Update sofa version 1.0.4.2
更新 sofa 到 1.0.4.2 版本,解决 palm 模型无法并行的 bug
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9217921
2022-06-30 15:35:59 +08:00
mulin.lyh
c2ae3de640 [to #42879757 #42887254]fix: Repository initialize lfs after clone, add download times counter
Repository在clone后执行 git lfs install初始化lfs支持,下载技术添加到header里
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9204291

    * [to #42879757 #42887254]fix: Repository initialize lfs after clone, add download times counter
2022-06-30 14:27:53 +08:00
mulin.lyh
0264b25a60 [to #42322933]modify to new ip
修改为新的服务ip
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9217420

    * modify modelhub datahub to new ip, fix image-caption case bug
2022-06-30 13:54:49 +08:00
hemu.zp
fabea5604e [to #42322933] Add MPLUG model
添加 MPLUG 模型的 visual question answering 任务 pipeline

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9182119
2022-06-29 11:08:34 +08:00
zhangzhicheng.zzc
576b7cffb1 [to #42322933] add pipeline params for preprocess and forward & zeroshot classification
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9180863
2022-06-29 09:12:59 +08:00
wenmeng.zwm
1cb2fa850f [to #42362425] update version with 0.2.1 2022-06-28 22:21:21 +08:00
mulin.lyh
0d17eb5b39 [to #42849800 #42822853 #42822836 #42822791 #42822717 #42820011]fix: bug test bugs
修复测试bug
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9186775

    * [to #42849800 #42822853 #42822836 #42822791 #42822717 #42820011]fix: test bugs
2022-06-28 21:12:15 +08:00
feiwu.yfw
5da470fd5d [to #42791465, #42779255, #42777959, #42757844, #42756050, #42746916, #42743595, #42791863] fix: fix msdataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9174075

* fix msdataset
2022-06-28 20:40:57 +08:00
bin.xue
04b7eba285 [to #42322933] Merge ANS pipeline into master
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9178339

    * refactor: move aec models to audio/aec

* refactor: move aec models to audio/aec

* refactor: move aec models to audio/aec

* refactor: move aec models to audio/aec

* feat: add unittest for ANS pipeline

* Merge branch 'master' into dev/ans

* add new SoundFile to audio dependency

* Merge branch 'master' into dev/ans

* use ANS pipeline name from metainfo

* Merge branch 'master' into dev/ans

* chore: update docstring of ANS module

* Merge branch 'master' into dev/ans

* refactor: use names from metainfo

* refactor: enable ans unittest

* refactor: add more log message in unittest
2022-06-28 14:41:08 +08:00
suluyan.sly
a7c1cd0fc9 [to #42322933]feat: add nlp-chinese-bert-fill-mask-pipeline to maas_lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9155437
2022-06-28 14:34:16 +08:00
yanheng.wyh
664de39b79 [to #42322933]animal recognation model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9126742

    * animal recognation model

* update codes

* delet file

* f

* pre commits

* revise

* fix last comment

* fix comments

* fix precommit

* fix comments

* Merge remote-tracking branch 'origin' into cv/animalRecog

* fix comments
2022-06-28 14:04:40 +08:00
xixing.tj
d4692b5ada [to #42322933]Merge branch 'master' into ocr/ocr_detection
修复master分支ocr_detection 单元测试bug
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9112290

    * create ocr_detection task

* fix code check error

* fix code check error

* fix code check issue

* fix code check issue

* replace c++ nms with python version

* fix code check issue

* fix code check issue

* rename maas_lib

* merge master to ocr/ocr_detection

* add model_hub sup for ocr_detection

* fix bug

* replace c++ decoder with python version

* fix bug

* Merge branch 'master' into ocr/ocr_detection

* merge master

* fix code check

* update

* add requirements for ocr_detection

* fix model_hub fetch bug

* remove debug code

* Merge branch 'master' into ocr/ocr_detection

* add local test image for ocr_detection

* update requirements for model_hub

* Merge branch 'master' into ocr/ocr_detection

* fix bug for full case test

* remove ema for ocr_detection

* Merge branch 'master' into ocr/ocr_detection

* apply ocr_detection test case

* Merge branch 'master' into ocr/ocr_detection

* update slim dependency for ocr_detection

* add more test case for ocr_detection

* release tf graph before create

* recover ema for ocr_detection model

* fix code

* Merge branch 'master' into ocr/ocr_detection

* fix code
2022-06-28 14:03:01 +08:00
Yingda Chen
cfeac7afd8 [to #42322933] skip aec test 2022-06-27 15:07:46 +08:00
shichen.fsc
5386748bc4 [to #42322933] add some code check
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9122842

    * [Add] add KWS code

* [Update] check code linters and formatter

* [Update] update kws code

* Merge branch 'master' into dev/kws

* [Fix] fix kws warning

* [Add] add ROC for KWS

* [Update] add some code check

* feat: Fix confilct, auto commit by WebIDE

* feat: Fix confilct, auto commit by WebIDE

* Merge branch 'master' into dev/kws

* [Update] refactor kws code

* [Update] refactor kws code

* [Update] refactor kws code, bug fix

* [Update] refactor kws code, bug fix
2022-06-27 11:59:44 +08:00
eniac.xcw
9ff6b704b0 [to #42322933]add multi-modal-feature
增加中文图文特征模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9157786

    * add multi-modal-feature

* 修改code review中的问题
2022-06-27 11:57:22 +08:00
yingda.chen
6702b29e21 [to #42794773]rename pydataset to msdataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9165402
2022-06-27 11:09:38 +08:00
Yingda Chen
b6e3fd80b0 Revert "[to #42794773] rename pydataset to msdataset"
This reverts commit c8e2e6de0e.
2022-06-25 08:50:28 +08:00
Yingda Chen
c8e2e6de0e [to #42794773] rename pydataset to msdataset 2022-06-25 08:36:48 +08:00
yingda.chen
0acbfe1663 [to #42322933] interface refine with doc
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9159678
2022-06-24 23:54:10 +08:00
mulin.lyh
6991620f59 [to #42698276]fix: git repo operations supports, gitlab token certification support. 2022-06-24 16:43:32 +08:00
jiaqi.sjq
4a3f22259f * Relax version requirements in audio.txt
* Fix bugs in ttsfrd which may cause text-to-speech break disappear and upgrade it to version 0.0.2
* other fix to make ut pass
2022-06-24 12:05:01 +08:00
yingda.chen
e7571a566f [to #42322933] skip dataset test for now
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9155405
2022-06-24 11:47:28 +08:00
suluyan.sly
0286dd45cc [to #42322933] Add nlp-structbert/veco-fill-mask-pipeline to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9069107
2022-06-24 10:12:16 +08:00
yingda.chen
1a0d4af55a [to #42322933] test level check
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9143809
2022-06-23 16:55:48 +08:00
zhangzhicheng.zzc
371530ed1d [to #42322933] update nlp models name in metainfo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9134657
2022-06-23 11:58:22 +08:00
yongfei.zyf
ace8af9246 [to #42322933] Add cv-action-recongnition-pipeline to maas lib
达摩行为识别合入maas lib
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9134444
2022-06-23 10:22:43 +08:00
lingcai.wl
2019315c54 [to #42463204] support Pil.Image for image_captioning_pipeline 2022-06-22 23:54:38 +08:00
feiwu.yfw
b8ba35bd27 [to #42670107] restore pydataset test
* pydataset unitest
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9132896
2022-06-22 22:01:25 +08:00
yingda.chen
8400ca1fc7 [to #42322933] add create if not exist and add(back) create model example
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
2022-06-22 18:39:08 +08:00
luoyiyun.lyy
849410e107 [to #41474818]fix: fix errors in task name definition
修改constant.py中task name定义的错误
- sentence-similarity重复定义
- fill-mask多加了一个空格
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9125956

    * [to #41474818]fix: fix errors in task name definition
2022-06-22 15:49:58 +08:00
wenmeng.zwm
e288cf076e [to #42362853] refactor pipeline and standardize module_name
* using get_model to validate hub path 
* support reading pipeline info from configuration file
* add metainfo const
* update model type and pipeline type and fix UT
* relax requimrent for protobuf
* skip two dataset tests due to temporal failure
 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9118154
2022-06-22 14:15:32 +08:00
mulin.lyh
76c6ff6329 [to #42675838]merge model hub code
合并model hub 代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9096493
2022-06-21 20:04:25 +08:00
zhangzhicheng.zzc
7a175ee9b3 [to #42322933]move tts dependency to local
requirements/audio.txt
中依赖存在两个问题:
1. torch/tensorflow版本写死
2. 两个whl包是linux环境下才可安装,进而whl包安装的package要在mac上忽略的话,代码中必须把相应package放到local中引用

上面两个问题在linux环境中的测试用例是可以通过的。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9103904

    * move tts dependency to local
2022-06-21 14:06:09 +08:00