Commit Graph

319 Commits

Author SHA1 Message Date
eniac.xcw
ef8b1f2bd7 [to #42322933]add clip fine-tune code
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9497065
2022-07-26 14:06:52 +08:00
Yingda Chen
2e43b376f5 [to #42322933]disable image segmentation test temporarily 2022-07-26 13:17:29 +08:00
mulin.lyh
fc90bf0d1a [to #43554786]fix: test error is not detected in gate test, protobuf version to (3, 3.21.0) for tensorflow
限制protobuf版本,修复单元测试有error返回值为0问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9510263

    * fix test error is not detected in gate test, protobuf version to (3, 3.21.0)
2022-07-26 10:57:16 +08:00
hejunjie.hjj
321292ceda [to #42322933] add image instance segmentation pipeline and finetune to MaaS-lib 2022-07-26 10:19:07 +08:00
shichen.fsc
b3b950e616 [to #42322933] simplify kws code, and remove disk-write behavior
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9491681
2022-07-25 22:37:15 +08:00
Yingda Chen
856c4323b7 [to #43259593] fix typo 2022-07-25 19:51:45 +08:00
yingda.chen
590bc52f97 [to #43259593] refacor image preprocess
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9501913

    * [to #43259593] refacor image preprocess
2022-07-25 17:00:21 +08:00
Yingda Chen
badc91aafa Revert "[to #43259593]chore: update cv requirements (更新cv侧统计的依赖项) "
This reverts commit bab28ae3fa.
2022-07-25 13:50:18 +08:00
liangting.zl
bab28ae3fa [to #43259593]chore: update cv requirements (更新cv侧统计的依赖项)
[依赖收集及列表](https://yuque.antfin.com/docs/share/59d1f42c-e061-4e73-903f-0af053a03627#XXbRB)
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9456258
2022-07-25 13:31:36 +08:00
wenqi.oywq
da20fb66e9 [to #43259593]添加image-color-enhance, pipeline and trainer
添加image-color-enhance, pipeline and trainer
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9483118
2022-07-25 13:30:11 +08:00
zhangzhicheng.zzc
016d22d8fb [to #43259593]update abs paths typo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9491629
2022-07-25 13:29:26 +08:00
baishuai.bs
2d1ce75dcc [to #43259593]add cv tryon task
增加虚拟试衣任务,输入模特图,骨骼图,衣服展示图,生成试衣效果图
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9401415
2022-07-25 13:07:20 +08:00
Yingda Chen
f581ad2eb4 [to #43525415]fix: fix docker ci performance issue 2022-07-25 12:41:44 +08:00
wenmeng.zwm
4814b198f0 [to #43112534] taskdataset refine and auto placement for data and model
* refine taskdataset interface
 * add device placement for trainer
 * add device placement for pipeline
 * add config checker and fix model placement bug
 * fix cycling import
 * refactor model init for translation_pipeline
 * cv pipelines support kwargs


Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9463076
2022-07-23 11:08:43 +08:00
mulin.lyh
c4fb2445d6 [to #43259593]feat: add list model api
添加list model查询api
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9446917
2022-07-22 22:46:01 +08:00
lingcai.wl
0f4e835dac [to #43103776] add __init__.py for build wheel
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9491285
2022-07-22 21:51:29 +08:00
hemu.zp
ab04ceafc5 [to #42322933] set rouge_score version
2022/7/22 更新的 rouge_socre 0.0.7 版本存在 import 报错的问题,暂时将 rouge_score 库版本设置为 <= 0.0.4
2022-07-22 18:22:43 +08:00
ly119399
e22a8a00f0 [to #42322933] dialog modeling use gpu default
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9443821
2022-07-22 17:26:25 +08:00
zhangzhicheng.zzc
68fc437044 [to #42322933] Add backbone-head model structure 2022-07-22 17:03:38 +08:00
yingda.chen
a68e3e526a [to #42322933] make decord and tf.contrib lazy load and clean import
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9409213
2022-07-22 16:46:25 +08:00
baiguan.yt
14a62d401e [to #42322933] Add image--pipeline to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9460900
2022-07-22 10:29:38 +08:00
baiguan.yt
52725fa3e9 [to #42322933] Update tasks of face_image_generation and image_super_resolution
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9465050
2022-07-21 18:17:25 +08:00
pangda
fd4a027a07 [to #42322933] NLP/命名实体识别模型(NER)接入
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9435758

* add model nncrf, which includes tcrf(transformer-crf) and lcrf(lstm-crf, will be implemented in 830 version).
* add NER metainfo, pipeline
2022-07-21 16:26:31 +08:00
baiguan.yt
789f66d7e6 [to #42322933] Add cv-image-super-resolution-pipeline to maas lib
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9440706

    * init

* merge master
2022-07-21 10:12:10 +08:00
baiguan.yt
51bd47a72c [to #42322933] 人脸生成
添加了基于stylegan2的人像生成算法
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9426478
2022-07-20 23:15:38 +08:00
yingda.chen
dbb450932d [to #42322933] clean requirment
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9458816
2022-07-20 20:43:42 +08:00
yichang.zyc
b5ff6e9b8c [to #42322933] add ofa source code and caption distill model code reivew link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9373663 2022-07-20 20:37:23 +08:00
feiwu.yfw
2c3875c0e1 [to #43299989] Fix msdataset
* fix msdataset
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9436292

    * fix msdataset
2022-07-20 16:38:15 +08:00
hemu.zp
0b7b964226 [to #42322933] Add palm finetuning
Palm 模型支持 finetuning
2022-07-20 16:36:11 +08:00
mulin.lyh
69047b99ae [to #43387011]feat: ci test to new host and running in docker
ci 测试迁移新的机器,并且在容器中运行,减小互相干扰的可能
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9427096

    * add docker ci script
2022-07-20 11:49:05 +08:00
jianqiang.rjq
5876fdc25c [to #42322933] Merge request from 雪洛:cv/aams
* add test code
 * fix bug
 * support gray image
 * update unitest
 * bugfixed
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9419792
2022-07-20 11:40:54 +08:00
ly119399
40b1a9566d [to #42322933] remove dependency en_core_web_sm from nlp.txt
将nlp.txt中的en_core_web_sm依赖删除,在代码中下载响应的依赖
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9432253
2022-07-19 22:39:54 +08:00
jiangnana.jnn
f3d739bea7 [to #43105545] add default config and new hooks 2022-07-19 17:41:25 +08:00
Yingda Chen
59879b687a [to #42322933]update develop.md 2022-07-19 14:07:47 +08:00
wenmeng.zwm
e62cd756df [to #42322933] relax requirements
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9407594
2022-07-18 17:52:14 +08:00
jiaqi.sjq
a17f29ce54 [to #42322933] Update tts task inputs
Refactor tts task inputs
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9412937
2022-07-18 17:50:59 +08:00
yingda.chen
6b3325088e [to #42322933] update dataset hub port
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9415565
2022-07-18 14:15:42 +08:00
yuze.zyz
8d0d6252ca [to #42322933] fix bug: run failed in tensor_utils.py
1. 修复default data collator的输入类型为tuple时运行会失败的问题
2. 修复default data collator的输入类型为dict时不兼容BatchEncoding的问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9403517

    * fix bug: 1. run failed when datatype is tuple 2. change type checking from dict to Mapping to fit transformers.datasets.BatchEncoding
2022-07-16 10:21:43 +08:00
wenmeng.zwm
231f400133 [to #43112534] finetune support and first case
co-contributed with 夕陌&雨泓

 * add torch epoch based trainer and dis utils
 * add hooks including optimizer, lrscheduler, logging, checkpoint, evaluation, time profiling
 * add torch mdoel base and test
 * add optimizer and lrscheduler module
 * add sbert for text classification example
 * add task_dataset for dataset-level processor

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9338412
2022-07-14 16:25:55 +08:00
jiaqi.sjq
1a486b4b28 [To #42322933] Make all same lang_type voice models into one
[To #42322933] Merge same language type voice models into one model card, these changes make demo service much easier to handle different voices.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9353173
2022-07-13 14:04:23 +08:00
shichen.fsc
d5affa2e31 [to #42322933] Bug fix: fix asr runtime error after python setup.py install, and add logger.info to prompt decoding progress
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9358893
2022-07-12 20:39:07 +08:00
yingda.chen
5db8480c64 [to #42322933]make asr dependency as lazy load
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9350976
2022-07-12 14:40:34 +08:00
shichen.fsc
d7c780069f [to #42322933] add asr inference with pytorch(espnet framework)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9273537
2022-07-11 16:48:47 +08:00
wenmeng.zwm
59495d375f [to #42362425] bump version to 0.2.3
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9313928
2022-07-11 16:22:43 +08:00
yingda.chen
d532d45559 [to #42322933]unified revision control
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9319772
2022-07-08 20:20:42 +08:00
mulin.lyh
3eed264bad [to #43040150] fix: login warn refactor, error message when exception, ut case to new user
未登录warn提示信息重构,只有遇到请求失败,exception时,如果cookie为空,提示用户login,单元测试用户修改成单独
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9283579

    * [to #42322933] add space dialog-state tracking pipeline 
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9227018

    * init

* token to ids

* add model

* model forward ready

* add intent

* intent preprocessor ready

* intent success

* merge master

* test with model hub

* add flake8

* update

* update

* update

* Merge branch 'master' into nlp/space/gen

* delete file about gen

* init

* fix flake8 bug

* [to #42322933] init

* bug fix

* [to #42322933] init

* update pipeline registry info

* Merge remote-tracking branch 'origin/master' into feat/nli

* [to #42322933] init

* [to #42322933] init

* modify forward

* [to #42322933] init

* generation ready

* init

* Merge branch 'master' into feat/zero_shot_classification

# Conflicts:
#	modelscope/preprocessors/__init__.py

* [to #42322933] bugfix

* [to #42322933] pre commit fix

* fill mask

* registry multi models on model and pipeline

* add tests

* test level >= 0

* local gen ready

* merge with master

* dialog modeling ready

* fix comments: rename and refactor AliceMindMLM; adjust pipeline

* space intent and modeling(generation) are ready

* bug fix

* add dep

* add dep

* support dst data processor

* merge with nlp/space/dst

* merge with master

* Merge remote-tracking branch 'origin' into feat/fill_mask

Conflicts:
	modelscope/models/nlp/__init__.py
	modelscope/pipelines/builder.py
	modelscope/pipelines/outputs.py
	modelscope/preprocessors/nlp.py
	requirements/nlp.txt

* merge with master

* merge with master 2/2

* fix comments

* fix isort for pre-commit check

* allow params pass to pipeline's __call__ method

* Merge remote-tracking branch 'origin/master' into feat/zero_shot_classification

* merge with nli task

* merge with sentiment_classification

* merge with zero_shot_classfication

* merge with fill_mask

* merge with space

* merge with master head

* Merge remote-tracking branch 'origin' into feat/fill_mask

Conflicts:
	modelscope/utils/constant.py

* fix: pipeline module_name from model_type to 'fill_mask' & fix merge bug

* unfiinished change

* fix bug

* unfinished

* unfinished

* revise modelhub dependency

* Merge branch 'feat/nlp_refactor' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/nlp_refactor

* add eval() to pipeline call

* add test level

* ut run passed

* add default args

* tmp

* merge master

* all ut passed

* remove an useless enum

* revert a mis modification

* revert a mis modification

* Merge commit 'ace8af92465f7d772f035aebe98967726655f12c' into feat/nlp

* commit 'ace8af92465f7d772f035aebe98967726655f12c':
  [to #42322933] Add cv-action-recongnition-pipeline to maas lib
  [to #42463204]  support Pil.Image for image_captioning_pipeline
  [to #42670107] restore pydataset test
  [to #42322933] add create if not exist and add(back) create model example         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
  [to #41474818]fix: fix errors in task name definition

# Conflicts:
#	modelscope/pipelines/builder.py
#	modelscope/utils/constant.py

* Merge branch 'feat/nlp' into feat/nlp_refactor

* feat/nlp:
  [to #42322933] Add cv-action-recongnition-pipeline to maas lib
  [to #42463204]  support Pil.Image for image_captioning_pipeline
  [to #42670107] restore pydataset test
  [to #42322933] add create if not exist and add(back) create model example         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9130661
  [to #41474818]fix: fix errors in task name definition

# Conflicts:
#	modelscope/pipelines/builder.py

* fix compile bug

* refactor space

* Merge branch 'feat/nlp_refactor' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into feat/nlp_refactor

* Merge remote-tracking branch 'origin' into feat/fill_mask

* fix

* pre-commit lint

* lint file

* lint file

* lint file

* update modelhub dependency

* lint file

* ignore dst_processor temporary

* solve comment: 1. change MaskedLMModelBase to MaskedLanguageModelBase 2. remove a useless import

* recommit

* remove MaskedLanguageModel from __all__

* Merge commit '1a0d4af55a2eee69d89633874890f50eda8f8700' into feat/nlp_refactor

* commit '1a0d4af55a2eee69d89633874890f50eda8f8700':
  [to #42322933] test level check         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9143809
  [to #42322933] update nlp models name in metainfo         Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9134657

# Conflicts:
#	modelscope/metainfo.py

* update

* revert pipeline params update

* remove zeroshot

* update sequence classfication outpus

* merge with fill mask

* Merge remote-tracking branch 'origin' into feat/fill_mask

* fix

* init dialog state tracking

* fix flake8 warning of dst

* Merge remote-tracking branch 'origin/feat/fill_mask' into feat/nlp

* merge with master

* remove useless test.py

* add init

* merge nlp

* Merge remote-tracking branch 'origin/master' into feat/nlp

* remove unformatted space trainer

* Merge branch 'feat/nlp' into nlp/space/dst

* revise based on comment except chinease comment

* skip ci blocking

* change Chinese notes of space3.0 into English

* translate chinese comment to english

* add space to metainfo

* space dst pipeline is ready, but model's result is wrong

* merge feat/nlp

* merge with master

* change processor

* change example

* test case ready

* dst loacl ready

* update dst conf

* merge feat/nlp

* inform revise

* inherit bug fix

* init

* add 2 complete examples

* fix bug

* add test case

* merge with master

* modify model name

* add missing setting

* add outputs

* modify test level

* modify chinese comment

* remove useless doc

* merge feat/nlp

* Merge remote-tracking branch 'origin' into nlp/space/dst

* Merge branch 'feat/nlp' into nlp/space/dst

* dst test ready

* merge feat nlp

* space outputs normalization

* update dst

* merge feat nlp

* Merge branch 'master' into nlp/space/dst

* update requirement

* merge with master

* Merge remote-tracking branch 'origin/master' into nlp/space/dst

* formating output

* update requirements/nlp

* merge with master

* add test cases

* Merge remote-tracking branch 'origin/master' into nlp/space/dst

* merge with master

* login warn refactor, error message when exception, ut case to new user

* login warn refactor, error message when exception, ut case to new user
2022-07-08 20:03:23 +08:00
yingda.chen
8a65b0b1ff [to #42322933]update docs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9316720
2022-07-08 14:52:29 +08:00
jiaqi.sjq
d313c440c4 [to #9303837] Merge frontend am and vocoder into one model card
Merge frontend, am and vocoder model card into one model card.
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9303837
2022-07-08 14:26:18 +08:00
yingda.chen
2e88a995ca [to #42322933]support model revision
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9300163
2022-07-07 23:00:14 +08:00
zhangzhicheng.zzc
407337fbf3 [to #42322933] add model profiling 2022-07-07 20:21:52 +08:00