Commit Graph

2220 Commits

Author SHA1 Message Date
zsl01670416
1e5e363235 fix issue of using cuda device in document segmentation pipeline inference
Fix issue of using cuda device in document segmentation pipeline inference.Time cost will be reduced when prediction is implemented.
2023-07-25 10:01:20 +08:00
Wang Qiang
0f551d3983 Merge pull request #408 from XDUWQ/lora_rank
Add lora_rank parameter for lora stable diffusion
2023-07-24 22:57:06 +08:00
XDUWQ
8e157cfa15 precommit 2023-07-24 22:10:52 +08:00
wenmeng zhou
64203e89ee Compatibility for huggingface transformers (#391) 2023-07-24 20:53:27 +08:00
XDUWQ
8e00d85317 fix bugs 2023-07-24 19:46:22 +08:00
XDUWQ
426f55d57b add lora_rank for lora stable diffusion 2023-07-24 19:43:20 +08:00
XDUWQ
bc93e2dc96 add lora_rank for lora stable diffusion 2023-07-24 19:32:04 +08:00
XDUWQ
eb24e23d19 add lora_rank for lora stable diffusion 2023-07-24 19:24:52 +08:00
XDUWQ
6fb340e7f8 add lora_rank for lora stable diffusion 2023-07-24 19:17:49 +08:00
Jintao
ba4b9fc43f Added full parameter sft to llm (#402)
* Optimized code

* update parse_args

* fix get_logger bug

* update parse_args

* Added full parameter fine-tuning

* Add support_bf16 warning

* Modify the code format and fix bugs
2023-07-24 15:52:09 +08:00
lylalala
f805d86aed llama2 support chat (#404)
* support chat

* update llama2 chat testcase

* add gen kwargs and devices

* update unittest and support max_length in multi-turn dialogue
2023-07-24 15:38:01 +08:00
Ikko Eltociear Ashimine
9dedac31fd Add Japanese README (#405) 2023-07-24 11:14:16 +08:00
tingwei.gtw
d16522723a [to #42322933] add files
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13158565
* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* update test data

* [to #42322933] add files

* Merge remote-tracking branch 'origin' into feature/sal_try_on

* [to #42322933] add files

* Merge remote-tracking branch 'origin' into feature/sal_try_on
2023-07-24 10:16:29 +08:00
mushenL
f77237b049 add llama2 pipeline (#399)
* Modify the parameter passing of the text_generation_pipeline class

* add llama2 pipeline

* add llama pipeline v1.1

* add llama pipeline v1.2

* add llama pipeline v1.3

* add llama pipeline v1.0.4
2023-07-22 21:53:04 +08:00
Xingjun.Wang
7608868290 Merge pull request #403 from modelscope/dev/check_lint
fix yapf error
v1.7.2
2023-07-22 00:01:01 +08:00
xingjun.wang
5a49093422 fix yapf 2023-07-21 23:37:17 +08:00
xingjun.wang
96a5282021 check format 2023-07-21 23:09:24 +08:00
LingFeng.Chen.Cn
9c4d9cdb68 fix file not found cause TypeError (#385)
* fix file not found cause TypeError

* fix linter test

* fix linter test

* format code

---------

Co-authored-by: Krasus <chen@krasus.red>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2023-07-21 15:34:19 +08:00
shuli.cly
13e345f6d9 add sv/speaker_diarization_dialogue_detection to branch sv/semantic-dialogue-detection
# Speaker Diarization Dialogue Detection CR

本模型是Speaker Diarization(`audio/speaker diarization`,语音/说话人日志)任务下的一个子模块。

本次提交的是基于文本进行判断的模型,其IO和中间过程和 `nlp/text-classification` 很像,且本地模型的初始模型也是基于huggingface训练的,因此此提交中复用了部分 `nlp/text-classification` 模型的代码。为了方便后续维护以及与nlp方面代码解耦,在model、pipeline以及preprocessor中 **单独** 创建了相应模块并重新register。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13269649
* start to add speaker_diarization_dialogue_detection files; Need to change constant and test

* add sv/speaker_diarization_dialogue_detection to branch sv/semantic-dialogue-detection

* update test case

* add comments for speaker diarization dialogue detection pipelines

* add outputs type and inputs type for speaker_diarization_dialogue_detection
2023-07-20 19:29:59 +08:00
shenweichao.swc
05c65ba225 add s2net for panorama_depth_estimation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13310819
* add s2net codes

* fix sphdecoder

* Merge branch 'master' into dev/cv_s2net_panorama_depth_estimation

* revise comments in the pipeline

* revise the code
2023-07-20 19:28:03 +08:00
xiangpeng.wxp
4085d821f3 [to #42322933] add polylm, a polyglot large language model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13339595
2023-07-20 18:21:07 +08:00
tongmu.wh
c859bea022 fix vad time stamp in sd pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13316765
* fix details of speaker models

* Merge branch 'master' into speaker-fix

* fix vad time stamp in sd pipeline
2023-07-20 17:32:51 +08:00
LingFeng.Chen.Cn
19ea082fec Update speaker_verification_pipeline.py (#364)
* Update speaker_verification_pipeline.py

* fix log too long when input tuple(bytes,bytes)

* Update speaker_verification_pipeline.py

* fix when bytes print too much

* Update speaker_verification_pipeline forward log

* pre-commit linter format


---------

Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2023-07-20 09:28:55 +08:00
tastelikefeet
78b3e74fd8 pre-commit passed (#395) 2023-07-19 20:59:58 +08:00
Jintao
2f7c669f33 support llama2 (#393)
* Unify sft and infer code into a single file

* update llama2 sft infer
2023-07-19 17:34:27 +08:00
tastelikefeet
3283a46c52 Add Llama2 from hf (#394)
* update llama code

* add llama2

* revert llama code

* add llama2 registry

* fix bug
2023-07-19 17:22:03 +08:00
XDUWQ
66795aa3ff change tests level 2023-07-19 09:41:21 +08:00
mulin.lyh
247ae5f637 default aliyuncs pip
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13320919
* default aliyuncs pip

* pip to aliyun source
2023-07-18 19:59:23 +08:00
mulin.lyh
bb9163f71a remove hard code tsinghua
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13314592
* remove hard code tsinghua
2023-07-18 14:51:18 +08:00
tastelikefeet
12bc1603a9 Fix amp + device_map (#386)
1. Fix the amp + device_map bug in chatglm2 finetune code 
2. Optional to save optimizer state 
3. Fix the logger double print problem
2023-07-16 08:45:20 +08:00
Wang Qiang
21d64f4518 Merge pull request #387 from XDUWQ/chinese_bug
Fix bugs of chinese stable diffusion pipeline getting an unexpected keyword argument 'lora_scale'
2023-07-16 00:05:47 +08:00
XDUWQ
fc85b57a3e fix bugs of chinese stable diffusion pipeline lora_scale 2023-07-15 23:16:16 +08:00
Jintao
c6189d68a0 Fix/chatglm2 (#384) 2023-07-15 09:59:53 +08:00
mulin.lyh
104cb93d50 [to #50841229]feat: precompile pai-easycv in image
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13225347
* [to #50841229]feat: precompile pai-easycv in image
2023-07-14 19:11:49 +08:00
Wang Qiang
442bdc74a4 Use more compatible DiffusionPipeline (#383) 2023-07-14 19:04:29 +08:00
Wang Qiang
0b85979f2e Update diffusers version to 0.18.0 (#377)
* update diffusers to 0.18.0

* fix bugs
2023-07-14 19:02:52 +08:00
baiguan.yt
ceac129c6b add parameters height and width for text-to-video
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13171907
2023-07-14 16:22:10 +08:00
XDUWQ
34ab717393 custom_diffusion 2023-07-12 19:47:32 +08:00
XDUWQ
cfa363d433 custom diffusion 2023-07-12 17:35:57 +08:00
XDUWQ
c1aa120029 custom diffusion 2023-07-12 17:15:10 +08:00
XDUWQ
d18cf31dfa custom diffusion 2023-07-12 16:00:18 +08:00
XDUWQ
73fe5d5d65 precommit 2023-07-12 15:52:36 +08:00
XDUWQ
bcf443c672 custom diffusion 2023-07-12 15:32:48 +08:00
XDUWQ
0e99c27d54 custom diffusion 2023-07-12 15:27:08 +08:00
XDUWQ
07296a837a fix bugs 2023-07-12 15:19:09 +08:00
XDUWQ
d6368b2617 custom diffusion 2023-07-12 15:02:43 +08:00
XDUWQ
0dc57f8dec custom diffusion 2023-07-12 14:56:14 +08:00
Xingjun.Wang
0f36b081ef Merge pull request #371 from foocker/master
ASRDataset for download_mode parameters
2023-07-12 14:47:32 +08:00
tastelikefeet
544f6c0410 Fea/chatglm6b v2 new version (#368)
* upgrade code

* add chatglm2 ptuning

* pre-commit passed
2023-07-12 14:44:09 +08:00
XDUWQ
2fb3665c67 custom diffusion 2023-07-12 10:14:00 +08:00