Commit Graph

1961 Commits

Author SHA1 Message Date
Jintao
ba4b9fc43f Added full parameter sft to llm (#402)
* Optimized code

* update parse_args

* fix get_logger bug

* update parse_args

* Added full parameter fine-tuning

* Add support_bf16 warning

* Modify the code format and fix bugs
2023-07-24 15:52:09 +08:00
lylalala
f805d86aed llama2 support chat (#404)
* support chat

* update llama2 chat testcase

* add gen kwargs and devices

* update unittest and support max_length in multi-turn dialogue
2023-07-24 15:38:01 +08:00
Ikko Eltociear Ashimine
9dedac31fd Add Japanese README (#405) 2023-07-24 11:14:16 +08:00
tingwei.gtw
d16522723a [to #42322933] add files
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13158565
* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* update test data

* [to #42322933] add files

* Merge remote-tracking branch 'origin' into feature/sal_try_on

* [to #42322933] add files

* Merge remote-tracking branch 'origin' into feature/sal_try_on
2023-07-24 10:16:29 +08:00
mushenL
f77237b049 add llama2 pipeline (#399)
* Modify the parameter passing of the text_generation_pipeline class

* add llama2 pipeline

* add llama pipeline v1.1

* add llama pipeline v1.2

* add llama pipeline v1.3

* add llama pipeline v1.0.4
2023-07-22 21:53:04 +08:00
Xingjun.Wang
7608868290 Merge pull request #403 from modelscope/dev/check_lint
fix yapf error
v1.7.2
2023-07-22 00:01:01 +08:00
xingjun.wang
5a49093422 fix yapf 2023-07-21 23:37:17 +08:00
xingjun.wang
96a5282021 check format 2023-07-21 23:09:24 +08:00
LingFeng.Chen.Cn
9c4d9cdb68 fix file not found cause TypeError (#385)
* fix file not found cause TypeError

* fix linter test

* fix linter test

* format code

---------

Co-authored-by: Krasus <chen@krasus.red>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2023-07-21 15:34:19 +08:00
shuli.cly
13e345f6d9 add sv/speaker_diarization_dialogue_detection to branch sv/semantic-dialogue-detection
# Speaker Diarization Dialogue Detection CR

本模型是Speaker Diarization(`audio/speaker diarization`,语音/说话人日志)任务下的一个子模块。

本次提交的是基于文本进行判断的模型,其IO和中间过程和 `nlp/text-classification` 很像,且本地模型的初始模型也是基于huggingface训练的,因此此提交中复用了部分 `nlp/text-classification` 模型的代码。为了方便后续维护以及与nlp方面代码解耦,在model、pipeline以及preprocessor中 **单独** 创建了相应模块并重新register。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13269649
* start to add speaker_diarization_dialogue_detection files; Need to change constant and test

* add sv/speaker_diarization_dialogue_detection to branch sv/semantic-dialogue-detection

* update test case

* add comments for speaker diarization dialogue detection pipelines

* add outputs type and inputs type for speaker_diarization_dialogue_detection
2023-07-20 19:29:59 +08:00
shenweichao.swc
05c65ba225 add s2net for panorama_depth_estimation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13310819
* add s2net codes

* fix sphdecoder

* Merge branch 'master' into dev/cv_s2net_panorama_depth_estimation

* revise comments in the pipeline

* revise the code
2023-07-20 19:28:03 +08:00
xiangpeng.wxp
4085d821f3 [to #42322933] add polylm, a polyglot large language model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13339595
2023-07-20 18:21:07 +08:00
tongmu.wh
c859bea022 fix vad time stamp in sd pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13316765
* fix details of speaker models

* Merge branch 'master' into speaker-fix

* fix vad time stamp in sd pipeline
2023-07-20 17:32:51 +08:00
LingFeng.Chen.Cn
19ea082fec Update speaker_verification_pipeline.py (#364)
* Update speaker_verification_pipeline.py

* fix log too long when input tuple(bytes,bytes)

* Update speaker_verification_pipeline.py

* fix when bytes print too much

* Update speaker_verification_pipeline forward log

* pre-commit linter format


---------

Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2023-07-20 09:28:55 +08:00
tastelikefeet
78b3e74fd8 pre-commit passed (#395) 2023-07-19 20:59:58 +08:00
Jintao
2f7c669f33 support llama2 (#393)
* Unify sft and infer code into a single file

* update llama2 sft infer
2023-07-19 17:34:27 +08:00
tastelikefeet
3283a46c52 Add Llama2 from hf (#394)
* update llama code

* add llama2

* revert llama code

* add llama2 registry

* fix bug
2023-07-19 17:22:03 +08:00
XDUWQ
66795aa3ff change tests level 2023-07-19 09:41:21 +08:00
mulin.lyh
247ae5f637 default aliyuncs pip
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13320919
* default aliyuncs pip

* pip to aliyun source
2023-07-18 19:59:23 +08:00
mulin.lyh
bb9163f71a remove hard code tsinghua
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13314592
* remove hard code tsinghua
2023-07-18 14:51:18 +08:00
tastelikefeet
12bc1603a9 Fix amp + device_map (#386)
1. Fix the amp + device_map bug in chatglm2 finetune code 
2. Optional to save optimizer state 
3. Fix the logger double print problem
2023-07-16 08:45:20 +08:00
Wang Qiang
21d64f4518 Merge pull request #387 from XDUWQ/chinese_bug
Fix bugs of chinese stable diffusion pipeline getting an unexpected keyword argument 'lora_scale'
2023-07-16 00:05:47 +08:00
XDUWQ
fc85b57a3e fix bugs of chinese stable diffusion pipeline lora_scale 2023-07-15 23:16:16 +08:00
Jintao
c6189d68a0 Fix/chatglm2 (#384) 2023-07-15 09:59:53 +08:00
mulin.lyh
104cb93d50 [to #50841229]feat: precompile pai-easycv in image
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13225347
* [to #50841229]feat: precompile pai-easycv in image
2023-07-14 19:11:49 +08:00
Wang Qiang
442bdc74a4 Use more compatible DiffusionPipeline (#383) 2023-07-14 19:04:29 +08:00
Wang Qiang
0b85979f2e Update diffusers version to 0.18.0 (#377)
* update diffusers to 0.18.0

* fix bugs
2023-07-14 19:02:52 +08:00
baiguan.yt
ceac129c6b add parameters height and width for text-to-video
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13171907
2023-07-14 16:22:10 +08:00
XDUWQ
34ab717393 custom_diffusion 2023-07-12 19:47:32 +08:00
XDUWQ
cfa363d433 custom diffusion 2023-07-12 17:35:57 +08:00
XDUWQ
c1aa120029 custom diffusion 2023-07-12 17:15:10 +08:00
XDUWQ
d18cf31dfa custom diffusion 2023-07-12 16:00:18 +08:00
XDUWQ
73fe5d5d65 precommit 2023-07-12 15:52:36 +08:00
XDUWQ
bcf443c672 custom diffusion 2023-07-12 15:32:48 +08:00
XDUWQ
0e99c27d54 custom diffusion 2023-07-12 15:27:08 +08:00
XDUWQ
07296a837a fix bugs 2023-07-12 15:19:09 +08:00
XDUWQ
d6368b2617 custom diffusion 2023-07-12 15:02:43 +08:00
XDUWQ
0dc57f8dec custom diffusion 2023-07-12 14:56:14 +08:00
Xingjun.Wang
0f36b081ef Merge pull request #371 from foocker/master
ASRDataset for download_mode parameters
2023-07-12 14:47:32 +08:00
tastelikefeet
544f6c0410 Fea/chatglm6b v2 new version (#368)
* upgrade code

* add chatglm2 ptuning

* pre-commit passed
2023-07-12 14:44:09 +08:00
XDUWQ
2fb3665c67 custom diffusion 2023-07-12 10:14:00 +08:00
XDUWQ
2493a7d0f4 fix bugs 2023-07-12 10:13:44 +08:00
XDUWQ
c2b0ad9bb0 Merge branch 'custom_diffusion' of github.com:XDUWQ/modelscope into custom_diffusion 2023-07-12 10:10:16 +08:00
XDUWQ
568bd9dac7 custom diffusion 2023-07-12 10:09:37 +08:00
Wang Qiang
04b940f600 Merge branch 'modelscope:master' into custom_diffusion 2023-07-12 10:08:11 +08:00
XDUWQ
0ab981a021 custom diffusion 2023-07-12 10:04:20 +08:00
XDUWQ
ba2b5e0a57 custom diffusion 2023-07-12 09:51:46 +08:00
gg
49c6d8bcf6 pre-commit 2023-07-12 09:43:24 +08:00
XDUWQ
1caa45422c custom diffusion 2023-07-11 20:46:32 +08:00
gg
574b4568ff flake8 2023-07-11 18:36:54 +08:00