1966 Commits

Author SHA1 Message Date
lukeming.lkm
65d4f07841 change use_fast_att and fix bfloat loading
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13522792

* check flash att is installed even if  use_fast_att is set True and fix bfloat loading

* skip pipeline model placement for quantization

* update unittest for qwen
v1.8.1
2023-08-03 16:01:14 +08:00
yuze.zyz
fe7f7d6725 fix streamer arg
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13520666
* fix streamer arg
2023-08-03 14:35:35 +08:00
wenmeng.zwm
0501dfc388 upgrade version to 1.8.1 2023-08-03 14:20:56 +08:00
wenmeng.zwm
40501c7e01 Merge branch 'release/1.8' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into release/1.8 v1.8.0 2023-08-03 12:02:22 +08:00
lukeming.lkm
33e754632f update LICENSE
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13516119
2023-08-03 12:01:48 +08:00
lukeming.lkm
74d6f13587 add LICENSE and related snippets
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13513677
2023-08-03 12:01:48 +08:00
lukeming.lkm
610ee7dea0 reformat stop_words_ids to sync QWen7b HF
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13510247
2023-08-03 12:01:48 +08:00
lukeming.lkm
366db40f80 add kwargs for save_vocabulary
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13508568
2023-08-03 12:01:48 +08:00
lukeming.lkm
2b27144384 add quantization in qwen pipelines and relevant unittests
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13499600

* add quant features

* resolve import

* resolve format

* fix save vocab
2023-08-03 12:01:48 +08:00
hejunjie.hjj
d160ff1e8b fix bug: referring_video-object-segmentation兼容Pillow10
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13479152
* fix bug: referring_video-object-segmentation兼容Pillow10
2023-08-03 12:01:48 +08:00
lukeming.lkm
3a83f6fc35 resolve stopword logits processor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13504522

* resolve stopword logits processor
2023-08-03 12:01:48 +08:00
suluyan.sly
15bc9e5769 update release date 2023-08-03 12:01:48 +08:00
suluyan.sly
2e9401c0b0 v1.8 2023-08-03 12:01:48 +08:00
lukeming.lkm
4f4a15c169 add qwen 7b base and chat
添加QWen 7b base模型和chat模型及相关pipelines
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235

* add qwen 7b base and chat

* fix logger

* update examples, lint test

* add unittest for qwen base and chat

* rename qwen to qwen-7b

* resolve imports and add a registry to text-generation

* reset load model from pretrained

* fix precheck

* skip qwen test case now

* remove strange file
2023-08-03 12:01:48 +08:00
wenmeng zhou
33ac4b3c3b Feat/chatglm2 32k support (#433)
* add support for chatglm2 32k

* fix
2023-08-03 12:01:48 +08:00
suluyan.sly
2f7afe505d remove requirement realesrgan for basicsr
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13488773
* remove requirement realesrgan for basicsr
2023-08-03 12:01:48 +08:00
mulin.lyh
5ff213aadf init pip to aliyuncs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13487845

* init pip to aliyuncs
2023-08-03 12:01:48 +08:00
lukeming.lkm
1366ca97df update LICENSE
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13516119
2023-08-03 11:23:40 +08:00
lukeming.lkm
16e0dbef2a add LICENSE and related snippets
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13513677
2023-08-03 09:40:01 +08:00
lukeming.lkm
4e00e607ac reformat stop_words_ids to sync QWen7b HF
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13510247
2023-08-02 18:46:46 +08:00
lukeming.lkm
74659be7d0 add kwargs for save_vocabulary
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13508568
2023-08-02 18:12:44 +08:00
lukeming.lkm
a69b32609c add quantization in qwen pipelines and relevant unittests
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13499600

* add quant features

* resolve import

* resolve format

* fix save vocab
2023-08-02 16:28:31 +08:00
hejunjie.hjj
cd3f5d659e fix bug: referring_video-object-segmentation兼容Pillow10
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13479152
* fix bug: referring_video-object-segmentation兼容Pillow10
2023-08-02 16:28:31 +08:00
lukeming.lkm
e2c19e89e6 resolve stopword logits processor
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13504522

* resolve stopword logits processor
2023-08-02 16:28:31 +08:00
suluyan.sly
903c5690ed update release date 2023-08-02 10:24:03 +08:00
suluyan.sly
3096ac226f v1.8 2023-08-02 10:18:24 +08:00
lukeming.lkm
fc0a0bcf60 add qwen 7b base and chat
添加QWen 7b base模型和chat模型及相关pipelines
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13482235

* add qwen 7b base and chat

* fix logger

* update examples, lint test

* add unittest for qwen base and chat

* rename qwen to qwen-7b

* resolve imports and add a registry to text-generation

* reset load model from pretrained

* fix precheck

* skip qwen test case now

* remove strange file
2023-08-02 09:47:30 +08:00
wenmeng zhou
54e65b034d Feat/chatglm2 32k support (#433)
* add support for chatglm2 32k

* fix
2023-08-01 23:22:49 +08:00
suluyan.sly
e38f67d747 remove requirement realesrgan for basicsr
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13488773
* remove requirement realesrgan for basicsr
2023-08-01 16:58:38 +08:00
mulin.lyh
70e205a54a init pip to aliyuncs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13487845

* init pip to aliyuncs
2023-08-01 16:58:30 +08:00
suluyana
30e11d159d Merge branch 'release/1.8' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into master-github 2023-07-31 20:33:05 +08:00
suluyan.sly
63ffe65859 remove cv requirements: basicsr
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13471366
* rm req basicsr
2023-07-31 19:36:29 +08:00
mulin.lyh
6f467de8e3 [to #51274424]fix: easycv extension and tinycudann conflict
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13471150
* fix easycv extension and tinycudann conflict
2023-07-31 18:35:42 +08:00
yuze.zyz
18fe67c814 Ignore http error
忽略log打印,防止在check_model_is_latest时打出信息使用户不明所以。
将log改为Error栈
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13463005
2023-07-31 18:35:32 +08:00
wenmeng zhou
f2396ddb6a Merge pull request #432 from modelscope/merge_master-gitlab_0731
Merge master gitlab 0731
2023-07-31 17:14:41 +08:00
wenmeng.zwm
7fbd6ecc40 Merge branch 'master-gitlab' into merge_master-gitlab_0731 2023-07-31 16:16:16 +08:00
wenmeng.zwm
48a39244f1 Merge branch master-merge-github-230728 into master
Title: Merge branch 'master-github' into master-merge-github-230728 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13456249
2023-07-31 16:09:07 +08:00
Xingjun.Wang
ef1b429bef Merge pull request #430 from XDUWQ/delete_nerf_log
delete unuseful logs
2023-07-31 14:48:39 +08:00
XDUWQ
4233916867 delete unuseful logs 2023-07-31 14:36:12 +08:00
suluyan.sly
e5b88d6e6b update requirements 2023-07-30 14:12:28 +08:00
Jintao
1a0a002e6a fix checkpoint, same device bug (#427) 2023-07-30 14:09:47 +08:00
tastelikefeet
3707a401db 1. add check model for training 2. add model_dir for automodel (#422) 2023-07-30 14:09:18 +08:00
frozoul
dc108150d9 cv/cv nerf 3d reconstruction 4k nerf damo (#389)
* add 4k-nerf core files

* update configure file

* update dataloader and model path

* update unittest

* Delete test_4k.py

* update unittest

* update unittest

* update pre-commit

* update dataloader

* update cuda code path

* check with pre-commit

---------

Co-authored-by: zhongshu.wzs <zhongshu.wzs@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
2023-07-30 14:08:56 +08:00
xingjun.wang
b7e2e3174c del redundancy code in func: get_dataset_meta_file_list 2023-07-30 14:08:41 +08:00
Wang Qiang
ac6967648b Upgrade stable diffusion version to a more powerful version 2.1 (#415) 2023-07-30 14:08:21 +08:00
zsl01670416
a3a6834f0d Merge branch 'debug_chatglm6b_json_dataset' fix conflict between hf dataset and to_hf_dataset
The type of dataset built from file is hf dataset, which can not use function to_hf_dataset.
2023-07-30 14:06:42 +08:00
suluyana
b68b90ba15 skip plugin 2023-07-30 00:30:30 +08:00
suluyana
9ece90ee84 skip plugin test case 2023-07-29 21:35:21 +08:00
suluyan.sly
d7cd2ce28e Merge branch 'master-github' into master-merge-github-230728 2023-07-29 10:42:54 +08:00
Jintao
312b63fe06 fix checkpoint, same device bug (#427) 2023-07-29 00:06:27 +08:00