Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2026-02-24 20:19:51 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,295 Commits 267 Branches 107 Tags
fix/win_swift_encode
Commit Graph

2295 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
xingjun.wang
bf5fa260d3 fix pandas read csv error: possible malformed input file 2024-01-02 14:21:06 +08:00
xingjun.wang
27619175a9 fix pandas read csv error: possible malformed input file 2024-01-02 14:14:45 +08:00
xingjun.wang
e6ef401265 update 2024-01-01 00:30:41 +08:00
xingjun.wang
30818480fd add open for utf-8 2023-12-31 19:51:06 +08:00
xingjun.wang
fdc72b86d0 update 2023-12-31 19:42:40 +08:00
xingjun.wang
7d54d8731e update 2023-12-31 19:19:52 +08:00
xingjun.wang
05070b713d update 2023-12-31 18:50:13 +08:00
xingjun.wang
dcc09be138 set fetch_meta_files_from_url to gbk 2023-12-31 18:37:20 +08:00
wenmeng.zwm
39562dc555 merge master 2023-12-27 00:08:20 +08:00
Firmament-cyou
1120b76ea4 Fix anydoor init and support url input (#698) 
* fix init

* fix bug
 2023-12-27 00:06:30 +08:00
wenmeng zhou
1839bfbd64 add __init__.py for anydorr 2023-12-26 22:18:46 +08:00
wenmeng zhou
212a70dea7 add __init__.py for anydoor 2023-12-26 21:49:31 +08:00
Firmament-cyou
b473decba0 update ckpt to general_v0.1 (#696) 2023-12-26 16:59:47 +08:00
wenmeng zhou
fb46e18351 Update develop.md 2023-12-26 15:22:28 +08:00
wenmeng zhou
01475c4304 Update develop_cn.md 2023-12-26 15:21:36 +08:00
Firmament-cyou
b3c6eebdf3 Add AnyDoor support (#688) 
* support anydoor

* add dinov2

* fix bug

* convert rgb

* update anydoor_pipeline and add docstr
 2023-12-25 19:01:50 +08:00
DuskSwan
3695e4491f LLM riddle add challenge (#692) 
* 1. add a challenge in chapter 2 as challenge 9
2. add a check_challenge.py script to makesure a challenge actually has answer
3. add blank lines to the file README_CN.md to look better

* delete redundant function

* code style check

* code style check

* style checkout change

---------

Co-authored-by: DuskSwan <aquark@foxmail.com>
 2023-12-24 21:28:34 +08:00
hitsz-zuoqi
2ef12d1e88 add syncdreamer as a image-to-3d pipeline (#679) 
* add syncdreamer

* delete demo_output

* remove useless files and hide clip install

* update pipeline

* update clip package

* update unitest
 2023-12-21 22:12:32 +08:00
wenmeng zhou
c12323572a Merge pull request #676 from slin000111/master 
fix embedding and inference device in faq question answering pipeline
 2023-12-19 21:44:43 +08:00
wenmeng zhou
71ed5e7598 Merge pull request #667 from modelscope/master-merge-internal20231208 
Master merge internal20231208
 2023-12-18 19:38:14 +08:00
slin000111
262e0d6df0 fix embedding and inference device in faq question answering pipeline 2023-12-12 19:54:02 +08:00
mulin.lyh
b16e24440e build whl with py310 2023-12-08 22:25:28 +08:00
mulin.lyh
86fcbb8fbf Merge branch 'master-gitlab' into master-merge-internal20231208 2023-12-08 21:24:27 +08:00
mulin.lyh
75ce66f824 fix exception when there is a version after sdk release 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14949463
* fix exception when there is a version after sdk release
 2023-12-08 14:16:37 +08:00
xingjun.wxj
2a991a5c6b update datasets version 
Update datasets version.
compatibility check： 2.14.5, 2.14.6, 2.15.0
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14916111
 2023-12-06 16:25:20 +08:00
Firmament-cyou
8f0f9d4a33 Register llm format map (#659) 
* add LLMAdapterRegistry

* fix bug

* replace traceback with cache
 2023-12-06 16:22:50 +08:00
suluyana
b21afc3424 set vllm backend default when build llm_pipeline from pipeline() (#662) 
* set vllm backend default when build llm_pipeline from pipeline()

* fix logger info

---------

Co-authored-by: suluyan.sly <suluyan.sly@alibaba-inc.com>
 2023-12-06 10:27:36 +08:00
suluyana
864fb48872 fix vllm gen cfg & set default to llm-ppl (#658) 
* fix vllm gen cfg & set default to llm-ppl

* fix code style

* reset llm_framework default value

* fix pre-commit

---------

Co-authored-by: suluyan.sly <suluyan.sly@alibaba-inc.com>
 2023-12-04 16:51:35 +08:00
xingjun.wxj
a8e9e0a48f set datasets==2.14.6 2023-12-01 17:33:07 +08:00
tastelikefeet
05e1069219 Fix _set_gradient_checkpointing bug (#660) 
* add logic
 2023-12-01 15:29:28 +08:00
liuyhwangyh
a28f7aa96c fix test reliability issue (#657) 
* fix test reliability issue

* fix lint issue
 2023-12-01 15:14:35 +08:00
mushenL
1b6723ea24 hf_tool add AutoImageProcessor and BatchFeature (#650) 
* add AutoImageProcessor and BatchFeature
 2023-12-01 15:14:06 +08:00
wenmeng zhou
7b80a87b5a fix: DocumentGroundedDialogRetrievalModel qry_encoder.encoder.embeddings.position_ids error (#647) 2023-12-01 15:12:31 +08:00
mulin.lyh
51a1b76e91 fix python3.10 compatible issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14678226
* modify librosa version

* fix python3.10 compatible issue

* remove healpy in requirements for windowns compatible
 2023-11-29 17:41:44 +08:00
mulin.lyh
fe8bfa9219 when build force install funasr pai-eacv etc 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14812168
* when build force install funasr pai-eacv etc
 2023-11-29 17:40:09 +08:00
mulin.lyh
6c7fca8307 支持modelscope直接拉起推理服务 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14702876

* add inference server code

* add server requirement

* fix import issue

* debug

* add command line

* add llmpipeline support

* modify port to int

* add serer usage

* remove unused code

* fix lint issue

* add inference server code

* upgrade env to VLLM_USE_MODELSCOPE
 2023-11-29 17:37:56 +08:00
chenyafeng.cyf
ae42543389 fix_gpu_bug 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14822269
 2023-11-29 10:03:52 +08:00
biwen.lbw
a19fe73afb fix numpy bug 
修复numpy版本导致的bug
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14816762
* fix numpy bug
 2023-11-28 17:17:29 +08:00
mulin.lyh
5ba9fd2307 modify auto gptq and vllm env 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14790283
* upgrade to python3.10

* modify auto gptq and vllm env

* fix lint issue

* Merge remote-tracking branch 'origin/master' into python10_support

* python310 support

* build from repo

* add commit id force install modelscope every build

* add commit id force install modelscope every build

* fix cpu build issue

* fix datahub error message

* Merge branch 'python10_support' of gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib into python10_support

* add --no-cache-dir install auto_gptq
 2023-11-27 20:21:00 +08:00
mulin.lyh
b8e86060f5 numpy version unrestrict 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13398805
* numpy version unrestrict
 2023-11-27 13:56:33 +08:00
xingjun.wxj
6833bdabfc set datasets==2.14.6 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14593950
 2023-11-17 10:46:58 +08:00
wenmeng zhou
d9b76330fe fix logger: remove file handler for original user logging (#645) 2023-11-15 19:31:42 +08:00
wenmeng zhou
5b67c02cef Feat/llmriddle update (#640) 
* format chatglm output

* format code and add one problem to llm riddle

* fix app warning

* refine app.py and add test fn for validate fn
 2023-11-13 23:29:25 +08:00
Yorick He
a831e3a85c add 5 problems (#638) 
---------

Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
Co-authored-by: YorickHe <yongyi.hyy@alibaba-inc.com>
 2023-11-13 21:11:54 +08:00
tastelikefeet
69d784f26d Support transformers==4.35.0 (#633) 
* fix _set_gradient_checkpointing
 2023-11-13 20:41:10 +08:00
wenmeng zhou
2d387e6a2a Update README_zh.md (#614) 2023-11-13 19:55:30 +08:00
wenmeng zhou
1b46d52b23 Update README.md (#615) 2023-11-13 19:55:21 +08:00
wenmeng zhou
0eb3c7a452 Update README.md 2023-11-13 19:54:45 +08:00
wenmeng zhou
6b8f0ac5b8 add chatglm support for llm-riddle (#634) 
* add chatglm-turbo 

* update readme

* format code
 2023-11-10 19:23:21 +08:00
Yorick He
b3e8fd0609 add 3 problems to llm-riddle and fix some bugs (#632) 
* add 3 problems


---------

Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
Co-authored-by: YorickHe <yongyi.hyy@alibaba-inc.com>
 2023-11-10 17:47:56 +08:00