Commit Graph

1107 Commits

Author SHA1 Message Date
Xingjun.Wang
1a66f069c4 Dataset refactor (#807)
* add main entry in ms_dataset

* update func get_data_patterns import

* modify return_config_only

* modify return_config_only to dataset_info_only

* udpate version for test

* del get_logger(__name__)

* fix py script loading

* fix loading py and without py

* add subset support

* add hf_datasets_util; refine list_repo_tree_ms; fix private datasets loading issue

* update version to rc5

* fix and support preview for dataset_info_only mode

* fix urlencode

* update to rc7

* loading of dataset_infos.json is deprecated; 2. add some ut

* update version

* add escapechar for read_csv and to_csv

* add params: Source=SDK

* add create_dataset func

* overwrite _get_paths_info

* update & version

* update list_repo_tree name

* add get_module_with_script, fix download imports

* fix py script loading issue in dataset_module_factory

* fix create dataset

* update log info in api
2024-03-22 17:30:34 +08:00
Ranqing
1ade52df17 upload marigold monocular depth estimation core files (#703)
* upload marigold monocular depth estimation core files

* fix lint

* remove unused files.

* update marigold model files

* update marigold core files to fix review comments

* fix lint

* fix lint

* fix lint

* format code

* format code

---------

Co-authored-by: 葭润 <ranqing.rq@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
2024-03-05 11:21:29 +08:00
Firmament-cyou
a0fe5947b7 Support stream_generate for LLMPipeline (#768)
* support streaming output for llm_pipeline
* add qwen2 format_messages
2024-03-05 10:05:18 +08:00
Zhe Sheng
f79a5b5924 Features/cv_geomvsnet_multi_view_depth_estimation_general (#790)
* add mvs_depth_estimation model: GeoMVSNet

* file headers

* modify unitest class name

---------

Co-authored-by: shengzhe.sz <shengzhe.sz@alibaba-inc.com>
2024-03-04 19:36:00 +08:00
yfchenmodelscope
2ecb97ac4f add res2net resnet models (#772)
* add res2net resnet models

* add paper link and model introduction
2024-02-23 16:19:13 +08:00
heyyxd
158d72bfd2 add self supervised depth completion. (#711)
* add self supervised depth completion.

* update.

* fix the problem of key inconsistency.

* delete args parser.

* rename metrics to test_metrics.
2024-02-22 22:30:48 +08:00
liuyhwangyh
3d442b5c7e damo to iic rename (#736)
* add version time

* fix list model none issue

* damo to iic

* rmove unused import

* fix preprocess issue

* fix revison None bug

* fix bug

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-01-29 09:38:23 +08:00
mulin.lyh
588e41c787 fix lint issue 2024-01-22 15:52:30 +08:00
liuyhwangyh
672c32e7bd fix ci compatible issues,fix llmpipeline lazy import issue (#725)
* fix ci issue

* fix case issue

* modify lint to python3.10

* fix case issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-01-17 22:19:05 +08:00
Yisheng (Ethan) He
94ce1ebd7a Feature/LoFTR_image_local_feature_matching (#687)
* Add loftr image local feature matching.

* add pipeline doc str and remove example data as examples exists in data/test

* update pipeline doc str.

* add pipeline doc str

add pipeline doc str

---------

Co-authored-by: 翼生 <heyisheng.hys@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
2024-01-17 21:51:29 +08:00
zhengyi-z
a9d5b88407 add image matching fast model based on lightglue (#694)
* add image matching fast model based on lightglue

* add model-paper doc str and pipeline doc str

---------

Co-authored-by: bushe.zzy <bushe.zzy@alibaba-inc.com>
2024-01-17 21:46:10 +08:00
Weihao Yuan
105247140c Feature/image normal estimation (#683)
* image_normal_estimation

* image_normal_estimation

* update according to pr review

* update submodule data test

---------

Co-authored-by: Weihao Yuan <qianmu.ywh@alibaba-inc.com>
2024-01-09 11:53:02 +08:00
slin000111
2d528ed482 fix anydoor pre-commit flake8 and isort errors (#707)
* fix anydoor pre-commit flake8 and isort errors

* Add noqa to resolve conflicts

* fix image_to_3d_pipeline test error

---------

Co-authored-by: slin000111 <zhaoshilin2015@sina.con>
2024-01-09 11:52:39 +08:00
zhangwlgq
0b1a974800 add rife-video-frame-interpolation and model (#685)
* add rife-video-frame-interpolation pipeline and model

* add doc, change test level

---------

Co-authored-by: miracle.zjf <miracle.zjf@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
2024-01-02 21:50:11 +08:00
wenmeng.zwm
39562dc555 merge master 2023-12-27 00:08:20 +08:00
Firmament-cyou
b473decba0 update ckpt to general_v0.1 (#696) 2023-12-26 16:59:47 +08:00
Firmament-cyou
b3c6eebdf3 Add AnyDoor support (#688)
* support anydoor

* add dinov2

* fix bug

* convert rgb

* update anydoor_pipeline and add docstr
2023-12-25 19:01:50 +08:00
hitsz-zuoqi
2ef12d1e88 add syncdreamer as a image-to-3d pipeline (#679)
* add syncdreamer

* delete demo_output

* remove useless files and hide clip install

* update pipeline

* update clip package

* update unitest
2023-12-21 22:12:32 +08:00
mulin.lyh
86fcbb8fbf Merge branch 'master-gitlab' into master-merge-internal20231208 2023-12-08 21:24:27 +08:00
Firmament-cyou
8f0f9d4a33 Register llm format map (#659)
* add LLMAdapterRegistry

* fix bug

* replace traceback with cache
2023-12-06 16:22:50 +08:00
myf272609
00eb4219a0 [to #42322933] fix issues for 3dhuman models
- 角色驱动:添加自定义blender路径支持;移除模型位置标准化
- 角色渲染:添加自定义渲染分辨率支持;添加模型位置标准化
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14459360
* fix some issues

* fix
2023-11-08 21:11:21 +08:00
Firmament-cyou
fafb0fe013 llm pipeline support chatglm3 (#618) 2023-11-04 20:44:55 +08:00
chenyafeng.cyf
e8b34a3bcd add_eres2net_speaker_diarization
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14412468
* add_eres2net_speaker_diarization

* fix lint issue

* update code

* update pipeline
2023-10-25 20:36:36 +08:00
wenmeng.zwm
881c98d751 feat: Resolve conflict, auto committed by Code 2023-10-24 19:31:23 +08:00
zhangyanzhao.zyz
ebd6ddb530 更新sentence embedding model,支持gte,bloom sentence embedding
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14375781

* fix linter

* bloom embedding
2023-10-24 15:23:50 +08:00
huizheng.hz
0911283dde add freeU model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14307648


* support sd21, sdxl
2023-10-24 15:23:50 +08:00
mulin.lyh
d30ef8b202 fix huggingface position_ids compatible issue
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14406558
* fix compatible issues

* fix transformer compatible issue

* skip case for huggingface link issue

* fix hf autotokenlizer case

* Merge branch 'fix_ci_issue' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into fix_ci_issue
2023-10-24 15:18:55 +08:00
Firmament-cyou
a3ae55577f Support swift in llm_pipeline. (#595)
* support swift in llm_pipeline

* adjust function name
2023-10-24 14:31:24 +08:00
zhangyanzhao.zyz
fb7328f4ec 更新sentence embedding model,支持gte,bloom sentence embedding
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14375781

* fix linter

* bloom embedding
2023-10-20 19:56:01 +08:00
huizheng.hz
690473ce85 add freeU model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14307648


* support sd21, sdxl
2023-10-20 16:10:54 +08:00
mulin.lyh
e93610f636 Merge branch 'master-gitlab' into master-merge-internal20231019 2023-10-19 19:12:00 +08:00
mulin.lyh
2d0d0689bf Merge branch 'master' into release/1.9 2023-10-13 22:39:59 +08:00
mulin.lyh
4ac59e29b0 refactor ci to analyze file dependency
import分析不需要实际import文件,通过静态扫描,得到文件中定义的符号,在分析import时找到import的符号所在的文件,从而建立起关联。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14281794
* refactor ci

* fix typo

* fix bug

* test

* add indirect import name resolve

* remove test code
2023-10-13 14:11:30 +08:00
hemu.zp
4cad376298 Add llm_first parameter for pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14264249

* support llm_first parameter

* register_module(Tasks.text_generation)

* fix bug

* update format & fix out_base64 for int4

* pre-commit
2023-10-13 14:04:04 +08:00
baiguan.yt
582c3a5415 add pasd_v2 保真度更好
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14202282
2023-10-11 09:59:19 +08:00
hemu.zp
d64cfa48bc Support int4 model for llm_pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14214673

* use ms qwen update

* support baichuan2 int4

* update qwen vl unittest and fix bug

* init from AutoModelForCausalLM

* add todo for AutoModelForCausalLM
2023-10-09 16:16:33 +08:00
mulin.lyh
c12b22ae3d fix onnxruntime providers parameter compatible issue 2023-09-28 17:20:21 +08:00
mulin.lyh
7f4fef0c3a fix provider bug 2023-09-28 17:20:21 +08:00
mulin.lyh
c3e2a0e842 fix provider bug 2023-09-28 17:14:42 +08:00
mulin.lyh
146e69e6ba fix onnxruntime providers parameter compatible issue 2023-09-28 14:19:36 +08:00
狄咖
8d0ffa47b3 [feat]chat pipeline 2023-09-28 00:56:38 +08:00
狄咖
74abc2e63f [feat]chat pipeline 2023-09-28 00:54:41 +08:00
mulin.lyh
23f1f474bf Merge branch 'master-github' into master-merge-github925
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14164566
2023-09-26 21:15:41 +08:00
myf272609
2ee65141e6 [to #42322933] add 3dhuman render and animation models
新增3D人物模型渲染pipeline
新增3D角色自动驱动pipeline

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14146042

* upload 3dhuman render and animation code

* remove chumpy dependence

* feat: Fix conflict, auto commit by WebIDE

* modify code structure, add user inputs, etc.

* add output path
2023-09-25 21:09:18 +08:00
jinmao.yk
0dd95b27dd add texture generation task(文本引导纹理生成)
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14123234
* add texture generation task

* add output dir

* add input
2023-09-25 20:03:04 +08:00
lipandeng.lpd
514848251c prost add support for cpu
支持cpu
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14126219
2023-09-25 14:19:16 +08:00
yuanzhi.zyz
860cdf5f48 add onnx exporter for ocr recognition model
1. 添加ocr recognition相关的exporter,支持现有三类模型转onnx
2. 更新lightweight模型
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14135723
* add ocr recognition export and update lightweight model

* fix
2023-09-25 11:34:53 +08:00
xixing.tj
e7e712c5c2 add onnx exporter for ocr_detection db model
支持ocr_detection db pytorch模型转onnx
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14117993
* add onnx exporter for ocr_detection db model

* add code for onnx convert

* fix bug
2023-09-25 11:34:28 +08:00
ryan.yy
04b24814ca 新建模型 image_control_3d_portrait
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14003131

* add image_control_3d_portrait code

* update requirements

* remove duplicate plyfile

* update test_image_control_3d_portrait code

* update test code

* update requirements

* change face landmark models and  revise as cr suggests

* add save images choice

* add image_control_3d_portrait.jpg

* mv ops related code to modelscope/ops
2023-09-25 11:23:02 +08:00
yanyi.ys
e686db72e5 zero123-XL-图像视角变换
该代码用于对给定图片中的物体进行多视角的生成,并且能够按照指定的视角进行生成。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/13902247
* [to #42322933] add files

* update test data

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* Merge remote-tracking branch 'origin' into feature/image_view_transform
merge master

* [to #42322933] add files

* [to #42322933] add files

* Merge remote-tracking branch 'origin' into feature/image_view_transform
merge the master

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files

* [to #42322933] add files
2023-09-24 16:21:53 +08:00