Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 12:39:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,405 Commits 263 Branches 106 Tags
33bdd0d21519637fa2eaa379b439ee6192d9e8a4
Commit Graph

1119 Commits

Author SHA1 Message Date
liuyhwangyh
f7a32e48e3 add dataset download (#906) 
* add dataset download

* fix cr issue

* fix cv matplotlib issue

* refactor code

* fix ut issue

* remove debug code

* remove unused import

* fix import issue

* sleep 65s before start docker avoid kill and run failed

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-07-12 19:06:44 +08:00
zhyncs
5b8e1e971c fix ignore_file_pattern (#886) 
* fix ignore_file_pattern

---------

Co-authored-by: root <root@kunkun>
 2024-07-01 14:31:39 +08:00
Firmament-cyou
8cdbeec3f6 Support swift model inference for llm pipeline (#880) 
* Support swift model inference for llm pipeline

* fix bug

* Add 'swfit' llm_framework and fix stream bug

* For pass the unittest run action
 2024-06-30 19:43:13 +08:00
yfchenmodelscope
f65f45959d Add Eres2netv2ep4 (#892) 
* add eres2netv2ep4
 2024-06-27 21:09:51 +08:00
mulin.lyh
4a22b05891 restore http_get_file interface 2024-05-28 15:09:05 +08:00
liuyhwangyh
17da5e2264 fix error report (#868) 
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-05-28 14:38:19 +08:00
liuyhwangyh
f93a184d88 add donwload command line and local_dir parameter (#866) 
* add donwload command line and local_dir parameter

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-05-25 14:21:55 +08:00
liuyhwangyh
5c470f8941 Download optimize (#862) 
* fix #845

Supports resumption of downloads from breakpoints, optimized download progress bar, finer display granularity, better experience under low bandwidth, and added function of downloading specified directories.

* restore push to hub

* fix merge issue

* fix ut issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-05-24 15:37:43 +08:00
yfchenmodelscope
f9451bfe38 add sdpn and tdnn (#865) 
* add sdpn and tdnn
 2024-05-24 14:39:16 +08:00
liuyhwangyh
82ee20f447 fix issue #845 (#861) 
* fix #845

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-05-23 20:34:52 +08:00
yfchenmodelscope
3a0072bef8 add eres2netv2 (#830) 2024-04-15 16:53:53 +08:00
pipikk
802f90d2e1 feat: add raft model (#702) 
* first version

* fix minor bugs

* add test images

* TorchModel & docstr

* modify pipeline implementation

* minor

* add datasets

* add extractor

* add update

* add augmentor

* add flow_viz

* add frame_utils

* add utils

* add raft_model

* add dense_optical_flow_estimation_pipeline

* add image_utils

* add test_dense_optical_flow_estimation

* test

* update cv/__init__

* [3]update cv/__init__

* update submodule data/test

* correct yapf

* fix bugs

* move test data

* update submodule

* minor

* update submodule

---------

Co-authored-by: kejie <kejie.qkj@alibaba-inc.com>
 2024-04-08 15:27:20 +08:00
Xingjun.Wang
1a66f069c4 Dataset refactor (#807) 
* add main entry in ms_dataset

* update func get_data_patterns import

* modify return_config_only

* modify return_config_only to dataset_info_only

* udpate version for test

* del get_logger(__name__)

* fix py script loading

* fix loading py and without py

* add subset support

* add hf_datasets_util; refine list_repo_tree_ms; fix private datasets loading issue

* update version to rc5

* fix and support preview for dataset_info_only mode

* fix urlencode

* update to rc7

* loading of dataset_infos.json is deprecated; 2. add some ut

* update version

* add escapechar for read_csv and to_csv

* add params: Source=SDK

* add create_dataset func

* overwrite _get_paths_info

* update & version

* update list_repo_tree name

* add get_module_with_script, fix download imports

* fix py script loading issue in dataset_module_factory

* fix create dataset

* update log info in api
 2024-03-22 17:30:34 +08:00
Ranqing
1ade52df17 upload marigold monocular depth estimation core files (#703) 
* upload marigold monocular depth estimation core files

* fix lint

* remove unused files.

* update marigold model files

* update marigold core files to fix review comments

* fix lint

* fix lint

* fix lint

* format code

* format code

---------

Co-authored-by: 葭润 <ranqing.rq@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
 2024-03-05 11:21:29 +08:00
Firmament-cyou
a0fe5947b7 Support stream_generate for LLMPipeline (#768) 
* support streaming output for llm_pipeline
* add qwen2 format_messages
 2024-03-05 10:05:18 +08:00
Zhe Sheng
f79a5b5924 Features/cv_geomvsnet_multi_view_depth_estimation_general (#790) 
* add mvs_depth_estimation model: GeoMVSNet

* file headers

* modify unitest class name

---------

Co-authored-by: shengzhe.sz <shengzhe.sz@alibaba-inc.com>
 2024-03-04 19:36:00 +08:00
yfchenmodelscope
2ecb97ac4f add res2net resnet models (#772) 
* add res2net resnet models

* add paper link and model introduction
 2024-02-23 16:19:13 +08:00
heyyxd
158d72bfd2 add self supervised depth completion. (#711) 
* add self supervised depth completion.

* update.

* fix the problem of key inconsistency.

* delete args parser.

* rename metrics to test_metrics.
 2024-02-22 22:30:48 +08:00
liuyhwangyh
3d442b5c7e damo to iic rename (#736) 
* add version time

* fix list model none issue

* damo to iic

* rmove unused import

* fix preprocess issue

* fix revison None bug

* fix bug

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-01-29 09:38:23 +08:00
mulin.lyh
588e41c787 fix lint issue 2024-01-22 15:52:30 +08:00
liuyhwangyh
672c32e7bd fix ci compatible issues，fix llmpipeline lazy import issue (#725) 
* fix ci issue

* fix case issue

* modify lint to python3.10

* fix case issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-01-17 22:19:05 +08:00
Yisheng (Ethan) He
94ce1ebd7a Feature/LoFTR_image_local_feature_matching (#687) 
* Add loftr image local feature matching.

* add pipeline doc str and remove example data as examples exists in data/test

* update pipeline doc str.

* add pipeline doc str

add pipeline doc str

---------

Co-authored-by: 翼生 <heyisheng.hys@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
 2024-01-17 21:51:29 +08:00
zhengyi-z
a9d5b88407 add image matching fast model based on lightglue (#694) 
* add image matching fast model based on lightglue

* add model-paper doc str and pipeline doc str

---------

Co-authored-by: bushe.zzy <bushe.zzy@alibaba-inc.com>
 2024-01-17 21:46:10 +08:00
Weihao Yuan
105247140c Feature/image normal estimation (#683) 
* image_normal_estimation

* image_normal_estimation

* update according to pr review

* update submodule data test

---------

Co-authored-by: Weihao Yuan <qianmu.ywh@alibaba-inc.com>
 2024-01-09 11:53:02 +08:00
slin000111
2d528ed482 fix anydoor pre-commit flake8 and isort errors (#707) 
* fix anydoor pre-commit flake8 and isort errors

* Add noqa to resolve conflicts

* fix image_to_3d_pipeline test error

---------

Co-authored-by: slin000111 <zhaoshilin2015@sina.con>
 2024-01-09 11:52:39 +08:00
zhangwlgq
0b1a974800 add rife-video-frame-interpolation and model (#685) 
* add rife-video-frame-interpolation pipeline and model

* add doc, change test level

---------

Co-authored-by: miracle.zjf <miracle.zjf@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
 2024-01-02 21:50:11 +08:00
wenmeng.zwm
39562dc555 merge master 2023-12-27 00:08:20 +08:00
Firmament-cyou
b473decba0 update ckpt to general_v0.1 (#696) 2023-12-26 16:59:47 +08:00
Firmament-cyou
b3c6eebdf3 Add AnyDoor support (#688) 
* support anydoor

* add dinov2

* fix bug

* convert rgb

* update anydoor_pipeline and add docstr
 2023-12-25 19:01:50 +08:00
hitsz-zuoqi
2ef12d1e88 add syncdreamer as a image-to-3d pipeline (#679) 
* add syncdreamer

* delete demo_output

* remove useless files and hide clip install

* update pipeline

* update clip package

* update unitest
 2023-12-21 22:12:32 +08:00
mulin.lyh
86fcbb8fbf Merge branch 'master-gitlab' into master-merge-internal20231208 2023-12-08 21:24:27 +08:00
Firmament-cyou
8f0f9d4a33 Register llm format map (#659) 
* add LLMAdapterRegistry

* fix bug

* replace traceback with cache
 2023-12-06 16:22:50 +08:00
myf272609
00eb4219a0 [to #42322933] fix issues for 3dhuman models 
- 角色驱动：添加自定义blender路径支持；移除模型位置标准化
- 角色渲染：添加自定义渲染分辨率支持；添加模型位置标准化
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14459360
* fix some issues

* fix
 2023-11-08 21:11:21 +08:00
Firmament-cyou
fafb0fe013 llm pipeline support chatglm3 (#618) 2023-11-04 20:44:55 +08:00
chenyafeng.cyf
e8b34a3bcd add_eres2net_speaker_diarization 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14412468
* add_eres2net_speaker_diarization

* fix lint issue

* update code

* update pipeline
 2023-10-25 20:36:36 +08:00
wenmeng.zwm
881c98d751 feat: Resolve conflict, auto committed by Code 2023-10-24 19:31:23 +08:00
zhangyanzhao.zyz
ebd6ddb530 更新sentence embedding model，支持gte，bloom sentence embedding 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14375781

* fix linter

* bloom embedding
 2023-10-24 15:23:50 +08:00
huizheng.hz
0911283dde add freeU model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14307648


* support sd21, sdxl
 2023-10-24 15:23:50 +08:00
mulin.lyh
d30ef8b202 fix huggingface position_ids compatible issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14406558
* fix compatible issues

* fix transformer compatible issue

* skip case for huggingface link issue

* fix hf autotokenlizer case

* Merge branch 'fix_ci_issue' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into fix_ci_issue
 2023-10-24 15:18:55 +08:00
Firmament-cyou
a3ae55577f Support swift in llm_pipeline. (#595) 
* support swift in llm_pipeline

* adjust function name
 2023-10-24 14:31:24 +08:00
zhangyanzhao.zyz
fb7328f4ec 更新sentence embedding model，支持gte，bloom sentence embedding 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14375781

* fix linter

* bloom embedding
 2023-10-20 19:56:01 +08:00
huizheng.hz
690473ce85 add freeU model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14307648


* support sd21, sdxl
 2023-10-20 16:10:54 +08:00
mulin.lyh
e93610f636 Merge branch 'master-gitlab' into master-merge-internal20231019 2023-10-19 19:12:00 +08:00
mulin.lyh
2d0d0689bf Merge branch 'master' into release/1.9 2023-10-13 22:39:59 +08:00
mulin.lyh
4ac59e29b0 refactor ci to analyze file dependency 
import分析不需要实际import文件，通过静态扫描，得到文件中定义的符号，在分析import时找到import的符号所在的文件，从而建立起关联。
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14281794
* refactor ci

* fix typo

* fix bug

* test

* add indirect import name resolve

* remove test code
 2023-10-13 14:11:30 +08:00
hemu.zp
4cad376298 Add llm_first parameter for pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14264249

* support llm_first parameter

* register_module(Tasks.text_generation)

* fix bug

* update format & fix out_base64 for int4

* pre-commit
 2023-10-13 14:04:04 +08:00
baiguan.yt
582c3a5415 add pasd_v2 保真度更好 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14202282
 2023-10-11 09:59:19 +08:00
hemu.zp
d64cfa48bc Support int4 model for llm_pipeline 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14214673

* use ms qwen update

* support baichuan2 int4

* update qwen vl unittest and fix bug

* init from AutoModelForCausalLM

* add todo for AutoModelForCausalLM
 2023-10-09 16:16:33 +08:00
mulin.lyh
c12b22ae3d fix onnxruntime providers parameter compatible issue 2023-09-28 17:20:21 +08:00
mulin.lyh
7f4fef0c3a fix provider bug 2023-09-28 17:20:21 +08:00