Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 12:39:25 +01:00
Code Issues Packages Projects Releases Wiki Activity
2,426 Commits 263 Branches 106 Tags
eec64bfbe224a5266a033cc101064f6567f10248
Commit Graph

1126 Commits

Author SHA1 Message Date
Xingjun.Wang
3f7ce97319 Fix streaming load issues (#953) 
* fix streaming context

* add ut for stream
 2024-08-22 14:43:37 +08:00
liuyhwangyh
96dfccbd75 fix compatible of origin command line (#944) 
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-08-07 18:31:45 +08:00
liuyhwangyh
bf7c717e17 fix file download off by one bug (#943) 
* fix file download off by one bug, command line default download model, add repo-type parameter
---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-08-07 10:40:25 +08:00
mulin.lyh
da9f3e58e3 enable download branch 2024-07-31 18:10:44 +08:00
mulin.lyh
775c29ef79 optimize code 2024-07-31 17:01:06 +08:00
Ranqing
543a2b32d7 upload high quality human normal estimation model (#903) 
* upload human normal estimation model

* upload human normal estimation unittest

* update human normal estimation

* update test data

---------

Co-authored-by: 葭润 <ranqing.rq@alibaba-inc.com>
Co-authored-by: ranqing <ranqing@Sundays-Mac.local>
Co-authored-by: suluyana <suluyan_sly@163.com>
 2024-07-31 10:19:41 +08:00
Xingjun.Wang
210ab40c54 Upgrade datasets (#921) 
* del _datasets_server import in hf_dataset_util

* fix streaming for youku-mplug and adopt latest datasets

* fix download config copy

* update ut

* add youku in test_general_datasets

* update UT for general dataset

* adapt to datasets version: 2.19.0 or later

* add assert for youku data UT

* fix disable_tqdm in some functions for 2.19.0 or later

* update get_module_with_script

* set trust_remote_code is True in load_dataset_with_ctx

* update print info

* update requirements for datasets version restriction

* fix _dataset_info

* add pillow

* update comments

* update comment

* reuse _download function in DataDownloadManager

* remove unused code

* update test_run_modelhub in Human3DAnimationTest

* set datasets>=2.18.0
 2024-07-23 22:26:12 +08:00
liuyhwangyh
f7a32e48e3 add dataset download (#906) 
* add dataset download

* fix cr issue

* fix cv matplotlib issue

* refactor code

* fix ut issue

* remove debug code

* remove unused import

* fix import issue

* sleep 65s before start docker avoid kill and run failed

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-07-12 19:06:44 +08:00
zhyncs
5b8e1e971c fix ignore_file_pattern (#886) 
* fix ignore_file_pattern

---------

Co-authored-by: root <root@kunkun>
 2024-07-01 14:31:39 +08:00
Firmament-cyou
8cdbeec3f6 Support swift model inference for llm pipeline (#880) 
* Support swift model inference for llm pipeline

* fix bug

* Add 'swfit' llm_framework and fix stream bug

* For pass the unittest run action
 2024-06-30 19:43:13 +08:00
yfchenmodelscope
f65f45959d Add Eres2netv2ep4 (#892) 
* add eres2netv2ep4
 2024-06-27 21:09:51 +08:00
mulin.lyh
4a22b05891 restore http_get_file interface 2024-05-28 15:09:05 +08:00
liuyhwangyh
17da5e2264 fix error report (#868) 
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-05-28 14:38:19 +08:00
liuyhwangyh
f93a184d88 add donwload command line and local_dir parameter (#866) 
* add donwload command line and local_dir parameter

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-05-25 14:21:55 +08:00
liuyhwangyh
5c470f8941 Download optimize (#862) 
* fix #845

Supports resumption of downloads from breakpoints, optimized download progress bar, finer display granularity, better experience under low bandwidth, and added function of downloading specified directories.

* restore push to hub

* fix merge issue

* fix ut issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-05-24 15:37:43 +08:00
yfchenmodelscope
f9451bfe38 add sdpn and tdnn (#865) 
* add sdpn and tdnn
 2024-05-24 14:39:16 +08:00
liuyhwangyh
82ee20f447 fix issue #845 (#861) 
* fix #845

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-05-23 20:34:52 +08:00
yfchenmodelscope
3a0072bef8 add eres2netv2 (#830) 2024-04-15 16:53:53 +08:00
pipikk
802f90d2e1 feat: add raft model (#702) 
* first version

* fix minor bugs

* add test images

* TorchModel & docstr

* modify pipeline implementation

* minor

* add datasets

* add extractor

* add update

* add augmentor

* add flow_viz

* add frame_utils

* add utils

* add raft_model

* add dense_optical_flow_estimation_pipeline

* add image_utils

* add test_dense_optical_flow_estimation

* test

* update cv/__init__

* [3]update cv/__init__

* update submodule data/test

* correct yapf

* fix bugs

* move test data

* update submodule

* minor

* update submodule

---------

Co-authored-by: kejie <kejie.qkj@alibaba-inc.com>
 2024-04-08 15:27:20 +08:00
Xingjun.Wang
1a66f069c4 Dataset refactor (#807) 
* add main entry in ms_dataset

* update func get_data_patterns import

* modify return_config_only

* modify return_config_only to dataset_info_only

* udpate version for test

* del get_logger(__name__)

* fix py script loading

* fix loading py and without py

* add subset support

* add hf_datasets_util; refine list_repo_tree_ms; fix private datasets loading issue

* update version to rc5

* fix and support preview for dataset_info_only mode

* fix urlencode

* update to rc7

* loading of dataset_infos.json is deprecated; 2. add some ut

* update version

* add escapechar for read_csv and to_csv

* add params: Source=SDK

* add create_dataset func

* overwrite _get_paths_info

* update & version

* update list_repo_tree name

* add get_module_with_script, fix download imports

* fix py script loading issue in dataset_module_factory

* fix create dataset

* update log info in api
 2024-03-22 17:30:34 +08:00
Ranqing
1ade52df17 upload marigold monocular depth estimation core files (#703) 
* upload marigold monocular depth estimation core files

* fix lint

* remove unused files.

* update marigold model files

* update marigold core files to fix review comments

* fix lint

* fix lint

* fix lint

* format code

* format code

---------

Co-authored-by: 葭润 <ranqing.rq@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
 2024-03-05 11:21:29 +08:00
Firmament-cyou
a0fe5947b7 Support stream_generate for LLMPipeline (#768) 
* support streaming output for llm_pipeline
* add qwen2 format_messages
 2024-03-05 10:05:18 +08:00
Zhe Sheng
f79a5b5924 Features/cv_geomvsnet_multi_view_depth_estimation_general (#790) 
* add mvs_depth_estimation model: GeoMVSNet

* file headers

* modify unitest class name

---------

Co-authored-by: shengzhe.sz <shengzhe.sz@alibaba-inc.com>
 2024-03-04 19:36:00 +08:00
yfchenmodelscope
2ecb97ac4f add res2net resnet models (#772) 
* add res2net resnet models

* add paper link and model introduction
 2024-02-23 16:19:13 +08:00
heyyxd
158d72bfd2 add self supervised depth completion. (#711) 
* add self supervised depth completion.

* update.

* fix the problem of key inconsistency.

* delete args parser.

* rename metrics to test_metrics.
 2024-02-22 22:30:48 +08:00
liuyhwangyh
3d442b5c7e damo to iic rename (#736) 
* add version time

* fix list model none issue

* damo to iic

* rmove unused import

* fix preprocess issue

* fix revison None bug

* fix bug

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-01-29 09:38:23 +08:00
mulin.lyh
588e41c787 fix lint issue 2024-01-22 15:52:30 +08:00
liuyhwangyh
672c32e7bd fix ci compatible issues，fix llmpipeline lazy import issue (#725) 
* fix ci issue

* fix case issue

* modify lint to python3.10

* fix case issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
 2024-01-17 22:19:05 +08:00
Yisheng (Ethan) He
94ce1ebd7a Feature/LoFTR_image_local_feature_matching (#687) 
* Add loftr image local feature matching.

* add pipeline doc str and remove example data as examples exists in data/test

* update pipeline doc str.

* add pipeline doc str

add pipeline doc str

---------

Co-authored-by: 翼生 <heyisheng.hys@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
 2024-01-17 21:51:29 +08:00
zhengyi-z
a9d5b88407 add image matching fast model based on lightglue (#694) 
* add image matching fast model based on lightglue

* add model-paper doc str and pipeline doc str

---------

Co-authored-by: bushe.zzy <bushe.zzy@alibaba-inc.com>
 2024-01-17 21:46:10 +08:00
Weihao Yuan
105247140c Feature/image normal estimation (#683) 
* image_normal_estimation

* image_normal_estimation

* update according to pr review

* update submodule data test

---------

Co-authored-by: Weihao Yuan <qianmu.ywh@alibaba-inc.com>
 2024-01-09 11:53:02 +08:00
slin000111
2d528ed482 fix anydoor pre-commit flake8 and isort errors (#707) 
* fix anydoor pre-commit flake8 and isort errors

* Add noqa to resolve conflicts

* fix image_to_3d_pipeline test error

---------

Co-authored-by: slin000111 <zhaoshilin2015@sina.con>
 2024-01-09 11:52:39 +08:00
zhangwlgq
0b1a974800 add rife-video-frame-interpolation and model (#685) 
* add rife-video-frame-interpolation pipeline and model

* add doc, change test level

---------

Co-authored-by: miracle.zjf <miracle.zjf@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
 2024-01-02 21:50:11 +08:00
wenmeng.zwm
39562dc555 merge master 2023-12-27 00:08:20 +08:00
Firmament-cyou
b473decba0 update ckpt to general_v0.1 (#696) 2023-12-26 16:59:47 +08:00
Firmament-cyou
b3c6eebdf3 Add AnyDoor support (#688) 
* support anydoor

* add dinov2

* fix bug

* convert rgb

* update anydoor_pipeline and add docstr
 2023-12-25 19:01:50 +08:00
hitsz-zuoqi
2ef12d1e88 add syncdreamer as a image-to-3d pipeline (#679) 
* add syncdreamer

* delete demo_output

* remove useless files and hide clip install

* update pipeline

* update clip package

* update unitest
 2023-12-21 22:12:32 +08:00
mulin.lyh
86fcbb8fbf Merge branch 'master-gitlab' into master-merge-internal20231208 2023-12-08 21:24:27 +08:00
Firmament-cyou
8f0f9d4a33 Register llm format map (#659) 
* add LLMAdapterRegistry

* fix bug

* replace traceback with cache
 2023-12-06 16:22:50 +08:00
myf272609
00eb4219a0 [to #42322933] fix issues for 3dhuman models 
- 角色驱动：添加自定义blender路径支持；移除模型位置标准化
- 角色渲染：添加自定义渲染分辨率支持；添加模型位置标准化
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14459360
* fix some issues

* fix
 2023-11-08 21:11:21 +08:00
Firmament-cyou
fafb0fe013 llm pipeline support chatglm3 (#618) 2023-11-04 20:44:55 +08:00
chenyafeng.cyf
e8b34a3bcd add_eres2net_speaker_diarization 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14412468
* add_eres2net_speaker_diarization

* fix lint issue

* update code

* update pipeline
 2023-10-25 20:36:36 +08:00
wenmeng.zwm
881c98d751 feat: Resolve conflict, auto committed by Code 2023-10-24 19:31:23 +08:00
zhangyanzhao.zyz
ebd6ddb530 更新sentence embedding model，支持gte，bloom sentence embedding 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14375781

* fix linter

* bloom embedding
 2023-10-24 15:23:50 +08:00
huizheng.hz
0911283dde add freeU model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14307648


* support sd21, sdxl
 2023-10-24 15:23:50 +08:00
mulin.lyh
d30ef8b202 fix huggingface position_ids compatible issue 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14406558
* fix compatible issues

* fix transformer compatible issue

* skip case for huggingface link issue

* fix hf autotokenlizer case

* Merge branch 'fix_ci_issue' of http://gitlab.alibaba-inc.com/Ali-MaaS/MaaS-lib into fix_ci_issue
 2023-10-24 15:18:55 +08:00
Firmament-cyou
a3ae55577f Support swift in llm_pipeline. (#595) 
* support swift in llm_pipeline

* adjust function name
 2023-10-24 14:31:24 +08:00
zhangyanzhao.zyz
fb7328f4ec 更新sentence embedding model，支持gte，bloom sentence embedding 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14375781

* fix linter

* bloom embedding
 2023-10-20 19:56:01 +08:00
huizheng.hz
690473ce85 add freeU model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/14307648


* support sd21, sdxl
 2023-10-20 16:10:54 +08:00
mulin.lyh
e93610f636 Merge branch 'master-gitlab' into master-merge-internal20231019 2023-10-19 19:12:00 +08:00