Commit Graph

1195 Commits

Author SHA1 Message Date
suluyana
40b689795a Fix ollama template (#1141)
* add marco o1

* add qwq

* feat: llama3.3

* fix space , add exaone3.5 , fix ministral
2024-12-10 14:22:02 +08:00
tastelikefeet
d2ef1003ea Skip obsolete sd pipeline (#1131) 2024-12-05 20:07:32 +08:00
Yingda Chen
e32a9361e3 fix accuracy case sensitiveness (#1118)
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-12-03 21:25:18 +08:00
Yingda Chen
2b1c839918 Format llm pipeline (#1094)
* format llm pipeline

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-11-22 20:04:59 +08:00
Yingda Chen
63febc58a6 add llamafile support to command line (#1087)
* add llamafile support to command line


Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-11-20 09:24:58 +08:00
suluyana
19fc9dc3f1 feat ollama template: llama3.2-vision (#1070) 2024-11-07 16:09:12 +08:00
suluyana
ae1541846b Template.to_ollama: add new argument split (#1039)
feat: 1. add new argument `split` 2. ollama template
2024-11-04 13:46:07 +08:00
Yingda Chen
83f1e20e80 add repo existence check hub-api (#1060)
* add repo existence check api

* update

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-11-02 08:04:40 +08:00
Mark
250b72fce7 fix: text error correction batch run bug (#1052)
Co-authored-by: Mark <smartmark-pro@qq.com>
2024-11-01 09:35:19 +08:00
Mashiro
e71057cacf feat(audio/ans): Add ZipEnhancer and related layers for acoustic nois… (#1019)
* feat(audio): Add acoustic noise suppression pipeline and tests for zipenhancer model

* Introduce `ZipEnhancer` module and associated layers (`ZipEnhancerLayer`, `Generator`, `ZipFormer`, ...).
* Add `speech_zipenhancer_ans_multiloss_16k_base` pipeline for `ZipEnhancer` module.
* Add new test cases and update metainfo.


Co-authored-by: Haoxu Wang <wanghaoxu.whx@alibaba-inc.com>
2024-10-24 15:38:09 +08:00
suluyana
bacdc53327 fix: set device_map=cuda if using gptq in gpu (#1027) 2024-10-17 17:13:22 +08:00
Xingjun.Wang
eab95f909f del ignore_verifications and add trust_remote_code for local py_script (#1021) 2024-10-15 12:41:12 +08:00
tastelikefeet
b0f03ffd6d Fix template of eos_token (#1013) 2024-10-10 21:40:51 +08:00
suluyana
bd1544bef0 fix template: llava-llama-3 & yi-1.5 (#1011) 2024-10-10 10:01:45 +08:00
Xingjun.Wang
2c4505e13a Adapt new datasets (#1002)
* update ds==3.0

* update

* add http_get_ms func

* del unused code

* fix pr issue and update requirements
2024-09-30 16:46:00 +08:00
tastelikefeet
834db59952 template and ollama in modelscope (#995) 2024-09-29 19:13:50 +08:00
tastelikefeet
74d97ea7e0 Refactor zero sized file downloading (#991) 2024-09-14 15:12:28 +08:00
tastelikefeet
96e33878b4 lint code (#970) 2024-09-02 10:16:35 +08:00
yuze.zyz
8b5a5bd1e3 fix 2024-09-01 18:37:01 +08:00
Xingjun.Wang
3f7ce97319 Fix streaming load issues (#953)
* fix streaming context

* add ut for stream
2024-08-22 14:43:37 +08:00
liuyhwangyh
96dfccbd75 fix compatible of origin command line (#944)
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-08-07 18:31:45 +08:00
liuyhwangyh
bf7c717e17 fix file download off by one bug (#943)
* fix file download off by one bug, command line default download model, add repo-type parameter
---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-08-07 10:40:25 +08:00
mulin.lyh
da9f3e58e3 enable download branch 2024-07-31 18:10:44 +08:00
mulin.lyh
775c29ef79 optimize code 2024-07-31 17:01:06 +08:00
Ranqing
543a2b32d7 upload high quality human normal estimation model (#903)
* upload human normal estimation model

* upload human normal estimation unittest

* update human normal estimation

* update test data

---------

Co-authored-by: 葭润 <ranqing.rq@alibaba-inc.com>
Co-authored-by: ranqing <ranqing@Sundays-Mac.local>
Co-authored-by: suluyana <suluyan_sly@163.com>
2024-07-31 10:19:41 +08:00
Xingjun.Wang
210ab40c54 Upgrade datasets (#921)
* del _datasets_server import in hf_dataset_util

* fix streaming for youku-mplug and adopt latest datasets

* fix download config copy

* update ut

* add youku in test_general_datasets

* update UT for general dataset

* adapt to datasets version: 2.19.0 or later

* add assert for youku data UT

* fix disable_tqdm in some functions for 2.19.0 or later

* update get_module_with_script

* set trust_remote_code is True in load_dataset_with_ctx

* update print info

* update requirements for datasets version restriction

* fix _dataset_info

* add pillow

* update comments

* update comment

* reuse _download function in DataDownloadManager

* remove unused code

* update test_run_modelhub in Human3DAnimationTest

* set datasets>=2.18.0
2024-07-23 22:26:12 +08:00
liuyhwangyh
f7a32e48e3 add dataset download (#906)
* add dataset download

* fix cr issue

* fix cv matplotlib issue

* refactor code

* fix ut issue

* remove debug code

* remove unused import

* fix import issue

* sleep 65s before start docker avoid kill and run failed

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-07-12 19:06:44 +08:00
zhyncs
5b8e1e971c fix ignore_file_pattern (#886)
* fix ignore_file_pattern

---------

Co-authored-by: root <root@kunkun>
2024-07-01 14:31:39 +08:00
Firmament-cyou
8cdbeec3f6 Support swift model inference for llm pipeline (#880)
* Support swift model inference for llm pipeline

* fix bug

* Add 'swfit' llm_framework and fix stream bug

* For pass the unittest run action
2024-06-30 19:43:13 +08:00
yfchenmodelscope
f65f45959d Add Eres2netv2ep4 (#892)
* add eres2netv2ep4
2024-06-27 21:09:51 +08:00
mulin.lyh
4a22b05891 restore http_get_file interface 2024-05-28 15:09:05 +08:00
liuyhwangyh
17da5e2264 fix error report (#868)
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-05-28 14:38:19 +08:00
liuyhwangyh
f93a184d88 add donwload command line and local_dir parameter (#866)
* add donwload command line and local_dir parameter

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-05-25 14:21:55 +08:00
liuyhwangyh
5c470f8941 Download optimize (#862)
* fix #845

Supports resumption of downloads from breakpoints, optimized download progress bar, finer display granularity, better experience under low bandwidth, and added function of downloading specified directories.

* restore push to hub

* fix merge issue

* fix ut issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-05-24 15:37:43 +08:00
yfchenmodelscope
f9451bfe38 add sdpn and tdnn (#865)
* add sdpn and tdnn
2024-05-24 14:39:16 +08:00
liuyhwangyh
82ee20f447 fix issue #845 (#861)
* fix #845

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-05-23 20:34:52 +08:00
yfchenmodelscope
3a0072bef8 add eres2netv2 (#830) 2024-04-15 16:53:53 +08:00
pipikk
802f90d2e1 feat: add raft model (#702)
* first version

* fix minor bugs

* add test images

* TorchModel & docstr

* modify pipeline implementation

* minor

* add datasets

* add extractor

* add update

* add augmentor

* add flow_viz

* add frame_utils

* add utils

* add raft_model

* add dense_optical_flow_estimation_pipeline

* add image_utils

* add test_dense_optical_flow_estimation

* test

* update cv/__init__

* [3]update cv/__init__

* update submodule data/test

* correct yapf

* fix bugs

* move test data

* update submodule

* minor

* update submodule

---------

Co-authored-by: kejie <kejie.qkj@alibaba-inc.com>
2024-04-08 15:27:20 +08:00
Xingjun.Wang
1a66f069c4 Dataset refactor (#807)
* add main entry in ms_dataset

* update func get_data_patterns import

* modify return_config_only

* modify return_config_only to dataset_info_only

* udpate version for test

* del get_logger(__name__)

* fix py script loading

* fix loading py and without py

* add subset support

* add hf_datasets_util; refine list_repo_tree_ms; fix private datasets loading issue

* update version to rc5

* fix and support preview for dataset_info_only mode

* fix urlencode

* update to rc7

* loading of dataset_infos.json is deprecated; 2. add some ut

* update version

* add escapechar for read_csv and to_csv

* add params: Source=SDK

* add create_dataset func

* overwrite _get_paths_info

* update & version

* update list_repo_tree name

* add get_module_with_script, fix download imports

* fix py script loading issue in dataset_module_factory

* fix create dataset

* update log info in api
2024-03-22 17:30:34 +08:00
Ranqing
1ade52df17 upload marigold monocular depth estimation core files (#703)
* upload marigold monocular depth estimation core files

* fix lint

* remove unused files.

* update marigold model files

* update marigold core files to fix review comments

* fix lint

* fix lint

* fix lint

* format code

* format code

---------

Co-authored-by: 葭润 <ranqing.rq@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
2024-03-05 11:21:29 +08:00
Firmament-cyou
a0fe5947b7 Support stream_generate for LLMPipeline (#768)
* support streaming output for llm_pipeline
* add qwen2 format_messages
2024-03-05 10:05:18 +08:00
Zhe Sheng
f79a5b5924 Features/cv_geomvsnet_multi_view_depth_estimation_general (#790)
* add mvs_depth_estimation model: GeoMVSNet

* file headers

* modify unitest class name

---------

Co-authored-by: shengzhe.sz <shengzhe.sz@alibaba-inc.com>
2024-03-04 19:36:00 +08:00
yfchenmodelscope
2ecb97ac4f add res2net resnet models (#772)
* add res2net resnet models

* add paper link and model introduction
2024-02-23 16:19:13 +08:00
heyyxd
158d72bfd2 add self supervised depth completion. (#711)
* add self supervised depth completion.

* update.

* fix the problem of key inconsistency.

* delete args parser.

* rename metrics to test_metrics.
2024-02-22 22:30:48 +08:00
liuyhwangyh
3d442b5c7e damo to iic rename (#736)
* add version time

* fix list model none issue

* damo to iic

* rmove unused import

* fix preprocess issue

* fix revison None bug

* fix bug

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-01-29 09:38:23 +08:00
mulin.lyh
588e41c787 fix lint issue 2024-01-22 15:52:30 +08:00
liuyhwangyh
672c32e7bd fix ci compatible issues,fix llmpipeline lazy import issue (#725)
* fix ci issue

* fix case issue

* modify lint to python3.10

* fix case issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-01-17 22:19:05 +08:00
Yisheng (Ethan) He
94ce1ebd7a Feature/LoFTR_image_local_feature_matching (#687)
* Add loftr image local feature matching.

* add pipeline doc str and remove example data as examples exists in data/test

* update pipeline doc str.

* add pipeline doc str

add pipeline doc str

---------

Co-authored-by: 翼生 <heyisheng.hys@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
2024-01-17 21:51:29 +08:00
zhengyi-z
a9d5b88407 add image matching fast model based on lightglue (#694)
* add image matching fast model based on lightglue

* add model-paper doc str and pipeline doc str

---------

Co-authored-by: bushe.zzy <bushe.zzy@alibaba-inc.com>
2024-01-17 21:46:10 +08:00
Weihao Yuan
105247140c Feature/image normal estimation (#683)
* image_normal_estimation

* image_normal_estimation

* update according to pr review

* update submodule data test

---------

Co-authored-by: Weihao Yuan <qianmu.ywh@alibaba-inc.com>
2024-01-09 11:53:02 +08:00