Commit Graph

2354 Commits

Author SHA1 Message Date
xingjun.wang
21c2e62082 fix get_dataset_file_url 2024-03-26 15:13:25 +08:00
Xingjun.Wang
1a66f069c4 Dataset refactor (#807)
* add main entry in ms_dataset

* update func get_data_patterns import

* modify return_config_only

* modify return_config_only to dataset_info_only

* udpate version for test

* del get_logger(__name__)

* fix py script loading

* fix loading py and without py

* add subset support

* add hf_datasets_util; refine list_repo_tree_ms; fix private datasets loading issue

* update version to rc5

* fix and support preview for dataset_info_only mode

* fix urlencode

* update to rc7

* loading of dataset_infos.json is deprecated; 2. add some ut

* update version

* add escapechar for read_csv and to_csv

* add params: Source=SDK

* add create_dataset func

* overwrite _get_paths_info

* update & version

* update list_repo_tree name

* add get_module_with_script, fix download imports

* fix py script loading issue in dataset_module_factory

* fix create dataset

* update log info in api
2024-03-22 17:30:34 +08:00
liuyhwangyh
9d2c2708ff fix download file with spical name as 'Image+Title.png' (#805)
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-03-12 20:55:13 +08:00
wertycn
0ecff264c0 Fix error "modelscope attributeerror: 'dict' object has no attribute 'task_name' " (#800) 2024-03-12 20:34:25 +08:00
tastelikefeet
c350c2446c move doc to classroom (#802) 2024-03-06 21:15:32 +08:00
ccyhxg
9cefe0a37b add ViViT-demo (#796)
add vivit-demo
2024-03-05 14:18:46 +08:00
tison
60d14f1f24 chore: Formal LICENSE content (#799)
The LICENSE text is used AS IS - Need not "customized".
2024-03-05 14:16:30 +08:00
Ranqing
1ade52df17 upload marigold monocular depth estimation core files (#703)
* upload marigold monocular depth estimation core files

* fix lint

* remove unused files.

* update marigold model files

* update marigold core files to fix review comments

* fix lint

* fix lint

* fix lint

* format code

* format code

---------

Co-authored-by: 葭润 <ranqing.rq@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
2024-03-05 11:21:29 +08:00
Firmament-cyou
a0fe5947b7 Support stream_generate for LLMPipeline (#768)
* support streaming output for llm_pipeline
* add qwen2 format_messages
2024-03-05 10:05:18 +08:00
Zhe Sheng
f79a5b5924 Features/cv_geomvsnet_multi_view_depth_estimation_general (#790)
* add mvs_depth_estimation model: GeoMVSNet

* file headers

* modify unitest class name

---------

Co-authored-by: shengzhe.sz <shengzhe.sz@alibaba-inc.com>
2024-03-04 19:36:00 +08:00
tastelikefeet
cc3238bef6 fix pre-commit (#794) 2024-03-04 19:26:53 +08:00
co63oc
30bae2eafa Fix (#781) 2024-03-04 10:56:11 +08:00
liuyhwangyh
614be60395 remove download interval check (#771)
* remove download interval check

* remove MINIMUM_DOWNLOAD_INTERVAL_SECONDS

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-03-04 10:53:10 +08:00
Starsky Wong
2d2d9e4fe9 fix image_portrait_enhancement rgb channel bug (#740)
Co-authored-by: Starsky Wong <wangsunping@rayvision.com>
2024-03-04 10:45:28 +08:00
RainJay
a0fb7e6fd8 fix SeqGPTPipeline input force cuda issue (#738)
tokenizer of SeqGPTPipeline force using cuda, now is depence on model devcie type
2024-03-04 10:44:33 +08:00
liuyhwangyh
f4e01d6228 fix build issue (#786)
* fix build issue

* fix lint issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-03-04 10:43:48 +08:00
tastelikefeet
c7c902a16d pre-commit passed (#789) 2024-02-29 21:52:42 +08:00
ccyhxg
fd838b5e6a Add files via upload (#788)
SD推理最佳实践,包括秒级生图,lora,controlnet
2024-02-29 21:16:33 +08:00
ccyhxg
021735207f add qwen1.5_doc_search_QA_based_on_langchain.ipynb (#769) 2024-02-23 17:06:24 +08:00
slin000111
8a8d273ec3 fix text_to_video_synthesis_model device (#751)
Co-authored-by: slin000111 <zhaoshilin2015@sina.con>
2024-02-23 17:05:15 +08:00
Qslia
2df76a9304 change output video format from mp4v to mp4 h264 (#757) 2024-02-23 16:32:42 +08:00
liuyhwangyh
5912cf3132 upgrade image build (#773)
* upgrade image build

* add timm upgrade

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-02-23 16:24:54 +08:00
yfchenmodelscope
2ecb97ac4f add res2net resnet models (#772)
* add res2net resnet models

* add paper link and model introduction
2024-02-23 16:19:13 +08:00
tastelikefeet
dfe57f9bc9 fix link (#774) 2024-02-23 14:29:16 +08:00
SiuMing
4f2e9d247c To solve the "ImportError: always import a name 'LlamaTokenizer' from 'transformers. Models. Llama" problem (#745)
RuntimeError: Failed to import modelscope.models.nlp.llama2 because of the following error (look up to see its traceback):
*aot imoont mame 'lamalokenizer'from tnansformers.models,llama /e:PVthoPvthn311li site-Dackagesitransformers models llama init.y
2024-02-23 14:03:31 +08:00
heyyxd
158d72bfd2 add self supervised depth completion. (#711)
* add self supervised depth completion.

* update.

* fix the problem of key inconsistency.

* delete args parser.

* rename metrics to test_metrics.
2024-02-22 22:30:48 +08:00
co63oc
07a5bef0ca Fix (#746) 2024-02-21 15:59:37 +08:00
ccyhxg
10e98f166f add SiT_ImageNet_Demo (#770) 2024-02-21 15:46:27 +08:00
Jintao
e168717f36 add awqconfig (#761) 2024-02-21 14:54:48 +08:00
co63oc
b037e9caf0 Fix word orignal (#750) 2024-02-21 14:53:33 +08:00
co63oc
473bf33705 Fix word pipleline (#749) 2024-02-21 14:35:11 +08:00
co63oc
aaedf05181 Fix word pubicly -> publicly (#748) 2024-02-21 14:24:24 +08:00
co63oc
71bb523432 Fix (#747) 2024-02-21 14:23:49 +08:00
williamcc
c5f058f306 Add a QA example based on llamaindex only (#759) 2024-02-21 14:18:12 +08:00
ccyhxg
05be6e1420 Add DiT_ImageNet Notebook (#767) 2024-02-21 14:17:07 +08:00
ccyhxg
66af92a21d UViT ImageNet (#763) 2024-02-20 15:51:01 +08:00
liuyhwangyh
5e8a8f4e93 add if download interval is too small, use local cache (#752)
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-02-04 21:25:09 +08:00
liuyhwangyh
3d442b5c7e damo to iic rename (#736)
* add version time

* fix list model none issue

* damo to iic

* rmove unused import

* fix preprocess issue

* fix revison None bug

* fix bug

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-01-29 09:38:23 +08:00
zhifu gao
ade394d68c Funasr1.0 (#733)
* funasr1.0 model.generate

* funasr1.0 update

* funasr1.0
2024-01-23 19:28:58 +08:00
liuyhwangyh
c3bb9e71cf add download retry reason message and some optimize (#734)
1. optimize download retyr message
2. fix input_output pipeline_info bug on python3.8

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-01-22 22:51:09 +08:00
liuyhwangyh
6f93ab01e6 Merge pull request #735 from modelscope/fix_lint_issue
fix lint issue
2024-01-22 16:46:45 +08:00
mulin.lyh
588e41c787 fix lint issue 2024-01-22 15:52:30 +08:00
liuyhwangyh
672c32e7bd fix ci compatible issues,fix llmpipeline lazy import issue (#725)
* fix ci issue

* fix case issue

* modify lint to python3.10

* fix case issue

---------

Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>
2024-01-17 22:19:05 +08:00
Yisheng (Ethan) He
94ce1ebd7a Feature/LoFTR_image_local_feature_matching (#687)
* Add loftr image local feature matching.

* add pipeline doc str and remove example data as examples exists in data/test

* update pipeline doc str.

* add pipeline doc str

add pipeline doc str

---------

Co-authored-by: 翼生 <heyisheng.hys@alibaba-inc.com>
Co-authored-by: wenmeng zhou <wenmeng.zwm@alibaba-inc.com>
2024-01-17 21:51:29 +08:00
zhengyi-z
a9d5b88407 add image matching fast model based on lightglue (#694)
* add image matching fast model based on lightglue

* add model-paper doc str and pipeline doc str

---------

Co-authored-by: bushe.zzy <bushe.zzy@alibaba-inc.com>
2024-01-17 21:46:10 +08:00
Jintao
8cf88e4141 Fix module loading error caused by '.' in model_id (#722)
* update snapshot_download

* update
2024-01-17 21:25:52 +08:00
williamcc
34fab808b1 add an example for qwen doc QA with langchain + llamaindex (#728)
* add an example for qwen doc QA with langchain + llamaindex

* change comments to ENG; clear output and add urls

* add helper in MD; add wget for data file download
2024-01-16 20:59:24 +08:00
zhifu gao
0485f50e6c funasr1.0 model.generate (#727) 2024-01-16 20:37:14 +08:00
lylalala
cc96a75901 Merge pull request #719 from modelscope/master-merge-internal20240110
Master merge internal20240110
2024-01-15 11:39:38 +08:00
liuyhwangyh
59760b123b Merge branch 'master' into master-merge-internal20240110 2024-01-14 10:43:11 +08:00