Commit Graph

2825 Commits

Author SHA1 Message Date
Yingda Chen
83f1e20e80 add repo existence check hub-api (#1060)
* add repo existence check api

* update

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-11-02 08:04:40 +08:00
Yingda Chen
06108d105a add log for download location (#1061)
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-11-02 08:02:50 +08:00
Mark
250b72fce7 fix: text error correction batch run bug (#1052)
Co-authored-by: Mark <smartmark-pro@qq.com>
2024-11-01 09:35:19 +08:00
Yingda Chen
fac865fd97 OCR pipeline shall depend on TF only when necessary (#1059)
* ocr pipeline tf as optional

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-11-01 09:10:37 +08:00
Mashiro
3de8430c03 fix(audio ans pipeline): Restore file reading from string input in ANSZip… (#1055)
* fix(audio pipeline): Restore file reading from string input in ANSZipEnhancerPipeline

Fix the code to support various types of input, including local or remote URLs.
Co-authored-by: Haoxu Wang <wanghaoxu.whx@alibaba-inc.com>
2024-10-30 16:34:35 +08:00
tastelikefeet
328bbc0494 Fix some bugs (#1056)
* fix some bugs

* remove install tf-kersa

* fix

* use bin bash as default
2024-10-30 15:49:38 +08:00
tastelikefeet
3762ba3318 fix tests (#1053) 2024-10-28 19:50:33 +08:00
tastelikefeet
62ffc04215 Fix the slow downloading (#1051)
* fix slow download

* fix

* fix audio installation

* fix build

* fix

* test

* test

* test

* test

* fix

* fix

* fix

* fix
2024-10-25 13:37:01 +08:00
Mashiro
e71057cacf feat(audio/ans): Add ZipEnhancer and related layers for acoustic nois… (#1019)
* feat(audio): Add acoustic noise suppression pipeline and tests for zipenhancer model

* Introduce `ZipEnhancer` module and associated layers (`ZipEnhancerLayer`, `Generator`, `ZipFormer`, ...).
* Add `speech_zipenhancer_ans_multiloss_16k_base` pipeline for `ZipEnhancer` module.
* Add new test cases and update metainfo.


Co-authored-by: Haoxu Wang <wanghaoxu.whx@alibaba-inc.com>
2024-10-24 15:38:09 +08:00
tastelikefeet
ae98067485 Fix timestamp in docker build (#1049)
* update flow name

* fix

* fix

* update docker builder

* lint

* fix build

* fix cpu build

* fix ts
2024-10-24 14:04:10 +08:00
tastelikefeet
acc60bab1c Fix pypi mirror (#1048)
* update flow name

* fix

* fix

* update docker builder

* lint

* fix build

* fix cpu build
2024-10-24 10:35:10 +08:00
tastelikefeet
a6d583b6cf Fix build error (#1047) 2024-10-23 18:44:11 +08:00
Xingjun.Wang
134fe72f06 hotfix for datasets 3.0.2 (#1046) 2024-10-23 16:25:53 +08:00
tastelikefeet
cda7a6f04a Update docker scripts (#1044) 2024-10-23 15:18:40 +08:00
tastelikefeet
136d8c0a9d Add docker workflow name (#1043) 2024-10-23 13:43:41 +08:00
tastelikefeet
7a57ee418c Refine dockerfile (#1042) 2024-10-23 09:59:51 +08:00
tastelikefeet
eac004d7f2 Refine docker file (#1041) 2024-10-22 11:13:17 +08:00
tastelikefeet
0026729f7a Fix dockerfile (#1038) 2024-10-21 19:47:11 +08:00
tastelikefeet
c4e561ec6b fix file mode (#1037) 2024-10-21 19:31:08 +08:00
tastelikefeet
320095144b Refactor Dockerfile (#1036) 2024-10-21 18:26:23 +08:00
Xingjun.Wang
e320b40a0d Fix/dockerfile (#1034)
* update version

* update build_image for swift

* add outlines in build_image.sh

* set outlines to 0.0.46 to avoid failure of building docker

* set vllm==0.5.2 in Dockerfile.ubuntu to fix CI issue

* update outlines version: <0.1

* update ms-swift installation in build_image.sh

* merge diff from release/1.19
2024-10-21 11:25:02 +08:00
tastelikefeet
607b7c37fe Fix patch processors and feature extractors (#1031) 2024-10-21 10:28:51 +08:00
tastelikefeet
88aefcdd74 lint code (#1025) 2024-10-17 18:35:08 +08:00
suluyana
bacdc53327 fix: set device_map=cuda if using gptq in gpu (#1027) 2024-10-17 17:13:22 +08:00
tastelikefeet
7ceac5a359 fix recursion (#1024)
* fix recursion

* lint code
2024-10-16 08:42:46 +08:00
Xingjun.Wang
eab95f909f del ignore_verifications and add trust_remote_code for local py_script (#1021) 2024-10-15 12:41:12 +08:00
Xingjun.Wang
90acaccc28 Fix trust_remote_code (#1016)
* add cmd line option of clear-cache

* fix typo

* fix trust_remote_code for old dataset and py-script

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-10-12 22:00:30 +08:00
tastelikefeet
b0f03ffd6d Fix template of eos_token (#1013) 2024-10-10 21:40:51 +08:00
suluyana
bd1544bef0 fix template: llava-llama-3 & yi-1.5 (#1011) 2024-10-10 10:01:45 +08:00
Yingda Chen
adc0374088 add cmd line option of clear-cache (#1009)
* add cmd line option of clear-cache

* fix typo

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-10-02 22:47:52 +08:00
Yingda Chen
9f631056f3 do not download pt and pth files for autoconfig, autotoknizer and generation config (#1008)
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-10-01 15:17:05 +08:00
Yingda Chen
8d72902e20 Update issue templates 2024-10-01 12:52:52 +08:00
Xingjun.Wang
2c4505e13a Adapt new datasets (#1002)
* update ds==3.0

* update

* add http_get_ms func

* del unused code

* fix pr issue and update requirements
2024-09-30 16:46:00 +08:00
tastelikefeet
834db59952 template and ollama in modelscope (#995) 2024-09-29 19:13:50 +08:00
Yingda Chen
058df0e34c Unify dataset download log and remove tqdm disable option (#997)
* use tqdm auto

* unify dataset download log and remove tqdm disable option

---------

Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-09-24 21:38:36 +08:00
suluyana
d5c9c82340 Fix problems with serializing audio output in serving (#993)
* fix audio out

* fix value in json output

* fix audio out
2024-09-18 08:48:20 +08:00
tastelikefeet
74d97ea7e0 Refactor zero sized file downloading (#991) 2024-09-14 15:12:28 +08:00
tastelikefeet
4c518db424 patch hf hub (#987) 2024-09-14 12:24:19 +08:00
tastelikefeet
51b33cecef Support create file with size 0 (#984)
* Support file size == 0
2024-09-11 19:35:02 +08:00
Yingda Chen
469159de34 use tqdm auto (#982)
Co-authored-by: Yingda Chen <yingda.chen@alibaba-inc.com>
2024-09-11 11:40:37 +08:00
tastelikefeet
96e33878b4 lint code (#970) 2024-09-02 10:16:35 +08:00
gylcalex1314
ce1ee32fde add facial 68 landmark detection model (#964)
Co-authored-by: 敛沧 <liancang.gy@cainiao.com>
2024-09-01 19:53:18 +08:00
Yingda Chen
de68c847d8 Merge pull request #969 from tastelikefeet/fix/patch-hf
Fix patching hf
2024-09-01 19:10:35 +08:00
yuze.zyz
7271542d7f add more requirements 2024-09-01 19:02:16 +08:00
yuze.zyz
8b5a5bd1e3 fix 2024-09-01 18:37:01 +08:00
yuze.zyz
61a88d00be fix patch hf 2024-09-01 13:58:09 +08:00
Yingda Chen
b28518d6b9 Merge pull request #965 from modelscope/download-file
log download file name
2024-08-28 19:45:54 +08:00
Yingda Chen
412e29c555 log download file name 2024-08-28 16:25:34 +08:00
Yingda Chen
1f63111d15 Merge pull request #958 from modelscope/log-config
[fix #934] allow logging level to be configurable

ci test failed due to connection error. from ut log, we can see that the logging is still functioning OK with default setting.
2024-08-27 21:14:31 +08:00
Yingda Chen
eec64bfbe2 fix format 2024-08-27 17:25:18 +08:00