liuyhwangyh
343878bb4a
Update version.py
2024-07-22 19:36:34 +08:00
mulin.lyh
73a746a45e
add Pillow to framework
2024-07-22 19:28:33 +08:00
mulin.lyh
81cfb6b13a
not upgrade pip
2024-07-22 10:57:47 +08:00
mulin.lyh
0b8c9ce938
vllm to 0.5.1
2024-07-18 22:02:11 +08:00
mulin.lyh
5ddb73c898
remove transformers from frameowrk
2024-07-17 18:35:55 +08:00
mulin.lyh
de782a5a9e
fix matplotlib.cm compatible issue
2024-07-15 16:28:40 +08:00
mulin.lyh
e21c91ae35
xformers<0.0.27
2024-07-12 21:09:23 +08:00
mulin.lyh
04b909b44d
version to 1.16.1
2024-07-12 20:52:08 +08:00
mulin.lyh
aa1f0b6814
Merge branch 'master' into release/1.16
2024-07-12 20:51:24 +08:00
liuyhwangyh
f7a32e48e3
add dataset download ( #906 )
...
* add dataset download
* fix cr issue
* fix cv matplotlib issue
* refactor code
* fix ut issue
* remove debug code
* remove unused import
* fix import issue
* sleep 65s before start docker avoid kill and run failed
---------
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com >
2024-07-12 19:06:44 +08:00
liuyhwangyh
53acf79d04
fix logger issue ( #899 )
...
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com >
2024-07-03 20:03:46 +08:00
liuyhwangyh
083aa80d09
refactor ast index file generator ( #897 )
...
* refactor ast index file generator
* fix lint issue
---------
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com >
2024-07-03 18:23:50 +08:00
mulin.lyh
12e3052bef
fix bug
2024-07-01 22:13:16 +08:00
mulin.lyh
b70fce21e3
fix pip compatible issue
2024-07-01 21:49:50 +08:00
mulin.lyh
0d1231b8c9
fix fairseq issue
2024-07-01 21:41:11 +08:00
xingjun.wang
0e8c280c28
merge master
2024-07-01 20:55:42 +08:00
xingjun.wang
6cb81f09e5
ok Merge branch 'master' of github.com:modelscope/modelscope into release/1.16
2024-07-01 20:55:19 +08:00
xingjun.wang
a0b12c09bd
update version
2024-07-01 20:53:51 +08:00
Zhongbing-Chen
3bafc5c344
exchange the order of replacement ( #893 )
2024-07-01 20:49:08 +08:00
liuyhwangyh
6995662f38
shorten check model timeout and snapshot_download file patter folder/ to folder/* ( #896 )
...
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com >
2024-07-01 15:52:16 +08:00
zhyncs
5b8e1e971c
fix ignore_file_pattern ( #886 )
...
* fix ignore_file_pattern
---------
Co-authored-by: root <root@kunkun>
2024-07-01 14:31:39 +08:00
liuyhwangyh
ff77845772
add command line usage, optimize command line log, optimize packaging… ( #888 )
...
* add command line usage, optimize command line log, optimize packaging version compatible
* Update command.md
* fix logging dup
* Refactor install dependencies (#889 )
* refactor install dependencies, default only depencies of hub and datasets
* move pandas import to function
* update hub deps
* test
* remove generate ast file
* remove gast dependency
* replace gast with ast
* add dependency version
* remove lap for compile error
* fix comments issue
* add install ollama
---------
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com >
---------
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com >
2024-06-30 20:15:03 +08:00
Firmament-cyou
8cdbeec3f6
Support swift model inference for llm pipeline ( #880 )
...
* Support swift model inference for llm pipeline
* fix bug
* Add 'swfit' llm_framework and fix stream bug
* For pass the unittest run action
2024-06-30 19:43:13 +08:00
yfchenmodelscope
f65f45959d
Add Eres2netv2ep4 ( #892 )
...
* add eres2netv2ep4
2024-06-27 21:09:51 +08:00
wenmeng zhou
5d00b7c304
Merge pull request #876 from modelscope/release/1.15
...
Release/1.15
2024-06-06 18:01:22 +08:00
mulin.lyh
f34817e95d
modify version merge master
2024-06-06 16:23:19 +08:00
wenmeng zhou
894bc90d96
remove assets and download from oss when running app ( #875 )
2024-06-05 21:18:21 +08:00
mulin.lyh
909e54fa33
modify build script
2024-06-05 19:08:46 +08:00
mulin.lyh
339ebab9dd
fix download retry bug, add get_cache_dir to hut/util
2024-06-04 16:18:52 +08:00
mulin.lyh
7b18f99d03
release to 06.05
2024-06-03 10:09:07 +08:00
mulin.lyh
4a22b05891
restore http_get_file interface
2024-05-28 15:09:05 +08:00
mulin.lyh
e2d8a6d45f
restore TDNN.py
2024-05-28 14:57:05 +08:00
mulin.lyh
8947d69fe2
Merge branch 'master' into release/1.15
2024-05-28 14:55:46 +08:00
liuyhwangyh
17da5e2264
fix error report ( #868 )
...
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com >
2024-05-28 14:38:19 +08:00
mulin.lyh
b46c5bc3f7
add TDNN.py and version to 1.15.0
2024-05-25 22:35:29 +08:00
mulin.lyh
f69ddba0bb
fix TDNN.py and tdnn.py
2024-05-25 22:34:11 +08:00
liuyhwangyh
f93a184d88
add donwload command line and local_dir parameter ( #866 )
...
* add donwload command line and local_dir parameter
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com >
2024-05-25 14:21:55 +08:00
liuyhwangyh
5c470f8941
Download optimize ( #862 )
...
* fix #845
Supports resumption of downloads from breakpoints, optimized download progress bar, finer display granularity, better experience under low bandwidth, and added function of downloading specified directories.
* restore push to hub
* fix merge issue
* fix ut issue
---------
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com >
2024-05-24 15:37:43 +08:00
yfchenmodelscope
f9451bfe38
add sdpn and tdnn ( #865 )
...
* add sdpn and tdnn
2024-05-24 14:39:16 +08:00
Alpha Hinex
da985ad92d
Fix json.decoder.JSONDecodeError when load pipeline_schema.json ( #859 )
...
When we use `modelscope server` to serve the model, the comma after last json object in this file will cause the error bellow:
```log
ERROR: Traceback (most recent call last):
File "/opt/conda/lib/python3.10/site-packages/starlette/routing.py", line 732, in lifespan
async with self.lifespan_context(app) as maybe_state:
File "/opt/conda/lib/python3.10/site-packages/starlette/routing.py", line 608, in __aenter__
await self._router.startup()
File "/opt/conda/lib/python3.10/site-packages/starlette/routing.py", line 711, in startup
handler()
File "/opt/conda/lib/python3.10/site-packages/modelscope/server/core/event_handlers.py", line 37, in startup
_startup_model(app)
File "/opt/conda/lib/python3.10/site-packages/modelscope/server/core/event_handlers.py", line 22, in _startup_model
info['schema'] = get_task_schemas(app.state.pipeline.group_key)
File "/opt/conda/lib/python3.10/site-packages/modelscope/utils/input_output.py", line 837, in get_task_schemas
schema = json.load(f)
File "/opt/conda/lib/python3.10/json/__init__.py", line 293, in load
return loads(fp.read(),
File "/opt/conda/lib/python3.10/json/__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "/opt/conda/lib/python3.10/json/decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/opt/conda/lib/python3.10/json/decoder.py", line 353, in raw_decode
obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting property name enclosed in double quotes: line 3836 column 1 (char 100720)
```
2024-05-24 11:39:37 +08:00
liuyhwangyh
82ee20f447
fix issue #845 ( #861 )
...
* fix #845
Co-authored-by: mulin.lyh <mulin.lyh@taobao.com >
2024-05-23 20:34:52 +08:00
wenmeng zhou
88c60f114a
remove necessary dependency of transformer ( #857 )
...
* remove necessary dependency of transformer
* fix import error
* fix typo
2024-05-15 20:44:17 +08:00
Xingjun.Wang
2f353bdd2a
Merge pull request #852 from modelscope/dev/del_print_info
...
Del print info for dataset_type
2024-05-14 15:20:57 +08:00
xingjun.wang
f9260e2e9d
update
2024-05-14 14:44:52 +08:00
wenmeng zhou
9e6986806d
update readme with latest model and github trending badage ( #851 )
2024-05-13 17:19:02 +08:00
Zhicheng Zhang
bedec553c1
merge from release 1.13.3 ( #837 )
2024-04-22 13:55:31 +08:00
Zhicheng Zhang
3b875e0229
Merge pull request #834 from modelscope/fix/datasets_hf_utils
...
Fix datasets hf utils
2024-04-21 10:52:57 +08:00
xingjun.wang
09779f1735
set datasets <2.19.0
2024-04-19 19:40:00 +08:00
xingjun.wang
c1c4603cce
update
2024-04-18 23:15:39 +08:00
xingjun.wang
7b8e10123b
fix dataset hf utils
2024-04-18 23:13:26 +08:00
