Commit Graph

1460 Commits

Author SHA1 Message Date
wenmeng.zwm
6a13557c19 Merge branch 'master-github' into merge_master_github_0224 2023-02-24 11:16:35 +08:00
jiaqi.sjq
058f772d16 [to #41669377] fix pipeline output wav is 32-bit float expect 16-bit int
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11765670
2023-02-24 11:00:40 +08:00
maojialiang.mjl
97e35a040c [to #42322933] fix: remove restriction on image resolution in the preprocessing stage
去掉预处理阶段resize 到720x1280的限制,支持输出与原始输入图像分辨率对应的结果

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11762135
2023-02-24 09:49:02 +08:00
klayzhang.zb
4ca52a0934 [to #42322933] fix for text error correction: generate <unk> when input contains upper letter
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11762322

* [fix] fix: generate <unk> when input contains upper letter

* compatible new fairseq version
2023-02-24 09:45:28 +08:00
Ikko Eltociear Ashimine
70d3799b26 fix typo in adv_utils.py (#133)
occured -> occurred
2023-02-23 20:37:01 +08:00
mulin.lyh
0cf0af9d62 [to #47521140]feat: tools statastics collection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11565214
2023-02-23 10:14:10 +08:00
jiangyu.xzy
0697f969a1 asr infer change vad/lm/punc input logic
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11747596

* change vad/punc/lm model input logic

* asr infer extra kwargs

* fix format

* new funasr version
2023-02-22 21:05:58 +08:00
Anderson
7d15025302 update librosa.resample() parameters for version after 0.9 (#128)
librosa.resample() changed parameters after 0.9

* Update ans_pipeline.py
2023-02-22 20:28:24 +08:00
zhk1425734486
99d2177bb0 landing AI: tbs image detection pull request (#84)
https://modelscope.cn/models/landingAI/LD_CytoBrainCerv/summary

兰丁宫颈细胞AI辅助诊断模型

Co-authored-by: QZStudio <1643006760@qq.com>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2023-02-22 20:25:37 +08:00
wenmeng.zwm
c5be16950f fix: fail to run ut in local because TEST_TOKEN required to set 2023-02-22 14:21:06 +08:00
wenmeng.zwm
f32fc32e16 update gif 2023-02-22 12:21:55 +08:00
chenxujun
adb4de753d Fix some words (#129) 2023-02-22 10:01:18 +08:00
zhangyanzhao.zyz
2ebb6db260 fix bug of modelscope.trainers.nlp.sentence_embedding_trainer.get_data_collator
修正sentence_embedding_trainer 初始化bug

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11725227
2023-02-21 22:42:13 +08:00
zhangzhicheng.zzc
fb9c41092a [to #42322933] update preprocessor for deberta v2
相关改动已经在 model repo中进行了改动

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11714125

* update preprocessor for deberta
2023-02-21 22:41:49 +08:00
zhangzhicheng.zzc
3e4ee5958a [to #47939677] load only backbone with weights
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11679242

* load backbone with weights directly
2023-02-21 22:41:14 +08:00
xixing.tj
a06297e8c4 add TorchModel for vlpt and dbnet for ocr detection
把vlpt和dbnet相关模型集成到model模块,通过configuration.json控制模型和后处理

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11712249
2023-02-21 22:40:00 +08:00
mulin.lyh
386be89f3d [to #47947101]fix: fix diff based case not process deleted file
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11729541
2023-02-21 20:50:03 +08:00
wenmeng.zwm
6599d2c7cd skip test_image_structured_model_probing 2023-02-21 12:08:22 +08:00
wenmeng.zwm
ef615d48af skip test_image_structured_model_probing 2023-02-21 12:07:28 +08:00
wenmeng zhou
3f35e2e866 add shuffle option for single gpu finetunning (#122) 2023-02-21 11:40:07 +08:00
Firmament-cyou
8092a82577 add directory for image_classification finetuneing scripts (#115) 2023-02-21 11:33:41 +08:00
wenmeng.zwm
285208912b add command line tool
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11661608

* add command line tool

* add unittest

* change absolute import to relative import for test case

* mv test_util to package
2023-02-20 21:21:54 +08:00
wucong.lyb
35d43e9945 fix bug: args lm_train_conf is invalid
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11717046
2023-02-20 17:07:14 +08:00
jerry.lp
ada2fcf48e [to #47630265] fix modelscope gpt moe finetune checkpoint path error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11716118
2023-02-20 14:59:50 +08:00
Yingda Chen
8b22c6d879 Merge pull request #119 from modelscope/feat/refine_readme
no code change, merge without waiting for tests.
2023-02-19 19:23:29 +08:00
wenmeng.zwm
7172a50d32 fix merge problem 2023-02-19 19:20:51 +08:00
wenmeng.zwm
f5ba729a1e merge master 2023-02-19 19:15:22 +08:00
Yingda Chen
350e76d296 refine readme 2023-02-19 18:43:40 +08:00
wenmeng.zwm
c8fc021824 update readme 2023-02-18 11:41:12 +08:00
wenmeng.zwm
fc9fed5fb5 update readmecn 2023-02-18 11:35:30 +08:00
Jinpeng Zhang
ad300d084a Add word alignment model (#101)
* word alignment

* Delete ast_index_file.py

* add introduction

* fix-wordalignmentpreprocessor
2023-02-17 16:34:35 +08:00
xingzhang.rxz
1ae4782c83 add langident codes
语种识别模型完成开发
模型地址:https://www.modelscope.cn/models/damo/nlp_language_identification-classification-base/summary

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11652333
2023-02-17 15:21:33 +08:00
wucong.lyb
63414ac7a7 change task name: language-model to language-score-prediction
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11700516
2023-02-17 15:20:35 +08:00
jiaqi.sjq
686e9a4d4e [to #41669377] bugfix: fix load missing map_location
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11700872
2023-02-17 14:16:45 +08:00
wenmeng.zwm
504bdccdc2 update gif 2023-02-17 13:42:16 +08:00
wenmeng zhou
443d714557 Refine README.md and add README_zh.md (#114)
* update readme and add chinese readme

* add inference gif and refine doc
2023-02-17 13:33:18 +08:00
wenmeng.zwm
bbe8849899 add inference gif and refine doc 2023-02-17 13:32:00 +08:00
wenmeng.zwm
78e0bc896f update readme 2023-02-17 12:16:03 +08:00
wenmeng zhou
3ca68bf22f remove profiling log (#113)
UT test by default does not run profiling
2023-02-17 12:01:54 +08:00
wenmeng.zwm
abd6757ec9 update README.md 2023-02-17 11:39:48 +08:00
wenmeng.zwm
7f29dd2583 update citest yaml 2023-02-17 11:37:38 +08:00
wenmeng.zwm
09146fc0a5 update readme 2023-02-17 11:25:24 +08:00
wenmeng.zwm
3a465dd9a6 update readme and add chinese readme 2023-02-16 23:54:20 +08:00
maojialiang.mjl
9d1a9301a6 [to #42322933] reformat image-driving-perception-pipeline output to support demo
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11679779
2023-02-16 11:16:57 +00:00
jiangyu.xzy
882780367b VoiceActivityDetectionPipeline add fs param
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11678415
2023-02-16 11:15:31 +00:00
shuying.shu
615c443020 [to #42322933] add test condition for GPU availablity
damo/cv_diffusion_image-segmentation不支持cpu环境测试

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11689517
2023-02-16 11:13:53 +00:00
wenmeng zhou
5df2930017 Merge pull request #108 from modelscope/master-merge-internal20230215
Master merge internal20230215
2023-02-16 16:13:51 +08:00
wenmeng.zwm
1bbcb54b05 install necessary deps for python whl setup 2023-02-15 20:30:21 +08:00
wenmeng zhou
2126c409fe Delete auto_approve.yml 2023-02-15 15:56:46 +08:00
zhangzhicheng.zzc
b99a8a94e6 [to #42322933] add use_fast for text_ranking 2023-02-15 07:29:46 +00:00