Commit Graph

1483 Commits

Author SHA1 Message Date
xuanjie.wxb
ebb50d7887 add maoe unit test 2023-03-07 15:24:37 +08:00
pangda
798aa93cba [to #42322933] add onnx/torchscript exporter for token classification models
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11895085
2023-03-07 14:12:23 +08:00
wendi.hwd
99fa2fe909 update license and revert support camouflaged-detection from latest master
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11892922

    * update license and revert support camouflaged-detection from latest master
2023-03-07 11:41:10 +08:00
shichen.fsc
04f63ec71f [to #42322933] add new kws models in UT and update requirements/audio_kws.txt
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11830273

* [Add] add new models for kws UT

* [Update] update requirements

* pre-commit
2023-03-06 23:14:45 +08:00
zhangzhicheng.zzc
4a72209e07 [to #48217480]bug fixed for ast scan funcitondef
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11882379
2023-03-06 16:48:08 +08:00
fubang.zfb
dfd1058d45 siamese uie finetune support
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11706625
2023-03-02 20:14:31 +08:00
wenmeng.zwm
77ff1d94d6 Revert "Add single-camera depth estimation model bts"
This reverts commit feb4123327.
2023-03-02 10:56:24 +08:00
wenmeng.zwm
f2f48dd305 Revert "support camouflaged-detection "
This reverts commit ff55bd9436.
2023-03-02 10:52:36 +08:00
ashui.cbh
329231fe9d ImagePaintbyexamplePipeline demo service 支持
修改pipeline输出格式为numpy array 供demo service使用

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11841517
2023-03-01 20:34:24 +08:00
xingjun.wxj
99e58c6ea3 [to #42322933] fix some feedback issues
1. Fix the conflict between local path and remote dataset name in the form of dataset_name='namespace/dataset_name' in MsDataset.load() function.
2. Modify the obj_key.startswith value in get_split_objects_map function to adapt to dir name 'xxx/' format.

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11820290

* fix the conflict between local path and namespace/dataset_name of the dataset_name

* fix function: get_split_objects_map

* add UT for loading local csv file

* add new test case for test_load_local_csv function
2023-03-01 20:13:31 +08:00
ryan.yy
4197f72124 nerf重建加速模型 加入trainer训练模块
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11794296
2023-03-01 12:05:57 +08:00
yuxiang.tyx
09a178d171 support onnx export for SCRFD model
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11826666
2023-03-01 10:02:49 +08:00
lee.lcy
8c39eefeff feat(trainer): support load_from for easycv trainer
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11794432
2023-03-01 09:54:24 +08:00
hemu.zp
ceeb85f10f [to #42322933] Support multi-machine data and tensor parallel finetuning
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11682479
2023-02-28 18:47:17 +08:00
myf272609
51cf0b16a8 [to #42322933] add fintune support for cartoon task
人像卡通化模型增加训练支持

 Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11675597

* add fintune support for cartoon
2023-02-28 17:01:34 +08:00
jiangyu.xzy
9f655da220 add speaker diarization pipeline
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11808124

* add speaker diarization pipeline
2023-02-28 16:19:30 +08:00
yuxiang.tyx
3e5dbd2997 set num_workers=0 to prevent create subprocess which may cause error in demo-service
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11802831
2023-02-28 14:12:50 +08:00
yuze.zyz
7181e667f6 Refactor hooks
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11651547
2023-02-28 13:51:01 +08:00
zhicheng.sc
d11fff0c0a add ControlNet for controllable image generation
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11697239

* add ControlNet for scribble2image

* update code comments

* support scribble input

* update scribble input for demo service

* support all models of ControlNet

* add requirements

* fix code style bug

* update model id
2023-02-28 13:39:12 +08:00
lee.lcy
a0877216a4 fix(damoyolo): fix FileNotFoundError when using trainer.evaluate() && add work_dir and exp_name to kwargs
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11793714

    * fix(damoyolo): fix FileNotFoundError when using trainer.evaluate() && add work_dir and exp_name to kwargs

* style(damoyolo): add code annotation to ImageDetectionDamoyoloTrainer
2023-02-27 19:26:12 +08:00
wenmeng.zwm
99892d0812 Merge branch merge_master_github_0224 into master
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11782747
2023-02-24 17:16:38 +08:00
yuanzhi.zyz
eca75bc6af add ocr_recognition bugfix
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11785977
2023-02-24 17:02:24 +08:00
zhongning.hzn
8411645524 bad_image_detecting模型支持在数据集上validation功能
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11761935
2023-02-24 14:23:57 +08:00
wenmeng.zwm
6a13557c19 Merge branch 'master-github' into merge_master_github_0224 2023-02-24 11:16:35 +08:00
jiaqi.sjq
058f772d16 [to #41669377] fix pipeline output wav is 32-bit float expect 16-bit int
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11765670
2023-02-24 11:00:40 +08:00
maojialiang.mjl
97e35a040c [to #42322933] fix: remove restriction on image resolution in the preprocessing stage
去掉预处理阶段resize 到720x1280的限制,支持输出与原始输入图像分辨率对应的结果

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11762135
2023-02-24 09:49:02 +08:00
klayzhang.zb
4ca52a0934 [to #42322933] fix for text error correction: generate <unk> when input contains upper letter
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11762322

* [fix] fix: generate <unk> when input contains upper letter

* compatible new fairseq version
2023-02-24 09:45:28 +08:00
Ikko Eltociear Ashimine
70d3799b26 fix typo in adv_utils.py (#133)
occured -> occurred
2023-02-23 20:37:01 +08:00
mulin.lyh
0cf0af9d62 [to #47521140]feat: tools statastics collection
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11565214
2023-02-23 10:14:10 +08:00
jiangyu.xzy
0697f969a1 asr infer change vad/lm/punc input logic
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11747596

* change vad/punc/lm model input logic

* asr infer extra kwargs

* fix format

* new funasr version
2023-02-22 21:05:58 +08:00
Anderson
7d15025302 update librosa.resample() parameters for version after 0.9 (#128)
librosa.resample() changed parameters after 0.9

* Update ans_pipeline.py
2023-02-22 20:28:24 +08:00
zhk1425734486
99d2177bb0 landing AI: tbs image detection pull request (#84)
https://modelscope.cn/models/landingAI/LD_CytoBrainCerv/summary

兰丁宫颈细胞AI辅助诊断模型

Co-authored-by: QZStudio <1643006760@qq.com>
Co-authored-by: wenmeng.zwm <wenmeng.zwm@alibaba-inc.com>
2023-02-22 20:25:37 +08:00
wenmeng.zwm
c5be16950f fix: fail to run ut in local because TEST_TOKEN required to set 2023-02-22 14:21:06 +08:00
wenmeng.zwm
f32fc32e16 update gif 2023-02-22 12:21:55 +08:00
chenxujun
adb4de753d Fix some words (#129) 2023-02-22 10:01:18 +08:00
zhangyanzhao.zyz
2ebb6db260 fix bug of modelscope.trainers.nlp.sentence_embedding_trainer.get_data_collator
修正sentence_embedding_trainer 初始化bug

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11725227
2023-02-21 22:42:13 +08:00
zhangzhicheng.zzc
fb9c41092a [to #42322933] update preprocessor for deberta v2
相关改动已经在 model repo中进行了改动

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11714125

* update preprocessor for deberta
2023-02-21 22:41:49 +08:00
zhangzhicheng.zzc
3e4ee5958a [to #47939677] load only backbone with weights
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11679242

* load backbone with weights directly
2023-02-21 22:41:14 +08:00
xixing.tj
a06297e8c4 add TorchModel for vlpt and dbnet for ocr detection
把vlpt和dbnet相关模型集成到model模块,通过configuration.json控制模型和后处理

Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11712249
2023-02-21 22:40:00 +08:00
mulin.lyh
386be89f3d [to #47947101]fix: fix diff based case not process deleted file
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11729541
2023-02-21 20:50:03 +08:00
wenmeng.zwm
6599d2c7cd skip test_image_structured_model_probing 2023-02-21 12:08:22 +08:00
wenmeng.zwm
ef615d48af skip test_image_structured_model_probing 2023-02-21 12:07:28 +08:00
wenmeng zhou
3f35e2e866 add shuffle option for single gpu finetunning (#122) 2023-02-21 11:40:07 +08:00
Firmament-cyou
8092a82577 add directory for image_classification finetuneing scripts (#115) 2023-02-21 11:33:41 +08:00
wenmeng.zwm
285208912b add command line tool
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11661608

* add command line tool

* add unittest

* change absolute import to relative import for test case

* mv test_util to package
2023-02-20 21:21:54 +08:00
wucong.lyb
35d43e9945 fix bug: args lm_train_conf is invalid
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11717046
2023-02-20 17:07:14 +08:00
jerry.lp
ada2fcf48e [to #47630265] fix modelscope gpt moe finetune checkpoint path error
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11716118
2023-02-20 14:59:50 +08:00
Yingda Chen
8b22c6d879 Merge pull request #119 from modelscope/feat/refine_readme
no code change, merge without waiting for tests.
2023-02-19 19:23:29 +08:00
wenmeng.zwm
7172a50d32 fix merge problem 2023-02-19 19:20:51 +08:00
wenmeng.zwm
f5ba729a1e merge master 2023-02-19 19:15:22 +08:00