Mirrors/modelscope
1
0
Fork 0
mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 20:49:37 +01:00
Code Issues Packages Projects Releases Wiki Activity
784 Commits 263 Branches 106 Tags
ba3db0f552b408e4196bb033a632070518b88078
Commit Graph

784 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
siyang.ssy
ba3db0f552 [to #42322933] fix video embedding output 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10525516
 2022-10-25 22:56:14 +08:00
tingwei.gtw
d40cc98994 [to #42322933] update IO for demo services 
修改了I/O的代码，以支持modelscope的demo services
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10518318
 2022-10-25 22:49:15 +08:00
yuze.zyz
c2da44b371 [to #42322933] remove dev model inference and fix some bugs 
1. Change structbert dev revision to master revision
2. Fix bug:  Sample code failed because the updating of model configuration
3. Fix bug: Continue training regression failed
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10519992
 2022-10-25 22:38:49 +08:00
lllcho.lc
41b35619e8 [to #42322933] Fix bug for demo service 
在demo service场景，同时调用同一个视频文件，会导致ffmpeg处理同名视频的冲突。通过uuid生成唯一的文件名解决这个冲突。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10518178
 2022-10-25 20:31:53 +08:00
yichang.zyc
62339161cd revert args of metric init 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10521235
 2022-10-25 19:26:44 +08:00
zhangzhicheng.zzc
e1ab73b7d8 [to #42322933]support type str for for zero-shot labels' input 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10506320
 2022-10-25 13:55:09 +08:00
hemu.zp
ffd834fc25 [to #42322933] Add bloom model 
添加 bloom 模型
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10509187
 2022-10-25 12:58:02 +08:00
yichang.zyc
6ddafb3218 [to #42322933]caption finetune done, add belu metric 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10318299
 2022-10-25 12:55:41 +08:00
yuze.zyz
605cd7f44a [to #42322933] NLP 1030 Refactor 
Features:
1. Refactor the directory structure of nlp models. All model files are placed into either the model folder or the task_model folder
2. Refactor all the comments to google style
3. Add detail comments to important tasks and nlp models, to list the description of the model, and its preprocessor&trainer
4. Model Exporting now supports a direct all to TorchModelExporter(no need to derive from it)
5. Refactor model save_pretrained method to support direct running(independent from trainer)
6. Remove the judgement of Model in the pipeline base class, to support outer register models running in our pipelines
7. Nlp trainer now has a NLPTrainingArguments class , user can pass arguments into the dataclass, and use it as a normal cfg_modify_fn, to simplify the operation of modify cfg.
8. Merge the BACKBONES and the MODELS, so user can get a backbone with the Model.from_pretrained call
9. Model.from_pretrained now support a task argument, so user can use a backbone and load it with a specific task class.
10. Support Preprocessor.from_pretrained method
11. Add standard return classes to important nlp tasks, so some of the pipelines and the models are independent now, the return values of the models will always be tensors, and the pipelines will take care of the conversion to numpy and the following stuffs.
12. Split the file of the nlp preprocessors, to make the dir structure more clear.

Bugs Fixing:
1. Fix a bug that lr_scheduler can be called earlier than the optimizer's step
2. Fix a bug that the direct call of Pipelines (not from pipeline(xxx)) throws error
3. Fix a bug that the trainer will not call the correct TaskDataset class
4. Fix a bug that the internal loading of dataset will throws error in the trainer class
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10490585
 2022-10-25 12:26:25 +08:00
siyang.ssy
6d51f44dc7 [to #42322933]fix input type for video embeding 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10506601
 2022-10-25 12:11:28 +08:00
bin.xue
525fa3ea89 [to #42322933]test: use 'master' branch in training test 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10509580
 2022-10-25 12:10:07 +08:00
huizheng.hz
a1738690c9 [to #42322933]test_image_denoise_trainer 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10465138
 2022-10-25 10:08:57 +08:00
caorongyu.cry
6178f46910 [to #42322933] add ut for multi threads 
1. 修复multi thread引起的问题
2. 增加multi thread的unittest
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10502008
 2022-10-25 09:49:02 +08:00
yingda.chen
de7b6a06e9 [to #42322933] remove revision usage for face detection 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10507910

    * [to #42322933] remove revision usage for face detection
 2022-10-25 09:28:01 +08:00
mulin.lyh
b41d275c70 [to #45703335]feat: refactor deploy 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10501307
 2022-10-25 09:05:33 +08:00
zhangyanzhao.zyz
c4dbb69d65 [to #42322933]增加对text-ranking任务中文模型的单元测试，以方便得到官方模型打标。 
增加对text-ranking任务中文模型的单元测试，以方便得到官方模型打标。
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492754
 2022-10-24 23:41:20 +08:00
yichang.zyc
35c612a642 [to #42322933]去除clip ut中的dev revision 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10507748

    * remove clip ut dev revision
 2022-10-24 23:40:38 +08:00
ashui.cbh
e223c1b008 [to #42322933]merge master after demo service support 
demo service 对接，修改输入接口为可调用的方式
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10502169
 2022-10-24 18:47:01 +08:00
mulin.lyh
7257f6c6fb [to #45631658]feat support eas deploy 
服务端文档链接(可能需要登录)：
https://test.modelscope.cn/api/v1/deployer/docs
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10478609
 2022-10-24 15:12:48 +08:00
leyuan.hjy
8b28b725ee [to #42322933] video detecor support output with timestamp 
适配demoservice，增加视频时间戳输出，每一个结果对应一个时间戳
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10496879
 2022-10-24 14:54:42 +08:00
caorongyu.cry
35644fa0a7 [to #42322933] change star3 to space_T_cn 
1. 合并star和star3框架
2. 修改star和star3的model type
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492793
 2022-10-23 20:25:24 +08:00
yanheng.wyh
cf831dbf98 [to #42322933] fix cv/animalRecog output format 
* fix output format
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491722
 2022-10-23 12:22:33 +08:00
zhangzhicheng.zzc
182ba1768f [to #42322933]support multi tasks for part of speech 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491994
 2022-10-23 10:56:52 +08:00
yuze.zyz
707cbef013 [to #42322933]Fix bug in daily UT 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491891
 2022-10-22 23:25:18 +08:00
zhangzhicheng.zzc
2a87dee561 [to #42322933]support multi tasks-- will be failed, since configuration has not changed yet 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492024
 2022-10-22 21:09:15 +08:00
caorongyu.cry
9edfd7e50c [to #42322933] update tableqa params 
1. 增加传入table_id
2. 将result和table的结构统一
3. 默认开启is_use_sqlite
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10492027
 2022-10-22 20:33:49 +08:00
baiguan.yt
46107e3ecf [to #42322933]converting string to int to meet the input of face-image-generation 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10489981
 2022-10-22 20:31:59 +08:00
shichen.fsc
1854ceeb74 [to #42322933] Fix all asr models in UT with mistake model_id 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491024
 2022-10-22 20:30:45 +08:00
tingwei.gtw
e09d277fd3 [to #42322933] fix cpu inference 
修复cpu推理
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10468823
 2022-10-22 19:19:23 +08:00
zhangyanzhao.zyz
824ee8232c [to #42322933]更新语义相关性任务英文名称为text ranking，修改对应变量名和类名 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10491951
 2022-10-22 17:12:48 +08:00
yichang.zyc
683ee5bfed [to #42322933]use Tasks.ocr_recognition 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10490937
 2022-10-22 17:01:03 +08:00
Yingda Chen
9bc06716c1 [to #42322933] fix typo 2022-10-22 16:30:19 +08:00
Yingda Chen
dee93c40e2 [to #42322933] force download dataset for portraint enhancement 2022-10-22 16:28:30 +08:00
yuze.zyz
f7f7eb21dc [to #42322933]Fix the logic of fast tokenizer 
1. Change the logic of using fast tokenizer from mode to user arguments and tokenizer_config.json
This is to fix the problem of RANER must use fast tokenizer in some special models.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10488982
 2022-10-21 22:10:40 +08:00
baiguan.yt
533ab3df63 [to #42322933]update msdatasets for image-portrait-enhancement training 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10453584
 2022-10-21 14:54:24 +08:00
liugao.lg
baff7c5b64 [to #42322933]add ofa-ocr-recogniiton pipeline 
新增ofa关于日常场景文字识别的任务，主要包括：
1、新增pipeline及task名称定义；
2、新增pipeline、task、model及prepreocess核心类方法的代码逻辑；
3、其它同步修正的小细节逻辑；
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10471089
 2022-10-21 09:11:15 +08:00
james.wjg
c582b19115 [to #42322933]cv/video_summarization fix a code bug 
修复一行错误代码
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10477534

    * fix a code bug
 2022-10-20 21:13:19 +08:00
chaojie.mcj
9842a427ef modify headers for __init__ 
更改部分__init__文件的header license
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10393596
 2022-10-20 21:12:47 +08:00
lee.lcy
0bc9660fcc [to #42322933] modify img_embedding type for image_reid_person 
modify img_embedding type for image_reid_person
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10477972
 2022-10-20 21:12:14 +08:00
hemu.zp
2b49b322a2 [to #42322933] Add palm ut 
为以下三个模型补充 ut
damo/nlp_palm2.0_text-generation_chinese-large
damo/nlp_palm2.0_text-generation_commodity_chinese-base
damo/nlp_palm2.0_text-generation_weather_chinese-base
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10435599
 2022-10-20 19:50:40 +08:00
hanyuan.chy
de6d84cb97 [to #42322933]修复pipeline串联时collate_fn异常 
修复pipeline串联时collate_fn异常
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10457058
 2022-10-20 19:33:06 +08:00
jiangnana.jnn
b2c5876ead [to #42322933]fix create dir when dist 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10459756
 2022-10-20 19:31:53 +08:00
xiangpeng.wxp
8ec90ccbf8 [to #42322933] Add uttest for en2fr and fr2en tasks 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10467797

    * add uttest for en2fr and fr2en tasks
 2022-10-20 17:35:27 +08:00
yuze.zyz
acba1786b0 [to #42322933] Fix bug in UT daily 
1. Fix bugs in daily test
2. Fix a bug that the updating of lr is before the first time of updating of optimizer
    TODO this will still cause warnings when GA is above 1
3. Remove the judgement of mode in text-classification's preprocessor to fit the base trainer(Bug)
     Update some regression bins to fit the preprocessor
4. Update the regression tool to let outer code modify atol and rtol
5. Add the default metric for text-classification task
6. Remove the useless ckpt conversion method in bert to avoid the requirement of tf when loading modeling_bert
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10430764
 2022-10-20 15:29:34 +08:00
shichen.fsc
1483c64638 [to #42322933] Fix ASR error when resample failed, and add all asr models UT, add apply-cmvn for pytorch models 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10465241
 2022-10-20 12:54:37 +08:00
xingguang.zxg
e7c7be6aae fix cpu error 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10432300

    * fix cpu error
 2022-10-20 12:51:48 +08:00
wenmeng.zwm
535acaef5b [to #42322933]add test case to check xtcocotools availbility 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10462622

    * add test case to check xtcocotools availbility
 2022-10-20 12:13:19 +08:00
shouzhou.bx
01d521dd78 [to #42322933]add face 2d keypoints finetune test case 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10421808

    * add face 2d keypoints & human wholebody keypoint finrtune test case
 2022-10-20 11:51:52 +08:00
jiaqi.sjq
eb7bd5b825 [to #42322933]Add lock to tts's AM and model loaded since its AR part not lockfree 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10464620
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10464620
 2022-10-20 11:46:50 +08:00
yingda.chen
3cd5f73da0 [to #42322933] refactor push_model 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10463992
 2022-10-20 10:28:15 +08:00