mirror of https://github.com/modelscope/modelscope.git synced 2025-12-25 12:39:25 +01:00

Go to file

hemu.zp 69104c0f8a [to #42322933 ] Refactor text generation model outputs and fix some bugs

1. 将 single_gpu_test 与 multi_gpu_test 中的 model.forward 部分分离为 EpochBasedTrainer 中的 evaluation_step，为部分 evaluation 阶段不调用 forward 的模型提供更好的灵活性
2. 重构代码将文本生成模型 Model 层的输入输出统一为 Tensor，Tensor 到 str 的 decode 过程移动到 pipeline 中完成
3. pipeline 后处理添加对中文和中文标点与英文混杂时空格的处理，使 decode 后中英文混杂输出正确
4. 添加 TextGenerationTrainer 修复了部分模型 evaluation 过程 forward 输出单个 token 计算 metrics 的问题
5. 修复了 rouge 无法接收空字符串的问题
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10473768

2022-10-27 09:52:05 +08:00

.dev_scripts

* [to #45486649 ]feat: modelscope model version use model repo tag, unsupport branch or commit it, client user-agent header unified

2022-10-26 13:55:51 +08:00

configs

support EasyCV framework and add Segformer model

2022-08-26 13:58:50 +08:00

data/test

[to #42322933 ] NLP 1030 Refactor

2022-10-25 12:26:25 +08:00

docker

[to #45546922 ]feat: add fasttext package

2022-10-17 20:51:58 +08:00

docs

[to #43115513 ] remove additional empty section header

2022-08-23 19:30:51 +08:00

modelscope

[to #42322933 ] Refactor text generation model outputs and fix some bugs

2022-10-27 09:52:05 +08:00

requirements

[to #42322933 ]SEA multilingual NLP (NER & word segmentation)

2022-10-26 14:52:22 +08:00

tests

[to #42322933 ] Refactor text generation model outputs and fix some bugs

2022-10-27 09:52:05 +08:00

.dockerignore

[to #43653669 ]feat: auto build docker images

2022-08-22 16:01:42 +08:00

.gitattributes

[to #42322933 ] add regress tests

2022-08-30 23:17:07 +08:00

.gitignore

[to #42322933 ]add cv-faceDetection and cv-faceRecognition

2022-07-28 21:52:18 +08:00

.pre-commit-config_local.yaml

[to #45549080 ]fix: fix pre_commit dependency importlib-metadata 5.0.0 compability issue

2022-10-18 17:47:23 +08:00

.pre-commit-config.yaml

[to #45549080 ]fix: fix pre_commit dependency importlib-metadata 5.0.0 compability issue

2022-10-18 17:47:23 +08:00

.readthedocs.yaml

[to #43878347 ] Rename runtime.txt to framework.txt

2022-09-03 12:10:16 +08:00

LICENSE

[to #42373878 ] refactor maaslib to modelscope

2022-06-09 20:16:26 +08:00

Makefile

[to #41669377 ] docs and tools refinement and release

2022-05-20 16:51:34 +08:00

Makefile.docker

[to #42362853 ] formalize the output of pipeline and make pipeline reusable

2022-06-16 11:15:09 +08:00

MANIFEST.in

[to #42373878 ] refactor maaslib to modelscope

2022-06-09 20:16:26 +08:00

README.md

[to #42373878 ] refactor maaslib to modelscope

2022-06-09 20:16:26 +08:00

requirements.txt

[to #43878347 ] Rename runtime.txt to framework.txt

2022-09-03 12:10:16 +08:00

setup.cfg

update EasyCV MsDataset

2022-09-15 18:11:03 +08:00

setup.py

[to #43726282 ] fix multi-model requirements missing

2022-08-02 21:58:15 +08:00

README.md

Introduction

ModelScope library is targeted to support training, evaluation and inference for the state of the art models provided by Mind and further support third-party models provided by users outside alibaba.

Design doc

Please refer to alidoc link

Development doc

Please refer to develop.md

ChangeLog

20/05/2022 First release version

Refer to change_log.md for more details