mirror of
https://github.com/modelscope/modelscope.git
synced 2026-09-02 03:59:31 +02:00
b4cff7cc3158212e1c9ff74e3e73cac3eece3d79
1、to_torch_dataset时支持保留原数据类型
2、替换orch.utils.data.IterableDataset为torch.utils.data.Dataset,支持分布式训练和shuffle。后续等streaming数据加载方式支持后再引入IterableDataset
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/10214102
Introduction
ModelScope library is targeted to support training, evaluation and inference for the state of the art models provided by Mind and further support third-party models provided by users outside alibaba.
Design doc
Please refer to alidoc link
Development doc
Please refer to develop.md
ChangeLog
- 20/05/2022 First release version
Refer to change_log.md for more details
Description
Languages
Python
98.7%
Cuda
0.8%
C++
0.4%