hemu.zp fd0099c92d [to #42322933] Refactor megatron-util ...

Rename import lib 'megatron' to 'megatron_util' and add error message for users when import failed.

Use initialize_megatron as a unified initialization entry in megatron-util, which can accept configuration input of ConfigDict in MaaS-lib.

Wrap the initialization process into the utils/megatron_utils.py file, add default parameters for the existing large model to be compatible with the uploaded configuration file.

The version of megatron_cfg currently supports v3 (default), v1 and moe.
        Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/11231840

2022-12-29 15:01:45 +08:00

..

export

[to #42322933] Fix some bugs when downgrade the version of some dependencies

2022-10-28 21:44:33 +08:00

fileio

[to #42322933]formalize test data storage

2022-07-04 12:11:12 +08:00

hub

skip temp failed case

2022-12-01 16:50:09 +08:00

metrics

[to #42322933] Fix some bugs

2022-10-27 19:49:21 +08:00

models

[to #42322933] NLP 1030 Refactor

2022-10-25 12:26:25 +08:00

msdatasets

[to #42322933] Refactor NLP and fix some user feedbacks

2022-11-30 23:52:17 +08:00

outputs

[to #42322933]fix bugs relate to token cls

2022-10-31 20:52:27 +08:00

pipelines

[to #42322933] Refactor megatron-util

2022-12-29 15:01:45 +08:00

preprocessors

[to #42322933] Refactor NLP and fix some user feedbacks

2022-11-30 23:52:17 +08:00

taskdataset

[to #43875101]

2022-08-17 22:51:22 +08:00

trainers

add kws nearfield finetune

2022-12-29 10:14:41 +08:00

utils

[to #42322933] speed up the ast indexing during editing

2022-12-02 10:06:24 +08:00

__init__.py

[to #41402703] add basic modules

2022-05-17 10:15:00 +08:00

run_config.yaml

add kws nearfield finetune

2022-12-29 10:14:41 +08:00

run.py

Fix bugs in testlevel1 & 2

2022-12-01 21:16:55 +08:00