xingjun.wxj cc3c384d5e Fix issues for downloading mplug-youku dataset ...

1. Optimize downloading meta-csv files for large-scale dataset like mPLUG-youku (> 1GB for meta csv mapping)
2. Add head and overall progress bar for NativeIterableDataset
3. Modify the try-catch info for oss_utils
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/12952842

2023-06-15 15:42:21 +08:00

2.3 KiB

Raw Permalink Blame History

View Raw