[to #42362853] refactor pipeline and standardize module_name

* using get_model to validate hub path 
* support reading pipeline info from configuration file
* add metainfo const
* update model type and pipeline type and fix UT
* relax requimrent for protobuf
* skip two dataset tests due to temporal failure
 
Link: https://code.alibaba-inc.com/Ali-MaaS/MaaS-lib/codereview/9118154
This commit is contained in:
wenmeng.zwm
2022-06-22 14:15:32 +08:00
parent 76c6ff6329
commit e288cf076e
35 changed files with 303 additions and 114 deletions

View File

@@ -33,6 +33,8 @@ class ImgPreprocessor(Preprocessor):
class PyDatasetTest(unittest.TestCase):
@unittest.skipUnless(test_level() >= 2,
'skip test due to dataset api problem')
def test_ds_basic(self):
ms_ds_full = PyDataset.load('squad')
ms_ds_full_hf = hfdata.load_dataset('squad')