2022-05-30 11:53:53 +08:00
|
|
|
|
# 快速开始
|
2022-08-04 22:38:31 +08:00
|
|
|
|
ModelScope Library目前支持tensorflow,pytorch深度学习框架进行模型训练、推理, 在Python 3.7+, Pytorch 1.8+, Tensorflow1.15,Tensorflow 2.x上测试可运行。
|
2022-07-05 21:44:33 +08:00
|
|
|
|
|
2022-08-04 22:38:31 +08:00
|
|
|
|
注: `语音相关`的功能仅支持 python3.7,tensorflow1.15的`linux`环境使用。 其他功能可以在windows、mac上安装使用。
|
2022-07-05 21:44:33 +08:00
|
|
|
|
|
2022-05-31 11:49:46 +08:00
|
|
|
|
## python环境配置
|
|
|
|
|
|
首先,参考[文档](https://docs.anaconda.com/anaconda/install/) 安装配置Anaconda环境
|
2022-05-30 11:53:53 +08:00
|
|
|
|
|
2022-06-27 11:09:38 +08:00
|
|
|
|
安装完成后,执行如下命令为modelscope library创建对应的python环境。
|
2022-05-30 11:53:53 +08:00
|
|
|
|
```shell
|
2022-07-01 17:35:56 +08:00
|
|
|
|
conda create -n modelscope python=3.7
|
2022-06-09 20:16:26 +08:00
|
|
|
|
conda activate modelscope
|
2022-05-30 11:53:53 +08:00
|
|
|
|
```
|
2022-07-01 17:35:56 +08:00
|
|
|
|
## 安装深度学习框架
|
|
|
|
|
|
* 安装pytorch[参考链接](https://pytorch.org/get-started/locally/)
|
2022-05-31 11:49:46 +08:00
|
|
|
|
```shell
|
2022-07-01 17:35:56 +08:00
|
|
|
|
pip install torch torchvision
|
2022-05-31 11:49:46 +08:00
|
|
|
|
```
|
2022-07-01 17:35:56 +08:00
|
|
|
|
* 安装Tensorflow[参考链接](https://www.tensorflow.org/install/pip)
|
|
|
|
|
|
```shell
|
|
|
|
|
|
pip install --upgrade tensorflow
|
2022-06-20 17:23:11 +08:00
|
|
|
|
```
|
2022-06-09 20:16:26 +08:00
|
|
|
|
## ModelScope library 安装
|
2022-05-31 11:49:46 +08:00
|
|
|
|
|
|
|
|
|
|
注: 如果在安装过程中遇到错误,请前往[常见问题](faq.md)查找解决方案。
|
|
|
|
|
|
|
|
|
|
|
|
### pip安装
|
2022-07-01 17:35:56 +08:00
|
|
|
|
执行如下命令:
|
2022-05-31 11:49:46 +08:00
|
|
|
|
```shell
|
2022-07-07 16:40:11 +08:00
|
|
|
|
pip install "modelscope[all]" -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html
|
2022-07-05 21:44:33 +08:00
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
|
|
如需体验`语音功能`,请`额外`执行如下命令:
|
|
|
|
|
|
```shell
|
2022-07-07 16:40:11 +08:00
|
|
|
|
pip install "modelscope[audio]" -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html
|
2022-05-31 11:49:46 +08:00
|
|
|
|
```
|
2022-06-01 10:20:53 +08:00
|
|
|
|
### 使用源码安装
|
2022-05-31 11:49:46 +08:00
|
|
|
|
适合本地开发调试使用,修改源码后可以直接执行
|
2022-07-01 18:29:34 +08:00
|
|
|
|
下载源码可以直接clone代码到本地
|
2022-05-30 11:53:53 +08:00
|
|
|
|
```shell
|
2022-06-09 20:16:26 +08:00
|
|
|
|
git clone git@gitlab.alibaba-inc.com:Ali-MaaS/MaaS-lib.git modelscope
|
2022-05-31 11:49:46 +08:00
|
|
|
|
git fetch origin master
|
|
|
|
|
|
git checkout master
|
2022-06-09 20:16:26 +08:00
|
|
|
|
cd modelscope
|
2022-07-01 17:35:56 +08:00
|
|
|
|
```
|
|
|
|
|
|
安装依赖并设置PYTHONPATH
|
|
|
|
|
|
```shell
|
2022-07-05 21:44:33 +08:00
|
|
|
|
pip install -e ".[all]" -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo.html
|
2022-05-30 11:53:53 +08:00
|
|
|
|
export PYTHONPATH=`pwd`
|
|
|
|
|
|
```
|
2022-07-05 21:44:33 +08:00
|
|
|
|
注: 6.30版本需要把cv、nlp、multi-modal领域依赖都装上,7.30号各个领域依赖会作为选装,用户需要使用哪个领域安装对应领域依赖即可。
|
|
|
|
|
|
|
|
|
|
|
|
如需使用语音功能,请执行如下命令安装语音功能所需依赖
|
|
|
|
|
|
```shell
|
|
|
|
|
|
pip install -e ".[audio]" -f https://modelscope.oss-cn-beijing.aliyuncs.com/releases/repo
|
|
|
|
|
|
```
|
|
|
|
|
|
|
2022-07-01 17:35:56 +08:00
|
|
|
|
### 安装验证
|
2022-05-31 11:49:46 +08:00
|
|
|
|
安装成功后,可以执行如下命令进行验证安装是否正确
|
|
|
|
|
|
```shell
|
2022-07-01 17:35:56 +08:00
|
|
|
|
python -c "from modelscope.pipelines import pipeline;print(pipeline('word-segmentation')('今天天气不错,适合 出去游玩'))"
|
|
|
|
|
|
{'output': '今天 天气 不错 , 适合 出去 游玩'}
|
2022-05-31 11:49:46 +08:00
|
|
|
|
```
|
2022-07-01 17:35:56 +08:00
|
|
|
|
## 推理
|
2022-05-31 11:49:46 +08:00
|
|
|
|
|
2022-07-01 17:35:56 +08:00
|
|
|
|
pipeline函数提供了简洁的推理接口,相关介绍和示例请参考[pipeline使用教程](tutorials/pipeline.md)
|
2022-05-30 11:53:53 +08:00
|
|
|
|
|
2022-07-29 10:28:50 +08:00
|
|
|
|
## 训练 & 评估
|
2022-05-30 11:53:53 +08:00
|
|
|
|
|
2022-07-29 10:28:50 +08:00
|
|
|
|
Trainer类提供了简洁的Finetuning和评估接口,相关介绍和示例请参考[Trainer使用教程](tutorials/trainer.md)
|