add bashscripts

README.md

@@ -14,9 +14,68 @@ Bo Dai
 
 <p style="font-size: 0.8em; margin-top: -1em">*Coresponding Author</p>
 
-[Paper]() | [Project](https://animatediff.github.io/)
+[Arxiv Report]() | [Project Page](https://animatediff.github.io/)
 
-<p style="color: red; font-weight: bold">Code will be released very soon, stay tuned!</p>
+## Todo
+- [√] Code Release
+- [ ] Arxiv Report
+- [ ] GPU Memory Optimization
+- [ ] Gradio Interface
+<!-- - [ ] Online Demo -->
+<!-- - [ ] Support WebUI -->
+
+## Setup for Inference
+
+### Prepare Environment
+Our approach takes around 60 GB GPU memory to inference. NVIDIA A100 is recommanded.
+
+```
+git clone https://github.com/guoyww/animatediff.git
+cd animatediff
+
+conda create -n animatediff python=3.8
+conda activate animatediff
+
+pip install -r requirments.txt
+```
+
+### Download Base T2I & Motion Module Checkpoints
+We provide two versions of our Motion Module, which are trained on stable-diffusion-v1-4 and finetuned on v1-5 seperately.
+It's recommanded to try both of them for best results.
+```
+git lfs install
+git clone https://huggingface.co/runwayml/stable-diffusion-v1-5 models/StableDiffusion/
+
+bash download_bashscripts/0-MotionModule.sh
+```
+You may also directly download the motion module checkpoints from [Google Drive](https://drive.google.com/drive/folders/1EqLC65eR1-W-sGD0Im7fkED6c8GkiNFI?usp=sharing), then put them in `models/Motion_Module/` folder.
+
+### Prepare Personalize T2I
+Here we provide inference configs for 6 demo T2I on CivitAI.
+You may run the following bash scripts to download these checkpoints.
+```
+bash download_bashscripts/1-ToonYou.sh
+bash download_bashscripts/2-Lyriel.sh
+bash download_bashscripts/3-RcnzCartoon.sh
+bash download_bashscripts/4-MajicMix.sh
+bash download_bashscripts/5-RealisticVision.sh
+bash download_bashscripts/6-Tusun.sh
+bash download_bashscripts/7-FilmVelvia.sh
+bash download_bashscripts/8-GhibliBackground.sh
+```
+
+### Inference
+After downloading the above peronalized T2I checkpoints, run the following commands to generate animations.
+```
+python -m scripts.animate --config configs/prompts/1-ToonYou.yaml
+python -m scripts.animate --config configs/prompts/2-Lyriel.yaml
+python -m scripts.animate --config configs/prompts/3-RcnzCartoon.yaml
+python -m scripts.animate --config configs/prompts/4-MajicMix.yaml
+python -m scripts.animate --config configs/prompts/5-RealisticVision.yaml
+python -m scripts.animate --config configs/prompts/6-Tusun.yaml
+python -m scripts.animate --config configs/prompts/7-FilmVelvia.yaml
+python -m scripts.animate --config configs/prompts/8-GhibliBackground.yaml
+```
 
 <!-- ## Setup
 Install the required packages:
@@ -40,7 +99,8 @@ configs/prompts/lora.yaml
 python -m scripts.animate --prompt configs/prompts/lora.yaml
 ``` -->
 
-## Results
+## Gallery
+Here we demonstrate several best results we get in our early experiments.
 
 <table class="center">
     <tr>
@@ -101,3 +161,9 @@ python -m scripts.animate --prompt configs/prompts/lora.yaml
     </tr>
 </table>
 <p style="margin-left: 2em; margin-top: -1em">Model：<a href="https://civitai.com/models/33208/filmgirl-film-grain-lora-and-loha">FilmVelvia</a></p>
+
+## Citation
+Coming soon.
+
+## Acknowledgements
+Codebase built upon [Tune-a-Video](https://github.com/showlab/Tune-A-Video).

download_bashscripts/0-MotionModule.sh

@@ -0,0 +1,2 @@
+gdown 1RqkQuGPaCO5sGZ6V6KZ-jUWmsRu48Kdq -O models/Motion_Module/
+gdown 1ql0g_Ys4UCz2RnokYlBjyOYPbttbIpbu -O models/Motion_Module/

download_bashscripts/1-ToonYou.sh

@@ -0,0 +1,2 @@
+#!/bin/bash
+wget https://civitai.com/api/download/models/78775 -P models/DreamBooth_LoRA/ --content-disposition --no-check-certificate

download_bashscripts/2-Lyriel.sh

@@ -0,0 +1,2 @@
+#!/bin/bash
+wget https://civitai.com/api/download/models/72396 -P models/DreamBooth_LoRA/ --content-disposition --no-check-certificate

download_bashscripts/3-RcnzCartoon.sh

@@ -0,0 +1,2 @@
+#!/bin/bash
+wget https://civitai.com/api/download/models/71009 -P models/DreamBooth_LoRA/ --content-disposition --no-check-certificate

download_bashscripts/4-MajicMix.sh

@@ -0,0 +1,2 @@
+#!/bin/bash
+wget https://civitai.com/api/download/models/79068 -P models/DreamBooth_LoRA/ --content-disposition --no-check-certificate

download_bashscripts/5-RealisticVision.sh

@@ -0,0 +1,2 @@
+#!/bin/bash
+wget https://civitai.com/api/download/models/29460 -P models/DreamBooth_LoRA/ --content-disposition --no-check-certificate

download_bashscripts/6-Tusun.sh

@@ -0,0 +1,3 @@
+#!/bin/bash
+wget https://civitai.com/api/download/models/97261 -P models/DreamBooth_LoRA/ --content-disposition --no-check-certificate
+wget https://civitai.com/api/download/models/50705 -P models/DreamBooth_LoRA/ --content-disposition --no-check-certificate

download_bashscripts/7-FilmVelvia.sh

@@ -0,0 +1,3 @@
+#!/bin/bash
+wget https://civitai.com/api/download/models/90115 -P models/DreamBooth_LoRA/ --content-disposition --no-check-certificate
+wget https://civitai.com/api/download/models/92475 -P models/DreamBooth_LoRA/ --content-disposition --no-check-certificate

download_bashscripts/8-GhibliBackground.sh

@@ -0,0 +1,3 @@
+#!/bin/bash
+wget https://civitai.com/api/download/models/102828 -P models/DreamBooth_LoRA/ --content-disposition --no-check-certificate
+wget https://civitai.com/api/download/models/57618  -P models/DreamBooth_LoRA/ --content-disposition --no-check-certificate