diff --git a/README.md b/README.md index 8bff14c..aaa6525 100644 --- a/README.md +++ b/README.md @@ -23,6 +23,25 @@ Bo Dai One with better controllability and quality is coming soon. Stay tuned. ## Features +- **[2023/11/10]** Release the Motion Module (beta version) on SDXL, available at [Google Drive](https://drive.google.com/file/d/1EK_D9hDOPfJdK4z8YDB8JYvPracNx2SX/view?usp=share_link +) / [HuggingFace](https://huggingface.co/guoyww/animatediff/blob/main/mm_sdxl_v10_beta.ckpt +) / [CivitAI](https://civitai.com/models/108836/animatediff-motion-modules). High resolution videos (i.e., 1024x1024x16 frames with various aspect ratios) could be produced **with/without** personalized models. Inference usually requires ~13GB VRAM and tuned hyperparameters (e.g., #sampling steps), depending on the chosen personalized models. Checkout to the branch `sdxl` for more details of the inference. More checkpoints with better-quality would be available soon. Stay tuned. Examples below are manually downsampled for fast loading. + + + + + + + + + + + + +
Original SDXLPersonalized SDXLPersonalized SDXL
+ + + - **[2023/09/25]** Release **MotionLoRA** and its model zoo, **enabling camera movement controls**! Please download the MotionLoRA models (**74 MB per model**, available at [Google Drive](https://drive.google.com/drive/folders/1EqLC65eR1-W-sGD0Im7fkED6c8GkiNFI?usp=sharing) / [HuggingFace](https://huggingface.co/guoyww/animatediff) / [CivitAI](https://civitai.com/models/108836/animatediff-motion-modules) ) and save them to the `models/MotionLoRA` folder. Example: ``` python -m scripts.animate --config configs/prompts/v2/5-RealisticVision-MotionLoRA.yaml diff --git a/__assets__/animations/motion_xl/01.gif b/__assets__/animations/motion_xl/01.gif new file mode 100644 index 0000000..20ec30e Binary files /dev/null and b/__assets__/animations/motion_xl/01.gif differ diff --git a/__assets__/animations/motion_xl/02.gif b/__assets__/animations/motion_xl/02.gif new file mode 100644 index 0000000..f19dfec Binary files /dev/null and b/__assets__/animations/motion_xl/02.gif differ diff --git a/__assets__/animations/motion_xl/03.gif b/__assets__/animations/motion_xl/03.gif new file mode 100644 index 0000000..4e54f5f Binary files /dev/null and b/__assets__/animations/motion_xl/03.gif differ