diff --git a/README.md b/README.md index 9696991..02387da 100644 --- a/README.md +++ b/README.md @@ -66,11 +66,12 @@ Manually download the AnimateDiff modules. The download links can be found in ea In this version, we did the image model finetuning through **Domain Adapter LoRA** for more flexiblity at inference time. +Additionally, we implement two (RGB image/scribble) [SparseCtrl](https://arxiv.org/abs/2311.16933) Encoders, which can take abitary number of condition maps to control the generation process. + - **Explanation:** Domain Adapter is a LoRA module trained on static frames of the training video dataset. This process is done before training the motion module, and helps the motion module focus on motion modeling, as shown in the figure below. At inference, By adjusting the LoRA scale of the Domain Adapter, some visual attributes of the training video, e.g., the watermarks, can be removed. To utilize the SparseCtrl encoder, it's necessary to use a full Domain Adapter in the pipeline. -
+           -Additionally, we implement two (RGB image/scribble) [SparseCtrl](https://arxiv.org/abs/2311.16933) Encoders, which can take abitary number of condition maps to control the generation process. Technical details of SparseCtrl can be found in this research paper: