diff --git a/README.md b/README.md index 008ec72..c9d3332 100644 --- a/README.md +++ b/README.md @@ -2,7 +2,7 @@ -***Track-Anything*** is a flexible and interactive tool for video object tracking and segmentation. It is developed upon [Segment Anything](https://github.com/facebookresearch/segment-anything) and [XMem](https://github.com/hkchengrex/XMem), can specify anything to track and segment via user clicks only. During tracking, users can flexibly change the objects they wanna track or correct the region of interest if there are any ambiguities. These characteristics enable ***Track-Anything*** to be suitable for: +***Track-Anything*** is a flexible and interactive tool for video object tracking and segmentation. It is developed upon [Segment Anything](https://github.com/facebookresearch/segment-anything), can specify anything to track and segment via user clicks only. During tracking, users can flexibly change the objects they wanna track or correct the region of interest if there are any ambiguities. These characteristics enable ***Track-Anything*** to be suitable for: - Video object tracking and segmentation with shot changes. - Visualized development and data annnotation for video object tracking and segmentation. - Object-centric downstream video tasks, such as video inpainting and editing. @@ -11,17 +11,17 @@ https://user-images.githubusercontent.com/28050374/232842703-8395af24-b13e-4b8e-aafb-e94b61e6c449.MP4 -### Video Object Tracking and Segmentation with Shot Changes +### Multiple Object Tracking and Segmentation (with [XMem](https://github.com/hkchengrex/XMem)) -one gif/video +https://user-images.githubusercontent.com/39208339/233035206-0a151004-6461-4deb-b782-d1dbfe691493.mp4 + +### Video Object Tracking and Segmentation with Shot Changes (with [XMem](https://github.com/hkchengrex/XMem)) + +https://user-images.githubusercontent.com/30309970/232848349-f5e29e71-2ea4-4529-ac9a-94b9ca1e7055.mp4 ### Video Inpainting (with [E2FGVI](https://github.com/MCG-NKU/E2FGVI)) -![image](./assets/inpainting.gif) - -### Video Editing - -one gif/video +https://user-images.githubusercontent.com/28050374/232959816-07f2826f-d267-4dda-8ae5-a5132173b8f4.mp4 ## Get Started #### Linux @@ -44,6 +44,6 @@ pip install madgrad python app.py --device cuda:0 --sam_model_type vit_h --port 12212 ``` -## Acknowledgement +## Acknowledgements -The project is based on [Segment Anything](https://github.com/facebookresearch/segment-anything) and [XMem](https://github.com/hkchengrex/XMem). Thanks for the authors for their efforts. +The project is based on [Segment Anything](https://github.com/facebookresearch/segment-anything), [XMem](https://github.com/hkchengrex/XMem), and [E2FGVI](https://github.com/MCG-NKU/E2FGVI). Thanks for the authors for their efforts. diff --git a/app.py b/app.py index 760b9a4..cd68477 100644 --- a/app.py +++ b/app.py @@ -193,9 +193,9 @@ xmem_checkpoint = download_checkpoint(xmem_checkpoint_url, folder, xmem_checkpoi # args, defined in track_anything.py args = parse_augment() -args.port = 12212 -args.device = "cuda:4" -args.mask_save = True +# args.port = 12212 +# args.device = "cuda:4" +# args.mask_save = True model = TrackingAnything(SAM_checkpoint, xmem_checkpoint, args) diff --git a/assets/qingming.mp4 b/assets/qingming.mp4 new file mode 100644 index 0000000..d8dee7a Binary files /dev/null and b/assets/qingming.mp4 differ