Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -58,19 +58,19 @@

MarkDiffusion is an open-source Python toolkit for generative watermarking of latent diffusion models. As the use of diffusion-based generative models expands, ensuring the authenticity and origin of generated media becomes critical. MarkDiffusion simplifies the access, understanding, and assessment of watermarking technologies, making it accessible to both researchers and the broader community. *Note: if you are interested in LLM watermarking (text watermark), please refer to the [MarkLLM](https://github.com/THU-BPM/MarkLLM) toolkit from our group.*

The toolkit comprises three key components: a unified implementation framework for streamlined watermarking algorithm integrations and user-friendly interfaces; a mechanism visualization suite that intuitively showcases added and extracted watermark patterns to aid public understanding; and a comprehensive evaluation module offering standard implementations of 24 tools across three essential aspectsβ€”detectability, robustness, and output quality, plus 8 automated evaluation pipelines.
The toolkit comprises three key components: a unified implementation framework for streamlined watermarking algorithm integrations and user-friendly interfaces; a mechanism visualization suite that intuitively showcases added and extracted watermark patterns to aid public understanding; and a comprehensive evaluation module offering standard implementations of 31 tools across three essential aspectsβ€”detectability, robustness, and output quality, plus 6 automated evaluation pipelines.

<img src="img/fig1_overview.png" alt="MarkDiffusion Overview" style="zoom:50%;" />

### πŸ’ Key Features

- **Unified Implementation Framework:** MarkDiffusion provides a modular architecture supporting eight state-of-the-art generative image/video watermarking algorithms of LDMs.
- **Unified Implementation Framework:** MarkDiffusion provides a modular architecture supporting eleven state-of-the-art generative image/video watermarking algorithms of LDMs.

- **Comprehensive Algorithm Support:** Currently implements 8 watermarking algorithms from two major categories: Pattern-based methods (Tree-Ring, Ring-ID, ROBIN, WIND) and Key-based methods (Gaussian-Shading, PRC, SEAL, VideoShield).
- **Comprehensive Algorithm Support:** Currently implements 11 watermarking algorithms from two major categories: Pattern-based methods (Tree-Ring, Ring-ID, ROBIN, WIND, SFW) and Key-based methods (Gaussian-Shading, PRC, SEAL, VideoShield, GaussMarker, VideoMark).

- **Visualization Solutions:** The toolkit includes custom visualization tools that enable clear and insightful views into how different watermarking algorithms operate under various scenarios. These visualizations help demystify the algorithms' mechanisms, making them more understandable for users.

- **Evaluation Module:** With 20 evaluation tools covering detectability, robustness, and impact on output quality, MarkDiffusion provides comprehensive assessment capabilities. It features 5 automated evaluation pipelines: Watermark Detection Pipeline, Image Quality Analysis Pipeline, Video Quality Analysis Pipeline, and specialized robustness assessment tools.
- **Evaluation Module:** With 31 evaluation tools covering detectability, robustness, and impact on output quality, MarkDiffusion provides comprehensive assessment capabilities. It features 6 automated evaluation pipelines: Watermark Detection Pipeline, Image Quality Analysis Pipeline, Video Quality Analysis Pipeline, and specialized robustness assessment tools.

### ✨ Implemented Algorithms

Expand Down
462 changes: 135 additions & 327 deletions README_es.md

Large diffs are not rendered by default.

462 changes: 135 additions & 327 deletions README_fr.md

Large diffs are not rendered by default.

462 changes: 135 additions & 327 deletions README_zh.md

Large diffs are not rendered by default.

6 changes: 2 additions & 4 deletions docs/BUILD.md
Original file line number Diff line number Diff line change
Expand Up @@ -131,11 +131,9 @@ docs/
β”‚ └── configuration.rst
β”œβ”€β”€ api/ # API reference
β”‚ β”œβ”€β”€ watermark.rst
β”‚ β”œβ”€β”€ detection.rst
β”‚ β”œβ”€β”€ visualization.rst
β”‚ β”œβ”€β”€ evaluation.rst
β”‚ └── utils.rst
β”œβ”€β”€ changelog.rst # Changelog
β”‚ β”œβ”€β”€ utils.rst
β”‚ └── evaluation.rst
β”œβ”€β”€ contributing.rst # Contributing guide
β”œβ”€β”€ citation.rst # Citation information
β”œβ”€β”€ _static/ # Static files (CSS, images)
Expand Down
Binary file removed docs/_build/doctrees/BUILD.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/api/detection.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/api/evaluation.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/api/utils.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/api/visualization.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/api/watermark.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/changelog.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/citation.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/code_of_conduct.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/contributing.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/environment.pickle
Binary file not shown.
Binary file removed docs/_build/doctrees/index.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/installation.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/quickstart.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/tutorial.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/user_guide/algorithms.doctree
Binary file not shown.
Binary file removed docs/_build/doctrees/user_guide/evaluation.doctree
Binary file not shown.
Binary file not shown.
Binary file removed docs/_build/doctrees/user_guide/watermarking.doctree
Binary file not shown.
4 changes: 0 additions & 4 deletions docs/_build/html/.buildinfo

This file was deleted.

1,046 changes: 0 additions & 1,046 deletions docs/_build/html/BUILD.html

This file was deleted.

928 changes: 0 additions & 928 deletions docs/_build/html/_modules/detection/base.html

This file was deleted.

1,182 changes: 0 additions & 1,182 deletions docs/_build/html/_modules/detection/gm/gm_detection.html

This file was deleted.

999 changes: 0 additions & 999 deletions docs/_build/html/_modules/detection/gs/gs_detection.html

This file was deleted.

1,068 changes: 0 additions & 1,068 deletions docs/_build/html/_modules/detection/prc/prc_detection.html

This file was deleted.

963 changes: 0 additions & 963 deletions docs/_build/html/_modules/detection/robin/robin_detection.html

This file was deleted.

987 changes: 0 additions & 987 deletions docs/_build/html/_modules/detection/seal/seal_detection.html

This file was deleted.

992 changes: 0 additions & 992 deletions docs/_build/html/_modules/detection/sfw/sfw_detection.html

This file was deleted.

953 changes: 0 additions & 953 deletions docs/_build/html/_modules/detection/tr/tr_detection.html

This file was deleted.

1,230 changes: 0 additions & 1,230 deletions docs/_build/html/_modules/detection/videomark/videomark_detection.html

This file was deleted.

1,153 changes: 0 additions & 1,153 deletions docs/_build/html/_modules/detection/videoshield/videoshield_detection.html

This file was deleted.

1,057 changes: 0 additions & 1,057 deletions docs/_build/html/_modules/detection/wind/wind_detection.html

This file was deleted.

1,141 changes: 0 additions & 1,141 deletions docs/_build/html/_modules/evaluation/dataset.html

This file was deleted.

1,123 changes: 0 additions & 1,123 deletions docs/_build/html/_modules/evaluation/pipelines/detection.html

This file was deleted.

1,635 changes: 0 additions & 1,635 deletions docs/_build/html/_modules/evaluation/pipelines/image_quality_analysis.html

This file was deleted.

1,342 changes: 0 additions & 1,342 deletions docs/_build/html/_modules/evaluation/pipelines/video_quality_analysis.html

This file was deleted.

1,248 changes: 0 additions & 1,248 deletions docs/_build/html/_modules/evaluation/tools/image_editor.html

This file was deleted.

2,142 changes: 0 additions & 2,142 deletions docs/_build/html/_modules/evaluation/tools/image_quality_analyzer.html

This file was deleted.

1,144 changes: 0 additions & 1,144 deletions docs/_build/html/_modules/evaluation/tools/success_rate_calculator.html

This file was deleted.

1,281 changes: 0 additions & 1,281 deletions docs/_build/html/_modules/evaluation/tools/video_editor.html

This file was deleted.

1,788 changes: 0 additions & 1,788 deletions docs/_build/html/_modules/evaluation/tools/video_quality_analyzer.html

This file was deleted.

987 changes: 0 additions & 987 deletions docs/_build/html/_modules/index.html

This file was deleted.

1,021 changes: 0 additions & 1,021 deletions docs/_build/html/_modules/inversions/base_inversion.html

This file was deleted.

1,014 changes: 0 additions & 1,014 deletions docs/_build/html/_modules/inversions/ddim_inversion.html

This file was deleted.

1,436 changes: 0 additions & 1,436 deletions docs/_build/html/_modules/inversions/exact_inversion.html

This file was deleted.

951 changes: 0 additions & 951 deletions docs/_build/html/_modules/utils/callbacks.html

This file was deleted.

1,012 changes: 0 additions & 1,012 deletions docs/_build/html/_modules/utils/diffusion_config.html

This file was deleted.

1,312 changes: 0 additions & 1,312 deletions docs/_build/html/_modules/utils/media_utils.html

This file was deleted.

1,007 changes: 0 additions & 1,007 deletions docs/_build/html/_modules/utils/pipeline_utils.html

This file was deleted.

981 changes: 0 additions & 981 deletions docs/_build/html/_modules/utils/utils.html

This file was deleted.

1,034 changes: 0 additions & 1,034 deletions docs/_build/html/_modules/visualize/auto_visualization.html

This file was deleted.

1,702 changes: 0 additions & 1,702 deletions docs/_build/html/_modules/visualize/base.html

This file was deleted.

1,333 changes: 0 additions & 1,333 deletions docs/_build/html/_modules/visualize/gm/gm_visualizer.html

This file was deleted.

1,135 changes: 0 additions & 1,135 deletions docs/_build/html/_modules/visualize/gs/gs_visualizer.html

This file was deleted.

1,180 changes: 0 additions & 1,180 deletions docs/_build/html/_modules/visualize/prc/prc_visualizer.html

This file was deleted.

1,095 changes: 0 additions & 1,095 deletions docs/_build/html/_modules/visualize/robin/robin_visualizer.html

This file was deleted.

1,095 changes: 0 additions & 1,095 deletions docs/_build/html/_modules/visualize/seal/seal_visualizer.html

This file was deleted.

1,095 changes: 0 additions & 1,095 deletions docs/_build/html/_modules/visualize/sfw/sfw_visualizer.html

This file was deleted.

1,040 changes: 0 additions & 1,040 deletions docs/_build/html/_modules/visualize/tr/tr_visualizer.html

This file was deleted.

1,202 changes: 0 additions & 1,202 deletions docs/_build/html/_modules/visualize/videomark/video_mark_visualizer.html

This file was deleted.

1,286 changes: 0 additions & 1,286 deletions docs/_build/html/_modules/visualize/videoshield/video_shield_visualizer.html

This file was deleted.

1,344 changes: 0 additions & 1,344 deletions docs/_build/html/_modules/visualize/wind/wind_visualizer.html

This file was deleted.

999 changes: 0 additions & 999 deletions docs/_build/html/_modules/watermark/auto_watermark.html

This file was deleted.

1,510 changes: 0 additions & 1,510 deletions docs/_build/html/_modules/watermark/base.html

This file was deleted.

1,720 changes: 0 additions & 1,720 deletions docs/_build/html/_modules/watermark/gm/gm.html

This file was deleted.

1,213 changes: 0 additions & 1,213 deletions docs/_build/html/_modules/watermark/gs/gs.html

This file was deleted.

1,319 changes: 0 additions & 1,319 deletions docs/_build/html/_modules/watermark/prc/prc.html

This file was deleted.

1,453 changes: 0 additions & 1,453 deletions docs/_build/html/_modules/watermark/robin/robin.html

This file was deleted.

1,265 changes: 0 additions & 1,265 deletions docs/_build/html/_modules/watermark/seal/seal.html

This file was deleted.

1,431 changes: 0 additions & 1,431 deletions docs/_build/html/_modules/watermark/sfw/sfw.html

This file was deleted.

1,238 changes: 0 additions & 1,238 deletions docs/_build/html/_modules/watermark/tr/tr.html

This file was deleted.

1,439 changes: 0 additions & 1,439 deletions docs/_build/html/_modules/watermark/videomark/video_mark.html

This file was deleted.

1,414 changes: 0 additions & 1,414 deletions docs/_build/html/_modules/watermark/videoshield/video_shield.html

This file was deleted.

1,178 changes: 0 additions & 1,178 deletions docs/_build/html/_modules/watermark/wind/wind.html

This file was deleted.

162 changes: 0 additions & 162 deletions docs/_build/html/_sources/BUILD.md.txt

This file was deleted.

96 changes: 0 additions & 96 deletions docs/_build/html/_sources/api/detection.rst.txt

This file was deleted.

83 changes: 0 additions & 83 deletions docs/_build/html/_sources/api/evaluation.rst.txt

This file was deleted.

Loading