Diffusion Editing with Soft Mask: Pixel Level Redo of Image and Video with Adjustable Strength

Excerpt

arXiv:2610.00359v1 Announce Type: cross Abstract: Diffusion models with prompt and reference image-guided editing have seen rapid progress, yet they remain too coarse for pixel-level control. One promising direction is to incorporate a soft mask that specifies spatially varying edit strengths but training such fine-grained control demands expensive pixel-wise annotations, while existing zero-shot methods often yield unsatisfactory results. We introduce SoftPaint, a new zero-shot sampling method