Skip to content

[Feature] LanPaint implementation in sd.cpp #1954

Description

@chaserhkj

Feature Summary

supports lanpaint sampling in sd.cpp

Detailed Description

lanpaint uses Langevin dynamics approaches to do inpainting/outpainting with any model, without the need of a separately trained model. Instead of relying on ML approaches it models the conditioned stochastic processes of the (de)noising of inpaint image generation using the well-studied Langevin equations, thus effectively making normal i2i models consider mask contexts. IMO it is still the best AI-based image edit approach up to date that ensures pixel-to-pixel identity.

The core mechanism of this approach is within the sampler, we would need to port the sampler with the Langevin dynamics to sd.cpp to make this happen, I can start to work on a PR for this later this week.

Alternatives you considered

No response

Additional context

No response

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions