Generating images can be achieved through various methods. One approach gaining attention recently is composing images with a noisy latent state. This technique involves composing images while they are still in a latent state, before they are fully refined, allowing for remarkable consistency and creative expression. In this article, we will explore the principles and applications of this method.
Principles of Noisy Latent Composition
Noisy Latent Composition, as the name suggests, is a technique for composing images in a latent state filled with noise. This process occurs before the image is fully cleaned, during the latent phase. In this phase, general shapes and poses emerge in the initial sampling stage, so by using this method, you can place subjects in desired positions while maintaining consistency.
- Generate background and subject images at different sampling stages
- Apply feathering techniques while compositing the subject into the background to soften the edges
- Complete the final image through the entire sampling process
Here, we demonstrate the practical application of Noisy Latent Composition through an example of compositing four images. The background image was set to a resolution of 1920×1088, and each subject image was set to 384×768. A total of 16 sampling stages were used to generate each image, with the initial four stages sampled using different prompts.
Next, the subjects, still filled with noise, were composited into the background image, and the remaining sampling stages were used to complete the final image. This process allows the subjects to interact or maintain specific poses while creating a consistent image with the background.
Technical Limitations and Possibilities
This method is highly effective in adjusting the position, pose, and general colors of subjects. However, there may be limitations in controlling finer details, such as eye color. Nevertheless, Noisy Latent Composition enables creative image generation while maintaining consistency between the background and subjects.
Conclusion
Noisy Latent Composition is a method that opens up new possibilities in image generation. It allows for the easy creation of more creative and consistent images, with potential applications across various fields. Try utilizing this technique to create your own unique images.
Reference: ComfyUI Examples, “Noisy Latent Composition Examples”