Recursive InPainting with Stable Difussion 2 Inpainting
Creators
Description
Recursive inpainting with Stable Difussion
The dataset contains images extracted from WikiArt that have been recursively versioned using inpainting techniques with a version of the Stable Diffusion model oriented towards instructional inpainting called stable-diffusion-2-inpainting.
The dataset contains two folders with two different experiments. Each experiment consists of performing recursive inpainting on 512x512 px images until reaching a percentage of pixels affected by the inpainting of 400% compared to the original image. Each experiment contains the following files:
- original_imgs_grid.png file with all the base images in an ordered grid.
- mask_64x64/[number_figure]_64x64.png with the inpainting version of [number_figure] and 64x64 mask
- mask_128x128/[number_figure]_128x128.png with the inpainting version of [number_figure] and 128x128 mask
- mask_256x256/[number_figure]_256x256.png with the inpainting version of [number_figure] and 256x256 mask
- lpips_distances.xlsx with the results of applying the Learned Perceptual Image Path Similarity (LPIPS) metric in its variants SqueezeNet, AlexNet, and VGG. The metrics are calculated with respect to the original image and the previous image.
There are two different experiments:
- lpips_distances_100_images_1_seed: contains recursive inpaintings of 100 different images with a single seed. This allows the analysis of different images when performing recursive inpainting.
- lpips_distances_10_images_15_seeds: contains recursive inpaintings of 10 different images with 15 different seeds. This allows the analysis of the differences in inpaintings when applying different seeds in the inpainting on the same image.
The folder code includes the a README.md with the instructions and the scripts to run the experiments