InstructPix2Pix : Learning to Follow Image Editing Instructionshttps://www.timothybrooks.com/instruct-pix2pix/
A method for editing images using human instructions, which involves providing an input image and a written instruction that tells the model what to do, and the model follows these instructions to edit the image. To generate training data for this problem, the article combines the knowledge of two large pretrained models, a language model (GPT-3) and a text-to-image model (Stable Diffusion), to generate a large dataset of image editing examples.