Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Now add a walrus: Prompt engineering in DALL-E 3

Oct 27, 2023 - simonwillison.net
The article discusses the author's experience with DALL-E 3, an image generation model by OpenAI. The author explains how DALL-E 3 is accessed via ChatGPT, which prompts the model to generate images based on user queries. The author demonstrates this by requesting images of a "posh pelican with a monocle watching the Monaco F1" and later adding a walrus to the scene. The article also reveals that DALL-E 3 can maintain consistency between images given the same seed and a slightly altered prompt, a feature not found in other models like Midjourney and Stable Diffusion.

The author also explores the "leaked" DALL-E prompt, which reveals OpenAI's policies for image generation, including avoiding images of politicians or public figures, diversifying depictions of people, and modifying descriptions that include specific people. The prompt also outlines the default behavior of the model and provides instructions for handling various scenarios. The author concludes by noting that the prompt offers valuable insights into OpenAI's prompt engineering process.

Key takeaways:

  • The author discusses their experience with DALL-E 3, an image generation model from OpenAI, which is accessed via ChatGPT and can generate different styles of images based on user prompts.
  • DALL-E 3 has an interesting feature where it can maintain consistency between images given the same seed and a slightly altered prompt, which is not common in other image generation models.
  • The author also explores the leaked DALL-E prompt, which reveals the inner workings of the DALL-E/ChatGPT combo and the policies followed to ensure the generation of diverse, inclusive, and non-offensive images.
  • The article provides insights into prompt engineering within OpenAI, highlighting how the prompts have been developed and refined over time to counter harmful or embarrassing capabilities of the underlying DALL-E 3 model.
View Full Article

Comments (0)

Be the first to comment!