{"id":13875,"date":"2022-09-05T14:37:57","date_gmt":"2022-09-05T14:37:57","guid":{"rendered":"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/"},"modified":"2022-09-05T14:37:58","modified_gmt":"2022-09-05T14:37:58","slug":"dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings","status":"publish","type":"post","link":"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/","title":{"rendered":"DALL-E can now help you imagine what\u2019s outside the frame of famous paintings"},"content":{"rendered":"

Source: https:\/\/www.theverge.com\/2022\/9\/5\/23337580\/openai-dall-e-text-to-image-generator-outpainting-native-function<\/a>
\n
<\/br><\/code><\/p>\n

\n

OpenAI has added a new \u201coutpointing\u201d function to its text-to-image AI model DALL-E that lets the system generate new visuals that expand the borders of any given picture<\/a>. <\/p>\n

In the example above, you can see how DALL-E, with the help of human prompting, \u201cimagines\u201d what\u2019s outside the frame of Johannes Vermeer\u2019s portrait \u201cGirl with a Pearl Earring.\u201d Note, how, even from the limited information provided by the portrait, the system is able to match Vermeer\u2019s style, mimicking the shadows and highlights of the original. <\/p>\n

In the timelapse below, you can also see how the artist responsible, August Kamp, had to expand the image in small sections at a time, often redoing DALL-E\u2019s generations in order to get the outcome she wanted. Not seen in this video but definitely worth highlighting, is the fact that the system is not generating these extensions just by itself. As with all text-to-image AI, the model requires that humans describe the new visuals.<\/p>\n

Outpainting as a function can be used to expand original content, but of course many DALL-E users have been playing with the feature to see what lies outside the frame of famous images. (Scroll down to the bottom for my absolute favorite example…)<\/p>\n

From a broader perspective, outpainting doesn\u2019t really expand the basic functionality of text-to-image AI systems, but it does show how OpenAI will likely position itself in the growing market for these systems: by making usability a key pitch to customers. <\/p>\n

Many text-to-image AI models can perform the same essential function as outpainting, but, like DALL-E itself prior to this update, it required quite a bit of manual fiddling. Making outpainting as easy as possible will help DALL-E differentiate itself from the growing competition of smaller but comparable systems like Midjourney and Stable Diffusion.<\/p>\n

DALL-E itself is now available via a beta program, with more than a million users currently given access. Each beta user gets 50 free image generations in the first month, then 15 additional uses each month after. They can then buy 115 extra image generations for $15.<\/p>\n

In the meantime, though, outpainting can be used to answer some of life\u2019s greatest mysteries, like, \u201cwhat if the Quaker Oats guy was a busty barmaid?\u201d Wonder no more:<\/p>\n<\/div>\n


<\/br><\/code><\/p>\n

Source: https:\/\/www.theverge.com\/2022\/9\/5\/23337580\/openai-dall-e-text-to-image-generator-outpainting-native-function<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

Source: OpenAI has added a new \u201coutpointing\u201d function to its text-to-image AI model DALL-E that lets the system generate new visuals that expand the borders of any given picture. In the example above, you can see how DALL-E, with the help of human prompting, \u201cimagines\u201d what\u2019s outside the frame of Johannes Vermeer\u2019s portrait \u201cGirl with […]<\/p>\n","protected":false},"author":1,"featured_media":13876,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"nf_dc_page":"","om_disable_all_campaigns":false,"pagelayer_contact_templates":[],"_pagelayer_content":"","_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[17,8],"tags":[18],"class_list":["post-13875","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech","category-technology","tag-tech"],"yoast_head":"\nDALL-E can now help you imagine what\u2019s outside the frame of famous paintings - Science and Nerds<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"DALL-E can now help you imagine what\u2019s outside the frame of famous paintings - Science and Nerds\" \/>\n<meta property=\"og:description\" content=\"Source: OpenAI has added a new \u201coutpointing\u201d function to its text-to-image AI model DALL-E that lets the system generate new visuals that expand the borders of any given picture. In the example above, you can see how DALL-E, with the help of human prompting, \u201cimagines\u201d what\u2019s outside the frame of Johannes Vermeer\u2019s portrait \u201cGirl with […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/\" \/>\n<meta property=\"og:site_name\" content=\"Science and Nerds\" \/>\n<meta property=\"article:published_time\" content=\"2022-09-05T14:37:57+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-09-05T14:37:58+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2022\/09\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings_631609c5cde53.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/\",\"url\":\"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/\",\"name\":\"DALL-E can now help you imagine what\u2019s outside the frame of famous paintings - Science and Nerds\",\"isPartOf\":{\"@id\":\"https:\/\/scienceandnerds.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/09\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings_631609c5cde53.jpeg?fit=1200%2C628&ssl=1\",\"datePublished\":\"2022-09-05T14:37:57+00:00\",\"dateModified\":\"2022-09-05T14:37:58+00:00\",\"author\":{\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\"},\"breadcrumb\":{\"@id\":\"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/#primaryimage\",\"url\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/09\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings_631609c5cde53.jpeg?fit=1200%2C628&ssl=1\",\"contentUrl\":\"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/09\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings_631609c5cde53.jpeg?fit=1200%2C628&ssl=1\",\"width\":1200,\"height\":628},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/scienceandnerds.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"DALL-E can now help you imagine what\u2019s outside the frame of famous paintings\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/scienceandnerds.com\/#website\",\"url\":\"https:\/\/scienceandnerds.com\/\",\"name\":\"Science and Nerds\",\"description\":\"My WordPress Blog\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/scienceandnerds.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/scienceandnerds.com\"],\"url\":\"https:\/\/scienceandnerds.com\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"DALL-E can now help you imagine what\u2019s outside the frame of famous paintings - Science and Nerds","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/","og_locale":"en_US","og_type":"article","og_title":"DALL-E can now help you imagine what\u2019s outside the frame of famous paintings - Science and Nerds","og_description":"Source: OpenAI has added a new \u201coutpointing\u201d function to its text-to-image AI model DALL-E that lets the system generate new visuals that expand the borders of any given picture. In the example above, you can see how DALL-E, with the help of human prompting, \u201cimagines\u201d what\u2019s outside the frame of Johannes Vermeer\u2019s portrait \u201cGirl with […]","og_url":"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/","og_site_name":"Science and Nerds","article_published_time":"2022-09-05T14:37:57+00:00","article_modified_time":"2022-09-05T14:37:58+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/scienceandnerds.com\/wp-content\/uploads\/2022\/09\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings_631609c5cde53.jpeg","type":"image\/jpeg"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/","url":"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/","name":"DALL-E can now help you imagine what\u2019s outside the frame of famous paintings - Science and Nerds","isPartOf":{"@id":"https:\/\/scienceandnerds.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/#primaryimage"},"image":{"@id":"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/#primaryimage"},"thumbnailUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/09\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings_631609c5cde53.jpeg?fit=1200%2C628&ssl=1","datePublished":"2022-09-05T14:37:57+00:00","dateModified":"2022-09-05T14:37:58+00:00","author":{"@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e"},"breadcrumb":{"@id":"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/#primaryimage","url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/09\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings_631609c5cde53.jpeg?fit=1200%2C628&ssl=1","contentUrl":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/09\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings_631609c5cde53.jpeg?fit=1200%2C628&ssl=1","width":1200,"height":628},{"@type":"BreadcrumbList","@id":"https:\/\/scienceandnerds.com\/2022\/09\/05\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/scienceandnerds.com\/"},{"@type":"ListItem","position":2,"name":"DALL-E can now help you imagine what\u2019s outside the frame of famous paintings"}]},{"@type":"WebSite","@id":"https:\/\/scienceandnerds.com\/#website","url":"https:\/\/scienceandnerds.com\/","name":"Science and Nerds","description":"My WordPress Blog","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/scienceandnerds.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/ea2991abeb2b9ab04b32790dff28360e","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scienceandnerds.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e6e14fc6691445ef2b2c0a3a6c43882?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/scienceandnerds.com"],"url":"https:\/\/scienceandnerds.com\/author\/admin\/"}]}},"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"https:\/\/i0.wp.com\/scienceandnerds.com\/wp-content\/uploads\/2022\/09\/dall-e-can-now-help-you-imagine-whats-outside-the-frame-of-famous-paintings_631609c5cde53.jpeg?fit=1200%2C628&ssl=1","_links":{"self":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/13875"}],"collection":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/comments?post=13875"}],"version-history":[{"count":1,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/13875\/revisions"}],"predecessor-version":[{"id":13877,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/posts\/13875\/revisions\/13877"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media\/13876"}],"wp:attachment":[{"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/media?parent=13875"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/categories?post=13875"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scienceandnerds.com\/wp-json\/wp\/v2\/tags?post=13875"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}