\nDumme\u2019s AI video editor creates YouTube Shorts in minutes<\/br>
\n2023-06-02 21:46:56<\/br><\/p>\n
Dumme<\/a>, a startup putting AI to practical use in video editing, is already generating demand before opening up to the public. The Y Combinator-backed company has hundreds of video creators testing its product, which leverages AI to create short-form videos from YouTube content, and a waitlist<\/a> of over 20,000 pre-launch, it says. Using a combination of both proprietary and existing AI models, Dumme\u2019s promise is that it can not only save on editing time but also \u2014 and here\u2019s its big claim \u2014 do a better job than the contracted (human) workforce who is often tasked with more menial video editing jobs, like cutting down long-form content for publication on short-form platforms like YouTube Shorts, TikTok or Instagram Reels.<\/p>\n Founded in January 2022 and a participant in startup accelerator Y Combinator\u2019s Winter 2022 program, Dumme co-founder and CEO Merwane Drai<\/a> said he was originally focused on building a search engine for video. But around six months ago, the team realized that a better product might be to repurpose the same AI models they were developing to edit video clips instead.<\/p>\n Joined by co-founders Will Dahlstrom<\/a> (CPO) and Jordan Brannan<\/a> (CTO), all with AI backgrounds, Drai realized Dumme may have landed on the right product-market fit after their app went viral, crashing their servers.<\/p>\n \u201cWe didn\u2019t really expect that it would get a lot of traction or anything, so we just put something out there,\u201d Drai explains. \u201cThen what happened is that overnight, we woke up to overloaded servers \u2014 like, nothing actually worked. So we took everything down and actually put together some sort of waitlist,\u201d he continues. \u201cThe next morning, we probably woke up to 5,000 people in there, which was interesting.\u201d<\/p>\n The team later discovered that a TikTok creator had posted a short video about the product, which sent a flood of traffic to their site.<\/p>\n \u201cIt actually never calmed down from that,\u201d Drai notes.<\/p>\n The product, pronounced \u201cdummy,\u201d appealed to creators because it aimed to simplify and speed up the work involved with video editing.<\/p>\n Image Credits:<\/strong> Dumme<\/p>\n<\/div>\n Using Dumme is as simple as the name implies. To get started, the user pastes in a YouTube video\u2019s link, then clicks on \u201cgenerate\u201d and the AI will output a number of short videos showcasing highlights from that ingested content. The company says it\u2019s using YouTube as the source, instead of supporting raw video footage, in order to outsource content moderation \u2014 that is, if it\u2019s allowed on YouTube, it\u2019s allowed in Dumme.<\/p>\n The processing time and the number of resulting clips will depend on the length of the original video.<\/p>\n But as an example, an hour-long video podcast might take around 20 minutes to process and you\u2019ll start receiving clips after about five minutes, Drai says. When complete, creators can download the video clips, which are less than 60 seconds by default, and upload them to any platform that supports short-form content, like YouTube Shorts, but also other platforms, like Reels or TikTok.<\/p>\n Image Credits:<\/strong> Dumme<\/p>\n<\/div>\n How this all works on the back end, of course, is much more complex. The company says that, initially, Dumme will learn as much as it can from the source video via the metadata. It then transcribes the video and tries to understand the semantics of what\u2019s being said while also looking at the frames to try to decode the emotions of the person speaking. These findings are correlated and passed to a language model that tries to determine what parts of the video are worthy of clipping. That\u2019s then handed off to another model that tracks active speakers and handles cropping.<\/p>\n Dumme says it\u2019s working with existing AI models like GPT-4, a fine-tuned version of Whisper and others it built in-house \u2014 like the model that tracks the active speakers in a video frame. One of its models is also trained on a bunch of YouTube Shorts to learn what makes for a good opening hook to pull viewers in. And, though not yet live, the team is also experimenting with an open source model, LaViLa<\/a> from Facebook Research, to better understand the context of the video.<\/p>\n The AI work is being done on GPU Cloud provider CoreWeave<\/a>, not AWS, as it\u2019s more affordable, the company tells us.<\/p>\n Because Dumme relies on AI that processes spoken words, the tech is not appropriate for things like long gameplay videos or others where people aren\u2019t talking. Drai says the startup is initially targeting YouTube creators, podcasters and agencies \u2014 the latter, they believe, would be the best bet for monetizing the product.<\/p>\n Image Credits:<\/strong> Dumme<\/p>\n<\/div>\n Agencies, explains Drai, today often outsource this type of work with hit-or-miss results.<\/p>\n \u201cThey just pay contractors in cheap jurisdictions to edit their own content. And the problem is that it\u2019s still actually pretty expensive and it takes a lot of time \u2014 it takes weeks, not minutes,\u201d he says.<\/p>\n Asked how he feels about creating a technology that would actually put people out of work, Drai was not worried.<\/p>\n \u201cThe way I think about it is that, eventually\u2026I think this is like telling me that math teachers are going to [be put] out of work because there\u2019s something called a calculator\u2026,\u201d he explains. \u201cPeople are going to adapt. And then there\u2019s going to be someone teaching you about the calculator, right? So I think it\u2019s just a matter of adapting to this,\u201d Drai says.<\/p>\n Currently, the pricing being considered involves tiers where a business would pay $0.40 per minute of video processed, while smaller creators may instead opt for a monthly subscription that\u2019s capped at 10 hours of content per month. (These numbers may change.) During testing, the product has been free to use.<\/span><\/p>\n Early adopters have been using Dumme for a variety of edits, including generating clips from their video podcasts to publish to Shorts, as well as cutting down other new videos and going through their back catalogs.<\/p>\n The product appears to be competitive with other AI technologies on the market, including that from creator company Jellysmack<\/a>, which has been leveraging<\/a> AI to turn longer YouTube videos into shorter videos, by cutting them, resizing them and optimizing them for specific platforms \u2014 a result of its 2021 Kamua acquisition<\/a>. Other tools doing similar work include things like Opus Clip<\/a>, Vidyo.ai<\/a>, Detail<\/a>, TubeBuddy<\/a>, Wisecut<\/a> and others. To what extent Dumme succeeds or fails will be on outperforming competitors on the quality of work and cost \u2014 metrics that are yet to be determined.<\/p>\n But some investors are placing their bets on Dumme. Ahead of launch, the startup raised a $3.4 million seed round from Y Combinator, Caffeinated Capital, Max and Nellie Levchin (through SciFi VC), Suhail Doshi, Nico Chinot, Protocol Labs, Chris Puscasiu and other angels.<\/p>\n Given the interest and the sizable waitlist, Dumme says it\u2019s aiming to onboard around 500 people every week. TechCrunch readers can jump the line using the invite code TECHCRUNCH<\/a> until the slots run out.<\/strong><\/p>\n \u00a0<\/p>\n<\/p><\/div>\n <\/br><\/br><\/br><\/p>\n![\"\"](\"https:\/\/i0.wp.com\/techcrunch.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-02-at-3.09.00-am.png?resize=1140%2C733&ssl=1\")
<\/p>\n![\"\"](\"https:\/\/i0.wp.com\/techcrunch.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-02-at-3.07.10-am.png?resize=1140%2C733&ssl=1\")
<\/p>\n![\"\"](\"https:\/\/i0.wp.com\/techcrunch.com\/wp-content\/uploads\/2023\/06\/Screenshot-2023-06-02-at-3.08.41-am.png?resize=1140%2C733&ssl=1\")
<\/p>\n