Adobe starts rolling out generative AI video tools in beta

Date:

Share:


Adobe is joining several other players in the generative AI (GAI) space by rolling out its own model. The Firefly Video Model is powering a number of features across the company’s wide array of apps. At Adobe MAX, the company announced that some of those are available in beta today.

is a Premiere Pro feature that Adobe . It enables editors to add generated footage and audio to the start or end of a clip. This can help cover a transition or edit if the required shot isn’t available. All editors need to do is drag out the beginning or end of a clip. Adobe says the tool can also correct eyelines and actions that change unexpectedly in the middle of a shot.

Adobe it worked with professional video editors over the last year to better understand how GAI could help resolve some issues in their workflow. While Generative Extend might give them the footage they need, other creatives may be less enthused. It may mean that reshoots are no longer required, taking days of work (and income) away from the cast and crew.

That said, Generative Extend is only intended for small tweaks. The feature is also limited to a maximum resolution of 1080p for now, so it’s not exactly cinema quality.

In September, Adobe its (similar to and ) and image-to-video features. Those are now available in the Firefly web app in beta, thought you may have to join a waitlist.

Adobe says that, like with other Firefly generative models, both the Firefly Video Model and the features it powers are designed to be safe for commercial use. Its Content Credentials watermarks are applied to whatever the video model outputs.

Elsewhere, Photoshop is Adobe , with Generative Fill and Generative Expand now running on the latest Firefly Image Model (the company says this can generate images four times faster than previous versions). The Generate Similar tool is fairly self-explanatory — it can generate variants of an object in the image until you find one you prefer. Adobe released those features today.

In addition, Adobe is adding a neat feature to the Remove tool, which lets you delete people and objects from an image with ease, like Google’s . With Distraction Removal, you can remove certain common elements with a single click. For instance, it can scrub unwanted wires and cables, and remove tourists from your travel photos.

Meanwhile, Frame.io V4, said to be the biggest update to the collaborative photo and video production platform since it debuted nine years ago, is available to all users. Adobe has entirely redesigned it to, for instance, improve workflows and upgrade the video player. It also emerged that Canon, Nikon and Leica will support , which allows for direct uploads of photos and videos to Frame.io. Adobe says that means most major manufacturers are now supporting C2C.



Source link

━ more like this

A new breed of Android flagships is coming and it should make Samsung nervous

A new wave of Android flagships is on the horizon, and they’re not playing it safe. The biggest shift is that these phones...

Watch the trailer for Science Saru’s Ghost in the Shell anime series

A new trailer has given us our best look yet at the upcoming The Ghost in the Shell anime. While it might not...

Apple is opening Siri to pick AI models, but there’s only only that makes sense to me 

Apple promised us a smarter, more capable Siri at WWDC 2024. The pitch was compelling: a Siri that understands your personal context, digs...

YouTube CEO opens up about AI slop, and it sounds like cozy promises

YouTube is in a slightly tricky position right now. On one hand, it’s encouraging creators to use AI tools to make content faster...

Meta’s next smart glasses sound like a treat for humans stuck with prescription lenses

For the billions of people who rely on corrective glasses every day (including me), smart glasses have always been a slightly awkward conversation....
spot_img