Adobe’s ‘Corrective AI’ Can Change the Emotions of a Voice-Over

Date:

Share:


Adobe’s Oriol Nieto loaded up a short video with a handful of scenes and a voice-over, but no sound effects. The AI model analyzed the video and broke it down into scenes, applying emotional tags and a description of each scene. Then, the sound effects came. The AI model picked up on a scene with an alarm clock, for instance, and automatically created a sound effect. It identified a scene where the main character (an octopus, in this case) was driving a car, and it added a sound effect of a door closing.

It wasn’t perfect. The alarm sound wasn’t realistic, and in a scene where two characters were hugging, the AI model added an unnatural rustling of clothes that didn’t work. Instead of manually editing, Adobe used a conversational interface (like ChatGPT) to describe changes. In the car scene, there was no ambient sound from the car. Rather than manually selecting the scene, Adobe used the conversational interface and asked the AI model to add a car sound effect to the scene. It successfully found the scene, generated the sound effect, and placed it perfectly.

These experimental features aren’t available, but they usually work their way into Adobe’s suite. For instance, Harmonize, a feature in Photoshop that automatically places assets with accurate color and lighting in a scene, was shown at Sneaks last year. Now, it’s in Photoshop. Expect them to pop up sometime in 2026.

Adobe’s announcement comes mere months after video game voice actors ended a nearly year-long strike to secure protections around AI—companies are required to get consent and provide disclosure agreements when game developers want to recreate a voice actor’s voice or likeness through AI. Voice actors have been bracing for the impact AI will have on the business for some time now, and Adobe’s new features, even if they’re not generating a voice-over from scratch, are yet another marker of the shift AI is forcing on the creative industry.



Source link

━ more like this

You might actually be able to buy a Tesla robot in 2027

Tesla CEO Elon Musk has once again laid out an ambitious timeline for the company’s long-awaited humanoid robot, Optimus. Speaking at the World...

Your next road trip is booked: Forza Horizon 6 comes this May

After months of anticipation and speculation, and even a leaked release date, Playground Games and Xbox have finally given fans what they’ve been...

Here’s when you can buy AMD’s Ryzen 7 9850X3D and how much it’ll cost

AMD has finally confirmed pricing and availability for its Ryzen 7 9850X3D processor, the company’s newest near-flagship desktop CPU aimed at gaming enthusiasts....

Sennheiser introduces new TV headphones bundle with Auracast

Sennheiser has unveiled its RS 275 TV Headphones, which are bundled with a BTA1 digital receiver. These headphones use Auracast technology to provide...
spot_img