Adobe continues working on generative AI and has just rolled out a web-based sound generator in beta, powered by the company’s neural engine, Firefly. It allows users to generate custom sound effects from text descriptions, but that’s not the most interesting part. You can also provide the model with voice guidance, recording audio hints for precisely timing sound effects to match actions. How exactly does the new Adobe Firefly sound generator work, and where to try it out – read in our article below! Generating sounds from text is already nothing new. Several companies have been offering this feature for a while now (with ElevenLabs at the forefront, for example). However, the idea to voice your desired effects out, so that AI knows exactly the length and the energy of the action in the video, is exciting. It offers much more control and inspiration for creative results. Think of it as Foley, quickly recorded with just your voice and then turned into correct sounds. Adobe Firefly sound generator and what it offers The new tool by Adobe looks more like a compact browser-based editor. It allows users to upload video input (up to 30 seconds in length at the moment) and then generate sound effects for it, aligning them directly to the correct time stamps. Image source: Adobe By combining a provided text prompt with a voice performance, Adobe Firefly sound generator creates a sound effect that is close to the text description, while following the timing and energy of...
Published By: CineD - Today