Voice cloning startup ElevenLabs launched a brand new instrument for customers to generate sound results by way of prompts right this moment. The corporate first introduced the undertaking again in February.
The instrument, obtainable to all customers beginning right this moment, permits customers to sort in prompts like “waves crashing,” “metallic clanging,” “birds chirping” and “racing automobile engine” to generate snippets of sounds.
The sound results instrument also can generate instrumental musical clips of as much as 22 seconds with prompts reminiscent of guitar loops, jazz saxophone solos and music techno loops.
Free customers get 10,000 character generations per 30 days — a sound byte era takes round 150 characters per request. Basically, free-tier customers can generate practically 60 sound results per 30 days. In addition they must attribute the sound to “elevenlabs.io” within the title whereas publishing any content material containing the sound clip.
ElevenLabs stated that it used Shutterstock’s audio library containing licensed tracks as a instrument to coach its mannequin. The corporate added that customers that attempted out the instrument through the alpha testing part included online game builders, movie producers, social media content material creators and entrepreneurs.
The startup famous that the instrument doesn’t enable sound era by way of prompts that violate its Prohibited Content material and Makes use of Coverage, which incorporates subjects like self-harm, threats to youngster security and fraud.
Whereas there are just a few firms and startups engaged on AI-powered sound era, ElevenLabs may discover the music era area crowded. Stability AI-backed Harmonai has launched Dance Diffusion; Google has labored on MusicLM; OpenAI has Jukebox; and Meta has its AudioCraft mannequin. TikTok and Adobe have additionally experimented with generative AI-based music creation instruments of their very own.
We’re launching an AI publication! Join right here to start out receiving it in your inboxes on June 5.
