Stability AI has launched an open source artificial intelligence (AI) model called Stable Audio Open. Users can leverage the model to create samples and sound effects of up to 47 seconds. Users can use it to create samples of instruments or ambient sounds. AI models also allow users to create different variations and styles of previously created samples. The open-source model is separate from the AI company’s Stable Audio platform, which allows users to create tracks up to three minutes long and is only available as part of a subscription.
Stability AI, Stable Audio Open launched
Stable Audio Open works similarly to many AI models on the market. Users can write text prompts for samples or sound effects, producing up to 47 seconds of audio. Stability AI noted in a newsroom post that its AI model has been released as open source to empower sound designers, musicians, and the creative community.
However, use of Stable Audio Open was limited to research and non-commercial use. To obtain commercial rights, users must purchase a Stability AI membership.
In terms of features, you can create drum beats, instrument riffs, ambient sounds, foley recordings, and other audio samples. Users can also fine-tune the model using custom audio data.
Highlighting one example, the AI company says a drummer can train an AI through recordings of drumming sessions and use the model to generate new beats. The model can generate short audio samples, but is not optimized for full songs, melodies, or vocals.
To train Stable Audio Open, the company used a dataset of 4,86,492 audio recordings from FreeSound and the Free Music Archive. He added, “Before starting training, we conducted an in-depth analysis to ensure that the training data did not contain unauthorized copyrighted music.”
However, Stability AI said the dataset lacks diversity and not all cultures are represented equally. As a result, the resulting samples reflect biases in the training data. To access the AI model, users can go to the company’s Hugging Face listing, where public model weights are currently hosted.
For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads, and Google News. Subscribe to our YouTube channel for the latest videos on gadgets and technology. If you want to know everything about the top influencers, follow our in-house Who’sThat360 on Instagram and YouTube.
WhatsApp is said to be starting beta testing a new layout for status updates with a preview feature.
