Note: I am not the original creator or owner of this model. Credit goes to Seth Forsgren and Hayk Martiros https://www.riffusion.com/about
I put together a quick Riffusion tutorial explaining how to get started, with some samples, etc - The Ally's Riffusion Tutorial
This is a novel txt2audio model - and it's wild. Select the model, give it a prompt: "Chill Beats", for example, and it'll output Spectrogram images.
These images can be used in Automatic 1111's SD WebUI, in conjunction with the WebUI Riffusion extension (https://github.com/enlyth/sd-webui-riffusion) to generate music inside the interface.
"Clips" (Spectrogram images) can be chained together using the Seed Travel script, and merged into a single audio file from the extension Riffusion tab.
Here's an awesome example of what's possible - https://youtu.be/Je1CD-gZI6o
Checkpoint has been pickle scanned, is legit, but Safetensors version also available, just in case!
Please consider joining my Patreon! Advanced SD tutorials, settings explanations, adult-art, from a female content creator (me!) patreon.com/theally - Riffusion tutorial to go live soon!
Riffusion txt2audio is a highly specialized Image generation AI Model of type Safetensors / Checkpoint AI Model created by AI community user theally. Derived from the powerful Stable Diffusion (SD 1.5) model, Riffusion txt2audio has undergone an extensive fine-tuning process, leveraging the power of a dataset consisting of images generated by other AI models or user-contributed data. This fine-tuning process ensures that Riffusion txt2audio is capable of generating images that are highly relevant to the specific use-cases it was designed for, such as music, txt2audio.
With a rating of 5 and over 2 ratings, Riffusion txt2audio is a popular choice among users for generating high-quality images from text prompts.
Yes! You can download the latest version of Riffusion txt2audio from here.
To use Riffusion txt2audio, download the model checkpoint file and set up an UI for running Stable Diffusion models (for example, AUTOMATIC1111). Then, provide the model with a detailed text prompt to generate an image. Experiment with different prompts and settings to achieve the desired results. If this sounds a bit complicated, check out our initial guide to Stable Diffusion – it might be of help. And if you really want to dive deep into AI image generation and understand how set up AUTOMATIC1111 to use Safetensors / Checkpoint AI Models like Riffusion txt2audio, check out our crash course in AI image generation.