Riffusion txt2audio

Riffusion txt2audio
theally
almost 3 years ago

Note: I am not the original creator or owner of this model. Credit goes to Seth Forsgren and Hayk Martiros https://www.riffusion.com/about

I put together a quick Riffusion tutorial explaining how to get started, with some samples, etc - The Ally's Riffusion Tutorial

This is a novel txt2audio model - and it's wild. Select the model, give it a prompt: "Chill Beats", for example, and it'll output Spectrogram images.

These images can be used in Automatic 1111's SD WebUI, in conjunction with the WebUI Riffusion extension (https://github.com/enlyth/sd-webui-riffusion) to generate music inside the interface.

"Clips" (Spectrogram images) can be chained together using the Seed Travel script, and merged into a single audio file from the extension Riffusion tab.

Here's an awesome example of what's possible - https://youtu.be/Je1CD-gZI6o

Checkpoint has been pickle scanned, is legit, but Safetensors version also available, just in case!

Please consider joining my Patreon! Advanced SD tutorials, settings explanations, adult-art, from a female content creator (me!) patreon.com/theally - Riffusion tutorial to go live soon!

Read more...

What is Riffusion txt2audio?

Riffusion txt2audio is a highly specialized Image generation AI Model of type Safetensors / Checkpoint AI Model created by AI community user theally. Derived from the powerful Stable Diffusion (SD 1.5) model, Riffusion txt2audio has undergone an extensive fine-tuning process, leveraging the power of a dataset consisting of images generated by other AI models or user-contributed data. This fine-tuning process ensures that Riffusion txt2audio is capable of generating images that are highly relevant to the specific use-cases it was designed for, such as music, txt2audio.

With a rating of 5 and over 2 ratings, Riffusion txt2audio is a popular choice among users for generating high-quality images from text prompts.

Can I download Riffusion txt2audio?

Yes! You can download the latest version of Riffusion txt2audio from here.

How to use Riffusion txt2audio?

To use Riffusion txt2audio, download the model checkpoint file and set up an UI for running Stable Diffusion models (for example, AUTOMATIC1111). Then, provide the model with a detailed text prompt to generate an image. Experiment with different prompts and settings to achieve the desired results. If this sounds a bit complicated, check out our initial guide to Stable Diffusion – it might be of help. And if you really want to dive deep into AI image generation and understand how set up AUTOMATIC1111 to use Safetensors / Checkpoint AI Models like Riffusion txt2audio, check out our crash course in AI image generation.

Download (3.5 GB) Download available on desktop only
You'll need to use a program like A1111 to run this – learn how in our crash course

Popularity

870 160

Info

Base model: SD 1.5

Latest version (Riffusion txt2audio): 2 Files

To download these files, please visit this page from a desktop computer.

1 Version