Sometimes it does an amazing job and generates exactly what you want with a vague prompt.

Other times, you get suboptimal outputs.

Here are some tips and tricks to get ideal results.

header image

That is especially likely since the checkpoints that inform how Stable Diffusion generates images will receive periodic updates.

The ideal prompt is going to be a moving target for the foreseeable future.

it’s crucial that you tell it exactly what you want.

A panel of 6 output images from Stable Diffusion using the prompt "Cute cat."

Here is an example using the internet’s favorite animals: Cute cats.

But what if you wanted grey cats, not a mix of cats?

Well, you’re gonna wanna specify that.

A panel of 6 output images from Stable Diffusion using the prompt "Cute grey cat."

Use “Cute grey cats” as your prompt instead.

Now Stable Diffusion returns all grey cats.

This applies to anything you want Stable Diffusion to produce, including landscapes.

Another panel of 6 output images from Stable Diffusion using the prompt "Cute grey cat with blue eyes, wearing a bowtie"

you’re able to (and should) also specify the style you want.

We’ll stick with our “Cute grey cat” prompt for this.

This example used Pablo Picasso.

6 grey cats from Stable Diffusion that look like acrylic paintings.

It tends to produce dramatic results.

Don’t be afraid to combine artists that wouldn’t normally go together, either.

Oftentimes Stable Diffusion will combine their respective styles in exciting and unpredictable ways.

Another example of grey cats in the style of "Unreal Engine."

It is a great way to stumble into new styles.

Stable Diffusion supports weighting of prompt keywords.

The decimal numbers are percentages, so they must add up to 1. it’s possible for you to use multiple parentheses to stack up the emphasis as much as you want.

A weird melty clay sculpture of a chicken in a Walmart.

Find Inspiration Elsewhere

Stable Diffusion and other AI art generators have experienced an explosive popularity spike.

you might find this sort of AI art all over the place.

Just drop in a subject of your choosing plus a few modifiers.

6 cats, as Stable Diffusion images Picasso would have painted them.

All other Stable Diffusion configs were kept the same as the prompts up above.

As a rule, Stable Diffusion creates sunsets and fall leaves exceptionally well.

This example prompt also included “Golden Hour” to get the sunset colors.

Stable Diffusion’s take on Mount Katahdin viewed from across a lake.

Try it out anywhere.

Remember, don’t be afraid to remove what you think might be a key term from your prompt.

A very colorful car.

A moderately bad weather day in New York City.

Kermit with an evil muppet behind him.