CDcruz| Install

Back to the main page

This page covers everything to do with prompts, prompt structure and best practices for you to craft your best prompts for amazing images. Everything is super new and changing all the time so be sure to experiment and discover cool tricks for yourself.

Prompt Formatting

Basic Formatting

Prompts can be practically anything you'd like them to be and can work with a simple sentence like Woman standing in a field of flowers, however that is a very simplistic way to use prompts and is not the most ideal way. It is better to use comma seperated descriptive words to describe the image you want to create. Waifu Diffusion as of version 1.3 has been focused on parsing Booru Tags instead of plain english sentences. So for our previous example, it would be better to word it like woman, standing, flowers, field so the AI only has the important words to generate the image instead of useless words (to a computer) like "a", "of", etc.

I have not been able to test this properly yet, but the use of underscores or hypens should work well and be read as expected. Although you can simply use a space between words like normal.

Prompt Order

Prompt order is the easiest way to change the image in subtle ways without having to add more prompts or add negative prompts. Essentially, whatever prompt is at the front of your list, will influence the model more than prompts further down the list. So, if you have a prompt like car, blue, metallic, night, city. The model will prioitize the car image and the city aspect will be less influential.

Parenthesis

Parenthesis/ brackets are very useful for making the model focus on specific prompts. This can be used to override the prompt order and allows you to personally choose how powerful a prompt is in a much more controlled manner. For example, hands, body, face, (eyes), woman will be more likely to generate images of eyes and improve eye quality while hands, ((body)), face, eyes, (woman) will be much more likely to generate images of a womens body and could even crop out the face since it isn't as important in this prompt list.

The more parenthesis you add, the stronger the influence, however, I have not tested what are the maximum amount of parenthesis that will actually affect the model. I would currently recommend using a maximum of 3 or 4 parenthesis as it doesn't make much sense to add more than that. Each parenthesis increases the influence of the prompt by roughly 10% (but not exactly 10%).

If you're wanting to reduce the influence of a prompt, but you still want it to be in your prompt list, you can use square brackets in the exact same way as parenthesis but to reduce a prompts influence instead of increasing it.

If you need to use the literal parenthesis/bracket characters in your prompts, you must prefix them with a backslash. For example, \(jumping\)

Number Multiplier

Similar to using parenthesis, you can use a format like (old:0.2), (evil:0.9), (sword:0.5), (skeleton:1.4) and the AI will prioitize prompts by the number you have stated for each prompt. You do not need to give every prompt a number, similar to how you don't need to give every prompt parenthesis. I personally have not done enough testing with this method to provide any further information but it is worth noting as it could be useful for your own use cases.

A 1 would equal normal influence while a 2 equals double the influence. You can use any decimal number from 0 and above. I have not tested negative numbers, but it doesn't make much sense to use them anyway, you should just use a negative prompt instead.

A quick way to change prompt weighting is to select the prompt you want to change and click CTRL + Arrow Up or CTRL + Arrow Down to automatically increase and decrease weights. It isn't anything fancy, but a nice QOL improvement.

You can use multipliers within multipliers and the values will be multiplied instead of added together. For example, ((a dog:1.5) with a bone:1.5)1.5) is the same as writing (a dog:3.375) (with a bone:2.25).

AND Operator

According to u/StoryStoryDie the AND operator is not actually a feature of the WebGUI, but I have kept this here for reference. I personally feel AND does influence generation, but that's simply my own opinion.

The AND operator is available through the WebGUI. It signals the AI to try to combine the two prompts togther. The AND operator can work well when you're trying to add an object to a character, for example, if you want a character to wear glasses, using woman AND glasses may produce better results than having them as seperate prompts.

Alternate Prompts

Alternative prompts are similar to the AND operator however instead of simply adding two prompts together, these prompts will be switch with each other every sampling step. The syntax to use alternating prompts is [prompt1|prompt2] and you can even add more than 2 prompts to cycle through by simply seperating them with the | pipe character. This alternating will create a different output compared to using the AND operator or using transitional prompts. It is simply another tool in the toolkit to create varied images. The first prompt will be a stronger influence than the second prompt so if the prompt was [cat|dog] the resulting image would look more like a cat but have dog features, while if it was the opposite way, it would look like a dog with some cat features.

You can use alternating prompts within alternating prompts, however logically it will not affect much if you were to create something like [[dog|cat]|[cat|dog]] because everything is switching at the same time, some values (in this instance "cat") would not even appear as a prompt while alternating.

In the linked Reddit post, they have combined long prompts together instead of just 2 words which could be an interesting this to experiment with.

Transitional Prompts

Transitional Prompts also known as Prompt Editing, is when you can swap out one of your prompts mid-rendering with a different prompt to achieve an effect where the image looks like a mix of those two prompts in a different way compared to simply listing both prompts seperately.

The syntax is [From:To:When] where From is your starting prompt, To is your ending prompt, and When is at what step count the prompts will be swapped out.

The When part can either be an integer step count number between 0 and the max step count, or you can use a decimal number between 0 and 1 to specify at what percent of processing the prompts should be swapped.

You can have multiple transitional prompts in your prompts list and they can all have different When parameters specified, allowing you to create a much more unpredictable and varied image. Logically, the later in the rendering process the prompts are swapped, the less influence the To prompt will be on the final image and vice versa.

In my limited testing, I haven't been able to get this method to work that well, but further testing is needed

A Reddit post with a useful tip that involves prompt edit.

Scheduled Prompts

This has been taken from u/StoryStoryDie. Scheduled prompts are a way to insert or remove a prompt from the generation at a specific sampling step. The format is [prompt:sampling step] for example, [balloon:20] this prompt would not use the prompt until the generation reaches step 20. Alternatively, you can use [prompt::sampling step] that will use the prompt initially but ignore it after the set sampling step. I'm unsure of the usefulness of this prompt tool and haven't tested it myself but it is always good to have more ways to modify your generation.

You could be mistaken for thinking that this format is for de-emphasising a prompt and you're not completely wrong, it simply de-emphasises in a different way by completely removing the prompt from the list at a certain point in the generation.

Japanese Prompts

If you are going for anime style artwork, it may be useful to use actual Japanese characters as prompts as that will prompt the AI to use images in its database that have been uploaded by Japanese artists or posted to Japanese sites which will have a much larger pool of anime related imagery to draw from. Unfortunately, I do not speak/ write Japanese, so I am unable to assist with what Japanese phrases to use, but a good starting point may be to use Google Translate, or try visiting Japanese websites, especially manga related ones that have stories and images listed by tags.

Romanji (the English spelling of Japanese words) does work in a lot of cases, so feel free to expriment with that. Words like Kawaii, gyaru and neko work to some effect.

Negative Prompts

Negative Prompts are just as important as normal prompts and as the name suggests, anything in your negative prompts lists will be objects/ characteristics that the AI will try to avoid or reduce its influence on the image generation. This is extremely useful to remove disfigured body parts or unwanted characteristics of a person.

Negative prompts give you just as much flexibility in prompt order as normal prompts, which means you can use parenthesis, brackets, numbering and ording to choose how negatively these prompts will affect your image.

My current general use negative prompts list is as follows, click the text below to copy it.

deformed, blurry, bad anatomy, disfigured, poorly drawn face, mutation, mutated, extra_limb, ugly, poorly drawn hands, two heads,child, children, kid, gross, mutilated, disgusting, horrible, scary, evil, old, conjoined, morphed, text, error, glitch, lowres, extra digits, watermark, signature, jpeg artifacts, low quality, unfinished, cropped, siamese twins, robot eyes, loli

Another crazy negative prompt list provided by Reddit user u/Superb-Ad-4661 covers a huge list of bad prompts and supposedly improves hand generation.

The user mentions that bad-artist is a textual inversion embedding but did not provide a link to the embedding.

done by bad-artist, ugly, dazed, light blue eyes, 3D render, 3D game, 3D game scene, 3D character, mosaic, painting, illustration, digital art, cartoon, anime, doll, toy, photoshop, video game, surreal, sign, 3dcg, decorating, decoration, crayon, clipart, cgi, rendered, 3d, cartoon face, drawing, cgstation, airbrushed, sketch, render, unreal engine, blender, digital painting, airbrush, pointillism, painting, image compression, distorted, JPEG artifacts, noisy, shaky, pixelated, unclear, artifacts, low detail, low quality, low resolution, distortion, amateur, low res, low-res, cropped body, cut off, basic, boring, botched, unprofessional, draft, failure, fake, image corruption, irregular, uneven, unnatural, contorted, twisted, unappealing, blurry, haze, worst quality, normal quality, bad shadow, poor quality, amateur photography, tasteless, tacky, lacklustre, simple, plain, grainy, out of focus, fuzzy, cropped, uncentered, out of frame, body out of frame, split image, truncated, disjointed, incoherent, disorganized, jumbled, floating, objects, unreal, deformations, kitsch, unattractive, opaque, boring pose, plain background, boring, plain, standard, average, uninventive, derivative, homogenous, uncreative, ineffective, drab, amateur, censor, censored, censor_bar, text, font, ui, error, watermark, username, signature, QR code, bar code, copyright, logos, HUD, tiling, label, watermarks, calligraphy, kanji, hanzi, hangul, hanza, chu, nom, latin, arabic, cyrillic, symbols, alphanumeric, unicode, script, artist name, logo, censor, high contrast, low contrast, High pass filter, watermarked, monotone, smooth, blur, vignette, filter, writing, oversaturation, over saturation, over shadow, gaussian, blurred, weird colors, blurred, grain, bad art, black-white, posterization, colour banding, grayscale, monochrome, b&w, oversaturated, black and white, no color, greyscale, poorly drawn, messy drawing, bad proportions, gross proportions, imperfection, dehydrated, misshappen, duplicate, double, clones, twins, brothers, same face, repeated person, bad anatomy, anatomical nonsense, malformed, misshaped body, uncoordinated body, unnatural body, long body, liquid body, deformed, mutilated, mutation, mutated, tumor, deformed body, lopsided, mangled, skin defect, disfigured, conjoined, connected, intertwined, hooked, bad body, amputation, siamese, cropped head, bad framing, out of shot, awkward poses, unusual poses, smooth skin, misshapen, gross proportions, poorly drawn face, bad face, fused face, cloned face, big face, long face, dirty face, long neck, warped face, loose face, crooked face, asymetric jaw, asymmetric chin, fake face, deformed face, extra heads, big forehead, head cut off, ugly hair, bald, poorly drawn hair, bad drawn eyes, asymmetric eyes, unaligned eyes, crooked eyes, closed eyes, looking_away, fused eyes, poorly drawn eyes, extra eye, cross eyed, imperfect eyes, cataracts, glaucoma, strabismus, heterochromia, woobly iris, square iris, weird eyes, distorted eyes, deformed glasses, extra eyes, bright blue eyes, cross-eyed, blurry eyes, poorly drawn eyes, fused eyes, blind, red eyes, bad eyes, ugly eyes, dead eyes, bad drawn nose, fused nose, poorly drawn nose, extra nose, bad mouth, fused mouth, poorly drawn mouth, big mouth, mouth cake, cracked mouth, crooked lips, dirty teeth, yellow teeth, ugly teeth, liquid tongue, colorful tongue, black tongue, bad tongue, tongue within mouth, too long tongue, crooked teeth, yellow teeth, long teeth, bad teeth, fused ears, bad ears, poorly drawn ears, extra ears, liquid ears, heavy ears, missing ears, asymmetric ears, big ears, ugly ears, bad collarbone, fused collarbone, missing collarbone, liquid collarbone, missing limb, malformed limbs, extra limb, floating limbs, disconnected limbs, extra limb, amputee, extra limbs, different limbs proportions, decapitated limbs, mutated hands, poorly drawn hands, malformed hands, bad hands, fused hands, missing hand, extra hand, mangled hands, more than 1 left hand, more than 1 right hand, less than two hands appearing in the image, cropped hands, out of frame hands, thousand hands, mutated hands and fingers, missing hands, distorted hands, deformed hands, imperfect hands, undetailed hands, fused fingers, mutated fingers, (tentacle finger), missing fingers, one hand with more than 5 fingers, disfigured hands, one hand with less than 5 fingers, one hand with more than 5 digit, one hand with less than 5 digit, extra digit, fewer digits, fused digit, missing digit, bad digit, liquid digit, extra fingers, too many fingers, bad gloves, poorly drawn gloves, fused gloves, disappearing arms, short arm, missing arms, extra arms, less than two arms appearing in the image, cropped arms, out of frame arms, long arms, deformed arms, short arm, different arms proportions, multiple belly buttons, missing belly button, broken legs, disappearing legs, missing legs, extra legs, more than 2 legs, huge thighs, disappearing thigh, missing thighs, extra thighs, more than 2 thighs, deformed legs, bad thigh gap, missing thigh gap, fused thigh gap, liquid thigh gap, poorly drawn thigh gap, huge calf, disappearing calf, missing calf, extra calf, fused calf, bad knee, extra knee, broken legs, different legs proportions, mutated feet, poorly drawn feet, malformed feet, bad feet, fused feet, missing feet, mangled feet, more than 1 left foot, more than 1 right foot, less than two foot appearing in the image, cropped feet, thousand feet, mutated feet and fingers, missing feet, distorted feet, deformed feet, imperfect feet, undetailed feet, ugly feet, extra foot, long toes, extra shoes, bad shoes, fused shoes, more than two shoes, poorly drawn shoes, fused cloth, poorly drawn cloth, safety panties, safety knickers, dirty panties, fused panties, poorly drawn panties, bad panties, dirty pantie, multiple breasts, fused breasts, bad breasts, huge breasts, poorly drawn breasts, extra breasts, liquid breasts, missing breasts, more than 2 nipples, missing nipples, different nipples, fused nipples, bad nipples, poorly drawn nipples, black nipples, colorful nipples, unnatural nipples, without form nipples, withered nipples, unerect nipples, extra nipples, more than two nipples, imperfect nipples, liquid tentacles, bad tentacles, poorly drawn tentacles, split tentacles, fused tentacles, bad tails, bad animal ears, poorly drawn animal ears, extra animal ears, liquid animal ears, heavy animal ears, missing animal ears, fused animal ears, poorly drawn hairs, fused hairs, bad hairs, bad crotch, bad crotch seam, fused crotch, poorly drawn crotch, fused seam, poorly drawn crotch seam, futa, she-male, bad buttocks, poorly drawn buttocks, fused buttocks, missing buttocks, huge haunch, bad asshole, poorly drawn asshole, fused asshole, missing asshole, bad anus, fused anus, poorly drawn anus, missing anus, bad camel toe, colorful camel toe, bad pussy, missing clitoris, bad clitoris, fused clitoris, colorful clitoris, black clitoris, liquid clitoris, poorly drawn pussy, fused pussy, mutated vagina, bad penis, poorly drawn penis, fused penis, missing penis, tiny penis, small penis, splitted penis, missing testicles, no glans, imperfect glans, ugly glans, unrealistic penis, unerect penis, penis with no glans, thin penis, poorly drawn glans, bad glans, bad cum, poorly drawn cum, fused cum

Prompt research

I've put some time into trying to find out what prompts work, what don't, and what can produce interesting results. There are some prompts that will completely change an image, and others that will barely change anything. It takes a lot of trail and error to find out what works, and it all depends on what you're trying to create.

If you want to see my extensive list of prompts that I've tested, you can see my Prompt List Page that includes descriptions of how each prompt can change an image. I mostly use Waifu Diffusion and Euler/Euler A for generating images, so prompts may affect your image differently depending on your specific settings, but since the amount of variables are practically limitless, my testing should be a good starting point to help you get what you're looking for.

Interrogator

The interrogator is a feature of the webGUI that allows you to give it any image and it will try to figure out what promtps best describe the image. It won't always work perfectly, but it can be a good starting point if you're unsure of how to describe an image or can be useful in learning new prompts and what prompts match an image.

The interrogate option is under the img2img tab of the webGUI as a button under the "Generate" button. All you need to do is drag an image onto the image drop area with the img2img tab selected, and then click the interrogate button.

If you are using the webGUI, you can add the COMMANDLINE_ARGS --deepdanbooru to allow the interrogator to use danbooru tags as its prompts instead of the normal sentence structure that it uses. This will be most useful for Waifu Diffusion and other models based on Waifu Diffusion or danbooru tags.

InstructPix2Pix

InstructPix2Pix is a new method of model instruction. Currently, it is not available on the AUTO web UI, but it can be accessed using the NMKD GUI.

InstructPix2Pix enables you to communicate with the model in a more human-like manner, allowing you to instruct it on the desired image generation and how to generate it more effectively than traditional prompts.

For instance, you can say "Make this image look like a scene from the anime Akira" and the model will understand your request and generate the corresponding image. As the technology advances, this method of instruction will provide more control over image generation, including the ability to position objects in a scene or combine objects, such as "Create an image of a turtle holding a rose and standing in the corner of a room".

This new method of instruction will represent a significant connection between language learning models like ChatGPT and image generation.

Prompts Information