Discussion of free and open source text-to-image modelsPrevious /ldg/ bread : >>101908455>Beginner UIEasyDiffusion: https://easydiffusion.github.ioFooocus: https://github.com/lllyasviel/fooocusMetastable: https://metastable.studio>Advanced UIAutomatic1111: https://github.com/automatic1111/stable-diffusion-webuiComfyUI: https://github.com/comfyanonymous/ComfyUIForge: https://github.com/lllyasviel/stable-diffusion-webui-forgeInvokeAI: https://github.com/invoke-ai/InvokeAISD.Next: https://github.com/vladmandic/automaticSwarmUI: https://github.com/mcmonkeyprojects/SwarmUI >Use a VAE if your images look washed outhttps://rentry.org/sdvae>Model Rankinghttps://imgsys.org/rankings>Models, LoRAs & traininghttps://civitai.comhttps://huggingface.cohttps://aitracker.arthttps://github.com/Nerogar/OneTrainerhttps://github.com/derrian-distro/LoRA_Easy_Training_Scripts>Fluxhttps://huggingface.co/spaces/black-forest-labs/FLUX.1-schnellhttps://comfyanonymous.github.io/ComfyUI_examples/flux>Pixart Sigma & Hunyuan DIThttps://huggingface.co/spaces/PixArt-alpha/PixArt-Sigmahttps://huggingface.co/spaces/Tencent-Hunyuan/HunyuanDiThttps://huggingface.co/comfyanonymous/hunyuan_dit_comfyuiNodes: https://github.com/city96/ComfyUI_ExtraModels>Index of guides and other toolshttps://rentry.org/sdg-linkhttps://rentry.org/rentrysd>GPU performancehttps://vladmandic.github.io/sd-extension-system-info/pages/benchmark.htmlhttps://docs.getgrist.com/3mjouqRSdkBY/sdperformance>Try online without registrationtxt2img: https://www.mage.spaceimg2img: https://huggingface.co/spaces/huggingface/diffuse-the-restsd3: https://huggingface.co/spaces/stabilityai/stable-diffusion-3-medium>Maintain thread qualityhttps://rentry.org/debo>Related boards>>>/h/hdg>>>/e/edg>>>/d/ddg>>>/b/degen>>>/vt/vtai>>>/aco/sdg>>>/trash/sdg
>>101911047https://huggingface.co/spaces/fancyfeast/joy-caption-pre-alpha/tree/main>git clone, create a new venv for it, activate venv, pip install the requirements then run the file and it will launch the gradio. For batching you will need to edit the file.
I wish purple witch would post in the containment thread so the schizo would stop spamming
>>101911094Thanks anon, it seems to use non local models so this needs to be adapted if that's even possible : CLIP_PATH = "google/siglip-so400m-patch14-384"VLM_PROMPT = "A descriptive caption for this image:\n"MODEL_PATH = "meta-llama/Meta-Llama-3.1-8B"
Blessed thread of frenship
Here's your Elle Fanning picture, saar bee bop be bop
Sooner
>>101911145now with lorai guess we can call this overCAKED
>>101911093Those times will never return. Make new memories, or transcend all attachment while you wait for death.
>>101911196
>using joy caption>it randomly cuts off mid sentence at the end of the paragraphuhhh
>>101911250/plap/
>>101911250its the underwear print that makes it for me
>>101911234>catiehttps://www.youtube.com/watch?v=out-etvwT8ABoxxy is an eternal archetype. The human who channeled her is irrelevant.
trying out using Anynode to have a basic prompt go through an LLM (gemini atm) to enhance/embelish the prompt so I can be lazy. Pretty cool desu, out of free tokenz for OpenAI tho. Gemini is hitting me with content filters a lot
>>101911250go back to /sdg/
>>101911260don't use that node it creates mustard gas
>>101911256
>>101911249it has a 300 token max output
>>101911289I like how you can begin with Taylor Swift at a political rally and end up generating /x/ boxxies four hours later.
>>101911310RIP
>>101911310it should be plenty for most images, stop giving it collagesbut I'm running it locally and can use whatever limit I want, it actually describes nudity and uses the correct pronouns so that's nice
noob here, i installed automatic1111 webui last year and it worked okay i have a shitty amd 8gb gpu but it did work okay somehow) but months ago i changed cpu (a cheap ryzen 5 , before i had fx 6300 lol) and mobo and now webui sometimes restarts the pc when generating pics. do u think it would help reinstalling the whole thing or the problem is somewhere else?
>>101911325Still not as good results as comfyui
>>101911286this is a different node from the compromised llm onehttps://github.com/lks-ai/anynode
>>101911347This happens to me when I do VR, too. I think I fried my GPU generating porn.
kek
>>101911183>>101911145
>>101911356i know im just being a goofy lil guy :3
>>101911347maybe check if things go out of memory with the task manager
>>101911384you silly goose
>>101911356Prompt?
>>101911345>uses the correct pronouns so that's nicehuh, does the local model work better at detecting whether the subject is male/female?unironically just had it spit out 'the figure is androgynous and it shows their bare chest'as if you couldn't discern sex from that bit
>>101904568so what, this model works both as a direct clip-l replacement and as long-clip?
>somebody has been generating busty nuns with horns for literal hours
>>101911411I used some Pony images and it did okay, changed the prompt for it to describe only sexual content and there were no refusals
>>101911397yeah it goes oftenly out of memory but it used to just crash or not generate anything, now it suddenly restarts everything. gpu temperature stays lower than when i play vidya so i don't think it's that
how the hell do I make flux generate something without a head, it's giving the thing a head or a helmet like 50% of the time even with the descriptor>he is headless, there is a small stump at the end of his neck instead of a headI guess that applies to diffusion models and general prompting as well, I'm a bit new to this stuff
>>101911262I can post in both threads
>>101911445Can you make it not look like a professional shot?
>>101911442>instead of a headthat doesn't work, it can't handle negatives at allenormous LLMs like GPT only started handling them reliably enough with GPT-4 so our little text encoders stand no chance
>>101911452sexo! goblin sexo!
>>101911442if dullahan doesn't work you have no chance.
So how much vram are the 50xx cards going to have?
>>101911442Deformities and missing limbs were impossible for me to gen. You might be able to fake it with something like "head out of frame" or "neck down"
>>1019114905090 rumored to have 28GB vram. Thankfully I don't have a reason to upgrade then.
>>10191149048gb minimum for the 5080/90
>>101911514>mfw develop cubital tunnel syndrome>stop playing videogames completely because of the pain>only joy in life comes from genningit's over
>>101910731Okay, so here goes Joy's attempt!>This is a digital illustration in a cartoon style featuring two anthropomorphic characters, a hedgehog and a blue hedgehog. The hedgehog on the left has a brown and cream-colored spiky back, large black eyes, and a small nose. It is holding a large, bright yellow sunflower with a dark brown center, and is smiling with a sense of joy and wonder. The hedgehog on the right is Sonic the Hedgehog, known for his blue fur, large green eyes, and white gloves. He is standing with a slightly surprised expression, looking at the sunflower. His shoes are red with white soles and he wears white gloves. The background is a simple, gradient yellow with small, glowing stars scattered throughout, creating a warm and magical atmosphere. The ground is a light brown with patches of green grass, adding to the natural setting. The overall mood of the image is friendly and whimsical, with a touch of magic and wonder. The textures are smooth and vibrant, typical of digital illustrations.Oh well...
anything new or notable in terms of controlnet?in the timeframe before flux i mean. especially for pony. (i've been on a break for a while)
>>101911531i don't know how you're all getting carpal tunnelmaybe it's all those wrists rests and titty mice and badly aligned tables and chairs
for anyone using the XLabs realism and the Topless lora beware they interact badly and make the image very fuzzy with some prompts
>>101911478I didn't even know that was a thing, neatthe model doesn't seem to understand it though
Anyone got a Kohya config file for low vram loras? Got 16gb
>>101911553yeah, it seems to have all semblance of violence, nudity, and sexuality removed from it, so little wonder it doesn't workyou may be boned.
>>101911548I played MORDHAU for 700 hours and I think that was the game that ultimately fucked me up
>>101911560Finetunes soon(TM)
>>101911558>16gb>low vram
>>101911586For training flux loras it is
Can you guys recreate something close to the classic boxxy image without using img2img? I tried and it seems Flux has very little understanding of a completely black background in a photo.
>>101911607that's shoe0nhead
>>101911615i think i know what boxxy looks like, anondon't compare her to that slut
>>101911615Hurry up and die
>>101911524There is no such nightly. But I will have my local build soon.
>>101911607
>>101911665What do you mean there is no such nightly? Just use it as index url or click on the link, it exist, just not public yet.
Fooocus
>>101911681
>>101911442Doesn't even work when you try genning the headless horseman. Pretty gay.
>>101911607>Low res Youtube screencap of a 20 year old woman her head is tilted slightly to the side, she has heavy eyeliner and a mid 2000s emo haircut, only her face is illuminated the background is completely dark
>>101911453DIY>myspace photograph grainy 1999 > an awkward normal young woman's low quality image on social media > so random XD jess omgg ur so EMO!! neon black t-shirt
>>101911679>>101911702nice one anons, my chatgpt prompt kinda sucked at getting it done right i guess
>>101911490Considering they're planning a "Titan AI" card, I'd venture a guess that the 5090 model will be somewhat cucked to 28GB of memory, to drive people towards the Titan. Then we'll have something like 48GB on the Titan that goes for $3000 and it's basically the only card that makes sense to buy if you want to upgrade or to buy a high end card for AI.That's my guess how this will play out.
>>101911706Owlle Fanning
>>101911722Now share the prompt you used for that pic
>>101911681Try to post a direct link to a rocm6.2 wheel. I'll wait.
>>101911722>>101911731lemme just share a catbox because it has some really silly non-standard settings from when I was messing around with nodeshttps://files.catbox.moe/4vq1hj.png
>>101911702>>101911679
>>101911781Ty based challengefag
>>101911795It's not doing the dark background
Should this fucking shit be out of memory all the time with 24gb? what the fuck. it out of memories the graphics card or it out of memories the 32gb ram. fucking shit
>>101911795>>101911813>1.5You'll likely have to adapt the prompt to a booru tag style
>>101911607Combining these two prompts >>101911679 (Me)>>101911702
>>101911837make sure you have the correct weight_dtype set
>>101911858with 24GB of VRAM he only needs to pin T5 to the CPU to avoid OOM
>>101911858Using forge right now. It out of memories whenever I load a LORA, even the nf4 one.
>>101911837>24GB vramlet
>>101911884this is not funny i did the right thing i did my research i bought the right graphics card only to get cucked
>>101911702Wife
>>101911722>mfw lowering the interpolate_phi on dynamic thresholding just makes miku progressively more retarded
>>101911945>>101911958Please share proompt
>>101911837I also have 24GB VRAM and 32GB RAM and never crashskill issue
>>101911702>20 year old woman>looks 35maybe next time don't specify white woman
>>101912014You're underage aren't you?
>>101912014this is what the average college girl looks like
>>101911693>>101911761https://hub.docker.com/r/rocm/pytorch
>>101911976Basically the same one I've kept using since last time but with Nihei Tsutomu replaced with Ayami Kojima.https://files.catbox.moe/gf1572.png
>>101911988reminds me of land of the lustrous
>>101912070Thanks, but I need gfx1010, which is never included by default.
>>101912097Holy shit I know this girl.
>>101912097gross
>>101912122dubs checked
>>101912080NTA, but thanks.are you enforcing a colour pallete by loading in an image with a high denoise like that?
>>101912080So it's img2img with very high denoise, you just use like a paper texture for the input or something?
>>101912065>the average college girl looks halfway to bogdanovyou can't fool me I went to college 10 years ago
>>101912170if you went to college 10 years ago then you should've seen girls like this everywhere lol
>>101912185bro I think you're just face-blindthis one's got wrinkles
>>101912185you must have some kind of autistic face blindness that causes some next level horror vision if thats what any girl looks like to you, what in the uncanny fuck
>>101912185>>101912197I went to college 15 years ago and a couple of the pics look like my gf back then.
>>101912197>>101912200to clarify: i live in bongland
>>101912222ohcarry on
>>101912168I use either solid colors, or random large blocks of color. This just gives me interesting gens sometimes.
>>101912231"Artists" and morons don't understand. AI makes you fucking dream when you see stuff like this. Directly downloaded from the astral planes and parallel universes.
Any lora that fixes the butt chins yet
>>101912222nevermind, it all makes sense now
>>101912222I'm so sorry
>>101912161Sometimes I do but it doesn't always work without changing the prompt, and you need to modify the prompt. For instance, this one used a neon green color as the base image I think. Without prompt modification, it's still mostly muted colors
>>101912260>parallel universesI like to think some of the stuff I gen is existing in parallel universes, books, characters, whatever.
>>101912299Take the schizo pill. Generative AI densifies thoughtforms by pulling them out of the quantum foam. Augment your low VRAM gens by the use of meditation and focused intent. Apply minimal thermal paste to your CPU for increased entropy.THE FUTURE IS NOW
>>101912310I'm serious. Look at this. This stuff stimulates creativity and fires up the imagination.This thing exists.
Kitta kitta!!
>>101911615holy shit you are horrible
And then I had this idea: I make FLUX draw each style in its own panel like in a comic, and then I make the characters join at the end so both styles are shown! Like this:>3 Panel comic. The top one contains children card illustration vintage style page scan of cute sunflower hedgehog at the park. kindergarden eyes. The middle one depicts Sonic the hedgehog. The bottom one has both of them sit with each other, and she offers the flower to Sonic.Except it didn't work...Man, FLUX looks waaaaayyy smarter when other people use it...
>>101912310>>101912359it's pretty cool that all this can come from nothing
>>101912448See, the really cool thing is that it does not come "from nothing". It comes from a large part of our culture, which is encoded in these models. In a way, it comes from the physicalized, form of our collective unconscious. Statistically manifested.
>>101912231How did you prompt that?
>>101912253Oh like this one I just got.
>>101912448pretty nice, is that GPT-4o?
>>101912379
>>101912490This image is a photograph of a vintage paperback book cover titled "Robotic future" by 4CHAN Press. The cover art features a surrealistic illustration of a robot with a human-like face and long, flowing, golden-brown hair. The robot's face has a blank, expressionless look, and it is wearing a red robe with a pattern of intricate, dark designs.The background of the cover is a stylized depiction of a building with turrets and a large, domed structure reminiscent of the U.S. Capitol Building. The building is rendered in muted tones of brown, gray, and beige, giving it an aged, historical feel. The sky above the building is a deep blue, and the horizon is slightly hazy, suggesting a dreamlike or fantastical setting.The title of the book is prominently displayed in bold, green text at the top of the cover, while the author's name and publication number are listed in smaller, green text in the upper right corner. The cover has a slightly worn and aged appearance, with visible creases and a slightly yellowed hue, typical of vintage paperback covers.
>>101912418nice
>>101912310>>101912231These gens made me think of Children of the Whales and Gargantia on the Verdurous Planet for some reason.
>>101912594Thanks, FLUX really rules at things like that!
>>101912657Yeah it's astonishingly good.I give random idea to an LLM, it fluffs it for me, then I give the fluff to Flux, which outputs amazing results.Too bad it's shit at poses and nsfw, it would the perfect model.
So, which quant should I use now? I am currently using fp8 (have 12GB of vram)
HOLY SHITIt's schnell q4_0 at 512x512, and it took 3 minutes, but I'm running Flux on an AMD RX 5700 XT with locally built torch and torchvision using rocm 6.2, which means I can run accelerated textgen with the same libraries and not have to rely on weird hacks anymore.It's probably useless and I will go back to SD 1.5, but I'm so fucking happy. I thought this would be impossible.
>>101912688Q1_0
>>1019126950_0
>>101912694congrats anon!
>>101912694Good job!
>>101912708uwu
>>101912694You know that you could have just built it with patch or use a distro packages that build with those. But, it's nice they finally fixed it upstream.
>>101912688QQ
where the fuck do you put the vae in forge
>>101912694very nice
>>101912750The vae folder
>>101912750youre probably in the right directory but rename it .safetensor instead of .sft
>>101912750the square hole
It keeps on trying to merge multiple jets into one, but a few are singular.
>>101912769.safetensors with an s i mean
>>101912750https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/1050
>>101912694Just gen at 1024x1024 and depict 4 panels and what is in them, whatever time it takes it's 1/4 of it.
>>101912777>>101912831very gay
>>101912777>>101912831very chiny
Im going to hunt down that anon from last thread who insulted me for wanting to get a workflow which he referred to as "childplay".I have a couple of words for him.
>>101912861>>101912868shut up chud!
>>101912942Are you ever going to post your workflow?
>>101912949You are not entitled to a catbox
>>101912949Are you asking specifically about the 3D conversion?
>>101913037Yeah. The results seem pretty decent. Better than what I've seen in the past.
>>101912222Oh yeah, that makes senseI thought the first girl looked like Lauren Mayberry
The day flux can make pron, I can feel it!
>>101913072Talk to you in 2025
>>101913060I use iw3 with pic related settings:https://github.com/nagadomi/nunif
>>101911066lust provoking image it up
>>101913112>I want to watch any 2D video as 3D video on my VR device, so I developed this very personal tool.>iw3 provides the ability to convert any 2D image/video into side-by-side 3D image/video.Oh cool. Man I can't wait to try all these nifty things after the Valve Deckard comes out. It's going to be great.Thanks.
>>101913137
>>101912996Looks like a legit screenshot, what was the prompt?
>>101913154
flux won
Flux GGUF 4_1 and 5_1 got added (also they improved the 8.0)
>>101913144It really is neato.
>>101913205Sauce?
Oh fug I missed a whole ass thread while I was asleep, that doesn't normally happen. I guess we back
>>101913247https://github.com/city96/ComfyUI-GGUF/commit/88fb6fa0014850615ca5b3e0ec1c018f67319237>Use FP32 to do the calculations while dequantizing to improve existing Q8_0 quants and to avoid double dtype conversion.>Add Q4_1 and Q5_1 dequant kernelsCan find Q4_1 and Q5_1 quant on the same HF repo.
>>101913172"a still frame from a 90s anime tv show of a girl screaming captioned in the bottom "my love has died""
>>101913200Where's her other leg?
>>101912844>just gen at 1024x1024Any side being above 512 is out of the question right now. Both forge and comfy (yes, I moved clip and vae to cpu) run out of memory if you look them sideways.Can anybody share memory optimization tricks for forge? I'm working with 8 GB here.
>>101912776it's not bad. got the rafale's fuel probe but the lines are mostly right.
>>1019133521 minute 30 second gens with this setup, 8gb vram
>>101913261Seems like the Q8_0 is the same
>>101913413Mine looks the same except I'm using schnell so that I only do 4 steps. But with the dimensions you're using, I'm guaranteed to OOM. Do you have anything else behind the scenes?
>>101913439Mmmmm, Olives
>>101913448nice
Erm am I supposed to believe that a computer made all this
>>101913428not that i know of.fresh install of forge today though.
guys i have an urgent question about forge, everything is working buthow do i put it in dark mode???
I'm gonna kill myself by the time I'm done captioning this dataset with joycaptionI think I'm half way to becoming a purple prose loving fantasy author with the amount of shit I've had to correct
>>101913535--theme=dark
>>101913557British people eat this btw
Mmh... Forge is idiotically slow even on SD. sdwebui isn't like this.
>>101913565Seuss was american, it's green ham
>>101913535settings --> user interface --> gradio theme drop down menu --> pick one --> apply changes --> reload ui
>>101913500I drew it all.
>>101913413lol this prompt is great. Love how well it captures the novel look
>>101913565Russians definitely eat this. Picrel is хoлoдeц
>>101913565It's basically aspic.
>>101913637picrel
Finally managed to coax flux into making a saint seiya armor. It REALLY wanted to make an anime picture, but halfway through it changed course and went for realism. Still not there yet.
I can't try myself since I'm still downloading those models, is it possible to merge those gguf models in Comfy? I want to make schizo merge gguf model if you ask
>>101913747Almost a Moebius feel.
>>101913751why
>>101913500Have you gone to this link?:https://huggingface.co/spaces/gokaygokay/FLUX.1-dev-with-CaptionerUploaded a picture and hit generate image?And gotten an image?If so, what's your theory about from where it came from?
Helloooo, still using Forge from February, anything new in speed or efficiency?Also, if you're using a Pony-based model (or SDXL, I don't really know about this whole Flux thing or w/e or whether it does best doki), what're yer gee pee yuu and how does it work for you?Been thinking of getting a used 2070 with 8GB or 3060 with 12GB (3060 because I have one, thus I know how it performs) so I can hook it up to my homeserver and share it over interwebz with a poor lad using a tater tot and mf Bing, so I wanna know how the 20-series performs but I don't really know where to find those stats
>>101913782The cloud
>>101913829uuuhhh krill yourself?
another "messing with all the options because i don't know what they do" gen before i go to bed
>>101913747prompt pls
>>101913829Go for 3xxx and 4xxx with at least 12GB of VRAM or better, 16+.
>>101913870"acoustic painter having a spasm"
>>101913555lol>>101913593thanks and wow thats a lot of themes
>>101913635i'm enjoying all the fun ways it's failing to render "retarded"
>>101913886it was pruned right
>>101913886It seems quite easy to find the words it never trained on or avoided.
>>101913878Didn't seem to work for me
>>101913902you are such a n-word individual
This image took 4 minutes.
>>101913912thanks i saved it, to my pc
>>101913854You mean like, eat 10 kilos of krill?>>101913873so, I should hunt for a 3060 then?Why, exactly? I'm not gonna let the dude load 2 gorillion loras, and unless told otherwise I'm gonna open up a Forge checkpoint which should run fineAnything higher is so piss bloody expensive in this retarded country market and not worth it even if I used the supposedly superior card to replace my current 3060 in my daily driver
>>101913912And it looks like that because I used negative which you're not supposed to do on flux?>>101913923You owe me a million dollars
>>101913894>>101913893this one works though
How in the actual ever loving fuck do you use Joy Caption locally? Huggingface's gpu limits are dicks and buying pro doesn't fix them..
Open release of NAI v3 in 10 days kek
>>101913923"No, help yourself. 3600 a bottle. Please enjoy it"
>>101913958I'm running it and I'm retarded so I don't know
>>101913932seeing on nvidias site that there's a 12gb 2060 but I doubt I'll be able to find it for any decent price
>>101913959>5 days
>>101913932>Why, exactlyOptions, it's the better cards for generation, well supported and working well by almost all tools and models with no fuss or endless tinkering.
>>101913989wait, what, why?
>>101913870I can't post it because I'm embarassed
>>101914002alr fairI'll take a look at getting a 3060 then. Anything more (expensive), and it'd be better to swap it with my daily driver's 3060, and it's not really worth it anyway since I'm already going to be spending the rough equivalent on a better chair.
1970s illustration by Ralph Bakshi of a large urban area with tall fantasy buildings, outside of the city are tiny houses and rivers and streams.
>>101913958I tried to make it work but utterly failed, I'll just wait for it to come out of pre-alpha, maybe someone will write an installation guide for complete retards by then.
>>101913934>negative which you're not supposed to do on flux?lol you're not? been using it this whole time, no wonder it didn' seem to do anything.
>>101914131I didn't use that prompt
>try to load some random ass lora on flux>gen speed drops insanely quickly??? -1 i guess
>>101914209Probably filled your VRAM to 99.999%
>>101914216quite
Looks like you should put distilled CFG scale pretty low if you want to get styles like pencil/oil painting etc. because having it at the typical 3 or so will make the model prefer well defined images over stylistic output and throw all your fine art styles in the trash. However putting it too low might make the image poorly defined so that's when you can raise the regular CFG a little to both preserve rougher styles while making them more defined.Probably common knowledge but I just figured this shit out now and feel dumb because I was living with the mindset of higher number = adheres to prompt better.
>>101911881How come I never run out of memory? I thought it must just use ram or something, I only have 8gb.
and with some low cfg so i can add neg prompt lol it takes 2 years to gen
>>101914459NTA, but I can confirm fucky things happen when I load LoRAs on comfy too. No idea why either, sometimes it ooms, others it doesnt
Come and get it...>>101914501>>101914501>>101914501
>>101911352nice
>>101914272>>101914317>landscape modenigger i had to zoom that shit down to 6% to see itcan't nobody cross their eyes that much
