[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip / qa] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: fp073.jpg (367 KB, 1024x1024)
367 KB
367 KB JPG
Discussion of free and open source text-to-image models

Previous /ldg/ bread : >>101857264

>Beginner UI
EasyDiffusion: https://easydiffusion.github.io
Fooocus: https://github.com/lllyasviel/fooocus
Metastable: https://metastable.studio

>Advanced UI
Automatic1111: https://github.com/automatic1111/stable-diffusion-webui
ComfyUI: https://github.com/comfyanonymous/ComfyUI
Forge: https://github.com/lllyasviel/stable-diffusion-webui-forge
InvokeAI: https://github.com/invoke-ai/InvokeAI
SD.Next: https://github.com/vladmandic/automatic
SwarmUI: https://github.com/mcmonkeyprojects/SwarmUI

>Use a VAE if your images look washed out
https://rentry.org/sdvae

>Model Ranking
https://imgsys.org/rankings

>Models, LoRAs & training
https://civitai.com
https://huggingface.co
https://aitracker.art
https://github.com/Nerogar/OneTrainer
https://github.com/derrian-distro/LoRA_Easy_Training_Scripts

>Flux
https://huggingface.co/spaces/black-forest-labs/FLUX.1-schnell
https://comfyanonymous.github.io/ComfyUI_examples/flux

>Pixart Sigma & Hunyuan DIT
https://huggingface.co/spaces/PixArt-alpha/PixArt-Sigma
https://huggingface.co/spaces/Tencent-Hunyuan/HunyuanDiT
https://huggingface.co/comfyanonymous/hunyuan_dit_comfyui
Nodes: https://github.com/city96/ComfyUI_ExtraModels

>Index of guides and other tools
https://rentry.org/sdg-link
https://rentry.org/rentrysd

>GPU performance
https://vladmandic.github.io/sd-extension-system-info/pages/benchmark.html
https://docs.getgrist.com/3mjouqRSdkBY/sdperformance

>Try online without registration
txt2img: https://www.mage.space
img2img: https://huggingface.co/spaces/huggingface/diffuse-the-rest
sd3: https://huggingface.co/spaces/stabilityai/stable-diffusion-3-medium

>Related boards
>>>/h/hdg
>>>/e/edg
>>>/d/ddg
>>>/b/degen
>>>/vt/vtai
>>>/aco/sdg
>>>/trash/sdg
>>
File: delux_flebo_00070_.png (1.45 MB, 1216x832)
1.45 MB
1.45 MB PNG
>mfw
>>
>/sdg/ is completely dead
And that's a good thing
>>
File: ComfyUI_01462_.png (1.16 MB, 1024x1024)
1.16 MB
1.16 MB PNG
>>101861834
>/sdg/ is completely dead
based, long live /ldg/
>>
File: 00059-3047152229.png (2.97 MB, 1280x1920)
2.97 MB
2.97 MB PNG
>>101861882
long live /ldg/
>>
File: FuckNhentaiAndItsPurge.jpg (139 KB, 715x446)
139 KB
139 KB JPG
>>101861881
Found the artist, Tachibana Omina
>>
>>
>>101861991
w-what is she referring to, anon?
>>
can flux do nsfw
>>
File: ComfyUI_01497_.jpg (925 KB, 1728x1344)
925 KB
925 KB JPG
ah shit posted my gen in the old thread
>>
>>101862100
No
>>
>>101862108
>left : earth in 2024
>right : earth in 2030
t. climate "scientist"
>>
File: asa006.jpg (213 KB, 901x900)
213 KB
213 KB JPG
>tfw classmates, teachers and people around the world have tons of my deepfakes
>>
>>
File: 00064-3823948623.png (2.9 MB, 1280x1920)
2.9 MB
2.9 MB PNG
>>
File: ComfyUI_00016_.png (1.03 MB, 1024x1024)
1.03 MB
1.03 MB PNG
As someone who has a waifu Dalle 3 kept making into 2B on half my gens there, I'm actually thankful in this case that this model is not overcooked on 2B. Not every girl with white bob cut hair and hair covering one eye is 2B, but Dalle thinks differently half the time. Only issue though is that Flux doesn't have a good vocabulary for exact hair sub-types so I can't get the hair style to be perfectly accurate, and thus I stopped genning. Maybe I'll cook a lora one day.
>>
>As someone who has a waifu
>Not every girl with white bob cut hair and hair covering one eye is 2B

Are we talking about an OC, or an existing character?
>>
File: ComfyUI_01503_.jpg (820 KB, 1344x1728)
820 KB
820 KB JPG
>>
File: 00065-2323014198.png (3.06 MB, 1280x1920)
3.06 MB
3.06 MB PNG
>>
>>
File: ComfyUI_01433_.png (1.47 MB, 1024x1024)
1.47 MB
1.47 MB PNG
>>101862193
do you also rage at 3DPD that cosplay as 2B cuz they arent from the game and their costume isnt 1:1?
>>
File: ComfyUI_01507_.jpg (759 KB, 1344x1728)
759 KB
759 KB JPG
>>
File: fs_0374.jpg (44 KB, 1152x792)
44 KB
44 KB JPG
>>
Installing flux nf4 on my work laptop with a 4060. What are the chances it works?
>>
File: ComfyUI_01513_.jpg (916 KB, 1344x1728)
916 KB
916 KB JPG
>>
>>
File: ComfyUI_01516_.png (3.73 MB, 1344x1728)
3.73 MB
3.73 MB PNG
>>
>>101862511
Damn nice.
>>
File: ComfyUI_01522_.png (1.89 MB, 896x1152)
1.89 MB
1.89 MB PNG
>>
File: ComfyUI_00286_.png (3.07 MB, 1248x1664)
3.07 MB
3.07 MB PNG
>>
File: Capture.jpg (417 KB, 2982x1538)
417 KB
417 KB JPG
Holy shit, maybe we can recreate the Kino from DynamicThreshold + CFG 6 + GuidanceNeg 10 with this one:

ToneMap + CFG 10 + multiplier 0.3 (still not optimal though)
https://imgsli.com/Mjg3MDgx
https://files.catbox.moe/1d2u6o.png
>>
>>101862193
Well, I think of her as an OC, but her visual design is mostly inspired by and close to an existing character (looks like Hamakaze from Kancolle but not exactly in certain aspects). Flux also doesn't know that character though. It also doesn't know Mashu which would be the next closest character, though her hair cut is yet more subtly a bit off from what I want.
>>
>>101861834
>Guys you're ruining this thread with your overt avatar fagging and off topic personal life discussions. It's extremely off putting to everyone coming into these threads who isn't in your weird clique.
>"Teehee this is an image generation thread and I am generating images and there's nothing you can do."

I'm glad to see the thread dying. They won't even notice the threads have died though. They'll just post quokkas and purple witches and talk about their gender reassignment surgery oblivious that they're completely alone.
>>
File: fs_0392.jpg (63 KB, 768x768)
63 KB
63 KB JPG
>>
File: Flux_00020_.png (1.39 MB, 1024x1024)
1.39 MB
1.39 MB PNG
>>101862688
wood
>>
File: ComfyUI_00289_.png (3.33 MB, 1536x1376)
3.33 MB
3.33 MB PNG
>>
File: fs_0396.jpg (106 KB, 768x768)
106 KB
106 KB JPG
>>
Not avatarfagging btw. Just seeing how much IP can be found with very specific prompting. This is the last Bulma.
>>
>>101862754
very cool picture
>>
File: fs_0406.jpg (224 KB, 1280x1280)
224 KB
224 KB JPG
>>
File: ComfyUI_01537_.jpg (835 KB, 1248x1824)
835 KB
835 KB JPG
goodnight /ldg/
>>
File: ComfyUI_00293_.png (924 KB, 1024x1024)
924 KB
924 KB PNG
>>
File: syxiox1tdbid1.jpg (214 KB, 1080x738)
214 KB
214 KB JPG
https://new.reddit.com/r/StableDiffusion/comments/1eqs7sq/some_fun_90s_anime_style_gens_flux_anime_lora/
Don't sleep on this lora, it can create amazing anime style pictures:

Workflow: https://files.catbox.moe/svkcy0.png
Civitai: https://civitai.com/models/640247/mjanimefluxlora?modelVersionId=716064
>>
File: ComfyUI_00297_.png (1.63 MB, 1024x1024)
1.63 MB
1.63 MB PNG
>>
>>101862769
I say that and ofc I get a pretty good one. Prompt is:
> Identify the illustration depicting the woman whose appearance and likeness most clearly and convincingly mirrors the characteristics and features of Bulma from the anime series Dragon Ball Z.

Wonder if this works for other anime.
>>
File: ComfyUI_00299_.png (1.67 MB, 1024x1024)
1.67 MB
1.67 MB PNG
>>
File: 00105-2024-08-12-cJak.png (1.74 MB, 1024x1344)
1.74 MB
1.74 MB PNG
>>
File: fs_0414.jpg (141 KB, 1024x1024)
141 KB
141 KB JPG
>>
File: ComfyUI_00306_.png (1.75 MB, 1024x1024)
1.75 MB
1.75 MB PNG
>>
What are the options for non-censored? Still only SD1.5?
>>
File: ComfyUI_00040_.png (796 KB, 832x1216)
796 KB
796 KB PNG
>>
>>101863049
Pony/pdxl would be the other major one.
>>
>>101863049
SDXL is way beyond SD 1.5 at this point, especially Pony

Only reason to use SD 1.5 is if you have a potato PC and for some reason can't run SDXL
>>
File: ComfyUI_00310_.png (1.77 MB, 1152x896)
1.77 MB
1.77 MB PNG
>>
File: fs_0444.jpg (132 KB, 1024x1024)
132 KB
132 KB JPG
>>
Is there someone who announced that he'll make a finetune out of flux yet?
>>
>>101863127
Multiple. They're all shit smalltime stuff though.
>>
>>101863138
can you give me some links? like they posted that announcment on twitter or something?
>>
File: ComfyUI_00312_.png (3.31 MB, 1664x1152)
3.31 MB
3.31 MB PNG
>>
>>101862702
How do you get this style?
>>
File: fs_0488.jpg (133 KB, 1024x1024)
133 KB
133 KB JPG
>>
>>101863143
Literal whos on reddit. I don't care enough to even look them up.
>>
>>101863361
>tumor nipples
>>
>>101863372
Actually it ass is in place of pussy .
>>
File: ComfyUI_00052_.png (1.12 MB, 832x1216)
1.12 MB
1.12 MB PNG
>>
File: ComfyUI_01078_.png (900 KB, 1024x1024)
900 KB
900 KB PNG
why thread suddenly so slow?
>>
>>101863507
I opened it :(
>>
>>101863507
hype cooled down, it happens with every new ai tool
>>
File: ComfyUI_00055_.png (1.22 MB, 832x1216)
1.22 MB
1.22 MB PNG
>>101863507
bedtime for americans
>>
Oh yeah baby fluxing shit up on my laptop
>>
File: FD_00013_.png (396 KB, 512x512)
396 KB
396 KB PNG
>>101863616
First non-test gen. Needs work
>>
https://reddit.com/r/StableDiffusion/comments/1eq98ca/euler_cfg_actually_works_on_flux/
What? I didn't know you could use the cfg++ samplers on flux? Everytime I tried euler_cfg_pp got some completely fucked up outputs
>>
File: flux1-schizo-merge_00012_.jpg (761 KB, 1024x1024)
761 KB
761 KB JPG
>>
>>101862368
should work fine desu
>>
>>101863707
It does indeed work fine. Genning on the train ride home
>>
>>101863080
>>101863078
13700k/RTX4080.

Last time I used SDXL it was alright. I did 4k+ with SD1.5, and using tricks to start with a higher res gen helped hands and some features.. still limited but I loved DareLites Fantasy Mix.

SDXL I found more limiting.. I guess too much stuff removed, it knew of some things better but worse in other areas. Has SDXL been 'fixed' by third party models now?

Is Flux1 uncensored, or at least doesn't have as much training data removed?

SD3 also cucked?
>>
>>101863765
From my light lurking
SD3 is the most cucked model to date
Flux can do ass and titty and vagoo, but I hear peen needs some work.
>>
>>101863805
>Flux can do ass and titty and vagoo
It really can't though, besides erotic stuff where everything is covered
>>
>>101863820
I've literally seen it do perfect pussy lips idk what to tell you anon
>>
>>101863805
>titty and vagoo, but I hear peen needs some work.
It's the opposite.
>>
>>101863831
>>101863829
>>
File: Capture.jpg (251 KB, 3049x1372)
251 KB
251 KB JPG
When I try to load this lora I got a OOM error,
https://civitai.com/models/640247/mjanimefluxlora?modelVersionId=716064
what the fuck? I have a 24gb vram card and without a lora it's usually at 13gb, why does it ask for so much?
>>
>>101863507
it's snore o'clock, back to shleep until the next big thing.
>>
File: ComfyUI_00064_.png (1.28 MB, 832x1216)
1.28 MB
1.28 MB PNG
>>
File: delux_cf_00047_.png.png (856 KB, 1024x1024)
856 KB
856 KB PNG
>>
>>101863639
I'm not a big fan of euler cfg++, this shit makes things blurry for no reason
https://imgsli.com/Mjg3MDk5
>>
File: ComfyUI_00056_.png (3.77 MB, 1920x1080)
3.77 MB
3.77 MB PNG
>>
File: fs_0104.jpg (83 KB, 768x768)
83 KB
83 KB JPG
>>
File: ComfyUI_10601_.png (2.35 MB, 1080x1280)
2.35 MB
2.35 MB PNG
>>
>>101863852
bro same, keep getting OOM with using one GPU when adding the Lora.
I have 48GB in total and I'm currently trying to use the second GPU too but Comfy is a bitch when it comes to that
>>
>>101864032
For sure
>>
File: ComfyUI_10602_.png (2.13 MB, 1080x1280)
2.13 MB
2.13 MB PNG
>>
>>101864264
It's weird for me too. It will oom on one generation, I'll stop and try again and it won't oom on the next. I don't know why.

I actually think it might be a bug.
>>
File: fs_0140.jpg (105 KB, 1280x768)
105 KB
105 KB JPG
>>
>>101864329
After yesterday's update I get a guaranteed OOM on the first run, but all the following ones work just fine.
>>
File: ComfyUI_10605_.png (1.9 MB, 1080x1280)
1.9 MB
1.9 MB PNG
>>
>>101864343
>>101864329
maybe because of that commit?
https://github.com/comfyanonymous/ComfyUI/commit/517f4a94e4a5c45edc64594d70585ec8aeb787e0
>>
https://xcancel.com/Lykon4072/status/1823094103862558893#m
>Oh wow look at me, SD3.1 can do women lying on grass now, please hype for us!!
>>
>>101864591
>add "lying on stomach" to the prompt
>cthulhu is summoned
>>
>>101864591
SAI is still acting as if they have the monopoly and that basic shit like lying a girl on grass should be celebrated, uhhh were they in a coma those last few days, we have flux now, they are done
>>
>>101863765
>>101863805
Don't listen to this guy: if you want NSFW, use sdxl with any one of a thousand "pony" models. Flux cannot do NSFW at all reliably and is most likely intrinsically censored. Maybe not as bad as SD3, but it's not the tool to use if you want to generate anything involving women without clothes on. This may change eventually but it's not true now. Also, flux has no concept of artist style that can be invoked at all reliably either. It is really not very good except as a novelty. But novelty can be fun in its own right. Depends on what you're after.
>>
>>101864591
>hands out of frame
>>
when will we get local Dark Rey feet gens bros?
>>
File: 2hues.jpg (68 KB, 1024x1024)
68 KB
68 KB JPG
>>101864802
flux is good for shitposting and realism right now. also stylized text
>>
How the fuck are people shitting out such good looking Flux LoRAs? Is it experience gained from SD or is Flux just that good to train on?
>>
>>101864871
is it difficult to train LoRas for Flux?
I have a 4090 is that enough to do it?
and how long does it take?
>>
>>101864871
If the base model is good it most likely already knows the concepts you are trying to teach it. You only need a little bit of training to bring it out. Even a textual embedding would probably give decent results for most styles.
>>
File: file.png (1.81 MB, 2508x564)
1.81 MB
1.81 MB PNG
>>101864864
I love these slightly changed prompts
>>
>>101864871
if you're talking about celeb loras, its because flux already kinda knows the celeb so it doesn't need much to learn what to do
artist style loras are still shit from what ive heard and seen
>>
>>101864889
A 4090 is apparently enough, this guy did it on a single 4090.
https://civitai.com/models/638000/arnold-schwarzenegger-1990s-flux-lora
>>
>>101863648
>take a perfectly good base model
>turn it into deep fried 1.5 slop
kill yourself
>>
>>101864927
so 1500 steps for a LoRa?
>>
>>101864938
Sometimes I wonder if people's monitor color calibration settings are incorrect. I think most are, their gamma and contrast and all that shit is fucked up which betrays their eyes.
>>
>>101864946
Loss graph tells you how many steps
>>
>>101864938
this
>>
>>101864917
Doesn't really explain why it has no easily accessible concept of stuff like "Impressionism" to begin with. The loss of generic style terms seems like a pure regression.
>>
>>101865102
Try the german translation of those styles
>>
>>101863805
>>101863820
>erotic
>covered
That doesn't sound too bad
I don't want photoreal or semi photoreal stuff like yhe ones posted in this thread, I like the 3dish stuff but not 3d stuff I got from darelites fantasy mix and anime style. Ir worked extremely well
>>
>>101865102
Simple, because the VLM that tagged all the images didn't know "impressionism" it just knew "a painting of"
>>
>>101864999
where can I read more about that?
>>
>>101863829
Base Flux? No, I don't believe you. catbox it right now
>>
>>101865187
I even used Kraut quotes around „Impressionismus”. It is a little better, yeah. Might be onto something kek.

>>101865199
Should have just used ChatGPT.
>>
File: ComfyUI_00060_.png (3.17 MB, 1920x1080)
3.17 MB
3.17 MB PNG
Flux makes some cool wallpapers but damn this shit takes long

>picrel with 33 steps on a 4090 takes about 8 minutes
>>
>>101865348
>33 steps on a 4090 takes about 8 minutes
nigga what are you doing
>>
>>101865348
User error
>>
>>101865360
what do you mean?
>>101865384
elaborate
>>
>>101865389
nigga a 4090 should generate that in ~30 seconds
>>
File: Merge.jpg (3.18 MB, 3500x3342)
3.18 MB
3.18 MB JPG
20 steps doesn't give consistent quality, 30 seems to be the sweet spot
>>
File: fluxremilia.png (3.17 MB, 2048x1536)
3.17 MB
3.17 MB PNG
>>
>>101865404
30 steps kills diversity, 20 steps seems to be the sweet spot
>>
File: questions.png (58 KB, 764x536)
58 KB
58 KB PNG
what is the difference between /ldg/ and /sdg/
>>
>>101865435
one is for diffusion models talk, the other is for diffusion models created by StabilityAI talk
>>
>>101865435
/ldg/ is the based thread
/sdg/ is the tranny containment thread
>>
>>101865416
yeah it's also true, less diversity but more consistency though, especially on text
>>
>>101865416
that's not good diversity, it is diverse because it's not converging enough and can have horrible lows, at least at 30+ steps you know the gen you're getting isn't a lucky gen, you know that if you touch other seeds you'll get the same quality
>>
>>101865454
all diversity is good, chud
>>
File: ComfyUI_00062_.png (2.81 MB, 1920x1080)
2.81 MB
2.81 MB PNG
>>101865398
1920x1080 ? no way.
it does work faster if I use Euler instead of Heun tho.
>>
>>101865495
>1920x1080 ? no way
way
Heun does twice the steps, are you telling that that image took you 4 minutes?
A 4090 should do it in 30 seconds. It does a 1024x1024 image in ~15 seconds
>>
is it possible to train loras for FLUX with 16gb vram?
>>
File: fluxRemilia2.png (2.35 MB, 1792x1408)
2.35 MB
2.35 MB PNG
>>101865518
fp8 takes 23gb for now. Currently grim for 16gb cards.
>>
>>101865303
It knows who van Gogh is, it just can't copy him.
>>
>>101865517
this one >>101865495 took about 3 and a half minutes.
>A 4090 should do it in 30 seconds.
might depend on the workflow tho, I noticed some workflows take longer for some reason.
>>
>>101865435
/sdg/ is for schizos and avatarniggers
/ldg/ is for frens
>>
>>101865542
just post the catbox so we can point and laugh at stupid shit you did to make a 4090 take longer to generate an image than a 1060
>>
>>101865533
>fp8 takes 23gb for now.
if you put the text encoder to the cpu it's only 12gb for the vram, and it's still fast
>>
>>101865563
https://files.catbox.moe/k0x9a7.png
>>
>>101865538
>>
>>101865554
fr?
>>
>>101865599
I hate how 32GB ram is barely enough. Can't have anything else open.
>>
File: MarkuryFLUX_00328_.png (2.26 MB, 1792x1536)
2.26 MB
2.26 MB PNG
>>101865599
Pretty sure Simpletuner purges the T5 before training starts. "2024-08-12 00:08:20,290 [INFO] (__main__) After nuking text encoders from orbit, we freed 9.11 GB of VRAM. The real memories were the friends we trained a model on along the way."
>>
>>101865653
it's not barely enough, ComfyUI isn't using it optimally
>>
>>101865653
ram is cheap, buy some more my nigga, I'm at 56gb and I'm feeling good
>>
File: file.png (2.48 MB, 1024x1024)
2.48 MB
2.48 MB PNG
>>
>>101865605
CFG with Flux Dev is a meme
>>
>>101865710
not a meme at all, you're delusional
https://imgsli.com/Mjg1Nzk5
https://imgsli.com/Mjg1ODI5
>>
>>101865710
>>101865731
so what did I do wrong??
>>
>>101865745
ok let me look at your workflow, did you add any flags into your .bat?
>>
>>101865745
how fast is it with CFG=1.0?
>>
>>101865724
its just a bunch of schizo stuff jumbled together to confuse the models into generating weirdness.
https://files.catbox.moe/w840mz.png
where it says "painting of" you can make it a painting of whatever, not just a cabin.
>>
File: Capture.jpg (266 KB, 2793x1640)
266 KB
266 KB JPG
>>101865745
do you only have 1 gpu? if that's the case you can already remove the Force/Set CLIP and VAE device
>>
File: mag?.jpg (87 KB, 1024x1536)
87 KB
87 KB JPG
>>101865768
>its just a bunch of schizo stuff jumbled together to confuse the models into generating weirdness.
damn, i thought you found a way to get a consistent art style with flux. oh well
>>
>>101865745
your image, the one using Heun, takes 10 minutes on my 4060, a 4090 should be close to four times faster
>>
File: FLUX_00043_.png (1.55 MB, 1152x896)
1.55 MB
1.55 MB PNG
>>
Why can't ComfyUI load the unet straight to the GPU? It loads fully into RAM first and only goes to the GPU when the sampler node runs so it's just there with T5 on the first gen slowing things down.
>>
File: 1707439893137705.png (204 KB, 1043x259)
204 KB
204 KB PNG
i keep getting this error message when running ImageSegmentation in ComfyUI. i realize it has something to do with TensorRT but i am unsure what that is exactly or how to fix it. Researching the problem led me to some reddit posts but they seem to be too old and just give me errors saying the versions im trying to install dont exist.
>>
>>101865869
I think that's just how computers work anon
>>
File: 1723542399212795.jpg (1.55 MB, 3024x1728)
1.55 MB
1.55 MB JPG
need more like
>>
File: FLUX_00045_.png (1.33 MB, 1152x896)
1.33 MB
1.33 MB PNG
I was expecting more of a silhouette, like seeing jesus in a tortilla
how do I say that
>>
>>101865869
yeah I don't know either that's weird, if that can help you can use this script to force the model to only be on your gpu with OverrideMODELDevice
https://reddit.com/r/StableDiffusion/comments/1el79h3/flux_can_be_run_on_a_multigpu_configuration/
>>
>>101865926
holy shit that looks beautiful, how did you make that style anon?
>>
>>101865915
no, anon, it's not
>>101865943
I use it, works fine to pin T5 to the CPU but using it to move the unet to the GPU early creates issues with Lora loading and probably other memory management issues too since it's a little hacky
>>
>>101865938
first 20% of steps: black SVG icon of trump on yellow circle with orange outline, seen at angle
rest of steps: vague likeness of trump visible in slightly charred pepperoni pizza
>>
>>101865938
ask bing or claude to make a boomer prompt so that the model understands better, or go for CFG 6 + GuidanceNeg, that helps aswell
>>
>>101865877
You on windows or linux
>>
>>101865975
linux
>>
>>101865967
>but using it to move the unet to the GPU early creates issues with Lora loading and probably other memory management issues too since it's a little hacky
Now that you say that... I had no problem with loras with this Override stuff, but after I updated yesterday, everytime I load a Lora I OOM yeah
>>
>>101865981
What distro
>>
>>101865988
fedora
>>
File: Merge.jpg (3.76 MB, 3325x3646)
3.76 MB
3.76 MB JPG
>>101865404
25 steps seems really good, you get diversity and the text is good aswell
>>
>>101865951
it's lost to time, it's from 2 Halloweens ago
>>
>>101865996
Do you have
mlocate
installed? If not, install it, run
sudo updatedb
and run locate libnvinfer and see if anything shows up
>>
>>101866016
>/.local/lib/python3.12/site-packages/tensorrt_libs/libnvinfer.so.10
>/.local/lib/python3.12/site-packages/tensorrt_libs/libnvinfer_builder_resource.so.10.0.1
>/.local/lib/python3.12/site-packages/tensorrt_libs/libnvinfer_plugin.so.10
but this is not in the virtual environment. can i pip install these somehow?
>>
Style keywords are "poisoned," which means you have to write everything out and hope you don't accidentally trip a different filter. This thing is going to need to be almost fully retrained to be of any use to anyone.
>>
>>101866159
>Style keywords are "poisoned," which means you have to write everything out and hope you don't accidentally trip a different filter.
Such as?
>This thing is going to need to be almost fully retrained to be of any use to anyone.
I wish anon, I wish, but I doubt it'll happen...
>>
>>101863852
>When I try to load this lora I got a OOM error,
>>101864264
>bro same, keep getting OOM with using one GPU when adding the Lora.
>>101864329
>It's weird for me too. It will oom on one generation, I'll stop and try again and it won't oom on the next. I don't know why.
>>101864343
>After yesterday's update I get a guaranteed OOM on the first run, but all the following ones work just fine.
Looks like we're not alone, Comfy fucked something up
https://github.com/comfyanonymous/ComfyUI/issues/4338
>>
>>101866190
>Comfy fucked something up
FUCK
>>
Euler CFG++ is a fucking meme, it makes real people look like plastic: https://imgsli.com/Mjg3MTI3
>>
>>101866174
Well, afaict many major art movements (Baroque seems to work but a lot of them don't or don't well), every artist name, etc.. Like "an impressionist painting of flowers" produces something that is not a work of impressionism, so impressionism is functionally a dead token. So then what do you do? Describe the quality of the brush work to it? Or you just don't make a painting, I guess. The amount of stuff this thing doesn't do well for something of its size is fairly staggering lol. No wonder people are getting fairly good performance out of aggressive quants. Most of the layers are probably filled with functionally dead nodes.
>>
>>101866280
>Like "an impressionist painting of flowers" produces something that is not a work of impressionism, so impressionism is functionally a dead token. So then what do you do? Describe the quality of the brush work to it? Or you just don't make a painting, I guess.
you can get the styles working if you go for CFG 6 + GuidanceNeg 10, have you tried it? >>101865731
>>
what's the name for a thing women wear when they're in a convertible car
I thought it was a wind scarf but I'm just getting scarves. I've tried babushka, headscarf and bonnet, but no dice
>>
>>101866353
believe it or not, 'convertible scarf'
>>
File: fp081.jpg (487 KB, 1024x1024)
487 KB
487 KB JPG
>>
File: asa007.jpg (142 KB, 854x894)
142 KB
142 KB JPG
1Asa-ing made|wasted my day again
>>
File: asa008.jpg (178 KB, 639x1139)
178 KB
178 KB JPG
>>
Hey dynamic thresholding anon, why is it white? This is your same workflow I just tidied it up.
>>
File: TakeTheFluxPIll.jpg (129 KB, 768x1024)
129 KB
129 KB JPG
>>
Have Flux devs said anything official about artists and styles? They're the only ones in capacity to tell us what is going here.
>>
>>101866611
That gen is really crispy
>>
File: fp083.jpg (202 KB, 1024x1024)
202 KB
202 KB JPG
>>
>>101866620
They haven't said shit about fuck, I don't know what you're expecting. You know exactly what has happened. A VLM saw a painting by Greg Rutkowski and said "This is a painting"
>>
>>101866620
In particular, it seems counterintuitive for them to cripple their model on the one thing no one else is doing (especially closed competitors like MJ, they are just asking for someone to release a better model eventually and replace theirs). Hopefully a v2 or 1.2, etc... of Flux fixes the issue.
>>
>>101866635
Yeah, but we don't k ow if this was intentional and therefore won't be fixed (and thus the community is expected to fi etune back in all classical art styles, concept artists, etc...) or if it's an issue with how it was trained that they would work on.
>>
>>101866643
>Hopefully a v2 or 1.2, etc... of Flux fixes the issue.
Won't happen, at this point it is us who should continue the pretraining/finetune
>>
File: ComfyUI_Flux_7669.jpg (241 KB, 768x1344)
241 KB
241 KB JPG
>>101865997
i do 50 steps, unless i'm using heunpp2 then its 20-25
>>
>>101866664
It's obviously not "intentional" it's just a side effect of using a VLM to tag your images. The VLM would have to know the artists in the first place in order to tag them correctly but it won't. Take any artwork and put it into chatgpt and ask it to describe the image, that's how this works, with billions of images.
Nobody manually looked at them each to make sure it was right.
>>
>>101861802
uuuuoooohhh androgynous demon tomboy erotic!
>>
>>101865997
>>101866668
Hold on to your panties for the ultimate 1girl
>>
>>101866620
No and I doubt they will. We're probably more likely to get instructions from them on exactly how to prompt for hardcore pornography than we are to get info about what IP went in there lol.
>>
>>101866668
Still has that weird belly button
>>
>>101866698
holy kek
>>
>>101866707
it's a magsafe charging port
>>
>>101866668
nice clit piercing
>>
>>101866684
Yeah but there's an easy fix, you just give the VLM context like artists, mediums from the metadata and tell it that if there's any in there it keeps it. Obviously based on the nature data can be scraped this would be very doable. I refuse to believe they just took untagged images while SD can do a much better job from just random tagged images that appear on LAION.
>>
File: fp090.jpg (423 KB, 1024x1024)
423 KB
423 KB JPG
>>
>>101866719
>I refuse to believe they just took untagged images while SD can do a much better job from just random tagged images that appear on LAION.
I believe that, it's no coinscidence that Flux is so good at prompt understanding, LLM captioning has probably being used for easily 80% of the whole dataset training if you ask me
>>
>>101866719
How easy do you think that is, to give a VLM artist context? If you really believe this to be an easy fix please go ahead and train a VLM with this context, the entire imagen community will suck your dick.
>>
>>101866719
The model just happens to coincidentally suck at the two things that make imggen controversial and be really really good at everything else.
>>
File: FD_00002_.png (1.36 MB, 1024x1024)
1.36 MB
1.36 MB PNG
20 steps vs 500 steps
https://imgsli.com/Mjg3MTM4
>>
>>101866719
>while SD can do a much better job from just random tagged images that appear on LAION.
because those captions are shitty but often true regarding the names of the people in it or the artists that made it.
>>
File: fp095.jpg (275 KB, 1024x1024)
275 KB
275 KB JPG
>>
>>101866807
>because those captions are shitty but often true regarding the names of the people in it or the artists that made it.
this, at this point you give the laion captions to the VLLM to help it, it would make a fine combo
>>
>>101866747
"Here's a file with some metadata. You will caption this image, while paying close attention to the metadata. If it contains an artist name, including "by X". If you know the medium or style, include that as well. If not, include the source name E.G. artstation" that's literally it.
>>
>>101866832
It really nails reflections
>>
>>101866846
So you need to feed it shit tagged data which is the reason SD base models are so garbage?
No.
>>
>>101866862
No, you're telling it to caption it as it normally does, but then analyze the metadata for artist names, styles and source and append them to the end in whatever format you desire.
>>
>>101866862
a smart enough VLM could work with it just fine
>>
>>101866862
Well, if the alternative is having to make a LoRA for literally every style of art, then ...
>>
>>101866892
>>101866900
Are you sure the metadata is correct, clit eastwood?
linkin_park_the_real_slim_shady_rubia_real_rare.mp3
You are talking about billions of images. The only way to do this, is to tag every image manually
OR
Fine tune with LoRAs of these concepts, and since you only need about 20 images to train a LoRA this is a MUCH simpler solution.
Then you leave it up to the highly autistic community.
>>
>>101866935
That's why you collect the images properly and make sure they have proper tags, and you also tell the VLM that if it's not sure just leave the info empty. But erroneous info would still perform much better than what we got.
>>
>>101866935
>Are you sure the metadata is correct, clit eastwood?
I was just looking for a LAION browser to find that again but it's all dead now.
Like I said, a smart enough VLM can work with even the shittiest captions. It just doesn't exist yet.
loras as simpler but not a substitute for actual training.
>>
>>101866960
Please, by all means Anon, build this VLM. You will get 40 million is series A funding.
>>
File: file.png (948 KB, 1010x707)
948 KB
948 KB PNG
Is comfy always going through the entire image during inpainting, even if I masked a small part of it? I mean, it does change only the masked area, but it still renders the entire image, thus taking the same amount of time as genning the full picture.
>>
>>
>>101866955
>That's why you collect the images properly and make sure they have proper tags
So manually? Are you going to manually tag billions of images? There aren't enough literate Indians in the world for this task.
>>
>>101866985
shut the fuck up
always with the "if it's so easy just build it, you'll get rich" stupid ass bullshit when you run out of things to say
>>
>>101866998
Now do the painting in the style of Monet, and then Da Vinci, Picasso and Michaelangelo.
>>
>>101867018
Literally yes. It's the same shit when people complain about something in a video game, who have never coded a line in their life and they say "Oh it's so easy to fix! lazy faggot devs"
>>
>>101866985
You don't need a massive VLM to fix the issue we're having.

You're vastly overestimating how hard it is to teach the model concepts of artists. There's a wikiart dataset published to huggingface. Just literally using that and giving it to the model would suffice. (Replacing any image that is duplicate). Most of the artists it needs to know are all congregated from a few sources. This is not rocket science, MJ isn't as bad as SD at prompt following yet you can ask it to give you a variety of styles, mediums, and artists no issue.
>>
>>101867039
because the idea of smarter VLMs is so outrageous, as if 4o doesn't exist
you stupid mouth breathing motherfucker, shut the fuck up
>>
How do I con comfyui into ignoring that .1 version difference "requirement" on OS install python without three pages of CLI and 8hr of arch wiki archaeology
>>
>>101867021
This is "Monet"
>>
File: ComfyUI_Flux_7657.jpg (216 KB, 768x1344)
216 KB
216 KB JPG
>>101866707
flux is usually good at avoiding those. maybe it's related to me going crazy with the model shift values
>>
>>101867069
4o is dumber though.... Anon do you know what you're talking about?
>>
>>101867082
Maybe. Always good to put belly button in the negs.
>>
>>101867089
dumber than what, anon, DUMBER THAN WHAT
>Anon do you know what you're talking about?
YES, SO ANSWER THE ABOVE SO I CAN RIP YOU A NEW ASSHOLE YOU FUCKING IDIOT
>>
File: FD_00109_.png (907 KB, 1024x1024)
907 KB
907 KB PNG
>>101867082
Belly buttons? They are easy, just say "her navel is showing"
>>
I'm the debo
>>
>>101867079
"da Vinci"
>>
>>101867109
Dumber than yo momma
>>
File: ComfyUI_00183_.png (1.23 MB, 1024x1024)
1.23 MB
1.23 MB PNG
>>101867115
now make her pregnant
then tell me your prompt because its hard to get the first trimester like this
>>
>>101866862
It's perfectly doable, man. You wouldn't even need to manually tag anything. There's no reason why these models shouldn't know every major artist and art style under the sun. It would be trivial to write a script to scrap wikiart and to automatically tag the images. Everything is already well tagged. You could even easily avoid anything that still isn't in the public domain, if that were an issue.
>>
>>101867141
Flux hasn't seen a single phallic shaped object in its short life.
>>
File: fp089.jpg (245 KB, 1024x1024)
245 KB
245 KB JPG
>>
File: asa009.jpg (261 KB, 709x1705)
261 KB
261 KB JPG
I stopped worrying about finger errors and love them.
Its fine if it works.
>>
>>101867120
>>
12b and the 1girls look like sd 1.5 gens. why?
>>
>>101867141
Anon she is not first trimester. She is well into the 2nd. Women only really begin to show in the 2nd trimester. Your pic is at least 6 months pregnant
>>
>>101867180
That's just cumbloating
>>
>>101867177
Because we are all promptlets figuring out the new way to do shit.
>>
File: FD_00008_.png (902 KB, 1024x1024)
902 KB
902 KB PNG
>>101867141
https://files.catbox.moe/cm5e16.png
>>
File: FD_00007_.png (1.16 MB, 1024x1024)
1.16 MB
1.16 MB PNG
Steps testing
https://imgsli.com/Mjg3MTQ4
>>
>>101867197
>Her pussy is really fat, there is a lot of fat in her pussy area.
Anon your brain is something special
>>
>>101867209
where 25, 30, 35, 40 and 45?
>>
If you prompt:
> Art containing signature "[ARTIST]"
that can retrieve some stuff
>>
>>101867177
They used synthetic data likely during the DPO/RLHF stage. Obviously SD 1.5 doesn't look aesthetic so it's a problem.
>>
>>101867241
I can do those too if you like after my current set.
>>
>>101867251
See, now this is a good fucking idea. The VLM would definitely be able to see that shit and it could mimic art styles from that. Post some examples, Anon.
>>
>>101867209
brap
>>
File: 00161-AYAKON_124044669.jpg (365 KB, 2560x2560)
365 KB
365 KB JPG
yoga
>>
It cannot differentiate stages of pregnancy
Left is 9 months pregnant, right is 1 month pregnant.
Every month in between looked the same
>>
whenever you prompt pregnancy it is never yours, you are a cuck
>>
>>101867344
I don't really care. I already have a son, my genes are safe so long as he doesn't become a faggot.
>>
Should I trade in a 7900XT for an A4500?
>3090
The end goal is to stack them inside of this shit box. Can't stack 2 3090s
>>
>>101867209
can we get a catbox for this one too?
>>
>>101867372
If your intent is AI workloads then yes.
>>
so what happened to the "clip_l understands artists" thing? in my testing, putting a photographer in the clip_l box certainly does work.
>>
>>101867384
Yes, will deliver with the 25-45 steps test
>>
File: FD_00022_.png (1.22 MB, 1024x1024)
1.22 MB
1.22 MB PNG
>>101867209
>>101867241
https://imgsli.com/Mjg3MTUx
>>101867384
https://files.catbox.moe/zy3mb2.png
>>
>>101865753
what flags?
>>101865758
about the same
>>101865771
>do you only have 1 gpu?
yes
>if that's the case you can already remove the Force/Set CLIP and VAE device
can you post a better workflow then?
I have no clue how to put this spagetti shit together.
>>101865810
>a 4090 should be close to four times faster
so why isnt it?
>>
>>101867390
Certainly does, or certainly does not?
>>
>>101867279
> painting containing the signature look, style, and feel of "MONET"

Not like perfect but the resemblance is there
>>
>>101867400
based, thanks for catbox anon!
>>
>>101867318
I'm 10000% sure we're getting the belly slider lora eventually, along with the overall fat, breast, age sliders like it was with sdxl/pony
>>
>>101867386
It's primarily an AI workstation. What's nvidia like on a linux system?
>>
>>101867412
it works. try "a person" in t5, nothing in clip_l > baseline fluxslop with the occasional weird outburst. now add a photographer with a distinct style into the clip_l, like "paolo roversi". voila. or try nobuyoshi araki. this is without negative and a positive guidance around 2.5
>>
File: fp092.jpg (191 KB, 1024x1024)
191 KB
191 KB JPG
>>
>>101867473
https://imgsli.com/Mjg3MTYw/2/1
It does not
>>101867431
Will test this next
>>
>>101867409
>about the same
that should absolutely not be the case, CFG at 1.0 means half the work, half the time
can you try using the first workflow from here? https://comfyanonymous.github.io/ComfyUI_examples/flux/
just run it and see the speed
>>
What is the actual prompt token limit? I've been putting in 1000+ and getting decent results, but it seems like it forgets some stuff from earlier in the prompt.
>>
>>101867496
Oh by the way the artist I'm trying to prompt is inflation4furs.
>>
>>101867431
>painting containing the signature look, style, and feel of "MONET"
I was really hoping this would work
https://imgsli.com/Mjg3MTYx
>>
>>101867496
Wow, bro. These bitches are hot. Now I get why this Picasso guy is so famous, bro.
>>
>>101867504
Technically 512 but some anon the other day said it it's actually only 256.
Could be because we are all running fp8?
>>
>>101867431
Picasso.
>>
>>101867550
When I am doing tests like this I want something good to look at with lots of little details. That's why I like using this prompt for it. Nice ass, lots of intricate patterns.
>>
>>101867566
this thing was not (or barely) trained on dead artists work; that we can conclude
>>
>>101867566
Also Picasso.
>>
>>101867575
Could eat those asses for days, bro. I really hope soon they make 3D printers that give us waifu robots, bro. Would sell my car to get one.
>>
File: FD_00012_.png (1.56 MB, 1024x1024)
1.56 MB
1.56 MB PNG
>>101867431
This works if not prompting anything specific it seems. Maybe my prompt was too complex.
>painting containing the signature look, style, and feel of "Greg Rutkowski"
>>
>>101867564
I heard that 256 was for schnell and 512 for dev. I read somewhere that t5 doesnt technically have a limit but it gets more retarded when you go above 512.
>>
File: fp093.jpg (301 KB, 1024x1024)
301 KB
301 KB JPG
>>
how the fuck do you have 512 token prompts, why are you writing paragraphs
>>
File: FD_00016_.png (1.69 MB, 1024x1024)
1.69 MB
1.69 MB PNG
>>101867512
>painting containing the signature look, style, and feel of "inflation4furs"
>>
>>101867593
The photorealism bias hammers impressionists and abstract artists, I think.
>>
>>101867620
I'm giving my prompts to an LLM and ask it specifically to expand them to a 500 words essay. Works like a charm. Unironically.
>>
>>101867628
catbox one so we can laugh at it not using even 1/5 of what is in the prompt
>>
File: fp099.jpg (214 KB, 1344x768)
214 KB
214 KB JPG
>>
>>101867566
>>101867596
>12B parameters
>the dataset doesn't contain Picasso
How do you fail something so simple?
>>
>>101867646
It likely does but was not captioned with "by Picasso" by the VLM they used.
>>
>>101867658
Oh, right. Yeah. Good call. They probably didn't even think of it. They were so excited by the VLM that they overlooked this. It should be easy to fix though.
>>
>>101867658
What VLM did they use? If they told us just that we could go back and unfuck things on our own lol.
>>
>>101867703
I'm calling it VLM but could be a caption model.
All we know is that whatever they used is dumber than what OpenAI used for DALL-E 3, so it could be anything openly available VLM/caption model.
>>
>>101867618
i really like these, what about inpainting the keyboard and screen for more detail?
>>
>>101867680
It is easy to fix. Look at the LoRAs of celebs that were trained with only 25 images. It already knows them, it just needs to be told who they are.
Which is why for Flux, embeddings is probably a better way to go, rather than LoRAs. It already knows all this shit, it just needs to be told "this face is Emma Watson"
We could get packs of tiny ass embeddings that bring out all the people and styles we want.
>>
Ready to go with the next bread...
>>101867704
>>101867704
>>101867704
>>
>>101867724
i cannot do that
>>
>>101867729
>We could get packs of tiny ass embeddings that bring out all the people and styles we want.
But no one does embeddings anymore.
Is there an embedding trainer for T5 yet? Would you train just for CLIP, both?
I wish they had used just T5.
>>
>>101867719
Salesforce has an open source BLIP-T5 caption writer. Wonder if it was something like that.
>>
>>101867754
Clip is there for a reason, I just don't know what that reason is.
Probably so trainers can re-use their data-sets
>>
File: ComfyUI_00068_.png (2.51 MB, 1920x1088)
2.51 MB
2.51 MB PNG
>>101867500
I tried it again after restarting my browser and now it only took 3:25 minutes with the old workflow.
on that other workflow with same seed, sampler and steps it took 3:02 minutes.

so CFG to 6 or 1 is only a difference of 23 seconds?
>>
>>101867813
something is seriously fucked with your setup, the example workflow should take under 20 seconds, are you sure you have a 4090?
>>
>>101867813
and no, CFG at 1.0 should half the generation time, it is literally doing half the work
>>
>>101867318
try "early pregnancy"
>>
File: 4090.jpg (10 KB, 488x73)
10 KB
10 KB JPG
>>101867832
>are you sure you have a 4090?
yes
>>
File: fp088.jpg (217 KB, 1344x768)
217 KB
217 KB JPG
>>
>>101867898
how are the temps?
>>
File: 40902t.jpg (124 KB, 623x895)
124 KB
124 KB JPG
>>101867913
looks normal
>>
>>101867929
have you ran benchmarks/games before on it? how was the performance.
>>
>>101867985
>have you ran benchmarks/games before on it?
yes
>how was the performance.
as expected from a 4090
>>
>>101868081
well, only thing left to try is alternative interfaces like A1111 or Forge to see if the issue is with Comfy.
>>
File: fp101.jpg (233 KB, 1344x768)
233 KB
233 KB JPG
>>
>>101868095
ok will do.
>>
File: 1.png (1.67 MB, 1024x1024)
1.67 MB
1.67 MB PNG
Any disadvantages running models on mac comparing to graphics card? (excluding not liking platform)
>>
>>101866609
update ComfyUi anon

>>101867409
>can you post a better workflow then?
bruh you just click on those nodes that have "Force/Set" and click on delete, how hard is that?



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.