Discussion of free and open source text-to-image modelsPrevious /ldg/ bread : >>101988457>Beginner UIEasyDiffusion: https://easydiffusion.github.ioFooocus: https://github.com/lllyasviel/fooocusMetastable: https://metastable.studio>Advanced UIAutomatic1111: https://github.com/automatic1111/stable-diffusion-webuiComfyUI: https://github.com/comfyanonymous/ComfyUIForge: https://github.com/lllyasviel/stable-diffusion-webui-forgeInvokeAI: https://github.com/invoke-ai/InvokeAISD.Next: https://github.com/vladmandic/automaticSwarmUI: https://github.com/mcmonkeyprojects/SwarmUI >Use a VAE if your images look washed outhttps://rentry.org/sdvae>Model Rankinghttps://imgsys.org/rankings>Models, LoRAs & traininghttps://civitai.comhttps://huggingface.cohttps://aitracker.arthttps://github.com/Nerogar/OneTrainerhttps://github.com/derrian-distro/LoRA_Easy_Training_Scripts>Fluxhttps://huggingface.co/spaces/black-forest-labs/FLUX.1-schnellhttps://comfyanonymous.github.io/ComfyUI_examples/flux>Pixart Sigma & Hunyuan DIThttps://huggingface.co/spaces/PixArt-alpha/PixArt-Sigmahttps://huggingface.co/spaces/Tencent-Hunyuan/HunyuanDiThttps://huggingface.co/comfyanonymous/hunyuan_dit_comfyuiNodes: https://github.com/city96/ComfyUI_ExtraModels>Index of guides and other toolshttps://rentry.org/sdg-linkhttps://rentry.org/rentrysd>GPU performancehttps://vladmandic.github.io/sd-extension-system-info/pages/benchmark.htmlhttps://docs.getgrist.com/3mjouqRSdkBY/sdperformance>Try online without registrationtxt2img: https://www.mage.spaceimg2img: https://huggingface.co/spaces/huggingface/diffuse-the-restsd3: https://huggingface.co/spaces/stabilityai/stable-diffusion-3-medium>Maintain thread qualityhttps://rentry.org/debo>Related boards>>>/g/sdg>>>/h/hdg>>>/e/edg>>>/d/ddg>>>/b/degen>>>/vt/vtai>>>/aco/sdg>>>/trash/sdg
I should go back to my old gens more often. I have them all saved and never go back to them. I genned some cool shit.
Combining the input with joycaption gives the most impressive results.
>A cinematic photo of a girl, she is cosplaying as Sailor Moon, including the Sailor Moon wig with long blonde twintails, she's attending an anime convention, she's surrounded by a crowd of illiterate Appalachian redneck mouth breathing cocksuckers
>>101990275Do you have that in a workflow or are you just doing it from huggingface?
>>101990275I used huggingface for that gen, I am waiting for the models to finish downloading before I try it locally, the workflow should be something like this I think
>>101990048This is cool. Good gen, Anon.
>>101990291>>101990291
>>101990354Ah yup I do this a lot. I often do a single gen, take that into Joy then take the Joy caption back into Flux and get a significantly better result.
For those who wonder if switching from clip_l to VIT L is a good choice, here's a comparison:>A realistic photo of a woman cosplaying as Sailor Moon is hugging a RTX 3090, a white subtitle text can be seen on the bottom of the image, it is written: "I knew I'd made the right choice in buying you"https://imgsli.com/Mjg5Mzk0
>>101990357thank you, I love my futuristic bullshit
>>101990392They're the same picture.
>>101990411if you consider an asian woman to be the same as a white women then maybe yes it's the same picture I guess
>>101990421you really think one is more asian than the other?
I wish there was a Simon Stalenhag lora for flux yet.
>>101990471nta but i think right looks significantly more asian. left looks like a white woman
>>101990485You can always make one. LoRA training is piss easy for Flux.
>>101990452this is cool
>>101990354>>101990421There is basically nothing that can be inferred about the quality difference between regular clip_l and vit L from the pic you posted, and the race defaulted to when you didn't specify one in the prompt (1) isn't a marker of clip quality and (2) is unlikely to be something you can predict from choice between these two clip models anyway.Show me several side by sides where one model is noticeably excelling at something specific in the image the other one is failing at. Here I see:>VIT L better tiara, base clip stupidly put nvidia logo on it>VIT L did the text a bit better, base clip fucked it up>VIT L made her look marginally less asian, base clip more asian>VIT L got the eye colour a bit off, base clip got it right>VIT L better wrist, still slightly fucked fingers, base clip fucked up wrist>VIT L the red blob in top left looks more naturally part of background bokeh, base clip looks weird>VIT L she's more attractivethis tells me sweet fuck all.
>>101990507I am to busy genning to collect Stalenhag pictures .. maybe later, but I am so fucking lazy right now
>>101990559I just spam pics on Civit for free buzz and train that way. My gpu couldn't do it.
>>101990392>text is better but still wrong>card is wrongIs this the power of schnell?
>>101990513
>>101990610>Is this the power of schnell?it was flux kek
>>101990507Can you train flux lora on 16GB VRAM?
>>101990569my 4090 will do
@101990690d*bostyle
>>101990392Could you have chosen a non-shitty non-fried image to do the comparison on?
>>101990626no
>>101990643I plan on getting the 5090 if it is a significant improvement over the 4090. At least 28GB VRAM.
>>101990690lmao them niggas gay af
>>101990626yeah soon
>>101990626No, sorry, only on 12GB or less.
>>101990727if they fucking only give the 5090 28gb (as the rumors say) I will go for a fucking workstation card
>>101990779I don't have $15 grand to waste on anime titties.I do all the AI shit for my work though, I am hoping to convince them I need it.
>>101990779>if they fucking only give the 5090 28gb (as the rumors say) I will go for a fucking workstation cardthat's precisely what they want you to do, go for the 10000 dollar card, mission complete
I updated stability matrix and now there is no DPM 2++ Karas
Genuinely flaborgoostered by Flux, even the fp8 quantized model is just giving bangers upon bangers
>>101990810ya fuck em, but I want the VRAM I needz it, especially when BSL releases their video model
>>101990779That is why 16GB is always the softcap on any non-90 class card and then 90 class cards have bit more.It does not cost them that much to give out more, but it would eat their workstation and enterprise AI card sales.Monopoly is a bitch.
>>101990779They should do at least 32Gb just a 4GB increase is taking the mick!
>>101990818he pulled?
>>101990844I just don't get why AMD and Intel are so incompetent to not be able to get something done these days>>10199085232GB would be okay .. I would just get a 5090
>>101990854He got that tattoo from the terrorists that captured and tortured him. He's finally free but will bear this scar for the rest of his life.
>>101990806The RTX 6000 Ada is 8 grand or so
>>101990877But 4GB increase over 24GB, what can that even do? It's not worth it.
>>101990877AMD CEO is nvidia CEO cousin, they only exist to protect nvidia from the law. And Intel is dead.
>>101990897>But 4GB increase over 24GB, what can that even do? It's not worth it.for flux it has 2 advantages, you can fully load the fp16, and if you had a 3090 it will be way faster
>>101990897that's almost a whole Q8 T5, anon!
>>101990908I see
>>101990919That's a pretty fun idea for a keyboard. Is this a thing?
>>101990896Not in dollarydoos
>>101990902>AMD CEO is nvidia CEO cousinliteral nepotism .. but ya I heard that, they divided the market: AMD gets the good CPUs, NVidia the AI>>101990897for FLUX? nothing really, you already can load fp16 on 24GB, you could do higher res, but upscale is better anyway cause anything above 2MP genned in flux looks like shit.. with 32GB you could do animations at hires maybe tho, once that comes out
>>101990946>Is this a thing?nta but yea, i see alot of random and weird keycaps on sites like aliexpress
>>101990946Custom keycaps? Absolutely.
>>101990960one could hope some companies shelf them out once they upgrade to blackwell, but who knows
>>101990960highway robbery it is then
Forge or reforge what’s the difference?
>>101990971I see!>>101990977lol cool
>>101990969Yeah I guess the extra 4GB might be able to make some future things just about work. Which is valuable, but gotta think about value vs cost. We shall see.
>sex horse
Man, this one specific prompt is slow as fuck and I don't know why.
>>101991017average furfags keyboard
Is 12gb vram good enough for flux?
>>101991043Good enough for using, good enough for training loras.
>>101991055keep hearing that but I've yet to see any evidence
>>101991043yes with some tricks and slightly lower quality models>>101991015ya also the speed increase of a 5090 might still worth it comparing 3090vs4090 flux speeds>>101991017>>101991036kek, never trust anyone with a pink keyboard
>>101991064Of what, training LoRAs? Even at my most conservative settings I don't really get below 18gb of vram. I don't see much hope for 12 and if it does come it will be so slow it would be quicker to mow lawns and save up for a new GPU.
civitai has a wojak lora. truly anything is possible now.
.
>>101991086That's because it's just being figured out right now, maybe in a couple of days we will have some updates and workflows.Even finetunes should be possible at 12gb
>>101991125Yeah sure dude, next we'll fine tune it on your calculator.
>>101991098unfunny, qa lost
>>101991098but even more impressive, there is a slime girl lora, have a slime miku.
>>101991064I trained two on a 3060, taking about 12 hours each because I blindly used Adafactor and the default learning rate. They started looking really good around 4500 steps. If you find good parameters for flux so that training takes no more than 2000 steps, you'll be able to train a LoRA in 4-6 hours.
>>101991137I guess you were one of the ones saying flux can't work on GPU's under 24gb when it released. You probably have no idea what you're saying.
tfw ended up downloading gguf all quant version
>>101991098does it do Sproke?
if you don't mind waiting you can finetune Flux on 1GB of VRAM
>>101991158All my LoRAs so far have been less than 1500 steps, and the results are exceptional.
>>101991160The model is basically being tortured just squeezing into 24gb cards for LoRA training and finetuning, basically every conceivable trick was pulled to make it work. 12gb LoRA training isn't happening, I don't care how much false reddit positivity you radiate, there are hard limits to how much you can bust a model up.
>>101991183subject or just style loras?
>>101991183share your lora settings on catbox pls?
>>101991181You can even finetune on RAM.
>>101991203cpu cache, no ram needed
>>101991158Oh, and I used batch size 1, but with 12GB you can set it to 4, that would cut the time for processing one image in half.>>101991183I just copypasted kohya's command without changing parameters, the learning rate turned out to be way too low.
>>101991217Tape drive only.
>>101991125just the model weights in fp16 precision take up 12 GB. Fine tuning requires also memory for activations and gradients, I would be surprised if someone can make it work on 24 GB. It's possible to offload to RAM or SSD, but that would be too slow to be useful.Training Lora could load model weights in lower precision, for example Q3_K and only the lora weights need to be in higher precision. That should be possible with 12 GB VRAM.
>>101991194Subject>>101991198Oh, not local, on Civit. Sorry Anon. All I changed were the repeats, which depends on my image set. 20 for 25 images, and the size to 1024.
>>101991152
>>101991244can civitai do bucketing?
>>101991185You can say whatever you want but there is always techniques to do it. The plan is to traing half the model at once, then swap and train the other half.
>>101991254Yes, all the images were random sizes and aspect ratios.
>>101991256Yes, on a 24gb card.
>>101991185I just realised you said 12gb lora training isn't happening.HAHAHAHAHAHAHAAHAHAHAHAHAHAHA!!It can already be done!Even 12GB finetuning will happen you fool.
>>101991304show me
>>101989536>Yeah so anyone who is finetuning flux in the future please add the names to any auto captions you make, it doesn't take long, you can select all images of the person in Taggui and simply add the name to all of them.I'm assuming this would also be the case for styles and concepts, right? I remember reading that the important information that you want to be read in should be at the very front of your caption.
>>101991290Sigh oh ye with little faith and knowledge
>>101991304NTA but every time I have tried to train one on my 4080 it OOMs and collapses. I could have gay settings, very likely, but I haven't been able to make it work. I will be interested to see if it can though, but I do have my doubts.
>>101991309No need when even other anons already do it>>101991158
>>101991315>Have faith bros! Kohya and CUMFY will save us receive many upvotes for their efforts>The heckin' community can do whatever they put their minds toYour endless optimism that someone is going to come along and cater to increasingly tighter and tighter vram restrictions through some kind of techno wizardry annoys me.
>>101991323Wait for the spammer guy to update his latest findings, he should get you on the right path. https://www.reddit.com/r/SECourses/
this lora only works on Q2, fuckin hell
let the record show he refused to show me
>>101991356It's not faith, it's already been figured out and on the way
>>101991356>Your endless optimism that someone is going to come along and cater to increasingly tighter and tighter vram restrictions through some kind of techno wizardry annoys me.nta but isn't that exactly what happened when flux was released? nobody could run it. then we could run it on 4090s. then we could run it on 16gb, then 12, then 8, then 6, etc.it also couldn't be trained because it was distilled, then it could be trained but only on 2 a100s, then on a single a100, then on a 4090.there's a pattern here.
>>101991373check your PMs
>>101991252
>>101991391where do i check my pms i logged into 4chan pass but i dont see it
>>101991356well thanks to comfy I can use q8 with no memory loading lag that I get with forge, and with kohya I made a one piece nami lora that works with TEN IMAGES, no captions. just namiOnePiece as an instance prompt.
>>101991416>no captions. just namiOnePiece as an instance promptatrocious
>>101991430its probably bad but its worthwhile to retest all your assumptions when you start working on a new method
>>101991442you may have thrown out common sense with the bath water
my flux gens have a colorless, de-saturated quality but I'm using vae, what could be causing this? They look fine right up till they hit the VAE Decode node and then they lose all their color, I've tried flux1DevVae and ae.safetensors. I'm using flux1-dev-Q4_K_S
>>101991416>just namiOnePiece as an instance prompt.:(
>>101991430I was just testing making a basic, basic lora. to learn the app. and it actually worked with a handful of images. of course it would be better with proper tagging and a good image set.
>>101991458post catbox
>>101991387Yeah, and it's dumb and naive to expect it go beyond that. It was already a miracle that it got that far.>>1019913822 more weeks trust the plan
add this to the beginning of your prompts to make it look less glossy>Movie still lomography, photo of beautiful woman, shadow on face, no light, misty, night
>>101991467>a basic, basic lora. to learn the appshare config pls
>>101991495why would I do that when I only generate men?
>>101991498It was the default lora preset, all I did was add my instance prompt and a link to the folder with my resized images, default epochs/etc, didn't change anything.then I clicked the 3 buttons at the bottom in sequence to set the folders up and I waited, was fast cause it wasn't intensive settings
>>101991518*also I learned if you set the output to the image directory you get a recursive loop. don't do that.
>>101991516sorry i just assumed everyone was doing 1girls>Movie still lomography, photo of homosexual man, shadow on face, no light, misty, night
>>101991539no, my men are straight
can you train flux models with 16gb vram yet?
>>101991543doubt
>>101991356>bloo bloo bloo why dont't computers use 512MB of RAMGet a fucking job holy shit
>>101991477It's not dumb and niave when you actually understand how it's done. Sorry but lack of knowledge makes you think it's impossible when it's simple ignorance.
Is there a shortcut key to bypass a node on comfy?
You anons better still be here in a few days when everyone is making loras and finetunes with 12GB vram. So that I can laugh at you.
>>101991631Even if through some miracle someone made it fit in 8 GB of VRAM, who the fuck is waiting 5+ minutes per image? At that point you seriously should go get a part time job and save up $700 for a 3090, it would be faster.
>>101991671I'm talking about lora training with 12GB vram
I'm convinced anything over 50 images for a LoRA ends up worsening the quality overall.
>>101991697Yeah anon, I can't wait to see your shitty Lora that took 3 days with a dataset of 50 images. Get a part time job, it'll be faster.
>>101991716It can be done in 3-4 hours
>>101991697Better buy some buzz kid, because you're not training that LoRA on 12gb of ram, at least not at a speed that won't brick your computer for the next 12 hours.
>>101991721Yeah, I know you make shit Loras, they're all over Civit, overbaked on the same face, body type and pose. It's SDXL all over again.
>>101991711for xl lower does seem better
>>101991657The exact same anons who were saying flux was impossible to train 2 weeks ago are here right now and being very quiet about it.They will not speak up when proven wrong. Nobody ever admits they were wrong, except that one guy who was arguing negative prompts are pointless.
You anons are legit annoying, had to deal with your type a million times before, always acting like nothing can change, that nothing is possible and EVERY single time things change.you were the same guys that thought the internet wouldn't be popular and that touch screens on phones was stupid and would never be popular. And you probably thought Flux couldn't run on 12gb vram lol
>>101991759Exactly, typical humans. Also respect to the nragtive prompts guy
agi 2 weeks ago
>>101991761>anonsIt's one guy
>>101991711picking the right kinds of images matters most, dont pick 50 images with wildly different styles (unless you want variety in aesthetics)
>>101991739Nope I have my own techniques to avoid same face.
Every single comment in this thread is me btw.
>>101991793Captioning is important too, if you have lower quality images then capture it as low quality, if you have anime style images make sure you say it's anime etc
>>101991761and you're someone who thinks you can use your computer from 2010 to use Flux and all your optimism is based on OTHER PEOPLE doing work, it's "trust the science" bullshit
>>101991798I know that already because I'm you.
>>101991816I literally just put my pics into joycaption and saved the exact output to txt. That was my captioning process. My LoRAs are perfect.
>>101991845are they style loras perchance
>>101991830You sound like the ugliest sonofabitch I ever heard.
>>101991849No. 25 images of a real person.
>>101991845Yeah that sounds good, although what I said can still matter if you want to make sure the image looks like what you captions, anime, low quality screencap etcBut yeah I'm gonna use Joycaption too
>>101991845joy caption fucks up too often tho, you should double check them
>>101991852I'm just a mirror.
>>101991845>download joy-caption>edit the script to loop the process in a folder
>>101991877perfection is stupid when the model itself isn't trained on perfection, you're not going to undo the model's miscaptions
>>101991877Yeah and add your own captions for better control of the lora. Like names and so on.
>>101991884and replace that weird character it uses in lui of an apostrophe
>>101991877Works on my machine. I did check them. Every caption was correct.
>>101991902no such thingit can be accurate or inaccurate
>>101991887my god, you're retarded>>101991902your shit must be real simple then
>>101991893I just did that with a powershell script to name the subject.
For LoRA training, doing>1 epoch, 800 steps>8 epochs, 100 stepsis the same, right?
>>101991926steps are derived, not specifiedI think?
>>101991887nice logic lmao
>>101991920your shitty 12 GB VRAM Lora can only tease out from what the model already knows, but good luck, I'm sure your images aren't overbaked garbage
does anyone know of a sampler that lets me randomize variation seed?
>>101991920>your shit must be real simple thenIt's a human. Can't get much simpler and complex than that. It captured everything correctly.
>>101991940you waste your time generating an image every 5 minutes and hand curating a 50 image dataset all day and are always behind because you don't know how to pick and choose your battles>no gen
>>101991950fuck are you talking about, retard
>>101991917>no such thing>it can be accurate or inaccurateWho gives a shit.
>>101991974I think it's time you start posting examples of your awesome Lorasor is this another one of those "I know what's best but in practice I don't do it"
>>101991973create all the imaginary narratives you want, it won't make you right
>>101991950You are being dumb, he's not the 12GB Vram guy, I am!
>>101990155So should I replace all my SD models with flux now?
>>101991988this is not what i expected from country grown vegetables
>>101992000If you aren't genning porn then yes
>>101991994>>101991995>no gens
>>101991993I said wait a couple of days, it's in the process of being perfected. You will see!!!!!!
>>101991936Should have worded it differently. Let's say I set things as 40_folder and 1 epoch; would I get the same results if I set it as 10_folder and 4 epochs?
>>101991993you're a schizo, who do you think you're talking to
>>101992028what batch size
>>101992028repeats are not the same thing as steps are not the same thing as epochs
>>101992006cucumber flavored cardboard doesn't sound too bad
>>101992035do you just prompt for this pose? these sitting poses often fuck up when I try them.
cyberjews
>>101992036>no gen
>>101992009Alright thanks
>>1019920423>>101992045I guessed as much, thank you for confirming it.
>>101992069it takes 20 minutes per gen, please understand
>>101991068>>101990877>>101990810haven't tried the 3090, but I have a 4090 with overkill ram and cpu and gens take around 25 secs on average. It's not like genning on sd 1.5 of course, but mostly tolerable.If they fucking come out with a gimped ram 5090 I'm certainly either buying another 4090 and go dual or a used ada or something.Not for genning, but running actually decent llms locally, like bloom
>>101992055yeah they mess up for me too, especially when you say spread legs they often do the opposite lol. And sometimes theyr legs get chopped in half.Prompt is sitting on the floor
>>101991650I think there's a hotkey list on his github page. I only remember ctrl+m for mute.
>>101992110>gens take around 25 secs on averagewith CFG, right? So 12 seconds with the default workflow.
>>101992151Damn I have no chance then
>>101992126with a random workflow I found on the internet, couldn't be bothered tinkering around with comfyUI, I'm far too used to automatic1111. even getting flux to work rustled my jimmies.
>>101992118Yeah I know ctrl+m but I don't want to have to reconnect any nodes so bypass is better
>>101992118>>101992166it's ctrl+b and it's so fucking obvious that it's that, I feel stupid
>>101992110ya 4090 is decent for pure picture gens, but upscales could be a lot faster, but mostly you are right, VRAM is what counts for AI applications, so 5090 on 28GB will be just a disappointment.. also with inflation going wild I guess even a 28GB 5090 will be $2500-3000 in the first 6 months, so a used ADA really gets to be an option for a 4090+ADA dual setup
So are T5xxl gguf quants worth it? Is Q8 significantly worse than the full fp16 model?
>>101992185>but upscales could be a lot fasterUltimate SD Upscale for tiled upscales works with Flux
Reminder to make sure that tiny sweat drops on the character's face are properly captioned, or just edit them out, mere two droplets in 50 images were enough to brick my lora.
>>101992185I am kind of glad the 5090 will have 28GB so I don't have a reason to upgrade from my 4090 kek
Behold, the first image I created with flux!
>>101992203The 5090 is basically a statement from NVIDIA that they no longer give a fuck about consumer GPUs. And why should they?
>>101992218gem
>>101992218I look like that
>>101992197thats what I am doing, but its still abit of time, atm I am using 512x512 tiles to upscale and they run at 2 its/s .. if the 5090 could do these at 4-5 its/s that would nice>>101992226kek, yaaa you can see it that way>>101992226if its like the rumors, its statement: if you are into AI give us money, our consumer range is for gayming
>>101992226because if they want my fucking money they would have put in more VRAM
>>101992185I never upscale using comfyUI, I use chainner and it's pretty fucking fast desu. How long and to what rez are you scaling to? what model?
>>101992275They don't care about you.
>>101992311Those fuckers
>>101992311they're essentially a monopoly so makes sense
>>101992325Maybe if AMD weren't retards there would be competition.Fucking Intel of all companies is more primed for AI than AMD
>>101992311that uptick is insane
>>101992298I use flux itself to upscale from 1280x720 to 2560x1440 with sdultimate_upsale, takes about 120-180 secondsprobably chainner is smarter .. but I run a big q of images most times and decide on the fly if a picture should be upscaled or not and cancel or not, also I am kinda interested how flux upscales since its still kinda new
>>101992341At the beginning of this year everyone in the business was talking about AI. Everyone wants to push AI SOMETHING in their product, it doesn't even matter if it makes sense.
>>101992311they are going to release the 5060 with 8gb aren't they? no way they release it with 12gb and then release the 5070 with 16...
>>101992358yeah i noticed, i'm in it, the thing that surprises me is that nobody is even trying to compete, like what the fuck man
>>101992344cool gen
now this is why loras are neatyoji shinkawa style miku (MGS)
>>101992365only when the AI bubble pops and they can't get rid of their stock
fucking fuck was organizing models folder on server via winscp, moved models folder to the folder containing models folder, thought it would merge but it overwrite the destination models folder with the empty models folder from comfy, now all models and my custom tuned loras since sd14 gone KEKW trying ext4magic and extundelete dont use winscp it is the biggest piece of shit, linux doesn't let you mv with files in there, instead winscp deleted without prompting me about the delete when issuing a move
>>101992358the bubble is already bursting
>>101992390Oh Anon, the bubble has only just begun.
>>101992375we will probably get a 5070 super with 16gb, so we are in the refresh hell.
>>101992373
The base 5060 will have 32GB, have faith.
>>101992409oh yeah this generation is fucked, but it'll improve in the future when things stabilise and people realise AI is a cash sink
>>101992064>bergtook me a while
>>101992425>it's not tho, I use it for work all the time and it has saved me lots of time and money. If you use it for gooning alone or even worse, having lewd chats, then yeah, it's a cash sink.
>>101992311>companies will save half a cent on components to save $1 million>they don't care about 2.8B in revenue
>>101992458I think he means more about the billions all these corporations are spending, probably a lot of them are gonna lose money when competing with everyone else. That's my guess
>>101992368thank you>>101992375>>101992390>>101992425stock wise its its always a gamble, but internally the in the tech industry it only just started it changed the server backbone requirements big time, every big corp and their uncle are preordering hundreds of thousands of blackwells just to power there new shiny AI software as a service things .. I mean didn't Elon just preorder a few hundred thousands blackwells, right?
>>101992413
>>101992459Not when that revenue costs them $4b
>>101992422it already leaked its 28gb
>>101992472openAI (Microsoft) are spending billions on DALL-E yet it loses to open source flux + loras.many companies are all in on "AI" just as they pushed the NFT meme. AI is here to stay but a lot of companies are not actually producing any more. (SAI)
>>101992493>openAI (Microsoft) are spending billions on DALL-E yet it loses to open source flux + loras.You think they haven't kept working on new image diffusion models?GPT-4o also has image generation abilities, we don't know how good it is.
>>101992509>we don't know how good it isalways promising
Good morning local diffusioners
>yurocel
>>101992482you have misunderstood this chart, the cost of revenue here is the cost of all the revenue, it just happens to be positioned with and a similar size to the gaming revenue. with that said it wouldnt surprise me if their gaming margins are lower than their datacenter margins
>>101992535Jew truck?
>>101992482retard do you know what gross profit is? holy shit you people really are 90 IQ
>>101992544i mean that's kinda obvious, the lockdown is over and things haven't changed much in a couple years for top end gaming requirements
>>101992482this nigga CANNOT READ A SIMPLE CHART
>>101992535What's in the truck!?
>>101992544>>101992556It doesn't even matter because the point remains they literally do not give a single fuck about you. You are not their main customer anymore. It's never been more over.
>>101992509the main problem with corporate AI is them neutering it because of DEI or people wanting censorship. I can use an uncensored Llama 3.1 model to say anything. ChatGPT will censor itself. DALLE will censor itself.Open source will always, always win, even if Microsoft have billions in AI farms.
>>101992576typical aislopper
>>101992581sorry you're 90 IQ, your opinion is useless
>>101992587Enjoy your 28gb $4000 5090
>>101992581I don't think that's how it works though, they want every penny possible. And the future is unpredictable, consumers can grow etc
>>101992595sorry you're 90 IQ, your opinion is uselessmakes sense why you're black pill though, you're too stupid to understand the world, without iPhones you wouldn't even be here
>>101990224I have never saved a single gen in all these years. They disappear almost as easily as the appear.
>>101992602see >>101992587
>>101990224I always like reusing old prompts in new models just to see what happens
>>101992609>not only can't I click right I think they don't care about $2B/quarter revenue
>>101992608I have a 2TB HDD full of them. I need a NAS.
Where do I set clip skip in comfy?
>>101992583you think the models OpenAI gives other corpos access to are the censored ones? No, they use the best they have, any restrictions on what can be generated are hammered in the contracts.It's different when they are offering a service to the public at large.
>>101992660You're wrong, they drink their own Kool-Aid.
>>101992545
Gotta love combining different character loras>Nicolas Cage and Alex Jones fighting each other
>>101992660and this is why we need open source, cause we aren't corporations. I'm sure openAI have image models that generate tentacle porn all day, but we'll never see them. But flux/sdxl/pony exist and are free.
>>101992671sama loves dick and money too much for that to be true.
>>101992676I dont get it
>>101992563huh? i said margins, as in the profit per dollar of costs within that sector, i.e. selling a $100 card for $200 vs selling a $100 card for $250. we agree that they aren't going to prioritize gaming but you seem to be misunderstanding a lot of the basics...>>101992598nta but. they do, but the issue is if you give a consumer card something like 48GB of RAM and still sell it at a "consumer" enthusiast price like $2k-$4k, you damage your business sales because suddenly a bunch of businesses swap to buying that instead of the $10k+ datacenter card. that's the real issue. yes, in theory with lots of competition they should sell the cards for exactly what they cost plus 1% margin, in practice supply and demand means they can crank the price and still sell almost as many for a greater return, at least with businesses.
not for honor, but for youuuuuuuu
Rad
>>101992685They're closeted puritans, it doesn't mean they're 100% bought-in in her turn, the male gaze, racism, etc. They might have their own personal models they train in their basement with their H100s laying around but at the corposhlurpo it's them marching together in Puritanism.
>>101992681If you didnt tell me it was them I wouldn't have guessed. Its not a good likeness
>>101992577this>>101992693it's an israel jew truck, that's it, inspired by the cyberjews post
>>101992645yup got about as much, luckily 4gb of nvme are just 100 bucks these days and getting cheaper everyday>>101992608sad, what I am actually doing right now is going thru my old gens and just paste em into flux (even the schizo 1.5 prompts) and check what turns out, some are awesome
>>101992715What is a cyberjew? Did I miss the establishment of a meme?
>>101992694It's bad business practice to bend your customers over a barrel, even enterprise don't like to be gouged. If they're basically willing to take a slower card but with 48 GB of VRAM because it closer matches their needs and Nvidia is actively ignoring and abusing them, they will remember that and there ARE competitors that don't think $2B+ as chump change.
>>101992707Nah, I believe in the greed of man.
What is the best FLUX model for a lower VRAM card? I have an 8GB card and have been using the nf4 but gen times are like over a minute a gen
>>101992708Yeah, chara loras overlap each other really hard
>>101992734>It's bad business practice to bend your customers over a barrelTell that to every business everywhere for the entire history of humanity.
>>101992740You're completely wrong, I worked at one of these companies, the peons believe in it 100%. The peons are the ones working with such fervor to ensure the model won't say nigger.
>>101992747lmao
>>101992761Yes can you fucking believe it? I bet you're too young to even remember Sears. Or IBM. Or as Intel crashes as we speak.
>>101992731>What is a cyberjew? I don't know why this question make me laugh so hard. Anyway I was referring to this post>>101992064
>>101992660>>101992671OAI definitely give the "uncensored" models to other businesses, very occasionally someone scrapes a big business's key with unfiltered Dall-E 3 and gens a bunch of very realistic but shitty lewds with it. The base model is much like any other in that it usually generates flesh horrors for genitals, and often weird lumps or gems for nipples, just due to the dataset and tagging stuff. Despite that it's still a very horny model by default.Also, they don't really drink their own kool-aid, they very obviously barely give a fuck about filtering/"safety" from a lewds and racism perspective, they do exactly what they need to to avoid getting completely BTFO by journalists and public opinion. The best example of this is serving up ChatGPT as the main source of GPT for the general public, which refuses to engage with anything lewd or illegal or race related or whatever to the point where even turbonormies get frustrated with it, but if you scratch the surface and pay a pittance to generate with an api key (or scrape/proxy), you can trivially launch right into your isekai raceplay gangrape tentacle pregnancy fantasy with any basic 2 sentence jailbreak from the sys role.
I can't get over the lack of control I feel with Flux compared to XL.
>>101992784Okay I guess I'm missing something because that's just a car
Fluxbros...
>>101992779I sure can't wait for the housing market to crash and for rent prices to come down and for fucking FOOD to be affordable. Thank you for your wisdom
Another discussion heavy thread hits the bump limit so here we go...>>101992797>>101992797>>101992797
>>101992817why is the discussion so heavy tho
>>101992715OK inspection of the truck is complete, you may continue...
>>101992734Agreed, and it may bite them one day, but it's not exactly "bending them over a barrel" to price according to supply and demand as long as you're genuinely trying to produce as much as you can. It might seem like stuff should theoretically be sold for something like "cost plus 10%" or whatever % is needed to cover risk in that business, but it's simply not true. If everyone wants the thing, and selling it for cost plus 100% results in people still competing to fight over the thing, then selling it for cost plus 10% simply promotes scalping, discourages/shuts out competition, prevents you from using those profits and reinvesting capital into further production, etc. Artificially limiting supply to fuck the supply/demand curve into giving you insane margins is terrible behaviour, but selling according to market demand is not really going to build any resentment.Also, if anything they engage a lot in the opposite with consumers for PR reasons w/ the whole "get the cards into the hands of gamers" stuff; lots of deliberately selling GPUs in bundles or in prebuilts so that it's harder for crypto miners to buy a GPU without ending up with useless extra crap.
>give the customers a 48GB cardDo you guys think businesses will only buy workstation cards or something? Make a cheap card with a shitload of vram and I guarantee you no ordinary person will ever see these cards in the light of day
>>101992794the sign in the background has "berg" at the end, which is a common jewish last name suffix, or surname, whatever. It took me a minute to realize why the anon wrote "cyberjew" with his image, it must have been since he only prompted for a car and got a random jewish sounding neon sign in the background unprompted, and once the realization hit I laughed and was inspired to generate trucks with the colors of the flag of israel and the star of david
>>101992882Sounds like you need to go outside man
>>101992865It is bending over a barrel to purposely underserve a market segment essentially forcing a $2000 upgrade.- 4090 (24 GB) is $1600- A6000 ADA (48 GB) is $8000We both know there should be a 4090 with 48 GB of VRAM for $2400
I am an idiot. Only been messing with AI for a couple of weeks. That said...I'm at the planning phase for a new machine. I'm fairly confident that the 50 series is going to disappoint (as someone mentioned above, less vram so you have to buy the enterprise cards) and I'd bet the top-end 50 card is gonn be over 3 grand. I saw the GN news vid mentioning a 48gb 4090 spotted in China priced at 2500 and it made me think.Nvidia SLI is long dead, but is there such a thing as AMD SLI? You could buy two 7900xtx for under 2 grand with a bit of shopping around, could that be a sneaky way to big boi vram?Another idiot question; I'm currently running a 1080ti, which does support SLI. What If I got 3 more secondhand 1080tis and ran a quad SLI setup? Has anyone tried that? OR would it be a terrible idea for other reasons?
>>101992747kek poisoned lora leaking on the other subject
>>101992919oh i thought you were talking about the businesses getting bent over a barrel by the margins being bigger. Yes, i agree completely, high end enthusiasts specifically get very fucked by this decision, people who want a card on the consumer pricing curve but further out into a 48GB VRAM range without jumping up to an $8k+ workstation card have no options, and are sacrificed in favour of not letting businesses have a cheap 48GB card. feel free to feel some resentment.with that said, as >>101992875 points out, let's pretend they *do* try to sell a 48GB consumer card for $2500. businesses will buy this card in droves and do anything they can to get their hands on it for anything a dollar below $8000, and scalpers will grab whatever they can knowing the market value is what businesses will pay for it. next to none will find their way into the hands of actual enthusiasts, even with "sold in a gaming PC" tricks.
>>101992893
>>101993011I just don't think it's that big of a deal, enterprise cards are more about efficiency, a 4090 with 48 GB of VRAM is going to be higher maintenance than an A6000 as well as being bigger. And going back to my point, if businesses actually want the 4090 with 48 GB of VRAM over the enterprise cards so bad, then it is Nvidia fucking them over.
>>101991531teehee, you silly sausage.
>>101992743q4 is good I think or nf4 v2
>>101993151Where can I get q4
>>101993162https://civitai.com/models/647237/flux1-dev-gguf-q4-q5-q8repo link on the page should have it, q4_0 should be it, use it with the unet loader gguf node
>>101993173Its unusable on forge?
>>101993249forge works just make sure you have the encoder + clip l + vae selected
>>101993329I dont see either of those in the model files on the pagehttps://huggingface.co/city96/FLUX.1-dev-gguf/tree/main
>>101993395https://huggingface.co/city96/FLUX.1-dev-gguf/resolve/main/flux1-dev-Q4_0.gguf?download=truethey should be in order from q4 to q8
>>101993451Yes I see and I'm downloading now I dont see the encoder, or vae etc,only the q4 gguf
>>101993478https://huggingface.co/black-forest-labs/FLUX.1-dev/tree/mainvaehttps://huggingface.co/comfyanonymous/flux_text_encoders/tree/main4gb text encoder
>>101993541Thank you so so much
>>101993548np, yeah the models are scattered all over, the main comfy guide uses an all in one file (model/encoder/vae in one)https://comfyanonymous.github.io/ComfyUI_examples/flux/
>>101993559Thanks again man. Which of each file do I download? I'm.prettue sure I need the ae.safetensors but what about the clip
elon musk gives you a guy who looks nothing like him while Elon Musk is pretty close. You'd think he would be well known enough to not have weird tokenization issues.
>>101993597clip l, and the fp8 t5xxl file, both are needed for the encodersit would be nice if this was all in one place but yeah, only need the files once.
>>101992944quad sli 1080 idea is based, but unfortunately Comfy doesn't have multi gpu support for inference (aside from offloading clip and vae to another gpu vram) maybe another client does
>>101993638Thanks again. And where do those go? Theres no clip folder in the models folder
>>101993674clip l and t5 in text_encoder, vae in vae, model in stable-diffusion I think
>>101992695Based. I love that song.
>>101993819i like this one
>>101993763Thanks so so so much again anon.
>>101993846np, yeah there are a billion variations of the same models and its initially confusing what you need for the various guis.
>>101993861Thanks again. Its very confusing and I'm a newbie to flux. I'm very grateful and I hope you have a good day.
>>101993914you too, have fun genning
>>101993673It's my reluctance to throw away/sell old hardware that spawned the idea. That 1080ti has been so good to me for many years, I'd feel bad if it didn't get a new life doing something cool. And using it in a home media centre (my go-to for old rigs) seems like it would be a bit of an insult to the greatest GPU ever made.I might do some digging around to look deeper into the quad SLI 1080 for AI idea, but I'm not savvy enough to figure out the issues that may arise.I mean, the enterprise folk are running multi-GPU stuff all the time (admittedly not for genning pictures but still), so there must be a way.
