Discussion of Free and Open Source Diffusion ModelsPrev: >>107999241https://rentry.org/ldg-lazy-getting-started-guide>UIComfyUI: https://github.com/comfyanonymous/ComfyUISwarmUI: https://github.com/mcmonkeyprojects/SwarmUIre/Forge/Classic/Neo: https://rentry.org/ldg-lazy-getting-started-guide#reforgeclassicneoSD.Next: https://github.com/vladmandic/sdnextWan2GP: https://github.com/deepbeepmeep/Wan2GP>Checkpoints, LoRAs, Upscalers, & Workflowshttps://civitai.comhttps://civitaiarchive.com/https://openmodeldb.infohttps://openart.ai/workflows>Tuninghttps://github.com/spacepxl/demystifying-sd-finetuninghttps://github.com/ostris/ai-toolkithttps://github.com/Nerogar/OneTrainerhttps://github.com/kohya-ss/musubi-tunerhttps://github.com/tdrussell/diffusion-pipe>Zhttps://huggingface.co/Tongyi-MAI/Z-Imagehttps://huggingface.co/Tongyi-MAI/Z-Image-Turbo>LTX-2https://huggingface.co/Lightricks/LTX-2>Wanhttps://github.com/Wan-Video/Wan2.2>Chromahttps://huggingface.co/lodestones/Chroma1-Basehttps://rentry.org/mvu52t46>NetaYumehttps://huggingface.co/duongve/NetaYume-Lumina-Image-2.0https://nieta-art.feishu.cn/wiki/RZAawlH2ci74qckRLRPc9tOynrb>Illustrioushttps://rentry.org/comfyui_guide_1girlhttps://tagexplorer.github.io/>MiscLocal Model Meta: https://rentry.org/localmodelsmetaShare Metadata: https://catbox.moe | https://litterbox.catbox.moe/GPU Benchmarks: https://chimolog.co/bto-gpu-stable-diffusion-specs/Img2Prompt: https://huggingface.co/spaces/fancyfeast/joy-caption-beta-oneTxt2Img Plugin: https://github.com/Acly/krita-ai-diffusionArchive: https://rentry.org/sdg-linkBakery: https://rentry.org/ldgcollage>Neighbors>>>/aco/csdg>>>/b/degen>>>/r/realistic+parody>>>/gif/vdg>>>/d/ddg>>>/e/edg>>>/h/hdg>>>/trash/slop>>>/vt/vtai>>>/u/udg>Local Text>>>/g/lmg>Maintain Thread Qualityhttps://rentry.org/debohttps://rentry.org/animanon
1st for kill ani
Finally, an epic bake! Expecting lots of good stuff this thread
Epic bread of valor
so what now?
>>108001477What we do every night...
cope and seethe over saas victory
>>108001500way to ruin that layup man...
“play with our nano bananas” was right there…
Blessed thread of frenship
>>108001424I wish sd.cpp was as fast as the pytorch web UIs but it just doesn't keep up (18.11s vs 10.7s in forge classic for picrel). You can just make Qwen coder 30b write a python QT GUI for the sd-server api though instead of using ani's mess that doesn't even compile.
>>108001623the majority of the time is spent inside cuda kernels on the gpu, whether you're using python, c++ or brainfuck to delegate those calls doesn't really matter, dumbasses think this is like traditional software where c++ == fast but in fact you gain zero speedup here, just the inflexibility of a shitty compiled language
>>108001623just use koboldcpp desu, it has llmao.cpp and sd.cpp integrated
skin came out damaged :(
Compiled around 200 images from some anime artist I'm into and captioned them with tags. Now how do I make a lora for flux 9 klein edit?
>>108001739Download a LoRA trainer of your choice and run the script on your dataset?You've already done the hard part.
>>108001739you also have to caption some edits in your dataset (source image -> dest image) along with caption.otherwise youll murder the edit capabilities
>>108001753For an edit model, do I not need before and after images since it's an edit model? Or will the model perform the same task while incorporating my lora into consideration?
>>108001778>>108001786I was thinking about that
Zib loras on Zit are better than Zit loras on zit
>>108001786Okay, for an edit model you'll need the control images. Luckily flux already does an okayish job of translating things from anime to real. If you want to paypig, you can use nanobanana or something to do an even better job.Use the real outputs as your control dataset and the anime images as your target dataset. So yeah if you want to do more than just train a style, you need to now convert those images to a realistic style.
>>108001849yep
>>108001849Nice now make her pregnant
>>108001706I know that, sd.cpp's cuda backend just isn't as optimized as pytorch and it's nothing to do with "muh language". I hope it closes the gap in the future because it's a lot lighter than pulling in 8GB of pytorch dependencies and is a lot less hassle to make work on AMD with the vulkan backend option which is more performant than their rocm backend but still results in an rx 9060 taking 21s for what takes an rtx 3060 18s.>>108001710I do use it but just for the text side when I want the fancy markdown rendering I don't get in a terminal with llama-cli. Does kobold's built in sd.cpp keep the image model loaded instead of loading it from disk ever gen like sd-cli or is it just a webui for sd-server?
>>108001864So 1:1 ratio , each anime image gets a realistic version?400 total images: 200 anime + 200 realistic counterparts.
>>108001911>>108001791>>108001623What the fuck is this llama talk and all this miku stuff? are we being raided by /lmg/? fuck off, comfy has a better ui
>batch size must be same or half of batch size of text embeddingsBut they are the same number of files and both divisible by two, wtf does it want? 58 images.
>>108001864>flux already does an okayish job of translating things from anime to real.I can reverse engineer my dataset.
>>108001947Are you using cache text embeddings or unload TE in AI Toolkit? They seem to be broken.
>>108001963caching
>>108001965Yep doesn't work with batches even if you have right amount of pics in each bucket.
>>108001962>I can reverse engineer my dataset.That's right.>>108001925Yes, but also that's a lot of images.
>tfw got zit working on my potato machine yesterday somehow>lost the workflow and every attempted recreation seizes the machinesigh
I know the dev is a roach but he shouldn't let bugs live in his code.
>>108001623Wow that even looks better than tranistudio
>>108001974>batchesI don't want to start a debate here, but is there really any point to batching. I feel like there's no middle ground. You either do none or have massive batches.
>>108001998>is there really any point to batchingfaster (and better) training, low batch = low signal to noise ratio
>>108001986>Yes, but also that's a lot of imagesHow many do you recomend?
>>108002006They say it helps the model generalize.
>>108002008Like 100 or so. I trained that WoW LoRA on 280 images and it was excessive. I've gotten the same or better success from like 50 or 100 images selected for best quality.
>>108001990I know the roach is a dev but he shouldn't let code live in his bugs.
the chroma2 images shared on Furry Discord are pretty intense.Looks like Klein 4b is a real monster when it comes to training
>>108002038Good, thanks, so 100 total images 50 anime style + 50 realistic style.
>>108002057You forgot to include your donation link, load of shit stones.
>>108002057proof?
>>108002064Yes, probably. But don't take my word as gospel. You can always just add more images to the dataset if it's not working.
best way to create decent lora from ~200 images?can any fren point me to somewhere where i can do it with 4070s?me too retarded for this
>>108002034Idk how much it helps in this regard since our lora batch sizes are very small, the training "time" is also incredibly short, still, its pure benefit with no drawback for diffusion models.https://arxiv.org/abs/2411.03177v1
>>108002082Onetrainer
>>108002082I'm feeling generous. Send me those pictures of your little cousin and I'll make that lora for you.
>>108002082Recently talked topic,
>>108002082You probably wont need 200 images. use AI-Toolkithttps://github.com/ostris/ai-toolkit
>>108002006That's what they say but how does say a batch of 4 perform over 1? or 50 compared to 1? I've never seen it quantified and you can find arguments for both.
>>108002057may we see it
>>108001998>You either do none or have massive batches.I've been told you should not do more than 4 batches (or 2 batches + 2 gradient accumulation) for characters. Just 2 batches seems to work as well.
So any news of large scale finetunes of z-image? Surely someone has started.
>>108002106Sublinear growth, it improves by sqrt(batch size), which is the ratio you can increase the learning rate by when increasing the batch size, with batch 4 you have twice the signal to noise ratio of batch 1, doesn't mean it will train twice as fast because of training dynamics (like how the first few steps the optimizer has no idea where to go and has to "warm up" accumulating momentum)>you can find arguments for both.Outside of diffusion models yes, there are neural network architectures that perform better on smaller batches (.e.g GAN), all of them still colossally larger than anything we do with loras (train at batch 64~32 instead of 128 or 512 lol)
>>108001942Relax schizo-kun I lurk the image gen threads more than I post in them, I just posted a couple mikus (second one isnt me) because I don't want to be a nogenner like you or an obnoxous avatarfag.I don't like comfy (or ani before you accuse me of it) so I don't use it, I don't care what you like or use.
>>108002129i think lodestone mentioned something about training a vae-less version of z-image
>>108002151Don't pay Julien any mindHis failure as a "developer" has made him intent on destroying this generalWe love our /lmg/ brothers
>>108002150Well, I'll give it a spin.
>>108001415I'm a complete neophyte regarding local diffusion, but I've recently trained a LoRA based on a character of mine>https://files.catbox.moe/yoamgt.safetensorssadly, I'm don't yet know how to make characters that don't look like burn victimsI'd appreciate any help
>ai toolkit webui has links to discord, youtube and donations, but not to githubWow truly the peak of today's foss software. Nukes when?
>sage attention>flash attentionwhich one does anon use?
>>108002317>Can't be assed to set up wsl to use diffusion pipe right now>decide to use AI toolkit>scroll down the page to get install instructions>See a bunch of random looking squares before the relevant information.>it's his patreon subscribers or somethingjesus.
>>108002270Whats the base model
>>108002328FA doesn't seem to work with imagegen and SA only has gains for video. Use fast fp16 if you want speed.
>>108002158It's so unfortunate that his broken UI and unhinged behavior here drives people away from even trying or contributing to sd.cpp, I've even seen anons being mislead about it's model support from his outdated readme failing to mention zimage and flux2.Not to be a shill or anything, I just prefer native GUIs to webapps and like the ease of setup compared to a pytorch environment especially for an AMD card. If anything he's why I post bringing attention to the upstream project which I think actually has some value especially for the AMD-only anons.
>>108002343>fast fp16 if you want speed.And fucked up results.
>>108002328Cross attention
>>108002317>wh*tes when they can't just enslave people to get shit for free
>>108002339Illustrious XL
>>108002355wut
Where are julien posts, I need to chase him
>>108002355Fix the batch size bug, roach. Not donating btw you grifting cuck.
i just pressed run workflow on z-image. i'll be back in a couple of days with the result
>>108001415Grok Imagine is almost completely uncensored btw, and is available over the xAI API. Does images and videos. It doesn't let you gen actual sex and pussies, but basically everything else is fair game. Also it does decent audio (not shown here, but it actually does, about Veo 3 level). I hope Musk doesn't censor it later.Videos are 6s but you can gen from 1s to 15s (i just used the default 6s), and generation for 6s takes under 1 minutehttps://files.catbox.moe/88w9kr.mp4https://files.catbox.moe/8uzs4d.mp4https://files.catbox.moe/5tan4z.mp4https://files.catbox.moe/cqh1cb.mp4https://files.catbox.moe/y4qofn.mp4https://files.catbox.moe/0z9vqq.mp4
>>108002481Is it local?
>>108002489better than local, better in softcore nude than your local models, you can switch tabs with comfy
>>108002481>gachashit>SAAStrashback to the jungle wth you, disgusting SEAmonkey
>>108002481This is very good! better than WAN rotoscoped slop, thanks anon I will try it out.
>>108002495What does that mean? Is it local?
>>108002495Ia it local?
>>108002347not a thing
>>108002506>>108002495Yes, like electricity, your money printer, and your bank account ;)You can access it from your home PC, or phone.
>>108002495>>108002502You think replying to your own posts will work?Everything you write smells like you: putrid shit
>>108002512>not a thingIt absolutely is. Do a test with and without it.
>>108002481>>108002495>>108002502>>108002526Why is the developer of tr*nushartdio shilling SAAS models now?
>>108002481What is it about the word "local" you don't understand?
>>108002530>You think replying to your own posts will work?Yes>Everything you write smells like you: putrid shitBetter than local. Meta off-topic crying is irrelevant. ;)
seems like the browns are upset, must be a good model then
>>108002552>Meta off-topic crying is irrelevant. ;)You are sething so hard, you shit-eating turd world nigger
>everyone falling for either the bait or oblivious personcmon local sisters, we can do better
>>108002543It’s better than local, it’s relevant and has to do with Local Diffusion>>108002570Where are you going to get your dataset local roach? Or did you forget the NAI leak and how the local roaches stole from it? ;)
>saar do the grokful saar
if it has api nodes then its local. if not, its off topic
>>108002481>>108002495Its not local. You have to spend money and use an api. Also I can do 30+ seconds for free, now fuck off.
>>108002623Don't fall for the bait please
>>108002623Hehe, don't disrespect the ancestors of your dataset local cuck! You're a joke, a low quality one, just like your failed models.
>>108002640Your life must suck to do this everyday. I'm sorry you have nothing else going on.
>>108002631its the bot samefagging back and forth
>>108002631Yes, please, don’t learn from SaaS, don’t even look at it! Let’s stay safe in our little local world!>>108002649Yours too, if you go mad whenever you see something of good quality that’s better than your local cope.
>>108002481Thanks anon, very usefull!
Are the saas shills ironical shitposters or real
Tranustudio losted
>>108002631Baiters, shills and trolls should always be reminded this is a local thread. Their ape keys are no good here.>>108002640Begone adversary of closed source.
>>108002683It's the same retard recycling through his bag of grief, when there's nothing going on with new models he goes into his personal vendettas now he's just spending all his time spreading FUD
>>108002481Thanks! I wish local could do moans.
>>108001181>>108001510Finally RNG'd one decent enough to stop. Might see if non-Turbo has better prompt adherence later.>>108002346I used commandline sd-cpp for a while early on, and it was alright. I think VAE had to be done on CPU to avoid a memory-allocation bug, but it was quicker than tiling on GPU. Later I switched away from sd-cpp to Olive DirectML for more speed, at a cost of needing to convert safetensors to onnx, and being RAM-limited to 1280x800 due to how Olive loaded models. These days ComfyUI with ROCm works best for me though, and 1600x1280's my sweet spot. (I tried sd-cpp's ROCm version when it came out a while back, but it didn't work somehow. Might recheck if it's fixed sometime.)
>>108002677I think they're just as much shitposters and as real as the shills from Lodestone, Tongui, Comfy, Anistudio and BFL.
>>108001415>>Maintain Thread Quality>https://rentry.org/debo>https://rentry.org/animanonwhy are these in the OP? we just had two drama free threads and it immediately went to shit
>>108002661>Yes, please, don’t learn from SaaSwhat is there to learn? how to type some text in a text box?you have no control and zero knowledge of any of the internals and everything is completely opaque
>>108002699Ahh, only about 15 minutes after the SAAS shilling started, what a coincidence
Local model anons are so adorable, still in their rebellious teen phase. Come back when you've left mom's basement and gotten a job and then we can discuss local models realistically instead of circlejerking in an echo chamber.
>>108001623>>108001911>>108002346I think the main issue is catjak absolutely dragging ani's name through the mud. ani doesn't do drama or shilling itt. the second thing is you can just ask him in /adt/.
>ask for pentagram>get jewish star
are localtards falling for the bait or is it just samefagging? kek
>>108002754He replies to himself, he's going to do this so he can alter the OP for one thread during the day to feel good about himself.
please stop dramashitting already
>>108002754Thread has been dead since ZiB released and flopped, he is probably samefagging.
>>108002699Welcone back ani how did you sleep today
>hahaha you are a puny insignificant miserable outdated fool who will be left behind!!>noo i am upset, leave this thread now you off-topic poster! look how upset i am!update the script
>>108002699Hi julien
https://huggingface.co/OpenMOSS-Team/MOVA-720phttps://mosi.cn/models/movaNew video model that also does audio. Looks better than ltxv 2, its a 32B moe though (18B active)
>>108002803>18B activeOh cool, so it's like LTX 2 but it rapes my pagefile twice as much?
Klein is almost perfect, it doesn't even need loras to turn anime into photo-real, but if it's even a bit stylized it makes their heads huge and younger looking, has anyone managed to get around that? No amount of prompting I tried could fix that behavior and all the recent realism transforming loras either do nothing, or not fix this issue.
ani cannot stop spawning schizos>>108002302
whatever happened to AceStep 1.5? someone was shilling the release for days and then nothing
>>108002803benchod
>>108002803>https://mosi.cn/models/movawhat the fuck, these samples look awful.
>>108002699Hey someone build a better sd.cpp ui than you i think you just should shut up now >>108001623
What schizosare real and what schizos only exist in the mind of those schizos
>>108002803Shameful display.
>>108002752I was listening to https://www.youtube.com/watch?v=B8klPYjS3ws and here is your post out of sudden. Love such coincidences.
>>108002831that's a python wrapper. it's shit and also if the author didn't like python why did he use it? fucking retarded
>>108002827They said in 2-3 more days 2 days ago. This was the last message from the developer specifically regarding its release and that was about 2 hours ago.My gut tells me not this weekend. The only people that have the code now are certified "influencers" and developers. Comfy should have the weights right now but he doesn't come here any more because of the schizos so there's no way to know.
>>108002803Oh! Another failed model! Thanks, anon!>>108002827Looks like the shilling anon changed jobs.
>>108002848Yeah but it didn't take him over 2 years for a mess that does crash all the time and doesn't even compile like your shitty wrapper
There is no day 1 without ComfyUI support. Deal with it.
>>108002852its wan 2.2 with audio. I expect it WILL be better than ltxv....
