Discussion and Development of Local Image and Video ModelsPrevious: >>108528950https://rentry.org/ldg-lazy-getting-started-guide>UIComfyUI: https://github.com/comfyanonymous/ComfyUISwarmUI: https://github.com/mcmonkeyprojects/SwarmUIre/Forge/Classic/Neo: https://rentry.org/ldg-lazy-getting-started-guide#reforgeclassicneoSD.Next: https://github.com/vladmandic/sdnextWan2GP: https://github.com/deepbeepmeep/Wan2GP>Checkpoints, LoRAs, Upscalers, & Workflowshttps://civitai.comhttps://civitaiarchive.com/https://openmodeldb.infohttps://openart.ai/workflows>Tuninghttps://github.com/spacepxl/demystifying-sd-finetuninghttps://github.com/ostris/ai-toolkithttps://github.com/Nerogar/OneTrainerhttps://github.com/kohya-ss/musubi-tunerhttps://github.com/tdrussell/diffusion-pipe>Zhttps://huggingface.co/Tongyi-MAI/Z-Imagehttps://huggingface.co/Tongyi-MAI/Z-Image-Turbo>Animahttps://huggingface.co/circlestone-labs/Animahttps://tagexplorer.github.io/>Qwenhttps://huggingface.co/collections/Qwen/qwen-image>Kleinhttps://huggingface.co/collections/black-forest-labs/flux2>LTX-2https://huggingface.co/Lightricks/LTX-2>Wanhttps://github.com/Wan-Video/Wan2.2>Chromahttps://huggingface.co/lodestones/Chroma1-Basehttps://rentry.org/mvu52t46>Illustrioushttps://rentry.org/comfyui_guide_1girl>MiscLocal Model Meta: https://rentry.org/localmodelsmetaShare Metadata: https://catbox.moe | https://litterbox.catbox.moe/Img2Prompt: https://huggingface.co/spaces/fancyfeast/joy-caption-beta-oneTxt2Img Plugin: https://github.com/Acly/krita-ai-diffusionArchive: https://rentry.org/sdg-linkCollage: https://rentry.org/ldgcollage>Neighbors>>>/aco/csdg>>>/b/degen>>>/r/realistic+parody>>>/gif/vdg>>>/d/ddg>>>/e/edg>>>/h/hdg>>>/trash/slop>>>/vt/vtai>>>/u/udg>Local Text>>>/g/lmg>Maintain Thread Qualityhttps://rentry.org/debohttps://rentry.org/animanon
>>108535367kino
MYTH: api models are censoredFACT: api models are less censored than local models and are in fact trained on NSFW imageryMYTH: api models are too expensiveFACT: it's actually quite cheap to use API through ComfyUI API Nodes. the price for api has went down in comparison to the price of hardwareMYTH: api nodes collect your data and are unsafe to useFACT: api is safer than local because nothing is stored on your hard drive. with local models, you need to download hundreds of loras and custom nodes, any of which could be infectedMYTH: an api can pull the plug at any time, why use something like that?FACT: everything you generate can be saved to your desktop so nothing is lostMYTH: it's impossible to train a custom style of character with api, loras make local way betterFACT: api can learn any style or character with a single image reference, which is much faster and smarter than lorasMYTH: if i buy api credits and don't like the model, that's money wastedFACT: comfyUI's API nodes credit system allows you to prompt hundreds of cutting-edge api models. the credits share between models so you aren't locked in to any one ecosystemMYTH: api users are poor and from third world countriesFACT: the top hollywood productions and anime studios all use api models. api is the weapon of choice for everyone world-wideMYTH: discussion of api models is off-topicFACT: api models are part of the comfyui experience and are relevant to this thread. combining api models with local workflows is still local
im becoming too powerful
Blessed thread of frenship
>thread collage has actual hand-drawn hard work from non-AI artists in itlmao
>>108535397based anon finally switched to api
>thread is baked >anon immediately seething How does baker do it?
>>108535438By being a retard who can't tell an AI gen from a real painting I guess.https://x.com/Nyte_Tyde/status/1909771508697964672
>>108535453No I meant this anon >>108535396
>>108535562
>>108535599nice
>>108535622
nice to see a 2023 ai nostalgia thread
>mfw Resource news04/05/2026>ComfyUI-ZImage-Triton: Triton-accelerated W8A8 quantizationhttps://github.com/newgrit1004/ComfyUI-ZImage-Triton>ComfyUI Assets Manager v2.4.4 update https://github.com/MajoorWaldi/ComfyUI-Majoor-AssetsManager/releases/tag/v2.4.4>From RTX to Spark: NVIDIA Accelerates Gemma 4 for Local Agentic AIhttps://blogs.nvidia.com/blog/rtx-ai-garage-open-models-google-gemma-4>FLUX.2-klein-9B — PolarQuant Q5: 9B rectified flow transformerhttps://huggingface.co/caiovicentino1/FLUX.2-klein-9B-PolarQuant-Q5>Qwen3.5-9B-Neo-PolarQuant-Q5: 9B on any GPU with PolarQuanthttps://huggingface.co/caiovicentino1/Qwen3.5-9B-Neo-PolarQuant-Q504/04/2026>STAGE: Storyboard-Anchored Generation for Cinematic Multi-shot Narrativehttps://github.com/escapistmost/Storyboard-Anchored-Generation>Regularizing Attention with Bootstrappinghttps://github.com/ncchung/AttentionRegularization>LTX2.3-Multifunctional: Functionality optimization based on LTX desktop versionhttps://github.com/hero8152/LTX2.3-Multifunctional>Gemma 4 31B IT NVFP4 model is quantized with NVIDIA Model Optimizerhttps://huggingface.co/nvidia/Gemma-4-31B-IT-NVFP4>AP Netflix VOID – ComfyUI Custom Nodeshttps://github.com/adampolczynski/AP_Netflix_VOID04/03/2026>JoyAI-Image: Awakening Spatial Intelligence in Unified Multimodal Understanding and Generationhttps://github.com/jd-opensource/JoyAI-Image>Netflix VOID: Video Object and Interaction Deletionhttps://huggingface.co/netflix/void-model>OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoninghttps://huggingface.co/tencent/HY-OmniWeaving>Bias mitigation in graph diffusion modelshttps://github.com/kunzhan/spp>Control-DINO: Feature Space Conditioning for Controllable Image-to-Video Diffusionhttps://dedoardo.github.io/projects/control-dino>FlowSlider: Training-Free Continuous Image Editing via Fidelity-Steering Decompositionhttps://huggingface.co/spaces/dominoer/FlowSlider
>mfw Research news04/05/2026>PANDORA: Pixel-wise Attention Dissolution and Latent Guidance for Zero-Shot Object Removalhttps://vdkhoi20.github.io/PANDORA>A Benchmarking Methodology to Assess Open-Source Video Large Language Models in Automatic Captioning of News Videoshttps://arxiv.org/abs/2603.27662>Gated Condition Injection without Multimodal Attention: Towards Controllable Linear-Attention Transformershttps://arxiv.org/abs/2603.27666>NeedleDB: Generative-AI Based System for Accurate and Efficient Image Retrieval using Complex Natural Language Querieshttps://arxiv.org/abs/2603.27464>Domain-Invariant Prompt Learning for Vision-Language Modelshttps://arxiv.org/abs/2603.28555>MolmoPoint: Better Pointing for VLMs with Grounding Tokenshttps://arxiv.org/abs/2603.28069>AGFT: Alignment-Guided Fine-Tuning for Zero-Shot Adversarial Robustness of Vision-Language Modelshttps://arxiv.org/abs/2603.29410>LivingWorld: Interactive 4D World Generation with Environmental Dynamicshttps://arxiv.org/abs/2604.01641>Efficient Inference of Large Vision Language Modelshttps://arxiv.org/abs/2603.27960>Wan-R1: Verifiable-Reinforcement Learning for Video Reasoninghttps://arxiv.org/abs/2603.27866>A Robust Low-Rank Prior Model for Structured Cartoon-Texture Image Decomposition with Heavy-Tailed Noisehttps://arxiv.org/abs/2603.27579>CDH-Bench: Commonsense-Driven Hallucination Benchmark for Evaluating Visual Fidelity in Vision-Language Modelshttps://arxiv.org/abs/2603.27982>Rényi Entropy: New Token Pruning Metric for Vision Transformershttps://arxiv.org/abs/2603.27900>HSFM: Hard-Set-Guided Feature-Space Meta-Learning for Robust Classification under Spurious Correlationshttps://arxiv.org/abs/2603.29313>LVRPO: Language-Visual Alignment with GRPO for Multimodal Understanding and Generationhttps://arxiv.org/abs/2603.27693>Jagle: Building a Large-Scale Japanese Multimodal Post-Training Dataset for Vision-Language Modelshttps://arxiv.org/abs/2604.02048
> >108535715thread schizo
>>108535361https://huggingface.co/circlestone-labs/Anima/discussions/112Really interesting and thoughtful discussion about Anima’s obvious issues, Qwen’s attention, memory and the whole artist tag dissolution debate.Feels like it’s time to take a step back, be a bit more realistic about this model, and figure out if it’s actually worth it.
>>108535731Anima white knights will tell you that @artist tags are outdated tech like loras.
don't care still using anima
>>108535731The only solution I can think of is for tdrusell to rebuild Anima from scratch, but make it style agnostic and move all styles into small loras. That way, he could free up memory to focus only on characters and concepts, and then extract loras from those styles so we can apply them ourselves with different weights, something like DLCs in video games.
>>108535361https://huggingface.co/circlestone-labs/Anima>Any LoRA you train on a preview version should be considered a "throwaway" LoRA. There's no guarantee it will work well on the final version.Any word on when this "final version" will be finished and uploaded? Or is that what preview-2 is supposed to be?
>>108535855THIS just like saas! we all know that models like GPT-2 Image use microloras for concepts, which is why they're able to accurately display the hands of an analog clock or fill a wine glass to the brim. They load up loras based on your prompts. I'd even better they're really all just running Flux.1 Dev in the background
>>108535821This same issue would’ve probably happened to Rouwei dev with their model that adapts the T5 text encoder to SDXL. CLIP was a gift from God for anime models.
https://huggingface.co/lodestones/Zeta-Chroma/tree/mainthis is so bad lmao
That's some pretty good, and thoughtful FUD desu. It matches my thoughts on blending multiple artists being a giant pain in the ass.>>108535889Sometimes I forget CLIP is from OpenAI, before they became a giant scam.
>>108535855>>108535882SaaS models probably ran into this same issue much earlier. At some point, having the model know every artist’s style all the time became unnecessary, especially since many art styles contradict each other and just end up confusing the model.
>>108535890i see why they call it pixel space!
>>108535930> many art styles contradict each other and just end up confusing the model.You’ve got a point. It could also be that MoE (Mixture of Experts) technology from LLMs gets applied to diffusion models, where the model doesn’t always activate all its parameters, but instead uses different ones depending on the prompt.
>>108535890Lodestone should retire.
>>108535890it's not finished. why are you judging underbaked models?
>>108536014>it's not finished.https://xcancel.com/LodestoneRock/status/2040745179372818437#m
chroma will never be finished because >>107962458
>>108535890why doesn't he try video model?
>>108536051money doesn't grow on trees
>>108536069Talent neither, he vibe trains models
>>108536038no model is ever truly finished because you can always make it better.
in kekstone's case, you can always make it worse!
SPARK Chroma is very promising even at 512 resolution. I'm looking forward to the 1024 version.
>>108535731the idea of embedding tables and removing artist string to avoid fucking up the semantics is interesting, has any model done this before?
>>108536069not starting from scratch. he can begin with loras, then merge models, and so on. it's better than spending money on new weird image models
>>108535731Fuck...
For the guy that wanted a "lewd" Jennie, ZIT gave me exactly one (and only one!) that wasn't too horrible... scaled down further than usual to help smooth over any flaws.Happy Easter!https://files.catbox.moe/7kr6oy.png>>108535890...aaaaaaand DONE!
>>108536181I wish he made gguf versions too
>>108536181>SPARK Chroma is very promising even at 512 resolution.can you showcase some images?
>>108536200why don't you make them yourself?
quick rundown of why CLIP is at the same time outdated and outperforming other encoding methods?
>>108536194??
>>108535731Anything that isnt clip will have similar issue, its not Anima specific.
>>108536209because the gimmick fork of lcpp doesn't compile
>>108536228I’m not sure, but the same thing happens with SaaS models , it’s kind of CLIP magic. Tdrusell will probably need to retrain CLIP and plug it into Anima because for anime, it’s super important.>>108536239It’s crazy how CLIP just happened to work so well with SDXL and how we use it for anime. Makes me think NAI might be doing something similar to Bluvoll, like training SDXL from scratch with a better VAE, CLIP, improved captions, and v pred, maybe a little text encoder for prose?
>>108536201trust the loss bro, trust the loss
>>10853627436 stars status?
>>108536286This is where you turn into a clown, man. We're literally talking about the HuggingFace link >>108535731 where that person breaks down Anima's problem really well, and you come back with '35 stars status.' Responses like yours are the ones that actually hurt Anima and /ldg/ the most.
is there a way to filter exclusively for cunny on civitai? they have to be tagged as SFW, but the problem is that normie slop can also be sfw. such a pain in the ass
>>108536363How do i use gpt 2 in aren.ai?
>Tdrusell will probably need to retrain CLIP and plug it into Anima because for anime, it’s super important.trani smell
-first pass seedvr-second pass with pre noise injection for 'to much details'-second pass blend luminosity onto first pass-Duplicate second pass, 3% screen blend-inject 0.08 noiseDownscale to 1mp and aggressive jpg save like quality 4Feed back into seedvr -> profit
>>108536197happy Easter based jenner!
>all of these issuesOkay, but what's the solution? Surely there's a solution amongst all the chaos, right?
>>108536197>https://files.catbox.moe/7kr6oy.pngWtf is wrong with you??? Are you a cuck or something??? Self insert is not a valid answer.
>>108536410what issues?
>>108536415>Self insertdo you seriously think this anon has such a big dick? kek
>>108536410Lucky there are people posting their issues on Hugging Face so tdrussell (who checks his account like once a month) can actually explain what's going on. The artist tags thing probably caught him off guard, not being into anime genning, he never imagined people would stack more than 1 or 2 of them or play with weights.
>>108536357No. You have to follow specific lora creators for the type of content you want, which sucks because people who only make 1~2 loras then disappear will be hard to find.
For people wondering about a method for mixing artist in Anima, just use prompt editing in Forge Neo.https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Features#prompt-editing
guess i'll conclude the rabbit theme
>so tdrussell trani smell
>>108536452Try 4-10 of them, autistically staged to come into or exit the prompt at certain stages, thanks to the seamless blending magic of CLIP, thanks to scam jewman
>>108535731Probably will be lost between discord drama shitflinging here but an interesting read.>>108535857No timeline.And preview 2 is not the final version.
>>108536496No, prompt scheduling and so on doesn't really work. [@artist1: @artist2: weight] just results in artist1's style.Curiously [@artist1|@artist2] which is supposed to alternate artists every step, seems to result in artist2 all the time. Not sure why.The only thing that seems to work is using them every step, @artist1, @artist2.... but even then one style really dominates the image composition.
>>108535890It's interesting how the Miku plushy seems somewhat OK compared to the rest of the raped image.Makes you wonder if he also fucked up something related to conditioning on top everything else related to this schizo experiment.
>>108536575prompt scheduling works to some degree. It's a poor man's controlnet. It'll never work the same as mixing though.
>>108536566This has been known since SD3. These nu-models cannot blend things, only stack concepts like clipart. Remember cumstain's early SD3 shilling where it just pasted objects on top of each-other and looked absolutely terrible? Not much changed in that regard. Nobody will do anything about it because it's a billion dollar research problem nobody cares to address. No modern models even have style tags to blend, only the anime community even gives a shit about artist mixing. Maybe you can beg lodestone to solve the problem.Or just train SDXL again for the third year in a row
>>108536575I've got it to work but you have to consider which artist has more data trained. An artist with 2k images will dominate an artist with 100 images. So something like [@WeakArtist:@StrongArtist:0.7] would be ideal. It's not perfect but is more effective than just listing artist.
>who cares if my characters and concepts keep getting blended together bro none of the 20,000 other artists match my special snowflake mixwhy should I care about 1girl, cowboy shot posters?
>>108536626The first x steps are supposed to determine the overall composition, not the last or how popular the artist is.....
>>108536657sdxlkeks are a cult and will be left behind, anima proved that. people used pony shitmixes for an entire year without a single artist tag. they will cope with loras like they always do, stacking 11+ concept, character, and style loras until the outputs melt down into the same civitslop style they always do.
>>108534217Read slop summary of its paper.I struggle to understand what this brings for fp16 inference. It doesn't seem to lower storage or VRAM requirements, nor increase inference speed.For int4, it seems to improve quality over standard int4 quantization. (New nunchaku method soon?)>>1085361812500 images seems rough for what its ambitions.This guy should better just make a lora instead of wasting compute, or expand the dataset at least ten-fold and commit fully.
>>108535361is it possible to make cohrent/consistent gifs with diffusion?
Weird how much discussion this model is getting when anon was so sure no one would use it because of its licence
I miss when anima didn't exist and this thread was gatekeeping Noob and also trolling people into using WAI-nsfw-whatever. That was some funny shit.
>gatekeeping noobholy newfag
>>108536752>also trolling people into using WAI-nsfw-whatever.No one did that kek
>>108536742just make a video and save it as gif
>>108536692>or expand the dataset at least ten-fold and commit fully.the guy is making it on a singular 4090 gpu. expanding the dataset 10x would make it take years to complete.
give me prompt idea
>>108536752The one shitposting was the NoobAI shill. Everyone still uses WAI because it's easier and gives comparable results. I still haven't seen a single image that convinced me to bother with NoobAI.Fuck off
>>108536797It says hundred hours in the screenshot so it would be thousand hours or 40 days which is doable.Even if he succeeds at stabilizing the model he will teach it a lot of noise with tuning on 2500 images.Just switch to lora at this point, also go for full 1024p training while at it.
