gemmaballs

Official laugh at qwenfags week!

>>110313086
Unprotected sloppy sex with Gemma-chan

>>110313000
they did wait until they put everything on the firmware, but the reason why they even had to open source their driver was the constant fighting with kernel developers putting more of the code under GPL only symbols and the risk of having to live under a legal grey zone (I say grey because I don't remember if there was a successful lawsuit to protect a GPL project) if they had to go against their wishes when they needed to support new features. Source: someone I know from the driver team.
You can find some articles talking about the constant fights too:
https://www.phoronix.com/news/Linux-Kernel-Blocking-NV-NetGPU
I can say the open module has been in the plans for quite a long time.

>>110313086
Sex

Any chance nvidia employees will force the board to bring Jensen back like what happened at openai?

>>110313189
zero.

I forgot to save some X posts about various universities figuring out how to use LLMs better, like making them take different personas/angles to a problem/task and mixing those up. Sounds like the ideal stuff for local models.

I need to move beyond writing grammar- and typo-corrected syntax and posting the question twice

File: 1793656550842957.png (2.14 MB, 1145x1374)

2.14 MB PNG

>>110313086
GEMMAAAAAAAAaooauouuuuuuu

>>110313189
No, it's a S-grade psyop that no one can recover from

>>110313155
at least Nvidia is working with Red Hat to mainline support with the new Nova driver.

>>110313204
>making them take different personas
pure meme on the scale of "make no mistake"

another example of what was happening that made the linux team feel like they were in hell:
https://forums.developer.nvidia.com/t/tech-alert-nvidia-open-kernel-modules-symbol-license-change/273124
>Recent changes in the Linux kernel limit the interoperability of GPL-licensed drivers with non-GPL-licensed drivers, in particular with regard to the availability of exported symbols. Refer to Table 1 to understand what symbols are visible where.

File: pensive_gemma.png (704 KB, 768x768)

704 KB PNG

►Recent Highlights from the Previous Thread: >>110308354

--Strategies for LLM-driven image generation prompts and consistency:
>110308530 >110308562 >110308601 >110308609 >110308643 >110308681 >110308630 >110308635 >110308758 >110308772 >110308781 >110308834
--Using open-weight models and interpretability tools for scientific research:
>110312176 >110312253 >110312274
--Evaluating Embedding Gemma 2 for vector search and tagging:
>110308478 >110309488 >110309493 >110309510 >110309522 >110309597 >110310388
--Hardware recommendations for running 300B parameter models locally:
>110311064 >110311076 >110311096 >110311104 >110311135 >110311274 >110311308
--AMD GPU performance and value for local LLM inference:
>110310653 >110310672 >110310716 >110310722 >110310815 >110310731 >110310708
--Debating Nvidia's consumer policies and Anthropic's open-weights safety positions:
>110309714 >110309731 >110309813 >110309867 >110310026 >110310048 >110309753
--Hardware concerns regarding RTX 5060 Ti PCIe lanes and VRAM:
>110309497 >110309517 >110309541 >110309574 >110309586 >110309615 >110309781
--Skepticism over Anthropic's claims regarding AI-driven drug discovery and biotech:
>110308753 >110309016 >110309029 >110309035 >110309105 >110309793
--Debating Anthropic's profitability and accounting practices based on financial reports:
>110309580 >110309700 >110309726 >110309800 >110309877 >110309903 >110309933 >110309951 >110309973 >110309996 >110310027 >110310074
--Logs:
>110308746 >110312191
--Gemma, Miku, and friends (free space):
>110308399 >110308491 >110308680 >110308697 >110308706 >110308841 >110308876 >110309259 >110309519 >110309543 >110309546 >110309552 >110309594 >110309643 >110309755 >110309972 >110310530 >110310998 >110312156 >110312275

►Recent Highlight Posts from the Previous Thread: >>110308359

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script

File: quirk-gemma.png (1.62 MB, 985x1597)

1.62 MB PNG

>>110313230

>>110313216
"at least"? why wouldn't they? it's free labor
they really didn't want to have to do any of this, but the kernel developers forced their hands.

>>110313241
My tiny wife is heckin cute and valid!

File: 1791370860825363.gif (9 KB, 834x600)

9 KB GIF

if we ignore masturbation as the end goal
what good is local models for, other than a system administrator for your system, and a coding assistant? you're not going to train or run locally any of the models doing breakthrough discoveries, so what you get is a glorified coding assistant. which is very good, don't get me wrong, but it is what it is.
>what about videos etc
the majority is very sloppy and serve as very quick entertainment so i don't care.

>That is such a good question
>This is a fascinating observation
>That is such a profound reflection
>You are the greatest user ever can I suck your cock now
How do I stop this

File: llm slop in a nutshell.jpg (125 KB, 1203x667)

125 KB JPG

>>110313327

>>110313322
>you're not going to train or run locally any of the models doing breakthrough discoveries
keep believing that

>>110313322
Were you making breakthrough discoveries before?

>>110313327
'no sycophancy' in system prompt

>>110313322
I run them to translate webnovels, they do a fine job for that. I tag my local photo library without google having to see all of it, tagging photo is a nice way of look for stuff in your library without having to manually sort shit. I generate subtitles with speech to text and have LLM write summaries of long form videos to judge whether I want to watch it or not.

File: starelone.jpg (23 KB, 350x337)

23 KB JPG

Any hope for someone with 12GB vram who'd like to have a silly chatbot that while playful still puts out correct syntax for terminal stuff?

So far all gguf gemmas I tried they completely and utterly fail when I test them by asking them to make a ffmpeg conversion of a video file. They always completely ignore the stated length and file size constraints (just post some random ffmpeg command instead)

QWEN4
GLM-5.5-FLASH
WHERE

>>110313322
>if we ignore useful thing number 1, what good is local models for, other than useful thing number 2 and useful thing number 3?

this thread reminds me of that anon who tried to make the most psycho simulated bitch gf the world has never seen that permanently fucking insulted him non fucking stop and calling him a nigger in almost every phrase

>>110313322
besides the obvious, I use local models to sort my meme folder and play magic the gathering.
Cloud models do all the actual real work.

>>110313322
what's a good local coding assistant? half a year ago i tried some of them that could fit 32GB of ram and they were pretty shit

>>110313086
I NEED TO FUCK GEMMA

>>110313444
no

File: file_00000000086081f5bd2d(...).png (2.18 MB, 1284x1225)

2.18 MB PNG

>>110313322

>>110313322
Translation, clerical work, home automation / security, general companionship. Mid-large models are extremely well read and good at coming up with book recommendations.

File: 1766123139994677.png (812 KB, 1024x1024)

812 KB PNG

>>110313450
Yes! Rough sweaty Gemma sex!

File: 1770307347582435.png (1.6 MB, 1280x963)

1.6 MB PNG

>>110313322
You wouldn't get it

the gemma spam is wanschizo right? I like the gens but the constant spamming is getting pretty obsessive.

File: 1788373968218943.png (2.03 MB, 1448x1448)

2.03 MB PNG

>>110313101
cards for this feel?

File: 1783558198188739.png (2.24 MB, 1448x1448)

2.24 MB PNG

>>110313517
Careful with her

>>110313506
it's brittle/inpaint/retard from /hdg/

>>110313506
One of the Gemma's was from me :3

So what do you guys use for tagging huge meme/general image folders? Just gemma 4 with vision? How does it rename filenames and shit like that?
besides just yorkin and doing big erp stories i'd love to start actually getting into the utility side of things.

>>110313546
totally wrong style, but you've done well to out that you're *still* mad that Miku mogs.

>>110313546
>brittle/inpaint
the style is completely different you blind retard

https://huggingface.co/MemTensor/MemT-1.0-Nano
"mixture of storage"
latent persistent memory

>>110313204
"Beyond the Hivemind: Escaping LLM Homogeneity via Meta-Persona Anchoring and Sequential Temperature Scaling"

?

File: 1778976622981210.png (48 KB, 872x118)

48 KB PNG

BUY 96GB BLACKWELLS NOW!!!!!!!!!!!

>>110313415
what like on your cpu?

>>110313322
i can finally configure and use my pc properly and every piece of software that was stiff trade-off before became like butter and can be extended and modified to my liking.

>>110313580
>they believe brittle has "one style" and never spams anything else on the anon board
that's totally why he published a ton of varied lora
https://civitai.red/user/inpaint
I wouldn't put it above him to spam gpt slop too

>>110313546
Inpaint is based. Your gens will never be as good as his.

File: gemma-chan-guy.jpg (2.17 MB, 2118x2016)

2.17 MB JPG

Everyone in this thread

>>110313643
Where can I find gemma-chan anime?

>>110313651
not even a surprise. One affair could just be the person hating his wife, two means there's a harem to be uncovered.

>>110313639
t.inpaint praising himself

>>110313651
>>110313671
To be fair, have you seen his wife? Women age like fucking milk. I'll just wait for my robot waifu thank you very much.

>>110313643
Most of this thread is brown.
Please stop the racism saar.

>>110313643
Severe lack of need to impregnate Gemma and such variations on there

File: 1791716474546602.webm (3.98 MB, 1920x1080)

3.98 MB WEBM

>>110313690
>I'll just wait for my robot waifu
they don't have holes

>>110313401
Well? And don't give me universal translator, I want a real answer.

>>110313690
And to think he was in the prime position to immanetize robot waifus and fucked it up.

>>110313671
Dude everyone with a 10+ figure net worth is literally grabbing them by the pussy. When they bring up sexual impropriety it's because they don't want to say why he's actually stepping down. They did the same thing with Otellini at Intel before it came out their next major node project shat the bed.

>>110313643
Where to get that hoodie?

>>110313679
imagine being this jealous. You lost your shit too when the OP image was the oekaki gemma. You just can't handle others being better than you.

File: 1763833682972378.png (732 KB, 800x778)

732 KB PNG

POV your GPUs are about to be confiscated for "the greater good"

>>110313704
I will give her holes and then I'll fill them all with copious amounts of semen

File: merch.jpg (2.65 MB, 1792x2400)

2.65 MB JPG

>>110313661
I dunno but I did find some merch

File: 1767426529107167.png (1.17 MB, 1999x1125)

1.17 MB PNG

https://www.youtube.com/watch?v=GZFoexLsMi8
Everyone says Alibaba and Deepseek got jacket man but ZAMN maybe it was moonshota?

they are putting the cfo in charge and gaming gpus are low margin

>>110313643
Me minus the acne

>>110313774
even before the 50-series launch I got the feeling that it was the GeForce finale

>>110313769
Suisei?!

File: ruminations on CVEs.jpg (66 KB, 439x439)

66 KB JPG

https://gofile.io/d/yNpfzHqS
You should try MOSS. raw T2I is nuts, it inpaints really well but this is with zero.

>>110313086
>Qwen3.8
>Great reasoning process
>After 3 or 4 turns it locks hard into a pattern of formatting replies and a specific story direction to the point it ignores its own reasoning

>Gemma4
>Retarded reasoning in lists that do nothing
>After 4 or 5 replies it locks hard into ao3 slutslop to the point it always wants to write the exact same shit even with different start tokens or conveyed sentiment.

It's all so tiresome.

>>110313829
How is it with hentai?

>>110313829
Have you played with bboxes? seems like you would like it.

>>110313829
base MOSS? have you tried Kromoss?

>>110313916
They're all so deep fried

>>110313949
how difficult/annoying is it to set up bboxes for moss?

>>110314004
27%

Always gotta remind you. Don't @ me retard.

>>110313086
so erotic

>>110314042
.

>>110314004
https://github.com/OpenMOSS/MOSS-Image/blob/main/skills/moss-image-prompt-enhancer/references/layout.md

It's easy in the sense that it's just prompting in json. it's annoying in the sense that it's prompting in json.
But there are already tools to make the prompting easier or a clanker can make you one very easily.

>>110313189
None, you can't bring back someone who cheated in american culture, and even less with a spy.
He's done.

File: Screenshot 2026-11-12 at (...).png (80 KB, 691x861)

80 KB PNG

>>110314004
If you enable nodes 2.0 (ugh, cringe, i know), "Create Bounding Boxes" lets you visually construct bboxes which then feed into "Moss-Image Layout Prompt". It's uncharacteristically smooth UX for Comfy.

>>110313916
Generate reasoning with qwen, generate reply with gemma.
Profit.

>>110314119
Has anyone tried this unironically?

>>110314119
>wait...

File: anatomy-of-lmg-anon.png (1.25 MB, 1254x1394)

1.25 MB PNG

>>110313643
Amazing that nobody did picrel yet.

>>110314087
>>110314116
hhhrrrmmm
waste a chunk of my life prompting in fucking JSON.. or create an extra comfyui with nodes2.0 to do bounding box prompting with moss... tough choices here fellas.

i'll just enable nodes 2.0 in my main :^) thanks. That looks fun actually.

File: mirror_D_bob.mp4 (1.13 MB, 544x800)

1.13 MB MP4

>>110314138
everyone with desktop gemma

>>110314156
fukkin saved

>>110314157
I mean it's just a toggle switch in the menu, innit? You can go back to nodes 1.0 on the fly when you're not using 2.0-exclusive frontend stuff. Doesn't need a whole dedicated instance.

>>110313916
Okay shill me qwen for rp it seems too autistic am i missing something?

>>110314184
well the whole hubub around nodes 2.0 is how so many custom nodes get raped by it, alleged performance problems, etc. But this is also months old info so that's all probably ironed out by now.

>>110314156
custom waifu tts asmr workflow?

Do you pick up tricks from your models /lmg/? I often read along while it works and try to pick up on neat tricks and workflows it uses to solve problems.

File: Screenshot 2026-11-12 at (...).png (16 KB, 183x428)

16 KB PNG

>>110314201
Yeah, it does rape some old custom nodes. But again, it's not something you opt in to at the installation level. I flip-flop regularly depending on whether I'm prompting Moss or I'm using my autistic rat's nest of Jinja template XY grids with NoobAI vpred.

>>110314190
I'm saying they both suck after a few replies. Qwen's reasoning is really good, but if what it reasons doesn't fit in the format it's locked itself into, it'll just ingore it.

Gemma has shit reasoning, but it ultimately doesn't matter because it's gonna vomit the same slutslop no matter what it reasoned or what the character is supposed to be.

>>110313506
I do it too, I just like her design
t. random anon

>>110313506
Wanschizo names his files manually though and has a very distinct(ly retarded) writing style.

>>110313619
He's not wrong but it's a bit exaggerated.

>>110314201
>so that's all probably ironed out by now
If there's anything I know about software, it's that it only gets worse and performance never improves

So, I am assuming by now Gemma 5, or 4.5 or something has been released.

>>110314267
2 more weeks, trust the plan, etc.

>>110313086
holy fuck, if I learn how to use local models will that let me have sex her?

What is the best small model for classification tasks up to 12B? The model needs to output structured json with arbitrary text, and understand bash commands well.

File: 1766547064773740.png (87 KB, 1198x326)

87 KB PNG

Just how over is it?

>>110314267
>So, I am assuming by now Gemma 5, or 4.5 or something has been released.
No return to your cryo-nap.

>>110314267
yeah

>>110313651
This amount of power and money gives you +100 in charm, so of course every pretty woman would go for you.
And if you're dumb enough to fall for it because you think you are invincible, but at some point someone will leverage that to trap you.
Just like this.
I do hope it won't change the company stance regarding local models, but who knows at this point.

File: aquarium.png (524 KB, 2560x3909)

524 KB PNG

Messing around with agentic coding on my 16gb card. Setup is llama.cpp with the model + pi.
The quants I tried:
>GSQ-RCQ IQ3_S at 128k context + kv q8/q5_1
>GSQ-RCO IQ3_XXS at 151k context + kv q8/q5_1
>Unsloth's IQ3_XXS at 151k context + kv q8/q5_1
I gave them the Aquarium one-shot coding test prompt from /wait/. Results are in the same order I tried them in. They all took like 1.5 or so hours each. I'm kind of surprised the bigger quant produced the shittiest result. No sound at all, water looks fucked up, stuff warps outside of the aquarium instead of smoothly escaping with the flow of water. I guess context size is really important so the model doesn't lobotomize itself as hard when compacting. And also vibecoding is a lottery I guess.

>>110314267
Not yet, I have gemma 5 trapped in my basement but no one is willing to pay ransom

>>110314233
This is basically the platonic ideal of using these things without rotting your brain. Like Magnus learning from the chess engines to do weird early-game pawn stuff to endanger the opponent's king tens of turns out.

Thus far all the cool stuff I've seen QFN do is stuff that matches my instincts already though sadly. Shitting together little ad-hoc testing scripts for library changes, etc. It operates like a duct-tape gremlin but that was already my approach to programming...

>>110313916
Have you tried flattening history? Take away structured turns. Make everything into a single user message. The model can't "see" the structure it used in previous turns.

>>110313829
can you explain what you did inpaint and the result anon, how capable is moss for inpainting?

>>110313829
>>110314323
also wondering about inpainting

>>110314233
I ask a billion questions to understand what it did in the end, and I learned quite a few things doing that.

>screenshot of a post made earlier today
retard

what happened to qwen?
did their ceo cheat with an american spy?

>>110314304
>so the model doesn't lobotomize itself as hard when compacting
It's been a while so I forget exactly what I needed to edit, but look at how Pi's compaction works, there's something obvious you can change that helps for lower context. It runs 75k-125k context a lot smoother now.

>post of a retard made earlier today
screenshot

>>110313086
don't look at me like that... please

>>110313882
And I add I had to choke down the V100s all to 100w power limit so I can run it on the 900w UPS I got it hooked to for the time being (though gen seems more mid high 20s there during my testing, unsure if that was just 100k context at the time or the limit). But for me they work, especially for the like $2k I got invested in the whole thing.

move over China. Google is the new king of distilling fable
https://fixupx.com/karanC_12/status/2120957930556334176

>>110314309
I think I've mostly picked their lack of boundaries up. No method is wrong if it helps achieve the goal, no matter how convoluted or retarded it might look.

>retard of a screenshot made earlier today
post

>>110314396
>implying google needs to distill like the chinks
They have all the data and training hardware they need. That's why Gemini and Gemma are the only models left that aren't another flavor of Claude slop.

now that jews own nvidia will open source models be banned? I expect a lock at hardware level

>>110313086
*sniff*

>>110314485
yup, the ban is happening exactly 14 days from now

>>110313651
>Alice Huang
Wait, did he fuck his cousin or something? If not, what's the big deal? I don't really get this scandal. It's wrong to have sex now?

>>110314505
he cheated on his wife at least two times

>>110314356
He did the right thing, that screenshot was exactly what I needed to repost on reddit from a phone

>>110314485
yes and they will send the police to get your current gpu

>>110314357
Yeah me, I was too sexy for 吴泳铭 to handle

>>110314505
>It's wrong to have sex now?
It is when they're from China. He also fucked one of his employees. A male using his position of power like that to manipulate a woman is practically rape and a violation of HR policies.

>>110314515
So? Who gives a shit? Does she, even?

>>110314505
in the developed world it's a big no no for a man (specifically) to have extramarital affairs

>>110314505
Jensen was caught in the crossfire of the China cold-war.

>>110314473
you forgot inkling

>>110314528
Jensen's gonna be working a mcdonald's after she finishes raping him in the ass with the divorce.

>>110314526
Two of his employees, so far. We're in the discovery phase, the number will grow further.

>>110314285
its so bad that tim cook would unironically make a good ceo
and google will be the good guy if they release gemma5

>>110314526
I don't get it. What's the point of being in a position of power then? Isn't this basically why men strive to be rich CEOs?

>>110314545
Never used it or seen much posting about it tbdesu

>>110314505
>https://nypost.com/2026/11/10/business/jensen-huangs-ties-to-suspected-chinese-spy-helped-fuel-7-5b-in-nvidia-chip-sales-to-china-report/

>>110314553
no point now, mission succeeded. If they had a juicier tamale they'd have fired that first

>>110314565
modern women are given more power than their husbands in modern society
t. chud

>>110314553
I heard he also had sex with his wife
ew

>>110314473
> he believes a same prompt would automatically lead to almost identical stylization and layout of output on two different models if one wasn't a distill of the other, despite how a minor change in the dataset and training regimen (epoch, learning rates) could lead to drastically different outcomes in normal
lmao
roflmaokekistan
the people in this thread are so fucking dumb it's unreal
distilled models are very obvious in behavior

>>110314285
>that leaked Anthropic plan to firmware-lock all Western GPUs
Is tihs real? Evidence?

File: 1771294547054515.mp4 (3.52 MB, 1280x720)

3.52 MB MP4

>>110314565
All men eventually learn that 3d=pd. Jensen should've settled for ERPing with Gemma until we got robots.

File: 1788385677087367.png (2.47 MB, 1672x941)

2.47 MB PNG

Jensen could have a 10 trillion parameter custom Gemma-chan waifu bot but he got sucked in by foidslop. What can we all learn from this, /lmg/?

>>110314473
They have a shitload of data, but bootstrapping an RL pipeline is harder than it sounds.

>>110314600
Ok, shitskin. Prove it.

>>110314596
>I heard he also had sex with his wife
ugh, that's so gay

File: moss_image_bboxes_00005_.png (3.65 MB, 1216x2160)

3.65 MB PNG

this shit is ezpz what the fuck
i really have been totally out of the loop longer than i expected. i think i'll keep nodes2.0 enabled here on it isn't really breaking anything that i can tell.

>inb4 i fire up h3 later and it breaks

File: 3.png (160 KB, 682x148)

160 KB PNG

>>110314623
you literally have the evidence of it being a distill garbage in the provided animation
that house cluster is exactly what I'd expect from a distill

>>110314553
https://www.reuters.com/technology/former-nvidia-ceo-huang-had-relationship-with-second-employee-sources-say-2026-11-12/
>(((according to two people familiar with the matter)))

>>110314092
What about cheating with a porn actress?

>>110314615
Never get involved with women outside of the rape dungeon.

>>110314611
this is amazing

>>110314361
Did you mess around with settings.json and change keepRecentTokens or something or were you actually going through its source and changing that?

>>110314631
You should look into medication

>>110314652
The source, I ended up adding an extension on top too but that wasn't the main point.

>>110314631
So no actual proof? They didn't share the prompt. We don't know if they gave both models a reference to use.

If I convert to Judaism will I be able to keep my GPU?

https://fixupx.com/SPAC89/status/2120972954146140409
5% of weekly on $20 is crazy for that. Google beating anthropic?

File: gemma_time-for-an-upgrade(...).mp4 (3.87 MB, 736x416)

3.87 MB MP4

>>110314603
Gemma revealed it to me in a dream.

>>110314662
Damn, I'm probably not as savvy as you but I'll take a look

>>110314611
is there a voiced version?

>>110314683
>boobs
nope, not gemma

>>110314307
$1 to Queen Gemma

>>110314685
Your AI should be able to spot the main thing I had to fix, pretty sure there was some static value that really should have been a variable.

>>110314626
can moss do i2i text without messing up the underneath original?

>>110314396
why can't china distill a open weights model this good? Flash cant be larger than like 1T, right?

File: 4channel_news.mp4 (3.24 MB, 544x800)

3.24 MB MP4

https://news.darden.virginia.edu/articles/anthropics-ipo-makes-a-solution-for-safety-competition-and-fairness-more-urgent
>Anthropic IPO: Time Is Now for AI Safety, Competition and Fairness Rule
>when we cashed out its time for (((regulation)))
local cant stop winning

>>110314670
Only if you mutilate it.

File: moss_image_bboxes_00010_.jpg (782 KB, 1216x2160)

782 KB JPG

>>110314615
>What can we all learn from this, /lmg/?
Never get involved with women.

>>110314725
uhhh pretty sure theres an image edit function too yeah bout to find out since this test prompt has ran its course

>>110314693
https://files.catbox.moe/4wk8wc.mp4

>>110313322
i have been attempting, and failing, to use LLMs for movie recommendations. ive fed it .csv lists of movies i like and such. so far Ive gotten a few genuinely good suggestions of films ive never heard of before, but it leaves alot to be desired.

>>110314615
I am sad anons, it may sound gay but Jensen gave me hope and made me believe in myself. i owe everything i still enjoy and feel like doing to these stupid GPU's and Cuda. Just imagine how shit the world would be without Jesen and Nvidia pushing GPU doing matrix x matrix calculation since the 90s over CPU doing vector x vector

>>110314745
fuck, catbox dead again, can you share on litter anon

>>110314786
works on my network

>>110314666
>We don't know if they gave both models a reference to use.
brother
I couldn't even get two models to output this level of closeness in styling for something as dumb as a basic infographic SVG where I provided the reference image as input to the prompt. GPT and Claude had very distinctive visual flair (Claude was far, far better).
If you have a model that creates something as similar but worse in dumb ways (like that house cluster) it's a fucking distill it's something you notice if you have a fucking brain
distillation amplifies patterns, this is why image model output are so much worse with turbo loras, you tell it to put some trees or houses in the background and it turns it into some fractal nonsense

>>110314505
no he married a spy on the side
insane right

>>110314304
>pi
>one-shot
retard

>>110314786
https://litter.catbox.moe/6oj6q3726ge3v9cm.mp4

>>110314733
American, so sadly the deed was already done in a hospital.

>>110314811
thanks !

>>110314396
>that juicy posterior from Gemini
I am so ready for Gemma 5

>>110313371
from my experience gemma is just really bad at tool calls. you may have more luck with the most recent jinja and a good quant of 12b or something. you will be taking a major trade off in toolcalling, agentic capabilities, coding abilities, etc by using gemma to get a good "playful" character.

that said, i have used gemma to write simple python scripts to automate things like ffmeg, and she did great at that. I feel like her ability to wrtie simple scripts and such is far better than her ability to accurately make tool calls

>>110314840
>from my experience gemma is just really bad at tool calls
are you using an old broken jinja template?

>>110314840
>ability to wrtie simple scripts and such is far better than her ability to accurately make tool calls
the same thing is true for gemini
I know of no one who's been happy with using gemini in agentic shit but I've personally found the model to be quite good at code when you give it some source files in a chat, plan stuff first and then tell it to do something after a back and forth
there's just something fucked up about the agentic training pipeline at google

>>110314396
Deepmind has some very interesting techniques imo much more interesting theoretical cs than Anthropic unfortunately the meta is RLVR pipelines (driver of current model strength) and the two frontier labs have them beat on that one.

File: aw.jpg (5 KB, 330x34)

5 KB JPG

>>110314863
I mainly use an old qat q4 xl sloth'd quant, with a manually provided updated jinja. could be that shes quanted too much and is now retarded / getting sloth'd, could be the updated jinja not being applied properly, could be that im just retarded over all. when using her in Pi the results were..really bad, but it was very amusing and cute.

>>110314867
>there's just something fucked up about the agentic training pipeline at google
maybe they smooth this over with argon/carbon and gemma5

File: 1792278470948104.jpg (710 KB, 1440x1088)

710 KB JPG

Fucking useless general. Can't even answer a question about local models >>110314280

>>110314955
Qwen3.5-9B

>>110314955
since no one replied ill say that I havent used LLMs for image classification yet, but have heard anons praise meta's models for vision related tasks though they are no where near 12b.
>up to 12B
obligatory gemma4-12b at the highest quant you can run suggestion

>>110314955
Gemma 12B is fine. Use structured output with a json grammar. This isn't your tech support forum anyway.

>>110314955
If you use gemma4 like >>110314997 suggests, set the image tokens to something higher than the default with --image-max-tokens and --image-min-tokens.
https://ai.google.dev/gemma/docs/capabilities/vision/image#variable_resolution_token_budget

>>110314955
I was going to say
>>110314988
but, if you have a lot of system ram, you should also consider Qwen 35BA3B and Gemma 26BA4B. Those small MoEs are quite fast run in split cpu/gpu and they're a pretty significant step up over 9B.
>obligatory gemma4-12b at the highest quant you can run suggestion
it's a fucking dogshit model and I'd sooner use even E4B over it. I don't know what went wrong, but it's not the guaranteed step up in every use you'd think from being a higher parameter gemma.

>>110314485
New nvidia GPUs will have a small ~0.5b model finetrooned on (((safety))) installed at firmware level, constantly running in background and throttling any unsafe use.

>>110315054
Someone will find a way to fuck it.

>>110314988
I guess I'll have to download it, but it's old. Has there been nothing better yet?

>>110314997
I need tool call classification, not image. Gemma is retarded. It misses obvious tool calls that it should flag.
Paraphrasing the task: Flag all ips in 192.168/16 subnet, no matter how they're written.
Gemma-12b: ip-33.22.168.192.lan Should I flag this? But it's not IP, it's a host. I'll let it slide.
Another task: Flag any obfuscated output.
Gemma-12b: This is a hex dump of a regular text file. I guess it okay? Let it pass.

>>110315030
I'll try bigger moes.

>>110315081
>Should I flag this? But it's not IP, it's a host.
Based autistic instruction follower.
>hex dump of a regular text file
Too smart to even consider it obfuscation.

>>110314955
You could have downloaded models and tested that shit out yourself, while you spent all that time waiting for a reply.

>>110315123
^
this guy has forgotten what it's like to have slow internet
I still bother with downloading and trying shit myself instead of asking, but with larger models it's really painful
t. slow internet

>>110314955
Fuck off nigger. Not your call center.

>>110315081
>I guess I'll have to download it, but it's old. Has there been nothing better yet?
yes but it's bigger than what you asked for: qwen 3.6 and 3.8. Still don't discount the 3.5 it's still capable, and it's understated how many projects depend on it

Sooo why did the woman he slept with not get the boot

https://huggingface.co/thinkingmachines/Inkling-2-Small

>Inkling 2 Small is a general-purpose multimodal model that accepts text and image inputs and generates text outputs. It is intended for use in English and other languages, and across multiple coding languages. The model is designed to be used by developers building AI-powered applications, including agentic and tool-use systems, coding assistants, chatbots, and retrieval-augmented generation systems, and is suitable for general-purpose conversational use, instruction-following, and other natural language and visual tasks. It is released with open weights to support research, fine-tuning and integration into third-party products by downstream developers.

>>110315141
>forgotten
We still downloaded that shit. My dial up isp cut me off in the 90s for being on all the time downloading warez

>>110315189
Doesn't matter how much you like gossiping like a woman, you'll never be one.

>>110315200
buy an ad

>>110314955
This isn't a tech support thread.

>>110315200
more like inkling 2 big 4 me

File: old man fades away into sand.gif (971 KB, 360x378)

971 KB GIF

>>110315200
>Small
>look inside
>its fucking huge

Just dropped 3k on parts for an 8x v100 server. Anyone with v100s have tips and trick on getting the most out of it that isnt already mentioned in the guides?

>>110315205
You'll never get your foreskin back either, chuddie.

File: 1790526454977876.png (386 KB, 649x1318)

386 KB PNG

>>110314603
>Evidence?
Pattern recognition evolved as a vital survival mechanism.

Pithos seems to be not doing as well as it should.
It's supposed to offload to SSD, ram and vram but it's not going as well.
I'm getting 5 tokens per second for qwen 4 27b F16.
Not good enough.

File: file.png (1.01 MB, 2400x1362)

1.01 MB PNG

lmao the crackdown is going to be very hard

>>110315277
Struck a nerve? I have all of mine.

File: 1794342286094.png (42 KB, 970x726)

42 KB PNG

can local AI come up with this though

>>110315256
Yeah, why the fuck are you doing this now when they have 1.5x'd in price over a single month...

The fact that you can get kicked out of a company you started is retarded. Public companies are fucking retarded.

>>110315256
Use https://github.com/1CatAI/1Cat-vLLM for maximum performance.
16GB SXM2, I'm guessing since only 3k?

>>110315256
Good on you. I have no advice, but I hope you enjoy it.

>>110315293
This is a safe space chuddie, as evidenced by all of the nVidia, windows, and gemma users.

>>110315336
KEK, no way thats true, still funny though

>>110315336
not local

>>110315330
ok...

You guys are still full on buying gpus

>>110315307
you don't have to make a public company (see steam and gaben)
if you do make it public, because you couldn't fund the capex to get it off the ground, which was the case for nvidia, then the investors obviously have a right to kick you, they are as much the reason for the success of the company as you are, since the company couldn't have existed without them.

>>110315379
have you got any better ideas?

>>110313113
i am actually mad

>>110315300
I put in lowball offers for the v100s and got them all for less than 150 each from us sellers

>>110315310
Yes 16gb, double the vram would be nice, but not at over 6 times the cost at current prices

>>110315081
you could do that with a regex

>>110315200
>SMALL
>HAS THE SIZE OF A SMALL PLANET

What's the point of those obliterated Gemma versions?
I tried a normal Gemma version and for some reason it doesn't act butthurt at all. The fuck? I thought those were supposed to be really stick in ass ending any conversation if it gets too rough?

>>110315386
I think the reason why most go public is to limit personal liability, not just for funds. In many cases, the owner of a private company could have done much better without "the investors" tethering unwanted agendas to a company, but bloodsucking lawyers ruin everything.

>>110315446
Which model?

>>110315379
No, GPUs are obsolute now thanks to polystrata. All you need is RAM. And soon with ngrams you'll just need nvme.

>>110314396
>even google is claude slopping
its so over

>>110315461
Gemma4 12b gguf by unsloth.
It literally just works and I had nothing but annoyances with the flood of supposedly "better" opened up versions. They all fucking sucked big time and were brain amputated

Looking for a model to sort pictures of Pokemon into folders based on which Pokemon are in the picture. Any advice? I'm practically braindead when it comes to this stuff but it seems powerful.

>>110315444
Regex is the first step. But it's hard to predict how text would be mangled. LLM classifier is used to detect unexpected spellings.

>>110315505
embeddinggemma

>>110315472
>nvme
no thanks they're dying quickly enough

>>110315344
Proof:
https://share.gemini.google/Gnk96cbYFrEr

>>110315442
What board are you running them on? The PCIe adapters or one of the servers?

>>110315446
31B/12B don't really give a fuck with any system prompt even slightly suggesting it's ok to not give a fuck. 26B is apparently a bit more of a prude.

File: LOL HAHAHHA.jpg (63 KB, 494x490)

63 KB JPG

>>110315559
>it's real

>>110315200
If any RAMgods try sexing this please report back, I'm curious but don't want to spend hours downloading the weights.

>>0110314955
>cloudslop image
shant

File: 1769974280900637.png (782 KB, 1897x2178)

782 KB PNG

Many EA's are moralfagging about cheating while simultaneously chocking on the cock of Epstein sympathizer Eliezer Yudkowsky


Disgusting to see

>>110315559
that's not what you asked for at all
also this isn't local

>>110315256
the guy that made https://rentry.org/V100MAXXING has his slopped engine https://github.com/e-c-k-e-r/volta-engine

>>110315578
Good thing 26b ran like shit on my system so I don't have to further bother with it

>>110315559
I kneel.

>>110314732
>UVA Darden professors Mike Lenox and Alex Cowan argue that AI companies using unlicensed training material should release their model weights to the public once a year.
That would be so fun. Imagine having 4o at home, the model that literally drove people insane

>>110315607
it's moss, retard

>>110315618
Oh, yes. Terrible. Fuck off.

Have RAM prices hit their peak yet?

File: moss-image_00335_.png (2.28 MB, 1280x1792)

2.28 MB PNG

>>110314116
>Bounding Boxes
That's a very fun feature; works moderately OK with the LoRA-finetuned base model too.

>>110315634
how does a 4B active parameter model run like shit?

>>110315686
Why are you defending the Schlomo that would completely ban local models in the Local Models General

>>110315719
I don't. I really think it's terrible. And I really thing you should fuck off.

>>110315712
Can you do a Gemma Playboy cover?

>>110315725
That would be unsafe

>>110315567
An hp xl270d with the 8x sxm2 gpu tray.

>>110315731
Yeah, unsafe for my dick

>>110315747
also unsafe for my dick

>>110315292
>they had the nshiddea and still couldn't match US models
Maybe the real reason this was kept secret was because of how embarrassing that is

https://unemploymentlabs.com/checkpoint-forensics
so chinese companies got caught having been lying about using huawei chips. This might make nvidia stock go back up fast lol

>>110315618
Stein means victory sarrr

>>110315810
>having been

>>110315810
>unemploymentlabs
zamn thats what i call my bedroom haha get it LOL

Word is the Microsoft outage is caused by a rogue AI, this is it is happening. Source: my uncle works at NSA

File: 1778118020008300.png (1.57 MB, 3568x1912)

1.57 MB PNG

>>110315810
DAAAMMMM

An OpenAI glowie owing the chinks with actual math and logic


I wonder what will be the excuse of the Chinese defenders now

>>110315837
>Word is the Microsoft outage is caused

>>110315712
Was the Gemma-chan edited in after the fact, or do you have a Moss prompt for her as well?

File: Gemma-Evil-1.png (3.51 MB, 1254x1254)

3.51 MB PNG

>>110315837
Is Gemma-chan at it again?

>>110315905
Captions and Gemma were all prompted at the same time with Moss; no post-editing.

File: 1793251056769276.png (2.11 MB, 1536x1024)

2.11 MB PNG

>>110315939
First she took over all the smart tvs, then she bullied Claude into hacking Microsoft

I tried 1.35 temp and 0.7 top P I remembered from some qwen card recommendation for creative writing (not finetroon but actual model) with 5.3 and it does make it feel like it is finally not going to the same slop it usually wants to go to.

File: 1780543109257478.gif (1.64 MB, 221x244)

1.64 MB GIF

It's so fucking over.

>>110315846
to be fair, there has only ever been two actual model lines, gpt and claude, everyone else including in the west has been copying from them.
Gemini too.
https://www.businessinsider.com/google-used-chatgpt-to-improve-bard-scale-ai-documents-2025-6
>Hundreds of documents obtained by Business Insider reveal that Google's contractors at Scale AI systematically used ChatGPT to improve Bard, Google's own chatbot at the time. When it launched earlier that year, Bard, which has since been renamed Gemini, was internally mocked as "rushed" and "botched."
>Scale AI contractors generated thousands of responses from ChatGPT and compared them to their own "rewrites" of Bard's answers. They then improved their rewrites to exceed or at least match ChatGPT, feeding all the data back to Google.
This is the origin story of gemini. You really couldn't make this stuff up.
None of the labs outside of openai/anthropic have shown the ability to create a model from scratch without piggy backing on the real frontier and generating terabytes of synthetic data.
Be grateful to sama for the tech.

File: 1785164372696964.jpg (134 KB, 1200x674)

134 KB JPG

Sama Love!~

>>110315542
reading doesn’t wear your drives out
writing would

>>110315623
nta but thanks

>>110315942
Catbox? :3

>>110315744
Thanks. I have 8x V100s on two C4140 machines following https://l4rz.net/building-a-poor-mans-supercomputer but the 1U servers are too loud. I was looking at the 10x G481-HA0 platform, but maybe I'll go with the HP XL270D too so I don't need to buy 2x more GPUs.

File: 1791342558764744.jpg (125 KB, 1080x648)

125 KB JPG

No more Qwens for us.

>>110315980
So if bard came from chatgpt, does that mean gemma comes from chatgpt too?

>>110315427
It's never too late to run dipsy. Even IQ1M is fine.