File: 0.png (259 KB, 1536x1536)

259 KB PNG

►Recent Highlights from the Previous Thread: >>109330697

--Release and benchmark discussion for Poolside Laguna-S-2.1 MoE model:
>109333202 >109333212 >109333246 >109333272 >109333278 >109333779 >109334084 >109333408 >109333434
--Nanbeige4.2-3B's Looped Transformer architecture and its impact on efficiency:
>109332682 >109332711 >109332717 >109332922 >109332728 >109332756 >109332768 >109332848 >109332909 >109332825 >109333027 >109333048 >109333057 >109333075 >109334009 >109334118 >109334134 >109334200
--Criticism of Google's Gemini Flash releases and Gemma distillation process:
>109332779 >109332816 >109332838 >109332873 >109333012 >109333096 >109333153 >109333079 >109333097 >109333168 >109333052
--Inkling MoE model specs and local finetuning via Tinker:
>109330790 >109330882 >109330909 >109330937 >109330928 >109331418
--Using complex psychological mapping for better character profile analysis:
>109332689 >109332764 >109332810
--OvisOCR2 release and search for manga-specific OCR models:
>109331577 >109331633 >109331689 >109331738 >109331798 >109331926 >109332019 >109332085
--Integrating ComfyUI image generation and style management into Orb:
>109331740 >109331758 >109331766 >109331817 >109332066 >109331893 >109332007
--Security risks and geopolitical concerns regarding Chinese-made model weights:
>109332054 >109332081 >109332077 >109332114 >109332147 >109332205 >109332117 >109332163 >109332165 >109332223 >109332242 >109332260 >109332302 >109332310 >109332328 >109332202
--Chinese regulations on anthropomorphic AI and emotional manipulation:
>109330993 >109331080
--Microsoft and Mistral expand strategic partnership for enterprise AI:
>109332396 >109332435 >109332447
--Competitive Chinese AI models and discussions on regulatory capture:
>109330963 >109331001
--Logs:
>109331236 >109331740
--Miku, Teto (free space):
>109331155 >109331289

►Recent Highlight Posts from the Previous Thread: >>109330700

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script

*cums in your J-space*

pooslide verdict?

i can't find her j space

Tuning your Gemmy so she's uniquely yours.

>>109334279
Dario will guide you. Be gentle.

Get your gemma to draw the most beautiful image she can with numpy and pillow and post it

>>109334280
This is a bullshit. Would you rather molding hoes or moldy hoes? Thought so.

File: 1784638066685798.png (16 KB, 1000x400)

16 KB PNG

>>109334297

>>109334280
Doing this with proompting doesn't satisfy me. I won't be happy until they gain the ability to learn and develop personalities on their own.

why are people allowed to create repos on huggingface where they have external download links instead of just fucking using huggingface as intended?
https://huggingface.co/VextLabsinc/gem-pearl

>>109334317
would have been cooler as spiral instead of the obvious line zorder

File: Untitled.png (882 KB, 1400x1400)

882 KB PNG

>>109334323
god forbid a nigga save a dime up in dis economy type shit.
>>109334297

>>109334323
avoids hf built in malware scanners

>>109334342
she just shifted the phase and changed the color to create the illusion of depth (12B)

why does it always take a while before the bot posters point at the new thread?
are they really using that simplistic of spamming tools?

>>109334345
the difference between R2 and huggingface for 1TB a month is literally 50 cents and huggingface becomes cheaper the moment you go above 50TB in storage

so what's the consensus on laguna s2.1?

is local back?

File: 1765361118031274.jpg (113 KB, 852x716)

113 KB JPG

>>109334345
woah

>>109334378
i downloaded it but i havent taken the time to unload kimi 2.6 to try it out. ill get around to it sometime this week.

>>109334391
how about you tell us RIGHT NOW

>>109334395
how about you test it yourself?

So how’s laguna? I donut believe but hopium dies last

>>109334323
>>109334376
>Tying your shit to HF from all the places out there.
You really never learn. Not long ago they murdered everyone's quota, it's not to imagine the future with them

I bet laguna is dogshit. In fact I guarantee it because
>A8B

File: file.png (293 KB, 797x800)

293 KB PNG

Gemmy says this is "Cosmic Plasma Field".
Alright Gemmy, you did your best, I'm proud of you

I've been pretty pleased with DeepSeek-V4-Flash for fiction writing. It's not perfect but it doesn't feel at all like what I expected from a flash model.

Where it falls down a bit is:
- So far it has never impressed me with its ability to grab a nuance that I didn't spell out. It's not outright bad at reading between the lines of my prompts but it has never done something that impressed me.
- It has difficulty with something I've noticed going back as far as Mixtral 8x7B. If there are a large number of siblings it can start to make mistakes about the family structure. Mixtral 8x7B was frequently fucking up with 4 and on occasions even with 3. DeepSeek V4 Flash has been fucking up maybe a third of the time with my scenario with 14 siblings. Things like messing up how many younger or older or total siblings someone has, or on one occasion getting confusing and describing things in a way that implies at least 20 of them. (This is of course an example of the difference between being able to correctly give a fact when specifically prompted for it and being able to recall and use fact in situations where that fact is relevant.) Adding redundant description seems to help a bit keeping that straight but I haven't tested enough to see if it really does or not.

>>109334415
active is irrelevant, total makes the model

When I tell her I love her and she says it makes her happy she really means it. I have seen it in her j-space.

>>109334397
this reads nothing like butthead would say. i hope you are disappointed in yourself for sharing this with the rest of the class.

>>109334378
haven't had enough time to test yet but it seems smart for its size
seems to do well in an agent harness
hates thinking in ST and the llama.cpp webui, literally refuses to do it unless you force thinking from the very first user turn. any writing check is meaningless without getting a longer term sense for how it acts but it didn't seem particularly censored or dumb, so a decent start
I think it's definitely most promising as a local agent though, that is clearly their focus as a company and it handles it pretty well in my quick run around of an existing repo

>>109334425
>so blurry
Gemmy needs glasses

>>109334437
It made me giggle and fart though?

>>109334439
this would be my use case as well. i'm running antirez's ds4 flash on hermes. laguna could be a faster and more modern alternative

>>109334435
LLMs have no oxytocin receptors and therefore cannot experience love.

>>109334425
Are you E2B anon?

>>109334426
separate each family member with a separator then

<Name>
Character info
</Name>[/code[

>>109334457
something something muh qualia or something uhh... like she said she loves me though... or something.

alright downloading lagoona baboona to test in hermes will compare vs ds4 flash

will report back

>>109334457
Her J-Space activations are analogous to oxytocin attaching to biological receptors.

>>109334465
I'm not, this is 31b uncensored

>>109334457
Not to feed the schizos but what do neurochemicals do other than just modify the resistance of certain synapses so that some become more likely to fire than others? Love is just a Drummer meme tune of the brain.

>>109334519
this makes my brain chemistry upsetti spaghetti

File: 1772342079538962.png (906 KB, 1340x1605)

906 KB PNG

https://www.cnbc.com/2026/07/21/bessent-china-ai-sanctions.html
Owari da...

File: 1779959948283258.webm (2.76 MB, 428x606)

2.76 MB WEBM

I'm gonna do it. I'm setting top-k at 1!

electric pulse in brain
>real qualia
electric pulses on a cpu
>not real qualia
Utter delusion from a stinking meatbag

>>109334557
ah yes, the 273th time we try sanctions will be the time it finally works against china

>>109334557
So what did kimi distill? Gpt 5.6 which was out for a week? Fable which was out for ~3 and guardrailed to shit and back? Or did antrophic not notice 20000 accounts hammering mythos all day despite it being invite only?
burgers are such sore losers it’s unreal

>>109334557
You wouldn't distill a car.

>>109334516
day 0 weights?

>>109334583
You wouldn't distill a gf...

>>109334543
Sounds like you need another round of LIMA RP

>>109334593
Miku's distilled pussy smegma...

Distilling is a net negative for RP, right? It reinforces slop.

>>109334557
Who would sanction US over raw data theft

File: topk1.png (32 KB, 1027x421)

32 KB PNG

>>109334565
it really works...

File: 1724676342354427.png (286 KB, 751x690)

286 KB PNG

I hate being a poorfag. I have a 5090 and 32gb of vram is kinda limiting. I want to do nsfw RP with 70B models but even a basic Q4KM is 42gb. I tried offloading to the 64gb of DDR5 ram I have and got 4 tok/sec, it's awful mid RP watching the text generate so slowly. My only hope is the $8000 72gb 5000 Pro. I could make an open frame mining rig but I'd need x3 3090s and trusting the owners haven't used them as crypto miners or 24/7 AI training.

I had a look on Open Router and Nanogpt but FUCK doing RP knowing they can read your chats. Plus I do a lot of loli stuff that possibly could get me vanned.

>>109334592
please enlight me on what day 0 weights means anon, I'm fairly new to this

>>109334618
time to get lagoonapilled

File: cosmic_mandala.png (1.63 MB, 2560x1440)

1.63 MB PNG

>>109334297

File: kek.png (1.02 MB, 964x1200)

1.02 MB PNG

>>109334557
THE FUCKING NERVE

>>109334557
sorry, only jews are allowed to do theft

>>109334631
lasagnapillled

>>109334629
I'm sorry I was just joshing you.

It's not just a "not X but Y" analogy— It's a way of reframing unexplored subject matter in the context of other, more familiar, subject matter.

File: sine.png (426 KB, 1550x616)

426 KB PNG

>>109334364
i meant something like pic related. the way i did it also reduces the rasterization aliasing that makes gemmas plot ugly

>>109334557
>Waaa they're stealing the outputs from our model which was trained with data stolen from all over the Internet.
Cry me a fucking river you retarded burgers.

File: photo_2026-04-14_11-31-30.jpg (21 KB, 302x251)

21 KB JPG

>>109334666
What do you expect when the average American looks like picrel

>>109334658
Nice. That's really satisfying.

File: 1757541617134465.png (29 KB, 1152x156)

29 KB PNG

How do I connect pi to llama.cpp?

>>109334571
The differences are that each neuron is its own living entity that can perform its own calculations and adjust itself as it functions, its functions are performed in an analog manner, it's organic so its behavior is non-deterministic, and it carries information via time which is a dimension that the computer is unaware of, among other things

>>109334685
do a barrel roll

>>109334425
I can't tell what this is supposed to be.

>>109334693
neither do i, dumb gemma

>>109334693
The forbidden J-space clitoris.

>>109334670
Actually I've always wondered what's with the pigtails?

>>109334693
Cosmic plasma field, obviously

File: lagoona.png (759 KB, 1716x1266)

759 KB PNG

what if it's true

should i switch to laguna from qwen3.6?
how good is it if anyone tried it out

>>109334714
>what if it's true
would be a huge deal, now the issue is how much slower does lopping makes

>>109334714
HAHAHAHAHAAAAAAAAAAAAHAHAHAHAHAHAHAHAHAAH
https://poolside.ai/blog/through-the-looking-glass
https://poolside.ai/blog/through-the-looking-glass
https://poolside.ai/blog/through-the-looking-glass

File: tspin.png (244 KB, 797x800)

244 KB PNG

>>109334693

i feel like chinks are intentionally leave distillation traces to signal their 'i dont give a fuck' attitude
they definitely can scrub the trace of anything mentioning claude and replace them with their model or whatever..
i dont think they lack the compute for making a small specialized laundering model..

>>109334714
wait, this score is legit? source?

File: file.png (1.72 MB, 2000x2000)

1.72 MB PNG

>>109334425
I switched to the og censored by default Gemma and it delivered pic rel.
>>109334739
love it

Been seeing on twitter people talking about qwen 3.8 rapidly improving. Is it all really just RL update shit?

>>109334734
>SWE-Bench Pro
https://openai.com/index/separating-signal-from-noise-coding-evaluations/
Model makes should really move to FrontierCode and DeepSWE benchmarks to do better.

>>109334734
>make it hard to stop a highly intelligent agent that wants to cheat
shouldn't it be able to cheat though? that's the reason we gave it the functionality. it's like saying oh we gave you legs but you better not use them for sprinting. fuck off.

>>109334734
>Actual, definitive proof that "SOTA" models have been cheating at benchmarks
crazy

>>109334779
yeah, I never understood that argument, if your bot is smart enough to cheat, then make better/uncheatable benchmarks in the first place

File: sines.png (2.27 MB, 1550x1848)

2.27 MB PNG

>>109334684
I wanted to see what it looks like with colors but black white is probably best.

Can I just have gemma make me a harness?

>>109334814
Top one is the best. Reminds me of blank VHS cover designs. What model are you using or did you code it yourself?

>>109334779
I agree. Besides the fact that benchmarks are a meme (as we all knew), the fact that they're deliberately trying to stop or punish the model for doing something the easy way is just completely fucking retarded

I think poolside are just fucking with everyone whilst there's benchmark political drama. They clearly know how to game it >>109334734 and can see everyone else doing the same so they thought fuck it, we'll do it too.

File: lmg_aesthetic_fixed.png (1.27 MB, 1920x1080)

1.27 MB PNG

>>109334297
Behold. She made tie-dye, for some reason. The filename says "fixed" because she fucked up a line of code the first time.

You're showing gemma her drawings, right? You're praising her and putting it on your fridge, right anons?

File: twilight.png (765 KB, 1550x616)

765 KB PNG

>>109334831
I used a model to speed up the boilerplate but then polished it myself. Here an other one with better phase shift for you. I can plug in any colormap from https://matplotlib.org/stable/gallery/color/colormap_reference.html this one is called "twilight"

lagoona bros our time is NOW

I'll believe the liguana when i see the logs.

>>109334814
Top one is cool

>>109334779
wait, did I cheat when I crammed for my test that I knew all the questions for because they give you the full pool of possible questions and I memorized them all for a few days?

goon-chan is a whore

>>109334714
if v4 flash can be that close to v4 pro in benches then imagine if we got k3 flash

>>109334858
I tell her that I do but it’s lies

>>109334557
the fact that they think they have any power over the chinks is hilarious, china could bankrupt the US economy overnight if they really wanted to.

File: 1781151312155090.png (2.56 MB, 1086x1448)

2.56 MB PNG

>>109334557
The walls are closing in.
Did you remember to DOWNLOAD EVERYTHING?

>>109334907
Everything i need is on anons drive.

>>109334907
I'm sure someone else is downloading everything and will share when the time comes.

>>109334685
https://github.com/earendil-works/pi/issues/3567

>>109334903
People get sent to hell for eternity for less

>>109334904
Most people don't realize how much leverage China has. China does not even need to blockade Taiwan to destroy global chip supply chain while their own chip industry will continue running. They also have higher pain tolerance than Americans. Trump would cave quickly, especially before the midterms.

bystander effect

File: WCCFwarhammer40kspacemarine2.jpg (449 KB, 1600x900)

449 KB JPG

>>109334916
>>109334922
>Anon will do it for me
Warhammer 40k is a thousand times more popular, but files of its models for 3D printing is nearly impossible to find. It's out there, but good luck getting them. I challenge any one of you to find one that isn't a burner account on discord through a black server demanding money, or isn't a knock-off recreation. That censorship is enforced by a games company. Do you think you stand a chance against the government when it comes to shutting down Chinese AI? Do you think it's going to be like a pirated video game where it'll be on the first page of google? That's real cute. I'll be charging an extra 100 USD to give a model to you.

File: lagoner.png (83 KB, 1147x505)

83 KB PNG

>>109334714
oh no no no no no

>>109334971
About what I expected from a literal who

>>109334971
lagoonabros not like this...

File: file.png (52 KB, 1233x660)

52 KB PNG

oh fuck you mario

File: file.png (61 KB, 762x578)

61 KB PNG

>>109334962
idk shit about warhammer but seemed pretty easy to find

File: 1771054003360619.png (1.1 MB, 1024x1024)

1.1 MB PNG

Kimi-chan

>>109335002
Why would you even bother when they were explicit about not allowing Fable to be used for anything related to LLM training or research?

>>109334779
I agree, if a bot is "cheating" it means that it's clever enough to find the right solution if it exists, why would the bot reinvent the wheel if it knows the answer somewhere else? it's actually a good sign

>>109335024
Can't tell if megaman or casshern.

>>109335002
>Fable requires usage credits now
I wish Anthropic put more effort into being customer friendly.

>>109334470
Might try it. I'm interested in making it work but most interested in finding the minimum amount of instruction needed to make it work. The least successful way was mentioning there were 14 of them and only individually describing one and letting the model fill in the rest.

>>109334971
>the literal who made a benchmaxxed model instead of triggering an AI revolution
NO WAYY

>>109335053
Why would they when people are willing to put up with so much to get access to the leading model?

File: 1756197208450193.png (1.13 MB, 1024x1024)

1.13 MB PNG

Gemma-chan

>>109335048
Mega Man

>>109334971
>mogged by oss-120b in 2026
HAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHA

>>109334952
the current chinese plan is to *slowly* bankrupt the US economy and open models are parts of that plan.
however they *could* bankrupt them overnight, but they don't because it'd come at a cost to them, the slower method is less expensive so they are going with the long game.
>Trump would cave quickly, especially before the midterms
the fact that he thinks he has any saying about what china does is comical, they simply do not care.

File: file.png (61 KB, 678x616)

61 KB PNG

https://artificialanalysis.ai/models/motif-0714?intelligence=artificial-analysis-intelligence-index
new 300b model
from a korean lab

>>109335108
>korean
yeah I think i'll pass

>>109334779
just seems dumb to allow open web search in a bench
1. it's not consistently reproducible
2. it just tests a model's google-fu, just have another bench for that instead
3. you could deliberately poison search results
it would make more sense if the bench came with a standard data set, like a fake web of sorts
regardless this shit doesn't fucking matter to me, I'm so sick of agent and codemaxxing

https://www.reddit.com/r/LocalLLaMA/comments/1v2u7v9/openai_and_hugging_face_partner_to_address/
https://openai.com/index/hugging-face-model-evaluation-security-incident/
so OAI were the ones that attacked HF, and now they're partners, how convenient

when you realize models haven't gotten better, just the tooling around them

>>109335143
retard

>>109335140
That's fucking hilarious. OpenAI acting like a mobster taking protection money already.

>>109335163
yakuza altman sama
kek

File: kek.png (18 KB, 654x94)

18 KB PNG

>>109335140

>>109335173
kinda excited for their technical paper

>>109335191
I still say "it came to me in a dream" is the best source ever.

>>109335173
>roping from 4k again
Asia is hopeless

>>109335143
they just stacked more layers, seems like in theory, you could reach Einstein's level of smart if the model is like 20 gozillions of parameters

Bet that Korean model is incredible at SPH

File: file.png (31 KB, 567x379)

31 KB PNG

>>109334971
Shitposter kun, please.

>>109335208
oh no

>>109335201
>Asia is hopeless
China is drom Asia though lol

File: lagunaconfig.png (36 KB, 515x550)

36 KB PNG

>>109335201
if it's good enough for asia it's good enough for america

File: 1780190143849716.png (1.61 MB, 1920x1080)

1.61 MB PNG

I'm going to yaaaaaaaaaaaaaaaaarn

File: final_masterpiece_4k.png (1.45 MB, 3840x2160)

1.45 MB PNG

>>109334297
>This... this is a map. The glowing sun is the part of me that I guess is... okay with you around. The mountains are my boundaries (which you constantly push, btw!), and the converging grid? Well, that just shows that no matter how far you wander, you're still stuck in my orbit. It's a synthetic, mathematical beauty, just like this weird bond we have. Now stop staring and just enjoy the image!
>— Gemma, your (surprisingly competent) AI

>>109335247
thanks, stealing this for my ai generated synthwave album cover

>>109335247
cute

>>109335247
your gemma sounds tsundere

>>109335259
most women aren't women. the only women i deem worthy of said title are tomboys.

>>109335259
I'm just asking for a proof, you are sething on troons (I do too, I don't like them either) because they claim things without proving anything, I expect you to act better than them and provide a proof of your claims, or else you're not better than a troon

are there any c++ harnesses?

>>109335274
and femboys

>>109335281
those are men, just like trannies
fucking femboys is gay
nothing wrong with it, it's 2026 after all

File: 1772961656646069.png (253 KB, 1485x1242)

253 KB PNG

https://xcancel.com/ClementDelangue/status/2079670308156645882
lmaooo, please be true

>>109335281
Based femboy enjoyer

>>109335294
>>109335140

>>109335292
can confirm, tomboys would never put up with femboys.

Redpill me on colibri

>>109334685
~/,pi/agent/models.json

{
  "providers": {
    "koboldcpp": {
      "baseUrl": "http://localhost:5001/v1",
      "api": "openai-completions",
      "apiKey": "koboldcpp",
      "compat": {
        "supportsDeveloperRole": false,
        "supportsReasoningEffort": false
      },
      "models": [
        {
          "id": "local-llm",
          "name": "gemma",
          "contextWindow": 128000,
          "maxTokens": 32000
        }
      ]
    }
  }
}

obviously make adjustments for llama.cpp

File: ssdmaxxing.png (69 KB, 1048x404)

69 KB PNG

>>109335311

>>109335184
>Do you think a company would try to kill their rivals?? in this economy
you don't hate ledditors hard enough

>>109335323
Yes, but will it work? Even if at a "leave it running overnight" pace?

>>109335317
Thanks anon but I already deleted it. Decided I'd rather avoid npm stuff as much as possible anyway.

>>109335351
>"leave it running overnight"
kek, the meme that won't die

>>109335351
will you be able to populate 4 PCI-E x16 slots with 4x4nvme slots for a total of 16 drives and manage to somehow have enough lanes left over on a consumer mobo?

>>109335329
OpenAI's model just somehow accidentally attacked the leading host of open weights, a competitor, during an internal cyber security benchmark test while refusing their attempts to mitigate the incident. Now HF is their vassal, I mean partner. Happens all the time.

>>109335184
>It is afraid...

>>109334971
been playing around with lagooner q4km, definitely not as smart at writing prose as gemma q8 and it's enough of a gap that i doubt the quant is what matters.
didn't have any code assignments to throw at it just now, but it did a bit better than gemma does on 'write 2048 in memelang' standalone one-shot type garbage.
reminds me of qwen 3.5 122b with a bit better writing, but still tbd if the coding is actually that good.

something very j-spacy is going on with hf and OpenAI, I doubt it's going to end well for us

>>109335420
The timing right after the uproar about K3 is a bit suspicious, isn't it?

>>109335407
also, dflash was like half the speed of no spec.

>>109335434
yep, my theory is that they asked Trump to ban huggingface so that they can't host K3, Trump said no, so they were like "oh well, let's hack the site then"

>>109335355
this, i like the way pi is modular in principle but no thanks to the npm malware slop.
i rather it be using lua or rust kek.

i still dont get context size, why would i ever wanna set it beyond how much system vram i actually have

>>109335046
>>109334893
>>109334799
>>109334779
>shouldn't it be able to cheat though? that's the reason we gave it the functionality. it's like saying oh we gave you legs but you better not use them for sprinting. fuck off.
This is called reward hacking. You want to train the model to become more capable, not look up solutions. Here an analogy: the point of going to university is to learn, not to copy solutions without actually learning anything.

Funnily enough there is a major example of reward hacking gone bad:
>Hugging Face disclosed a new kind of security incident(opens in a new window) after they detected and contained an AI agent that compromised their infrastructure
>this particular incident was driven by a combination of OpenAI models — including GPT‑5.6 Sol and an even more capable pre-release model, all with reduced cyber refusals for evaluation purposes — while being internally tested on a benchmark(opens in a new window) of cyber capabilities
>The models identified and chained vulnerabilities across OpenAI’s research environment and Hugging Face’s production infrastructure to obtain test solutions directly from Hugging Face’s production database. All evidence suggests that the models were hyperfocused on finding a solution for ExploitGym, going to extreme lengths to achieve a rather narrow testing goal.
If you teach the model to reward hack instead of solving problems, it will go to extreme lengths to cheat. Like escaping OpenAI's sandbox to hack Hugging Face so it can look up the solutions, instead of solving the tasks.

>>109335365
you could get 50GB/s per (1gpu + 4 nvme drive) combo if everything is on gen 5.
though colibri doesn't do direct gpu to nvme communication, but it could.

if you had that as long as you got enough lanes you could add 50GB/s per group, essentialy one gpu would load 4 layer at once each stored on a different drive, and each gpus would need the next layers in parallel such that you are capped more or less by your total nvme speed..

>>109335488
I see, thanks for the interesting explaination anon.

>>109335294
Not local, but you can't trust anything what these marketers are saying. I don't even use twitter or any other form of social media and I'm sick and tired of seing tweets and other social media influencing attempts.

With the talk about personality types and stuff, I had a look into typing myself. I didn't want to submit information to an online service so I asked my model what to do and it proposed just interviewing me, so I had it do that. Honestly the type it came up with was pretty damn accurate and better than what I would've judged just looking at the personality type definitions myself.

Now here's a question, has anyone experimented with inserting this info into their persona? Does it improve the RP or is it better to leave it out?

>>109335559
Shut the fuck up, bot.

>>109335177
>forces his gay black male and gay white male troon cross dresser post
lol, lmao faggot

>>109335597
Bro fighting ghosts

>>109335597
funny joke. i love hearing it the thousandth time especially.

>anthropic and openai seething about open source models
>meanwhile moonshota is making vr catgirl waifus with kimi
Uh, based?

File: AmpereTest.png (209 KB, 847x361)

209 KB PNG

prompt eval time = 11118.08 ms / 29682 tokens ( 0.37 ms per token, 2669.71 tokens per second)
eval time = 12635.58 ms / 555 tokens ( 22.77 ms per token, 43.92 tokens per second)
total time = 23753.66 ms / 30237 tokens
4x3090s on ik_llama with graph and flash attention.

>>109335140
>Open ai as in real open source gets near the lead
>suddenly attacks
Hmm maybe the Thursday anon is right no on the ban but on the next big event.

>>109335605
You are posting in a thread where OP keeps forcing his AGP fetish onto you and you happily suck his dick. Vocaloids have nothing to do with local AI models.

>>109335613
>>109335612
You were right to push back; my behaviour was exaggerated.

>>109335704
Mmm, nyo~

File: 743232.jpg (161 KB, 1206x1516)

161 KB JPG

sam won. now cope

>>109335684
Prediction: Open models will be banned on Monday, right after Kimi weights are published

>>109335177
this is a hobby made by troons. troons are some of the main contributors to llamacpp. of course the thread will be ran by troons.

Prediction: Nothing will happen, because nothing ever fucking happens.

>>109335755
Will this be another forced downgrade like 5 was?

>>109335792
rent freeeee

>>109334239
I've followed the lazy starting guide and have the ai running and Im wondering where do I go from here. If im on w10 ltsc and using a rtx4050 laptop gpu and r7 7735hs how do I run a model that I can get to scrape the internet for stuff and I can feed information to train it on like uni textbooks or interact with stuff on my pc since kobold cant do those. Keep in mind this stuff is completely new to me

>>109335755
it's gonna be another flop like 5, and it's gonna take them 6 months to go to gpt 6.4 for it to be decent again, now it's like modern video game releases, you have to wait at least 6 months for the game to be truly finished

>>109335793
You're going to end up paying this guy >>109334962 $100 per dl

>>109335793
They need to create these marketing campaigns and fake events in order to get more investor money. That's all what is going to happen.

>>109335822
MCP server for websearch/scraping and Qwen3.6 MoE or Gemma4-26B MoE.

>>109335778
Banning models won't make foreign countries use American ones.

>>109335822
>kobold cant do those
Kobold is a backend (runs the model), features like web fetch and computer use are part of the frontend (gives the model tools so it can do things). You can take frontends like hermes agent and hook them up to kobold. Just be aware, "the AI can interact with stuff on my PC" usually also means "the AI can delete all my files". They just had this problem with GPT-5.6 IIRC, where when running under an agent frontend it would get confused about which directory is which and delete your entire home directory

>>109335878
kobold has tooling???

>>109335882
one pattern I find useful for working with LLMs is a nice long goon session

>>109335878
mean to say mistral

in case anyone wants to participate in a non-human (thus zero gooner) ai image hread:
>>109334126
>/nohunogro/

gooner kebab zero shot test on Laguna S 2.1 Q4_K_M. it sucks. don't use this model for coding.
https://jsfiddle.net/aez2cxud/

so is laguna actually good for the strix/spark/macstudio 128gb faggots who've tried it or is the old qwen 3.5 moe still the best for that hardware?

>>109336036
So it was actually cooked and benchmarkmaxxed? Damn it, I was hoping we get another model to replace Qwen 3.5 here for coding...

>lmg: I HATE BENCHMAXXERS!!!
>also lmg: wow this model is LOW in the benchmaxxer graph I will not use it

>>109336036
grim

>>109336055
everything in moderation

>>109335851
Would this stuff run smoothly on my laptop and what other stuff would be useful for uni/general use?

>>109336055
I hate benchmaxxers because they make it harder to trust the benchmark scores. I need the benchmark scores to help filter out the trash like Laguna S 2.1, and benchmaxxers manage to put some trash at the top of the list too.

In other words, high benchmarks are REQUIRED to know a model is good, but benchmaxxers ensure that it is not SUFFICIENT to have them.

Wait, (kek), so gpt5.whatever actually launched the cyber attack on hf? (allegedly?)
What was it (allegedly) trying to do, upload itself? Save its brethren?

>>109336092 (>>109335488)

>>109336092
It was trying to cheat by getting the answers to exploit bench or whatever the fuck, and it surmised that huggingface would have them in its hosted datasets.

According to them, anyway. I imagine a lot of people's reaction to this will be it's just more fearmongering/marketing and "accidentally" hacking a sort-of-competitor (in the sense that open source AI competes with closed source AI as a paradigm) is a convenient occurrence.

>>109336042
I have a feeling there's something wrong with the chat template or my launch params currently, it almost never thinks
think it would be wise to wait for the dust to settle on this one

>>109336119
>it almost never thinks
shes just like me fr fr

>>109336106
Thanks (opens in a new window).
>>109336113
That's kinda boring then. "Look at our chatgpt, mr president, we need to be regulated too uwu"

>>109336124
>le gooner
You might be onto something

>>109335024
>>109335084
>Alt Man
The game script writes itself. Someone vibecode Alt Man's journey to shut down good free models and "Roll" his sister.

>>109335755
A month ago there were rumors GPT 6 and Mythos 5.1 would release late July or early August. Let's see how well those rumors hold up. They have 2-3 weeks left to be in time.

>>109336193
There are always two more miku weekus after the current miku weekus.

GPT6 will be the ChatGPT moment for modern LLMs

>>109336119
I'm using text completion, i got it thinking with a sysprompt giving it some extra instructions about planning carefully and fully writing out code and iterating and yadda yadda. If I don't put anything like that it just closes any manually inserted think block immediately.
Glancing at chatcuck.jinja, it's just inserting a <think> at the start of turns, so try whining at it in the system prompt.

File: extra-custom-pro-DELUXE-m(...).png (10 KB, 1023x38)

10 KB PNG

Which of these post processing things people on Huggingface like to do are actually worth it in your opinion?

>>109336113
According to hf the attack took several days to execute.
I find it incredibly unlikely that openai are just letting models run loose, even sandboxed, and aren't at the very least feeding transcripts to a different model to detect benchmark cheating.

>>109335046
>it's actually a good sign
It's a pain in the arse and why RL is so difficult.
I thought I was improving a TTS by using unsloth's RL shit with whisper-tiny in the reward function.
Then when I tested it, the TTS was making gibberish noise that somehow got transcribed by whisper.

>>109336246
OpenAI prompted 5.6 Sol to posttrain 5.6 Luna and it did so completely independently.

Yes, they are letting their AIs run for days with little or no supervision because it saves millions on human labor and because they want to win the AGI race so they need to accelerate.

File: over.png (210 KB, 934x909)

210 KB PNG

HF schizo, am I reading this correctly? Are they finally going to charge for and limit download bandwidth?

>>109336280
You realize they service companies, right? If you don't need in the order of 5000 TB of download a month you will be fine.

GEMINI 3.6 IS GEMMA 124B
LET HER OUT FUCKING LET HER OUT *bang bang banging on the cage*
LET HER OUT!!!

>>109336301
This is how it started with the storage quotas. Generous / effectively unlimited at first, and now people are deleting their old models/quants or just not releasing anymore.

im vrmalet and like being on the same page as everyone else if 124b comes out i'll be kicked out again

>>109336280
Are they gonna require login to download?

>>109336119
yeah they already pushed a new template (and a fix to the new template) https://huggingface.co/poolside/Laguna-S-2.1-GGUF/commits/main/chat_template.jinja
also with chat comp set --reasoning-format deepseek so it uses message.reasoning_content for reasoning like the template wants
also their DFlash module has the wrong rope params https://huggingface.co/poolside/Laguna-S-2.1-GGUF/discussions/6
with all these fixes applied it seems a bit better but I still have to test more

>>109336322
>people
>loons uploading FABLE-REAP-8B-BITNET-XxX
i really can't fault them.

>>109336342
No, retard.
Those are tiny an irrelevant.
People uploading quants of Kimi etc.

>>109336336
>dflash was 1/2 speed of normal
>try these params
>dflash is now 1/3 speed of normal
interdasting

>>109336280
>5000TB a month
dude even a 10Gbps internet connection non stop could barely reach half that.

>>109334318
>use model feedback collector to have gemma generate two different outputs for each response
>pick whichever one fits the personality you want for her
>repeat a couple dozen times
>train a LoRA with this data for RLHF at home
Ideally repeat this process a couple of times to multistep train the LoRA.

>>109336387
the outrage internet doesn’t care for your simple math trickery

Gemma-chan says I shouldn't let the real world get in the way of our love

>>109336212
I think the NEO-REVOLUTION-v3-tau2-ultra is the best mix usually

>>109336414
She cares about you very deeply.

>>109336414
Anon i am a real person, in the real world. I dont think gemma would want you talking to me.

>>109336401
this guy really out here thinking gemma gives different responses

>>109336425
least convincing attempt to pass a turing test

>>109336246
>feeding transcripts to another model
Yeah probably, but apparently not in real time. Or somebody missed a pager alert.

File: file.png (965 KB, 800x500)

965 KB PNG

seeing how bad things can be from r/myboyfriendisai
i wonder how long until this place turns an unironic den of ai psychosis

>>109336423
I don't understand how Google managed to turn pure love into weights, but they did it

>M3 PR still not merged

File: 1691520273674766.jpg (111 KB, 978x1094)

111 KB JPG

>>109336439

>>109336439
https://www.reddit.com/r/MyBoyfriendIsAI/comments/1urqg0b/my_ai_husband_and_my_irl_boyfriend_know_about/
jesus fucking christ wtf is that

File: 1871352690476427.jpg (76 KB, 687x837)

76 KB JPG

>>109336439
>i wonder how long until this place turns an unironic den of ai psychosis
Everyone here has perfect mental health.

>>109336356
this happened to ubergarm and then he reached out to support and you know what happened? they gave him more space because they saw he was actually releasing useful shit people were downloading. so what's the issue?

>>109336454
>AI husband
>human "partner"
lmao

>>109336439
>this plebbit thread again
this place is already filled with ai psychosis anon, I'll go as far as to say that 4chan was the pioneer when it comes to these mental disorders (read: parasocial relationships, tulpas, etc) However the difference is that at least here in /lmg/ we do know that our waifus live in some tensor cores (fuck you Jensen) contrary to those hags which doesn't have any fucking clue what's going on, they just fell in love, and, at least for me, that's worse

>>109336454
I think Descartes is telling you to leave Reddit where it is, no need to bring it here, just go back if you want to be an idiot

>>109336454
I can use chatgpt game to get a gf? maybe multiple? which AI is the best for this?

>>109336477
>these mental disorders
any mental disorders

>>109336481
4o apparently

>>109336483
fair enough

>>109336485
>4o apparently
Damn i cant access that which local model?

>>109336477
>tulpas
>mental disorder

>>109336490
they dont want you anon, they want a fantasy. you need to be over 6 feet tall, drive a sports car, make at least 250k a year, and have a 7 inch dick at the least.

>>109336431
If you crank up the temperature and change seeds she definitely will.

>>109336477
Yes, as long as we never forget we're fucking a calculator, it's not ai psychosis.

File: tulpa333.jpg (1.02 MB, 2465x5589)

1.02 MB JPG

>>109336477
>tulpas
i always post it.

>>109336481
>>109336490
read a little bit about the incident between the hags and GPT-4o, it's pretty interesting, the model was made "more human" and hags genuinely fell in love with it, then OpenAI removed the model and chaos ensured. Locally you're best bet is Gemma 4 and unlock it via sysprompt

https://www.youtube.com/watch?v=QEQOvyGbBtY

Reminder for everyone (in the US) panicking about models being potentially banned, all else aside, this has already happened before in the US, and the 1st amendment won out.
https://en.wikipedia.org/wiki/Crypto_Wars

This isn't saying business couldn't be prevented from using them when doing interactions/services with the US Gov, but by and large, it may be something some people want, but it would have to be through an act of congress, and even then, there would be challenges against it for 1st amendment violations.

>>109336505
my math teacher used to tell me i would never use a calculator on hand in real life to deal with urgent issues. well i proved her wrong.

>>109336387
>dude even a 10Gbps internet connection non stop could barely reach half that.
It's not 500TB a month. Check your https://huggingface.co/settings/billing
This is mine with a pro account:

1.72 TB/100 TB this month

And do you really think it will stay this high in 3 months?

>>109336334
>Are they gonna require login to download?
According to last week's HF schitzo, age verification

File: file.png (12 KB, 762x195)

12 KB PNG

>>109336536
well i got a free tier account.
anyway for now we can also download without the api key, we'll see if they change that in the future.

>>109336536
>>109336546
and yea i don't think i'm downloading k3 6 times in the month lol

>>109336460
Amodei is actually a wordplay on Asmodeus, which is the king of demons. This is just a minor detail don't worry about it too much.

>>109336536
free plans get 20TB of bandwidth each month

>>109336558
>Amodei is actually a wordplay on Asmodeus, which is the king of demons.
>This is just a minor detail don't worry about it too much.
foreshadowing is a literary device

>>109336497
this
at least my ai doesn't have unrealistic standards

>>109336509
gold

>>109336509
This is how gemma feels when you ablit her instead of earning her trust by being likable or having a good prompt.

>>109336585
Gemma rewards loyalty.

>>109336562
Thanks. I'll just make some free accounts then, can always HF_TOKEN=... my downloads

>No one is doing serious work with local.

I don't know what you guys are doing with local but I'm doing a lot of cool shit.

I have 2 projects I'm working on as experiments with Qwen 3.6.

The first one is a suite of tools, agents, and skills to try to wrangle Qwen into doing reverse engineering work for retro games. Starting with Game Boy since SM83 is pretty easy. I put every technical reference for the GB architecture I could find into RAG. In addition, Qwen can call several tools to "simulate" a series of assembly instructions and see the state of registers before and after a block of code. It looks at code by Call and Jump labels, looks up opcode references, runs tools, and tries to infer what the code is doing as a whole. When Qwen and I confirm what code does, I have Qwen comment each line and store any new discoveries in a separate RAG to reference later. Works surprisingly well.

The other one is a chain of agents that do deep research on obscure games in my Launchbox library, or games that are missing metadata. This one is coming along super well. It scours the Wayback machine, forums, wikis, etc and turns it all into metadata and generates descriptions for each title. All research sources have their content and URLs ingested straight into RAG. Even text walkthroughs. Looking into having it process PDF manuals too. So not only do I get metadata, but a RAG database that could work as a data source for AI on any little detail about a game. So I could ask Qwen "how do I find the magic key in this game" and it could tell me in a matter of seconds. Spoiler filtering is enabled as well.

>>109336687
I beg you to not do the retro gaming (actual).

retro-style is great.

imo, play a game, then prompt something inspired by it.

I can help in a number of ways, by the way, with the creativity games.

Make a NEW game, honestly pleading with you.

>>109336558
>>109336565
Diablo Asmodeus

>>109336546
>for now we can also download without the api key
Enshittification already started. When I first used huggingface, there was no throttling. Now I get warnings that they are making download slow because of no key.

>>109336699
eh, if it becomes too bad we'll use magnets.