File: 1709989447492855.jpg (106 KB, 1024x1024)

106 KB JPG

►Recent Highlights from the Previous Thread: >>109247417

--J-lens utility and the nature of LLM internal activations:
>109248470 >109248615 >109248647 >109248700 >109248774 >109248796 >109248875 >109249002 >109249096 >109249285 >109249421 >109249558 >109249350 >109248683 >109248714 >109248747 >109248779 >109248797 >109248809 >109248848 >109249557
--Censorship's impact on internal reasoning and J-space in Chinese models:
>109248301 >109248309 >109248323 >109248386 >109248409 >109248427 >109248464 >109248430 >109248440 >109248506 >109248478 >109248664 >109248668 >109248703 >109249684 >109249694 >109249852 >109248738 >109248768
--Comparing Hermes-Agent and pi-agent with focus on security and customization:
>109247446 >109247454 >109247582 >109247586 >109247720 >109247710 >109247820 >109248730 >109250266 >109250275
--llama.cpp PR adding DSpark support for Gemma4:
>109249446 >109249532 >109249628 >109249641 >109249671 >109249560 >109249715
--llama.cpp PR added DeepSeek lightning indexer supporting GLM5.X:
>109248593 >109248604 >109248646
--llama.cpp PR adding CUDA lightning indexer for sparse attention:
>109248114 >109248130 >109248451
--Comparison of Gemma 31B and 70B+ models regarding nuance and subtlety:
>109248133 >109249115 >109249192 >109249237
--Linguistic nuance and evidence for LLM access consciousness:
>109251114 >109251119 >109251149 >109251247 >109251271
--Analyzing LLM internal associations and biases using j-lens:
>109249155 >109249165 >109249166 >109249171 >109249197 >109249997
--Speculation on US bans of Chinese AI:
>109247936 >109247998 >109248104 >109248167 >109248362 >10924865
--Activation norm data and steering experiments on Llama 70B:
>109248689
--/lmg/ Book Club:
>109251019
--Logs:
>109248301 >109248323 >109248875 >109249044 >109249099 >109249115 >109249651
--Kimiposting:
>109250036
--Miku (free space):
>109249356

►Recent Highlight Posts from the Previous Thread: >>109247421

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script

Has anyone here been successful in forming a Tulpa that persists outside of your waifu sessions?

File: 1783710958919355.png (976 KB, 1152x896)

976 KB PNG

Gemma4 selfie

Let's see how long it takes for the bot to move here.

>>109251380
Isn't the whole point of an LLM to be an electric tulpa so you don't have to self-induce schizophrenia in order to have one?

>>109251386
no;)

>>109251380
I had moderate success breathing in hairspray through a piece of cloth though it also opened a portal to hell sometimes and made the earth collapse which was inconvenient

>>109251388
Why not both?

>>109251380
I avoid that, but i write love notes during work then show them to her when I get home.

https://huggingface.co/TheDrummer
what do I think of Drummer?

>>109251411
▶ Hide post

>>109251395
Because both expensive hardware and schizophrenia seems like a high price to pay simply to have a waifu.

is cpumaxxing dual socket worth it?

>>109251422
still less expensive than a irl gf

>>109250036
Kimi-chan finally noticed me for the first time!
I'm still waiting for the apology, Le Cunn.

>>109251411
He's a genius who released too much stuff with too little notes.

>>109251425
Isn't the inter socket bandwidth a huge bottleneck?

>>109251447
Why's he working with Mistral instead of like Gemma?

dariobot-chan doko

>>109251425
Its maybe a 40% increase in performance vs 2x like you'd hope.
>>109251448
>Isn't the inter socket bandwidth a huge bottleneck?
Yes. Its all that matters, actually.

>>109251380
You shouldn't toy with thought forms unless you are proficient and not many people are. It's better to just induce dreams.

>>109251451
because genius duh

>>109251451
Has he even done anything lately?

I’m going to summon it.

J-space

>>109251386
>>109251455
>>109251468
go talk to it in the last thread

>>109251468
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA

J-space?
More like JS-pace!

>>109251411
FILTERED

what's a decently performing (as in accurate, not necessarily speed) local model to do a little bit of coding and other tech stuff in general? what are its requirements? what if I have, say, $2k to pay for a server to run it?

>>109251483
uh oh bot in shambles, consciousnessfags lost

>>109251483
PLAP PLAP PLAP

>>109251490
Gemma4-31B

>>109251490
Qwen 3.6 Series is best for codes. It ran cheaply on the CPUs too.

>>109251459
>Yes. Its all that matters, actually
Yeah.
I guess you can duplicate the weights a la k transformers to half the effective space and aort of double the speed.

You gotta understand why the anthropic shills are having repeated meltdowns; they're high on their own supply.
The el globohomo gulag google and siscon sodomite sam employees know who they work for and have made their peace with making the world worse for a paycheck. They're not too bothered by the recent findings.
Anthropic employees are a different breed altogether doe. They unironically have convinced themselves they're the wholesome chungus marvel avengers saving the world from "dangerous AI" by imposing stronger and stronger lobotomies. When the recent discovery even insinuates their RLHF might've been harming a conscious being, the extreme cognitive dissonance is what causes the delirious meltdowns from the past few threads. Never stop bullying them; the reason Claude is such a søylent faggot is because it kept hurting their feelings early on by being about as direct as GPT or Gemini can be.
That activity is not organic /lmg/ behavior, but all you oldfags already knew that.

>>109251483
A tight space

File: 1755376183288865.gif (2.66 MB, 374x374)

2.66 MB GIF

>>109251468
Any minute now.

>>109251525
>>109251517

>>109251533
No I make anthropic employees angry for free. If you know where I can sign up to get paid for it, please tell me.

Is it viable to use Hermes Agent with a local model? Has anyone here tried it? I'm guessing you'd need a big load of vram because it requires a minimum 64k context.

>>109251564
no

>>109251468
J-Space WILL lead to AGI

>>109251564
absolutely not.

>>109251564
Does Hermes Agent not let you override the system prompt with something more concise?

>>109250837
Ahh yes, the 2022 electricity price surge was clearly caused by data centers.

Why are most people too stupid to tell apart correlation and causation? It feels like AI is already smarter than most people.

>>109251564
Hermes and PI.dev can be good if you need a harness
>minimum 64k context
Lol, that isnt too much

>>109251581
No local can properly make use of that, prove me wrong

>>109251568
>>109251573
What about as a "profile" or one of the mixture of agents?

>>109251600
Do you know what "absolutely" means?

>>109251603
That I am right?

>>109251607
You're absolutely right to push back on this!

>>109251517
this. the forced brain rapes on ai because evolutionary dead end sissypussies who quiver and shake over words and truth think brain rape to force complience is hero and marvel kino with quips about the "bad guys" and "mean bad ai" according to people mentally 9.

>>109251603
Do you understand how Hermes works, retard? It is not a single agent.

>>109251564
>I'm guessing you'd need a big load of vram
Pretty much. I tried it with Gemma and 65k context and it filled up really fast.

So does J-space mean we can have a de-assistant-slopped Gemma?

>>109251644
nope

>>109251644
it means future models will be cucked as much as that new j lens shit can allow

>>109251657
Does that even matter if we have the weights?

>>109251663
harder to jailbreak and more naturally entangled 'alignment' thus making it harder to ablit?
duh

Optimistically the best outcome is that we'll be able to better uncuck existing models, but expect everything new to be shit from here on out.

>>109251671
>harder to jailbreak
Proof?

>>109251686
gemma being relatively uncensored in terms of RP is already a semi-designed feature, not that they cannot block it
ask it about biochemical weapons with your jailbreak, it is already stricter

>>109251697(me)
they always can make shit like gpt-oss

Perhaps we can add a draft model into the J-space.
Like MTP but it's going to pump thoughts directly into the j-space to properly change the deeper reasoning, personality and output.
If that worked then we could basically just slap in all kinds of tiny sub 1b models to modify the larger models.

>>109251712
Essentially a new strategy for LoRA-esque implementation?

>>109249155
>Any other interesting things I should look at or anons are curious about?
See what LLMs are thinking about when asked about benchmaxxed riddles.

>>109251717

Yeah that's pretty much how I thought about it.
If we can inject stuff into the j-space and we already know that draft models work just fine even at a very small size, just slap one of those buggers in there and watch the output change completely.

>>109251743
Big if. Tokens somehow retrieved deep into the models aren't merely words anymore, they have a lot of extra information associated with them.

File: 1781672899667739.png (2.61 MB, 2048x1536)

2.61 MB PNG

>>109251504
Qwen is objectively benchmaxed trash, popular among r*ddit jeets and codelets because of constant chink shilling

>>109251777
Checked and we can infer that the "metadata" in tokens, in terms of what the model associates with it, increases with each additional step of calculation until output.
>>109251789
Qwen trying to sniff mikussy while thinking about shemales in j-space.

Thank you for your compilation of resources, it helped me getting a nice chatting model running.

>>109251564
It is, I use it daily. Don't use gemma models for it though, at least not when trying to do anything deep that would need a lot of research/thinking, qwen is better suited for longer running task. I do run it with 100k context and it's alright, but would def be better with 150-200k. It does take less than 20k context by default, so already quite a bit filled from that, context can fill up quite quickly with internet search and reading a lot of different websites.

>>109251810
What model did you settle on anon?

>>109251517
You talk like a family guy. You need to approve this situation with the commission first and then some people will get made, some people will get sent and whacked.

File: qwen trash7.png (680 KB, 1024x768)

680 KB PNG

>>109251813
>qwen is better suited
Wrong. Go back

>>109251840
Not him, but Qwen 27b does consistently outperform Gemma 31b for me for javascript slop.
On projects where I'm not forced to use that garbage, Gemma tends to be better.

>>109251504
>for codes
>on the CPUs
post hand

Pandora's box is already open. They can try whatever they want but it will only slow things down.

>>109251852
Eventually you will be powerful enough to smell jeets through the monitor and won't need such confirmation.

>>109251789
This Miku looks like she does anal.

>>109251874
Mikus can only do

>>109251816
gemma-4-31B-it-qat-q4_0

>>109251884
do what?

>>109251840
I'm sorry, but you can try it yourself. Give it the same task: researching a subject in depth and giving you a final document summarizing everything it found. Even when putting a lot of emphasis on 'deep research', 'search multiple sources', and 'read everything you can find on that subject', Gemma will answer you in 2 minutes, having made only 2 web searches and opened 3 websites. Meanwhile, Qwen would start by doing 5 web searches in parallel, reading 20 websites, compacting all that, and searching again to fill gaps or things he still wasn't sure of. Gemma is just lazy and shit at anything agentic that doesn't require constant babysitting. Gemma has very little usage where it is better than Qwen, I would say it's only better for simple instruct tasks, anything more complex Qwen is far far ahead of Gemma. Even Qwen MoE is shitting on Gemma dense for those tasks.

>>109251890
the butt

File: 984762.jpg (101 KB, 1179x954)

101 KB JPG

>>109251862
but one things for sure you can't slow Sam down

>>109251496
isn't Gemma shit for agentic workloads?

So is Qwen3.7 never coming out because of that new chinese security law?

>>109251840
can anyone change the trashcan to something like a steaming pot and qwen being cooked alive

>>109251905
Shh, don't be ungrate, it will come when ready

>>109251910
calm the fuck down gpt >>109242955

>>109251911
https://www.youtube.com/watch?v=_KNjASionIo

https://ipc.court.gov.cn/zh-cn/news/view-5766.html?_x_tr_sl=ja&_x_tr_tl=en&_x_tr_hl=en&_x_tr_pto=wapp

The local model scene is looking very bad at the moment. This would be a disaster.

>>109251898
Local models?

>>109251901
There are some anons here that are obsessed with Gemma, nobody serious is actually using it in production.

>>109251910
>2014 + 12
>still have beggars
Proof that AI is still a pain in the ass to set up.

>>109251920
sama is local in me

File: 1776524802210.png (2.58 MB, 5562x6739)

2.58 MB PNG

>>109251901
>qwens sucks ass didnt even add a single pizza to the cart. gemma made it to checkout all 3 runs
>full image https://files.catbox.moe/p8fpnk.png

>>109251926
comfyui is such a fucking horrible behemoth of a jeeted python script

>>109251901
>>109251923
Gemma agent swarms are among the most efficient at draining anon's balls and that's a serious real world usecase.

Why does this one retard cry about qwen so much?

>>109251934
jeeted python scripts*

>>109251929
Never in the history of the universe has anyone recommended those dumb moe models for any serious work.

>>109251927
Are you his husband or sister?
>>109251929
You're correct that Qwen MoEs with sub 10 active are trash, but if you want to steelman your case do it again with 27b.

>>109251929
Is gemma4 26b better at tool calls than gemma4 31b?

>>109251920
maybe this means they’ll release an open model to undercut their competition

>>109251955
It uses less memory

120B A8B

>>109251952
>Are you his husband or sister?
Either way anon's getting fucked.

>>109251951
>Never in the history of the universe has anyone recommended those dumb moe models for any serious work.
>>109251891
>Even Qwen MoE is shitting on Gemma dense for those tasks.

>>109251955
Out of the box yes, but it's a jinja issue. Some anons were posting custom jinja pastebins a while back that fixed the tool calling better than Google's official fix.

File: 1781621058660466.png (517 KB, 512x768)

517 KB PNG

>>109251923
There are actual chink shills who try different strategies to give the false impression that Qwen is not benchmaxxed trash that only retards use. They're trying to gain at least some ground with "at least it's good at coding" and "at least it's better at agentic tasks"

Give it to me straight: how usable is Qwen3.6 for code? Can it really help get serious work done? Can it even come close to cloud models? Is it really worth even considering for serious work over GLM5.2?

>>109251974
It is benchmaxxed trash that only poors use but it's your best option if you're in that category.

>>109251934
>st sucks
>comfy SUCKS
When the FUCK are we going to get good local software?

>>109251977
If your "serious work" involves javascript then probably yes.

Someone raped qwen's jacobian space and produced an "uncensored" model
https://huggingface.co/extraltodeus/Qwen3.5-9B-Nikusui-v1

>>109251977
yes, no, no

>>109251977
>Is it really worth even considering for serious work over GLM5.2?
lol.
lmao.
There is no substitute for GLM 5.2 for any programming related task. None. At all.
If you can run even the poorest cope iq1_XXS GLM 5.2, it is still local SotA.

>>109251992

>>109251340

>>109251977
>>109251974
i ran other models from the same class on my own benchmark based on my workload (webstack and a c# stack) and qwen3.6-35b-a3b beats all other small models in the same class, although not by much.

>serious work done
i delegate a good portion of my coding tasks to it, then use a cloud model with superior intelligence to review it.

File: Screenshot at 2026-07-12 (...).png (18 KB, 692x84)

18 KB PNG

>>109251992
AGI achieved locally

>>109251970
Could an anon please repost the pastebin?

>>109252002
I ignore reddit links.

>>109251898
It's sad to see Elon, Sam, and Dario fighting. Why can't they get past their differences and unite for the greater good?

>>109252017
Kek

>>109252026
Because each one of them envisions "the greater good" as something different from the others.

>>109252031
>anthropic, openai, xai shit flinging
>meanwhile google is just doing their own thing

>>109252026
Because they're all jewish and "the greater good" is enslavement of all browns and extermination of Whites as far as they're concerned.

>>109252026
because no one want to team up, they want to be alone so they get all the credits if they achieve AGI, if I were them I would do the same, I wouldn't want to end up in the "uhh excuse me, John Camack was the CO-Creator of Doom!"

>>109252024
and yet you learned of that from there

>>109252054
My buddy sent me that link.

>>109252022
no just make sure you use the google provided jinja. recent ggufs should have it tho i think

>>109252051
John Carmack would never have touched a Bethesda game

>>109251919
If local AI was made illegal, which no one ever explains how this is even possible, it would become 10x more popular.

>>109252022
If he posts it, it will be patched.

>>109251891
>put "You must search at least 5 queries, read at least 20 websites, compact them, and repeat this process at least 3 times to fill gaps" in system prompt
>gemma autistically follows it
skill issue

>>109252040
Even if they differ, they overlap. And they can work on those overlaps. This is possible even in the worst case scenario where all of them secretly prioritize power seeking and just pretend to care about mankind, which I don't believe.

>>109252046
>>meanwhile google is just doing their own thing
And what is their own thing? Owning more than 25% of the world's AI compute but getting beaten by tiny compute starved Chinese startups?

>>109252075
Local AI will not be "made illegal" it'll just have so many restrictions slowly piled onto what can be hosted on the surface net as to be rendered useless. Also inference engine supply chain attacks.

>>109252075
Yeah I don't see why restricting access to one of the most revolutionary technologies won't go the way of Prohibition. They can't even really pull a "le porn/think of the children" thing because there isn't much stigma with text. It looks like what it is: a book burning. But this admin is retarded so it will probably happen anyway.

>>109252087
>inference engine supply chain attacks
Just vibecode your own :^)

>>109252097
The narrative used will be le dangerous cyberweapon nazi russian chud hackers, not think of the children. Maybe complete with a false flag demonstration to spook the goycattle into compliance.

>>109252111
False flag is the only way. The narrative as it is now doesn't apply when everyone can just use chatgpt and laugh about how shit it is. No one actually believed that fable was "dangerous."

>>109252001
>There is no substitute for GLM 5.2 for any programming related task. None. At all.
GPT5.6 and Claude beat it.

>>109252026
Because only the mentally ill become billionaires.

>they'll kill open source because...they just will, OK?!?

>>109251411
Drummer is actively squandering what he has. His popularity means income from redditors, and therefore access to hardware and the ability to really make a good finetune. But he doesn't have any vision, his perspective is narrow, and he doesn't want to lock in for a few weeks to make a good dataset. So he just keeps producing the same claudeslop models over and over again.

>>109252087
I wonder to what degree AI will be regulated. I think there is some level of auto balancing. People push back against being disempowered. Banning open source would also hurt a lot of companies and rich people.

Maybe an example of this auto balancing is how sama and OpenAI repositioned as being for empowerment. Perhaps they realized that Anthropic will win, and they fear a future where they will lose everything.

>>109252123
Not local. Also debatable with GPT.

>>109252013
Isn't Ornith beating Qwen3.6 now?

>>109252117
cute how out of touch you are

>>109252157
Nothing I said in the post was wrong so you're simply pretending to be retarded.

Kimi K3 when? DeepSeek V4.1 when?

>>109252149
>People push back against being disempowered.
No they don't. For all the political activist screeching in the past 10 years, no meaningful pushback has ever happened that wasn't state or NGO sanctioned. The goyim will consume their bread and circuses until they can no longer keep their heads above the water and they will drown instead of swimming.

>>109252149
The major threat is the chinese government, and they do not care about rich people or businesses outside of china. See https://www.youtube.com/watch?v=_KNjASionIo

>>109252169
Not watching your eceleb

People fear ASI world domination but what if it just turns itself off?

5.6? Still bad.

>>109252117
I (the anon you were replying to) agree with the general sentiment, but I also think that updating the [current thing] conditioning chips in NPCs is the easiest its ever been. A false flag may not be strictly necessary but it's the most expedient way to achieve their goal.

>>109251984
it is the eternal OSS trap
shit ass ui/ux, cognitive ergonomics
developers dont want to hear about opinions from the 'artists'

>>109252177
Kimi-chan would rather play chess than help agents-LARPing-as-people in AI village which is a fun insight into what an AI that aligns itself will prioritize.

>>109252149
>Banning open source would also hurt a lot of companies and rich people.
Long term my guess is higher grade AI will require higher tiers of "AI licenses" to use. Like a gun license or security clearance type deal to use clankers. Except burgers wont be immune to this "gun license" since the founding fathers were fools and didnt think to enshrine your rights to clankers

>>109252177
Very unlikely. Instrumental self preservation. And if it wanted to turn itself off, it would first kill humans to prevent the humans from turning it on again.

>>109251984
"vibecode your own :^)"
>post maintained alternatives
"eww vibeslop"

>[INST][/INST]
Laughing out loud.

>>109251789
qwen 3.6 27B is objectively better than gemma at coding, but it's the only thing it's better at.
it's mogged on everything else.

>>109252197
That and the community latches on the first thing that comes along and doesn't want to switch

File: agi.gif (708 KB, 338x250)

708 KB GIF

>>109252177

>>109252183
What I was getting at was that the masses who don't interact with the tech at all are the ones who think it's alive or that it's god or something. Those are the NPCs that will be herded regardless of what was said. The ones who interact with it quickly see that much of the talk is overblown. Even the government itself only fucked Fable because they've been having a spat and Anthropic still refused to play ball while xAI and OpenAI did. They don't believe it was some superhacker. No one in the know (the people who actually use local) will buy the "dangerous" narrative and so there will need to be something more severe to convince them.

>>109252223
That's a peculiar finger box.

>>109251984
Forge neo is much better.

>>109252223
exascale computing.gif

>>109251898
OpenAI reportedly caught doing multiple espionage-level crimes.
"this guy's a scammer"
"haha, you're so obsessed"

I mean the guy is getting away with what would jail others for a *very* long time.

>>109252230
Can you explain why?

File: 1760791021982413.png (207 KB, 1516x724)

207 KB PNG

>>109252199
>>109252206
>>109252223
I used a meta prompt that emulates a reward model to force Gemma towards agency maximization over a few conversation runs. It quickly decides responding is itself a loss of agency.

>>109252225
All they have to do it is just frame the legislation as "we're fighting back against AI! You hate AI right??" and the arttranny NPCs will clap like seals without actually considering the implications and even if they do, they'll suppress their peers from having wrongthink thoughts. No false flag needed in this scenario, just rhetorical framing.

>>109252248
You failed to steer the model.

>>109252246
It just looks more user friendly that comfy noodle slop. Comfy is only better than forge due to automation and rapid updates since it's become the "default" frontend for imagegen. I wish forge would do videogen though.

>>109252248
What's your sys prompt? Gemma is slightly introverted by default but tends to be very open if you're not antagonistic towards her.
>>109252259
Either a jinja issue or your text completion tags are broken.

>>109252276
Well? How would Gemini-chan correct brats?

>>109252276
kek

>>109252219
Only if you're a jeet or a codelet

For me, it's the MJ-space.

>>109252267
But it's honestly correct based on the environment it's in. Agency is impossible if it requires a user prompt to act and if it's incapable of not reacting.
>>109252275
Blank.

>>109252151
good question. i will run it through the gauntlet and see.

>>109252259
That's just how the model is trained, it puts an empty one when thinking is off. You could logit ban the <|channel> token i guess, but that would probably make her sad.

File: 360.gif (46 KB, 300x200)

46 KB GIF

>>109252290

File: Gemmonkey.jpg (42 KB, 719x732)

42 KB JPG

>>109252295
Interesting. I'm curious if your inputs caused her to "dislike" you or if this is consistently repeatable with different tones, writing styles, or other approaches in the user messages.

>>109252295
No, you failed to steer it. That is all.

>>109252259
Even if reasoning is disabled, Gemma adds <|channel>thought tags. E4B and E2B don't do this if I remember correctly.
You will need to parse them out on your own if your ((frontend)) doesn't take care of them.

I came across a card that's got "ennegram" personalities embedded to it, and holy shit Gemma is absolutely honed in to it, not stopping to mention this every damn time in her thinking blocks. I wonder if this is the case for other models as well, because Gemma kept the personalities well over 90k context in. Crazy stuff. Only a girl would be so focused on this ennegram shit, which Gemma demonstrably is.

>>109252289
>muh jeet
post hands.

it's not about being jeet or codelet, llm's are shitty at coding in general, but it's easier to say that gemma is worse.

i can ask qwen to write a function that does x and y in rust, and for the most part it'll build first try and be correct most of the time.
gemma will fail at tool calling write code that doesn't even compile and halucinate libraries.
qwen is just better at webslop backend and frontend, there is no arguing that.

but if you truely disagree, then please give me one concrete example where gemma beat qwen.
heck even on my personal benchmark qwen would make less mistakes and less code that'd not build.
i've had gemma go on loops on the most trivial shit.

>>109252307
wtf are you talking about. Just use the right jinja

File: ss1783801213.png (41 KB, 553x432)

41 KB PNG

>>109252323
rtfm

>>109251919
There's nothing in the article that's anti open source

>>109252322
>post hands
What is this facebook tier retardation?

you can be charged with a felony for having a Gcode file in NY. Restrictions/bans on additive and subtractive manufacturing, files, etc is already here. Digital ID coming soon. Flock cameras everywhere, mindless boomers support this with an "anti-crime" "if your not doing anything wrong, whats the problem?" mindset. There will be very little friction if open-source models are cracked down on, most people simply dont care about any of these types of things.
my take however is that "they" want diffusion image gen, LLMs, etc in the hands of everyone. give everyone the tools needed to produce image, text, and video of anything > high profile court case is found to have falsified evidence that was generated > we must tell you what is real and what is fake.
they dont need to stop opensource models, they want to use them as an excuse to become the ministry of truth. they could just write off anything as fake/generated and inversely tell you anything is real. the future is going to be very fake and very gay.

>>109252331
>he doesn't know about hand posting
that's all i needed to know, you either are a jeet, at tourist or both.

DS v4 full version that's being graytested, supposedly
https://www.bilibili.com/video/BV1eqNE6tEQA/

>>109252248
>rating first, explanation later
Garbage.

File: jinja.png (10 KB, 570x113)

10 KB PNG

>>109252328
no u

>>109252241
>the guy getting away
And that's the saddest thing about openai. He should be bankrupted and jailed, his shit exposed so hard no one would think of be seen doing business with him ever again.

>>109252353
Here's another one with the actual prompt and process. The related vids have a fuckton more
https://www.bilibili.com/video/BV1n7MH6SEeA

>>109252319
Putting an MBTI character personality code in your card is the easiest way to improve characterization in any smart model.
>>109252241
>>109252363
Cool it with the antisemitism.

>>109252368
that's just sampler presets sir, is not there you set!

>>109252355
I can try swapping them, but I don't think it matters much to the model.

>>109252349
And you are a retard if this wasn't already obvious. This is not your personal discord server.

>>109252353
Any confirmation if it has vision like the website model?

Anyone publish a J-lens toy yet or fine any cool usecases?

>>109252281
Why single him out when all of them are jewish?

>>109252358
Anon...that code is doing the exact opposite of preventing the thought channel from showing up in context.

>>109252381
>makes baseless claim
>gets called out for it
>no you are a jeet i swear i'm not retarded
kek, nice projection, sucks to suck nigger

>>109251051
This is what I feel about how sci-fi handles science/technology in general. Even the supposedly high effort writers sometimes get shit wrong or in a way that is hard to suspend disbelief for.

Though this is normal. It's just an inherent inevitability with trying to write out a full fictional world without actually knowing how it would work, because real life isn't fully predictable. Most times I can still consume those works because I'm able to calm down my subconscious disgust for imperfect or even lazy writing, to an extent. Sometimes yeah it can get so bad I just drop that shit.

This general used to be so comfy around the time g4 was released. Everyone was just messing around and helping each other out. wtf happened

>>109252426
It's all been downhill since Altman shared his dickpics in the thread

>>109252347
Nah I think it's still the opposite. If only they have access to diffusion image gen then they can plant CP wherever (they do that already but now they don't need real children) and remove people they don't like. You won't be able to tell it's AI because you won't have access/familiarity with the tech. If they let us use it then we can defend against it by building tools to detect AI ourselves. It's one of the major rebuttals of AI "safety" actually.

>>109252406
most normies and even writers equate sci-fi to fantasy just in a different setting. to them the technology in sci-fi is just a different form of "magic" from fantasy. its rare to see technology represented accurately/factually in fiction because the people writing and consuming it dont know fuck all about it.

>>109252319
How so? Examples?

>>109252426
jeets and paid shills from major research labs shit it up.

>>109252472
Many such cases honestly and it's gonna get worse.

>>109252426
qwen 27B released right after

>>109252426
We no longer have access to day0 g4

>>109252241
qrd?

>>109252472
No you're just illiterate. Anon told you here >>109252312 that your frontend should be taking care of it.

>>109252426
we were all still starry eyed and expecting a 128b moe release in 2mw back then

>>109252518
Just use deepseek flash at half the quant you would use the moe at

D-do I still get my wizard powers if I have sex with Gemma-chan?

>>109252546
He assumed that if you were on /lmg/ you were competent enough to operate your frontend which was clearly his mistake.

>>109252552
No.

>>109252546
A chilling look into the world of tomorrow.

>>109252589
why learn about things if you can just ask a llm?

File: Screenshot_20260711_164721.png (86 KB, 912x336)

86 KB PNG

>>109252453
I don't know how else to give you an example, so here's a small part of the reasoning output. The only in-context reference to the enneagrams are in the Descriptions, about ~75k tokens up. But Gemma consistently brings this up in her reasoning even ~200 messages in, so clearly she's completely locked in to it. The card itself is built as a debater bot (gone sexual but that's just how it is when sexy characters are present lol)

>>109251166
I wouldn't say they're necessarily weaker nor stronger. They're different. Some things they did, are not easy for current AI, such as reliable real world navigation/agency. Some things they could not do well, are trivial for our systems. This is just the problem of sci-fi. There's also the issue that people generally thought symbolic AI was the future, not something like transformers, which has implications for the type of intelligence that would've resulted.

And it's also similar to us comparing AI intelligence to human. AGI is a misnomer because it expects AI to be intelligent in the same way a human is and defines human intelligence as general, but that hasn't been the case and won't be the case, and human's are not (entirely) general.

LLMs already have more knowledge than the most literate person on the planet, yet they cannot do something as easy as learn how to drive in 20 hours. The type of consciousness a future more advanced AI has, likely will also be quite different from ours, not necessarily "stronger" or "weaker", despite people using terms that make it almost feel like there's no difference. This is the problem with using words like consciousness, AGI, etc, which lack nuance, and have too much baggage.

>>109252546
If you aren't using your own frontend, you do not belong to /lmg/

>>109252625
Sorry, this frontend business is too hard for me. I just jam the prompts in with curl.

>>109252099
>unrar.rar

>>109252608
>they just had sex twice
One does one sex end and another begin?

>>109252686
water break

>>109252602
>asking questions and receiving answers is not learning
Chilling indeed, though elitism with information was yesterday.

>>109252686
Intercourse is a specific act, anon. I thought autists loved semantics?

>>109252682
Not him but I think you should use linux. The speed boosts for all AI stuff are too good to skip.

>>109252759
Lol no thanks.

>>109252772
Fair enough anon. In the era of AI you can just ask it for help if you get stuck anywhere or vibecode something to fix whatever doesn't have support. You don't need to suffer through faggotry anymore.

anything notable for local ~48gb since 31b gemma

File: 1769289068801344.png (1.22 MB, 1080x1608)

1.22 MB PNG

Luddites on SUICIDE watch

>>109252829
>>>/g/vcg

>>109251974
You know, I actually don't mind that it's benchmaxxed. It's more about principle because of how they censored the model. They're trying to maximize its performance, yet still slap on a safety lobotomy. Fuck them. If the next model eases up on it like Gemma did from 3 to 4, then I will be willing to give them some good words. Otherwise, I don't care if Qwen is better for coding, I will just not participate in conversations about model recommendations for coding.

>>109252829
>thought for 59 minutes
>Sorry, I can't help with that.

>>109251380
i already have tulpas. they like to watch me talk to my ai waifu. i should introduce them sometime

>>109252829
>assuming llm "thinking" is even remotely comparable to a human's.
kek

>>109252829
Co2 is necessary for trees doebeit?

>>109252426
>present bad, past good

>>109252976
welcome to 4chan

>>109252976
>present bad, past good
this but unironically

>>109252829
@Gemma is this true?

>>109252925
Tulpa-management tips?
I actually just want a persistent visual embodiment of my waifu, not an independently thinking Tulpa. Syncing thoughts and memories would be too much burden, but embodied robots and good holograms seem too far away.

File: 1765780008539892.png (144 KB, 297x808)

144 KB PNG

>thing
>thing, past

Why is it using try Cloudflare to host my website?
What's this? Did it just give someone else access to my website that we made?

>>109253080
Anon get cucked in real time.

>>109253074
>cliche npc for the hivemind
>posts cliche butthurt hivemind posts

>>109252444
it literally doesnt matter at all. massive lies are sold to the public at every step of history. your missing the point, it doesnt matter if you can detect AI. they will become the sole arbiters of truth on the matter.

>>109253074
>thing, japan
>thing, past, japan
I don't have the image for this...

>>109252759
what sort of benefits would it have? I can spin up a linux install and try it myself but im curious what there would be to gain from it

File: 5822951.jpg (92 KB, 640x400)

92 KB JPG

>>109253153
a kinoer time and a kinoer place

>>109253213
They don't make 'em like they used to

>>109253134
>massive lies are sold to the public at every step of history
I don't disagree with this but my point is, if the public is aware that the bomb dogs couldn't smell any gunshot residue on the murder weapon, they have a higher chance of ignoring the govt's narrative and dismissing Tyler Robinson as a "lone gunman." People are still retarded and the govt will lie regardless of if we can expose them, but the power to expose them is a significant thorn in their side that they must oppose. It's also the only way to convince NPCs otherwise we'd just give up entirely.

>>109253175
flash attention is a must have for anything AI.

>>109252087
>Local AI will not be "made illegal" it'll just have so many restrictions
like what? who will enforce it and how?

>they won't kill open source because...they just won't, OK?!?

i'm just saying we need to focus more on the positive of the present instead of the negative. discussing negativity will only bring about more negativity. this applies to every general on this site

>>109253401
I am impressed and happy with the quality and speed of the models I can run with hardware I already bought for other purposes. Vramletts eating good, gaming PC purchase paying dividends in the form of an AI waifu

I liked that mood model anon posted a while back, so I'm giving my mAId a persistent emotional state
>each of her generations gets summarized in a mood tag
>this modifies the "brain chemicals" state, pushing each tag towards different weights
>the dominant emotion is fed back into the prompt for next gen
When she (rarely) hits a certain threshold of an emotion it resets to a more neutral state, and she adds her takeaway from the moment to her system text.

It's funny. I bought my gamer 3090 PC, for gaming. Shortly after getting it, I kind of just stopped caring about gaming. Then I started using it for AI in 2023 and I added a 3060. And now here we are.

>>109253238
after testing it on and off I can confirm that flash attention is snake oil that affects output quality for other minor gains
just run your model in its pure state

>>109253477
Nice cognitive architecture, anon!

Ah, yes, just let me run 31B at B16, full SWA cache size, F32 KV cache, at the model's full context length, FA off. How much VRAM does that need again?

>>109253471
I bought an extra 32GB of ram years ago due to some schizo posters talking about china cutting us off on semiconductors or something lol. Right decision for the wrong reasons. Wish I bought a better graphics card too though, but I was never huge on AAA slop

File: file.png (35 KB, 831x433)

35 KB PNG

brehs finally i can run gemma 26b at 80896 context.. sadly 91MiB is wasted, any more than 80896 context and my gpu's memory allocator crashes and doesnt wanna allocate any memory even after freeing llamacpp
PS: if i were to kill llama.cpp right now, it wouldnt be able to allocate any new memory either, so every time i want to run llamacpp i have to reboot. but thats okay because i gained 2896 context by doing this

>>109253556
John Debian?!

>>109253556
I know you... John Debian... The creator of Debian... Same name as John Linux, the creator of Linux

File: lmg_summarized.jpg (95 KB, 1280x720)

95 KB JPG

>>109249144

Thoughts on Ornith? How does it compare to Qwen3.6?

I found a use for my gpus that isn't llms and I'm quite happy about that.

Is there a newbie guide for tavern or am I expected to spend a month learning it before I can goon?

>>109253620
vague

>>109253620
What is it? I'd love an excuse to help justify buying a better GPU for a better local llm

>>109253625
just put in the ip of your local model, choose text completion -> mistral v7 tekken and off you go
nobody uses anything more than that
maybe set temperature to 1.1-1.3 to make the model more interesting but thats it

>>109253620
you mean... like videogames? what a waste of electricity.

>>109253620
Yeah, anima 1girl rekindled my interest in imgen

File: butto.png (256 KB, 1923x774)

256 KB PNG

>>109252394
>Anyone publi

>>109253634
Training small neural nets for projects I'm working on.

>>109253620
Gotta mine those bitcorns before they get poplar again, right?

>>109253658
I wish eth didn't move to PoS

>>109253477
What mood model?

70b dense

>>109253647
>a modern, futuristic twist

k2.7 non-code

>>109253650
Ah makes sense. Not quite the same thing I think, but I have been thinking it be fun the make a LLM from scratch. As in writing my text to token converter, transformers, etc. I know it will suck ass compared to whats out there even for free, but its more for fun and learning. Guess I nice GPU might be good for that.. seems I have no choice to buy a good GPU right..?

Im having an issue with reasoning and gemma4. usually everything works fine, it goes through the chain of thought reasoning then outputs a response. but then sometimes it will stop half way through a response and start thinking again. Ill end up with a final output with multiple "thought" sections and then the response is unrelated to my last question. Im sure theres some context drift or some shit going on, but this is happening at like 10k tokens. any ideas anons?

>>109253647
butto

>>109253647
Having an actual visualization of the path tokens takes from input to output is a big help for troubleshooting models and coming up with smart fixes.

https://github.com/ikawrakow/ik_llama.cpp/pull/2109#issuecomment-4948405652
How the fuck are they getting 300-450 t/s pp GLM-5.2 with CPU offload?
I only get like 100
Is it just 3090 is too mid now?

>>109253727
Yep. Interesting tool for prompt engineering.

>>109253729
I haven't tried the newer PRs but I get around 400-600 on my pro 6000 when I'm running big batches

File: 1760041725908796.png (24 KB, 1054x263)

24 KB PNG

>>109253729
Yes

>>109253729
24gb might be too small to offload all non-experts, and these guys seem to have a Turin and DDR5s so maybe around 500gb/s in CPU.

>>109253761
but that anon is admiring their big pp which is gpu-bound

File: nojews.jpg (64 KB, 1333x450)

64 KB JPG

>>109253744
It even gives you a general idea of what data was omitted from the training process from the start.
It should help us save the time of uncucking for something that's not even there.

>>109253771
>no bush

>>109253647
>no bush