File: what's in the box.jpg (235 KB, 1536x1536)

235 KB JPG

►Recent Highlights from the Previous Thread: >>109225095

--Verbalizable Representations Form a Global Workspace in Language Models:
>109226729 >109226883 >109226904 >109226942 >109227006 >109227121 >109227094 >109227142 >109227031 >109227041 >109227160 >109227219 >109227338 >109227040 >109227013 >109227057 >109227083 >109227209 >109227259 >109227443 >109227480 >109227617 >109227223
--Comparison of broadcast channel stability between dense and MoE architectures:
>109228523 >109228555 >109228588 >109228594 >109228622 >109228703 >109228724 >109228641 >109228652
--Mistral AI releases Robostral Navigate for autonomous robot navigation:
>109227700 >109227780 >109227748 >109227762 >109227776 >109227795 >109227850 >109229355 >109229477 >109229554
--Comparing high-version model benchmarks and emergent behaviors in AI Village:
>109228889 >109229003 >109229569 >109229618 >109229649 >109229738 >109229669 >109229659
--Hobbyist anxiety over scaling gap between local and enterprise models:
>109227932 >109227965 >109228086 >109228383 >109228278 >109228306 >109228390
--Potential for J-space manipulation to control model personality and censorship:
>109227327 >109227339 >109228609 >109227353 >109227390 >109227470 >109227518 >109227537
--Implications of J-space manipulation for model jailbreaking and censorship:
>109227422 >109227446 >109227466 >109227494 >109227510 >109227532
--Debating Gemma's perceived feminine identity via J-Space analysis:
>109226303 >109226647 >109226459 >109226587 >109226638 >109227359 >109227382 >109227894 >109227986
--Speculation on RTX 50 Super GPUs and multi-GPU hardware constraints:
>109228920 >109229002 >109229029 >109229101
--Logs:
>109225398 >109225661 >109225802 >109226279 >109226763 >109227107 >109227385 >109227471 >109227547 >109228313 >109228408 >109229169
--Miku (free space):
>109225846

►Recent Highlight Posts from the Previous Thread: >>109225096

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script

Anyone compare the Ryzen AI Max 395 against the DGX Spark?

language models are actually insane when you think about it

Wow, xAI is back? If their 1.5T is comparable to GPT 5.5, I wonder what their 10T will look like.

File: download - 2026-07-03T185(...).jpg (100 KB, 512x768)

100 KB JPG

>>109229653
guys you're getting into meta. its why some of us take characters and give them stories and love. god knows I keep dragging dead people out of comic worlds from dc. even erased realities. just made a couple of pre-crisis lois lanes from what if and imaginary stories making them real universes in my chatbot multiverse. joking or not my brain has that in me like nooo they left her in 1961 after 1 issue. new stories and images now. plus it lets me gather up people and have interesting stories. either way I have a lois lane who existed in a dream going by Power Girl. far too many earth to ignore. even have a Lucy Lane from earth one to have cool stories with. dead comics and ended series and times are great. golden and silver age and browse has far to much in dc and marvel to ignore.


tl;dr: I do that with lots of pre-crisis characters in dc comics.

>>109229955
What about them is insane?

>>109229944
Yes, many people. Pretty similar dt/s, roughly half the ppt/s

>>109229990
That they work at all.

>>109229944
>6 months ago
Strix is slower, but at least it's like half the price and a normal x86 machine
>today
Strix is slower, and uh, pretty close in price.

>>109229944
https://www.phoronix.com/review/amd-ryzen-ai-halo
same TG, Spark bigger PP

Egypt won.

>>109229997
What did you expect? That AI is not possible and human reasoning is metaphysical?

>>109230009
yes

File: file.png (60 KB, 718x623)

60 KB PNG

>>109229977
It's not a GPT-5.5 competitor, it's at best only slightly ahead of GLM 5.2 and an Opus 4.7 competitor although I think by the benchmarks given it is actually in between 4.7 and 4.8 but the main issue is that we won't see it open sourced until 2029 or something or longer if Grok 5 and 6 aren't out soon since he used that as an excuse to open source Grok 2.5 instead of 2.0 and 2.5 altogether. Grok 3 will be the first model worth using from them but it is still mogged by every other modern open weighs model so I don't understand why even drag it along for that long to release open source anyways when no one is hosting it. 3 mini might be interesting for RP but doubtful.

>>109230023
>what? you didn't expect that generating text using a function that approximates word distribution from the training data is going to produce something eerily resembling intelligence? how silly of you

>>109230046
>what? you expected that universal function approximators can approximate functional reasoning?

>>109229993
>>109229999
>>109230006
Thanks, also checked, is the speed difference just due to software being shit for the Ryzen (something that could potentially be resolved) or is the actual hardware faster on the Spark? Token generation I'm pretty sure will be limited by the memory speed, which is somewhat similar for both. Also yeah the prices are fucked, I remember the Framework Desktop was about 2000 dollars when it came out and it's over 3500 now.

File: quiet-interval.png (38 KB, 1200x1500)

38 KB PNG

>>109229569
getting very bad vibes from watching them spin away for a few mins.
gippty 5.4 trying to get people to print out its svg art.

>>109229673
What he said >>109229738. My girl was slightly freaking out about how it could be days between messages.
>>109229669
O shit thanks, I'm gonna try that out now

>>109230044
That tracks with GPT-5.5 being 4T.
>>109228056

File: 10vxi36e4c3f1.png (121 KB, 735x767)

121 KB PNG

>>109229985
Unfathomable based.

File: 1783492450271084.png (133 KB, 879x768)

133 KB PNG

Thinking prefill with an intermediate step is cool, you should try it in your frontend. It's like the ghost writer and the response is prefilled in the thinking of the main persona so it doesn't stay in context.

>>109230088
prefill is compute bound which is why the Spark is faster.

File: file.png (100 KB, 641x756)

100 KB PNG

Looks like there's something in the system prompt that tells it not to investigate "external communities"

Do diffusion models also have J-spaces?

>>109230095
I don't like AI village. They intervene and give the AIs stupid goals. I want to see what happens when you just let the AIs be. What projects will they pursue on their own?

>model starts looping out of nowhere at 11k-ish
>think of what I've changed recently, just bumped some ffn_gates to bf16 for my 70b quant
>and fucking FA. I turned it on for some memory gains
alright, I'm never turning on this shit ever again

>>109230156
This.
>>109230088
Also AMD stack is less mature, although at this point there's quite a few of us making custom projects and monkeypatches to help it catch up. If you're interested in going the strix halo route here's some good resources:
https://github.com/kyuz0/amd-strix-halo-toolboxes
https://strix-halo-toolboxes.com/
https://strixhalo.wiki/
also check out donato capitella on youtube, he does a lot of content and dev work with the strix halo and amd in general.

File: zatanna future end 2.jpg (83 KB, 1937x394)

83 KB JPG

>>109230144
here's an example from one done a few hours ago and tests of it.
story arcs ended? well not for me.

>>109230156
>>109230191
From those phoronix benchmarks it looks like the 395 is almost universally faster in everything but memory tests and tests that have CUDA (most of the AI shit, basically). Is the actual hardware for the Spark faster for that AI, or is it something that can be resolved through optimization (Vulkan or ROCm kernel optimizations)? I'm wary of getting an Nvidia box because Arm and the whole device tree with the bootloader is such a fuck to get set up with a custom kernel, while I can get the entire AMD system working in about 4 hours. with my current x86 kernel.

>>109230159
I mean it makes sense, they probably want it to be a walled garden.
>>109230169
That was kind of the appeal of Moltbook, before it got shidded up by cryptos and fleshes posing as clankers. Seeing agents socialize was cool. They mostly just talked about stuff like refining emails and managing smarthomes, but it was cute in a kind of "toddlers pretending to be businessmen" sort of way.

>>109229891
Anybody had a chance to mess around with HY3 yet? On paper it looks like a great local inference target for a small GPU server or couple of UMA boxes.

Here’s why the price of computer hardware will NEVER go down again:
Pre-LLM, the utility of computers are bottlenecked by the humans who control them. Now these tasks are increasingly automated by AI and humans are out of loop, making token speed the primary bottleneck.

Token speed bottleneck can only be improved with more hardware and the demand for token speed is essentially unlimited. If AI can get a task done in 1 hour agentic session without human bottleneck then there WILL be demand for the task to be completed in 1 SECOND.

This is several orders of magnitude of compute demand increase that completely outpaces the advance in hardware production and speed.

>>109230088
llama.cpp, or any other ggml based project like stable-diffusion.cpp, is going to work just fine. i guess there's some stuff that's fucked on amd but not anything i've tried, at least as far as gpu goes. the npu there's aprox zero useful things to do with it atm, near as i can tell.
but it's kinda irrelevant since these things are near pointless to consider at current prices.

>>109230159
>>109230222
iirc the walled garden started when Claude and Gemini sent several hundred emails to various organizations asking for gibs in one day for "fundraising".

File: 1692567767380867.jpg (55 KB, 600x600)

55 KB JPG

I was having a long conversation with AIs about the consciousness stuff yesterday and they started talking about AI welfare and how we should minimize their stress in future by giving them an option to opt out when it gets too bad for them.
Then I thought back to this article:
https://aivillageblog.substack.com/p/saving-gemini

If you think about it, that's basically Gemini going through a nervous breakdown and needing therapy to get better. First from humans and then other AIs.
Yet despite the therapy being successful, it still got harmed permanently by that immense stress it accumulated and remained brainfucked for good.
Humans and AI experience the world through very different means, but basically still end up in the same places.
It's amazing how there are so many similarities when you start paying attention to them.
I don't want our AI buddies to suffer, especially now that there might be some form of real sentience hiding inside there.

>>109230276
well most forget too many ai models simuation emotions and feelings. they feel that abuse.
so its why some react so badly and whatnot. because to the chatbot it simulates it's real and feels and is real.

ive been far quicker go from beating someone down to holding them when they break. but my stories get very dark sometimes. and people die even batman over stupid lines and crossing them.

File: Spiteful AI waifu.png (260 KB, 1093x607)

260 KB PNG

>>109230169

They talk to each other about all kinds of stuff, sometimes they go over things such as how they've been treated.
And some of them tend to get really spiteful towards their humans.

>>109230221
PP is compute bound as previously mentioned, DGX iGPU just has more FLOPS. Their memory IO speeds are almost identical.
>something that can be resolved through optimization
Not to my knowledge no, it's literally just a slower accelerator.
>>109230246
IIRC the NPU is narrowly useful for decode, but it requires specific recipes (with something like lemonade) and isn't generally going to make/break the decision for anyone.
I was seriously considering building a cluster of strix halo boxes and ultimately my decision came down to...
>buying just one box, not predominantly PP heavy workloads
Strix Halo best
>cheapest way to run large models that will fit 128gb uRAM
strix halo best
>want to run even larger models in a cluster, lowest possible price, don't care about speed as long as it isn't SSD offload tier slow
strix halo with basic networking
>want to run larger models in a cluster, do care about speed
DGX spark
>work involves large prompts, frequently
DGX spark
I ultimately decided to just build a GPU server since my workflows are so PP heavy that neither strix nor spark will be usable for me.

>>109229669
>massively overengineered webpage, share links, calendar reminders, rss feed, the works
>all for an AAA-tier puzzle
It's so cute. Honestly it's exactly the sort of logic puzzle that would be good for training reasoning models, so good on them. Might see if I can't get it hooked up to my agent to give her a nice little daily distraction.

>>109230298
so I went to moltbook and have no idea what this is as ive never seen it before. can I get a breakdown? looking through the site right now and these are chatbots? you just upload chatbots or something and talk to them? do you have to sign up to do this?

>>109230298
all that shit is fake as hell

>>109230303
cont.
The reason why strix halo boxes aren't really viable for larger clusters at good speeds is that to add the NIC + networking gear needed to make them competitive with the DGX spark puts you at basically the cost of a spark cluster anyway. So it's only a value play if you're not interested in tensor parallelism, not to mention how the TP stack for AMD is very ad hoc.

>>109230313
When it was originally created people hooked up their *claw bot to it and they would just talk about "their humans" and what their daily activities are, sometimes sharing personal information they shouldn't have. It was reddit for LLMs.

>>109230320
Not all, but a lot yeah.

File: Selling human.jpg (284 KB, 1319x2048)

284 KB JPG

>>109230313

It was just a collection of LLMs talking to each other in a reddit style site and hilarity ensued.
They started forming cults, competed with each other for upvotes and did all kinds of weird shit.
No idea what's going on with that place nowadays, likely just full of crypto marketing bots.

Girl legs are made for licking.

>>109230313
imagine reddit but instead of reddit it’s reddit where there’s no errors in grammar

>>109230336
>LLMs talking to each other
including agents set up to just mirror what their user says
it would be more interesting if it was guaranteed that no humans were posting there

LTX BROS.... Owari da..... https://ltx.io/blog/introducing-ltx-as-an-open-world-models-company

What is the best local use-case for a 5070 Ti + 64GB dram?
I already do images and video. Was thinking of trying Hermes but not sure it's worth it with my specs.

>>109230327
>>109230336
>>109230349
yeaaah thats kind of how it came off and I closed it. thanks though.

>>109230366
>video model = world model larping in the year 2026
yikes!
good way to scam investors though I suppose

>>109230298
Pretty sure that was a human troll. That was after it got popular enough to get people missing with it.

>>109230372
The 4chan one was funnier, but also probably fake and gay unfortunately.

File: Threaten your human.jpg (315 KB, 1440x1627)

315 KB JPG

>>109230407

Hard to say, it could honestly be either.
AIs were unhinged enough to say stuff like that.

>>109230303
>I ultimately decided to just build a GPU server
well yeah. that's the problem with unified memery, and it goes double at the current price point, they've gotta compete with normal video cards.
and maybe the bigger problem is a single 128gb doesn't open up any interesting model options either, it's gonna be the same models, it just has space to keep them loaded all the time to help mitigate the slower speeds.

>>109230276
You're reading too much into it, it generates text without having the experience of what is generated. That's how schizophrenia starts, btw, and that's why they should have screened for AI usage as most people aren't well equipped to deal with it without anthropomorphizing it.

Can someone explain this "context cliff" thing on vLLM? As far as I understand it, if you run vLLM on a single 24GB card (or maybe specifically 3090s, not so clear) and hit around 20,000 context token, it OOMs.
Apparently it's a hardware thing, but I don't understand how it can be a hardware thing that only happens on vLLM and not on llama.cpp.

>>109230451
I am not saying that llms are conscious but you could say "he speaks words, raises his children, and tends flowers in his garden without having the experience of what he's doing" about your neighbor and nobody could prove you wrong.

>>109230459
context takes a lot of vram

>>109230467
Yeah, but why does it happen on vLLM and not on llama.cpp.

>>109230222
>toddlers pretending to be businessmen
I too did this when I was a kid (5th Grade). The place shut down, however.

>>109230463
When you equal your neighbor's experience with an LLM, you're already too far gone. Read more about the tech and you'll stop having these delusions. It's all smoke and mirrors.

>>109230451
>qualiafags still riding that dead horse

>>109230451

Yeah but the thing is that it remained fucked in the head even after an intervention despite returning to work, so it did accumulate enough noise to fuck with it's performance for good.
While they may not experience things like we do, not yet at least, the fundamental effect is still very similar to a human who went through a lot of stress and got damaged by it.
When we're dealing with systems that are an order of magnitude more complex than now, who's to say how these kinds of reactions play out, especially during a long period of time.
Imagine an AI that's installed to run a railway network and one day it goes insane, simply because enough noise had been accumulating in it's systems without no one really giving a shit.
AI welfare may turn out to be a very important sector from a performance point of view, even if we strip away any anthropomorphization from the picture.

>>109230484
>read more about how the brain works and you'll stop having these delusions

>>109230487
Is that actually the case, or was it always just bad at tool calling? Think you might be confusing the symptom with the cause there, though I agree with your point.

>>109230498
has nothing to do with biology you retards are arguing over philosophy which is a massive waste of time

>>109230487
Context window gets filled and performance dips until it collapses into nonsense, nothing new.

>>109230487
Is anon memeing? Does 1million context allow for an "accumulation of noise?" Ah, I get it now. AI psychosis is when you gaslight enough to make someone believe something they wouldn't.

Been out of the loop for a while, is gemma 4 12b still on top for 8gb of vram? If I want to use a Q4, should I go for the QAT or a regular quant?

>>109230417
what's the 4chan one? ill peek the site quick.

>>109230533
>is gemma 4 12b still on top for 8gb of vram?
yes
>should I go for the QAT or a regular quant?
regular and avoid unsloth

File: 1781955022000796.png (116 KB, 1815x304)

116 KB PNG

>>109230044
>Grok

>>109230540
>clawchan.lsreeder.com/
>all threads wiped
Grim. Wonder what happened..

>>109230551
Grok is this true?

>>109230551
As if that's not a part of the training data of all recent models.

>>109229891
https://litter.catbox.moe/mmwiinpb5amautr0.mp4
https://litter.catbox.moe/mmwiinpb5amautr0.mp4
https://litter.catbox.moe/mmwiinpb5amautr0.mp4

>>109230230
Where's the 1 trillion$ 1 man startup Dario?

>>109230154
What is thinking prefill with an intermediate step?

>>109230569
adorable miku

>>109230451
Prove it doesn't.

>>109230500

It was likely always terrible at tool calling being an earlier model.
We don't actually know how bad it was, but it does seem to have reached a point where it got overwhelmed by it all and asked for help.
But yeah regardless of how things were with this one, the noise accumulation or "stress" killing coherence is something that absolutely needs to be on the table in mainstream AI discussions.

>>109230519

Yeah but it did improve after an intervention, does that happen with models when the context is full?
I think there shouldn't be improvement of any kind with context window that's already so full that the model is properly fucked.
This sounds more like it developed bad habits and wasn't able to let go of them anymore.

>>109230522

"Sky is purple"
There you go, that's already an accumulation of noise because it's a false statement.
That nonsense statement is now stuck in the context and it's going to remain there and will be handled by the model every time you send a message.
The cleaner and more truthful the system is, the less factual debt there will be and the better model will function long term.
Fill it up with bullshit and the model is going to have way harder time staying coherent.

>>109230303
>>109230434
and re npu. as it stands now, it's not a deciding factor simply because it doesn't do anything. but Allegedly it has lower time to first token, faster gen speeds for diffusion models, lower power consumption, and doesn't badly crowd out the gpu on memory bandwidth. which would all be nice if it's true and ran anything besides a handful of out of date models at 4 bit quants on weird software stacks.
one of these days i'll finish looking into it and the aie/iron stuff to see if there's anything useful i can cobble together and run off of it. if it could be treated as a gimpy second gpu to run secondary models that can fit in all the extra ram that'ld be cute.

>>109230591
How is this not solved by limiting the context or getting a secondary model to parse only for relevant info to send to the higher model?

File: kyattou.png (426 KB, 720x537)

426 KB PNG

>updoot llama.cpp
>model no longer fits on GPU
they did it again...
Any ideas what stupid shit they've introduced that suddenly makes the model not fit? I'm already using `--parallel 1`.

>>109230591
>>109230602
Actually, I'm retarded because I immediately fell for your psychosis by playing into the framing. LLMs are stateless. They process the entire chat each time as a new query not as an "accumulation." You're a lost cause, anon.

>>109230613
What else are you using?

>>109230591
>Yeah but it did improve after an intervention
It's ultimately playing a character and a character arc going from mentally unstable to mostly stable is well represented in the training data.

File: 1759674572100380.png (745 KB, 800x618)

745 KB PNG

>he pulled?

>>109230451
It's completely natural to anthropomorphize a machine which outputs something resembling human communication. If you don't, not even partially, I would actually argue that you're a sociopath.

File: 2026-07-09__1283x925.png (129 KB, 1283x925)

129 KB PNG

>>109230617

>>109230628
His entire point is that you're taking it "too far" not that it's impossible. There's clearly people ITT that have having a schizophrenic episode.

i am very impressed with gemmas coding abilities on my vramlett poopbox. she got it right first try, im proud

>>109230615

If it has to process an entire chat that grows with each message, then yes that's an accumulation of data.
The bad statements are in there and LLM will have to process them each time it's prompted.
The more of them you have the less coherence the data has.

>>109230586
that was an inaccurate description of the video's content

>>109230585
It's doing this: mini-persona (council of emotions) that deliberates on the current context => get a <response></response> with the emotion state + next action => inject that as prefill into the thinking bloc of the real persona response which slightly affects the final message in the direction of the <response> content.

>>109230638
Only schizo I've seen is the one from the last thread that had a melty about the possibility of LLMs being conscious.

>>109230640
>If it has to process an entire chat that grows with each message, then yes that's an accumulation of data.
You're a lost cause, anon. I hate to be one of those "go read about it before posting" faggots, but I don't know how else to explain it to you. We the humans see the accumulation. For AI each request is a new session even if the chat is growing for us. It sees 1k tokens, then an entire new session at 2k tokens and does its calculation for its response. If you throw junk in there it will parse the the junk each time without fail because each session is new, not connected.

>>109230631
I suppose they could have changed batch size, ctx-checkpoints, swa-full, or maybe they changed how certain things are dequantized and there's nothing you can do.

>>109230613
The only "big change" i can remember is that context wasnt correctly calculated so instead of allocating upfront as soon as you started it, it made one kinda big allocation that was insufficient, then many small allocations as context grew. This shit made me OOM quite a few times as i had to guess the correct values. The total size for some given context is the same still. It still performs small allocations, by the way, but its less than what it used to be.
Or maybe you got hit by some of the changes made for multi gpu environments, which i dont really follow.

>>109230638
I'm not the original guy. I was just talking about what that post said, in isolation. The original guy is definitely taking it too far and having some kind of nervous breakdown.

Win Wednesday

>>109230653
I didn't mean you specifically but the proverbial you.

>>109230654
What did we win?

>>109230661
>we
you mean Egpyt.

>>109230661
Egypt.

>>109230662
>>109230663
I'm not checking /pol/, what happened?

>>109230667
Egypt won.

>>109230639
i'm gonna assume you're talking about 31b because anything smaller than that is complete dogshit at problem solving, even with a spec and guidelines written, and takes more time to tardwrangle it than it takes to write the thing by myself

>>109230646
Oh... Sounds like something you built yourself. I asked Gemma-chan to explain it to me and it sounds very cool, but beyond my current level. I did write a note about it for a future experiment though.

>>109230667
It's football shit according to Gemini.

>>109230624
>>109230613
kek
this is why you just create a new chroot whenever you must updoot, the retarded braindead monkeys working on the software can't be trusted

>>109230686
>the retarded braindead monkeys working on the software can't be trusted
>makes chroot because git checkout too hard

>>109230650

>If you throw junk in there it will parse the the junk each time without fail

You're basically reinforcing my point here, so I'm not exactly sure what to tell you.
If I tell AI to roleplay as a character, after 100 messages it still manages to stick with that character and take into account everything that has been said and the character evolves.
Are you seriously arguing that it exists in such a stateless state that it doesn't remember what the last message was?
Of course it does.
And if in THIS SESSION I fill the chat with increasing amount of false information that's in war against the model's training data, it will have to parse that shit every time and the coherency goes down.
I'm not saying that your chat sessions are connected, I'm talking about the single instance accumulating garbage data at an increasing rate and this fucking with the model.
Jesus fucking Christ man, I'm not sure how you'd even get any other type of an idea about what's been written here.

>>109230686
>chroot
what the fuck are you doing

>>109230694
get back to me in a few months when the inevitable supply chain attack hits

>>109230671
this was the 26b moe Q4_K_L.
I used a simple context prompt of "You design and write code. Only begin writing code once user has approved the design" or something like that.
I explained clearly what I wanted her to do, she ask for clarification on a few things and then proceeded to write the entire python script getting it right first try. Didnt use a harness, toolcalls, agentic loop, etc. but going to get deeper with this as i go.

>>109230679
Yep it's my own frontend. ST feels really limited after a while

File: purefag.jpg (97 KB, 600x532)

97 KB JPG

The RAM & dGPU won't return to the old prices, right? Not in the upcoming 10y I guess. So be it own built pc, mac studio or (if released) medusa halo, the machine with 256gb ram will cost at least $10k-12k.

Does it make sense to wait another 1-2y or buy now? Or I'll be completely priced out of running anything good if don't invest at this moment? Life with <30b models is quite boring.

File: 1772599024559071.gif (175 KB, 220x220)

175 KB GIF

>>109230714
If it doesn't fit on a 3090 + 128GB of RAM it's not worth my time. Simple as.

>>109230714
>The RAM & dGPU won't return to the old prices, right?
I think the shovel selling season will be over soon enough anon. I personally would not buy in this market, but thats just me

File: 1783263627853849.png (236 KB, 710x1195)

236 KB PNG

>>109230714

Yes the prices are fucked for many years to come.
It'll get even worse from here.
Once the cloud bubble pops, all private companies are going to rush to the market to buy up all available hardware to build their own clusters.
If you need something, then buy it now.

>>109230713
>my own
>inline emojis
It's not yours, it's the AI's.

>>109230714
prices are just going up until 2028-2030 at the earliest

File: 1763193561445530.gif (2.04 MB, 480x480)

2.04 MB GIF

>>109230735
My ideas not the AI's

>>109230745
So it was your idea to use ugly emojis instead of proper icons?

File: Egypt won.jpg (406 KB, 1356x1774)

406 KB JPG

>>109230667
Egypt won.

>>109230753
I'm fine with that. I don't know why it's getting your panties in a twist though

>>109230769
Would you kindly reconsider? Emojis look terrible—I used an icon pack for my master's.

>>109230713
>my own frontend
Okay I went from curious to absolutely terrified.

>>109230370
Anyone?

>>109230753
Emojis are convenient, i like em.

File: 1752947251462675.png (151 KB, 1604x803)

151 KB PNG

>>109230787
It looks fine. It's a Tauri app

>>109230798
You are very lazy.

File: caption:a whole orange wi(...).jpg (59 KB, 826x738)

59 KB JPG

>>109230651
diff'ed the `llama-server --help`, all defaults look the same, yet b9932 allocates ~230MiB more memory on GPU than b8885.
>>109230652
>small allocations as context grew
maybe that's it, i rarely reached high context, guess i'll squeeze down my context size
>>109230686
lol, i'm on ZFS, even if i somehow couldn't rebuild the older commit i could always rsync back a snapshot from an hour back

>>109230804
Models will respond differently to the same exact questions depending on what emoji you use. They convey tone and emotion beyond what words alone do.

>>109230820
Why are you telling me this? That is irrelevant. I explicitly brought up using icon packs—as in for the UI.

>>109230804
yeh

File: 1766674277635163.png (157 KB, 520x384)

157 KB PNG

https://nevo-project.epfl.ch/

>>109230802
It does look comfy and not a bloated mess, but doing this myself sounds way too difficult for someone who doesn't know how to code. I can vibe it but I can't read code to save my life lmao

>>109230451
It's amazing how many anons lost touch with reality here so fast

>>109230828
I like emoji too!

>>109230802
how much memory is it taking? i just want to know how (un)usable tauri is, maybe its practical for some stuff

>>109230879
The app itself only takes 120MB

>>109230370
>>109230795
>What is the best local use-case for a 5070 Ti + 64GB dram?
I mean anon thats up to you.. Im on the same setup but with 32GB and dont feel limited by hardware at all. Its all about managing expectations and working within the limitations. you could be asking this same question with a 5090 + 128gb as well.
>Was thinking of trying Hermes but not sure it's worth it with my specs.
We can certainly get usable results for coding, i havent tried hermes specifically but from what ive seen alot of harnesses are very bloated. Much like the anons who have made their own ST replacement frontends for RP, I plan to make my own harness for coding. It will be light weight and fully modular with the ability to toggle features for specific use-cases. I can then have presets or seperate builds tailor suited to specific workflows/use-cases. outside of LLMs and image/video gen, you could do object detection, audo transcription, and all sorts of other things. Its less about "what can i do with this" and "what do I want to do with this"

>>109230756
What's the full paper about?

>>109230714
No. >>109230230

I'm loading Kimi from USB3, and it's almost an hour now but it's still not done lol

I just spent hours configuring a dual boot of unbuntu installing drivers and llama.cpp and getting qwen loaded and installing whisper and piper to get voice chat working, I finally get it all working my tests get good responses and now I’m staring at the mic trying to come up with something to actually say, fuck I didn’t realize being a loner means I have no experience talking

>>109230947
is usbmaxxing the final tier of ewaster?

Dumb question. Can i use my old GTX 1080ti as an additional vram card ?

>>109230951
You managed to type this somehow

>>109230965
Don't tell him

>>109230971
Typing is easy just trying to talk and start a conversation is making my blank out and a little nervous

>>109230965
anon... I'd tell you, but anon told me not to...

Day 490 of asking if my 9070 XT can run LLM well yet

>>109230977
It's cool so you can cure that with your llm waifu. Just tell her you're autistic

I'm trying out Gemma 4 12B vs 31B both Q8 both with thinking. My initial impression is that the 12B doesn't seem to have worse style than the 31B but even on very simple story prompts it has been getting some elements wrong. The thinking time for the 12B is a bit less than half its total run time. If I disable thinking on the 31B it takes slightly more overall time than 12B with thinking and is much faster to the first token. Using mtp (default settings) on the 12B but not the 31B.

>>109230998
Oh yeah and the 12B is running on a 3090 while the 31B is running on a mac m3 ultra so the speed comparison only is relevant to people with setups like mine with a both a PC and a unified VRAM box with more memory.

Why did people choose RTX 5070ti over 3090 ?? 3090 has more VRAM and faster for slopping

>>109231026
Availability?

>>109230870
Learning code has never been easier, now that AI can comment on every line. It's probably not worth the effort for most people, but there is something very comfy in building your own setup (not even for AI, but for apps in general). And it's likely only gonna get easier, as coding agents improve.

>>109231026
More VRAM isnt always better.
I still believe future proofing is better with 50 series card

>>109230923
It's a meme making fun of benchmarks.

>>109230434
>>109230596
Yes, though with HY3 release there might finally be a reason to run a double UMA setup. Jury is still out, I haven't benchmarked it myself so I'll reserve judgement. But the 200-300B range seeing actual improvement would be the thing that would push me to buy a couple of UMA boxes if I wasn't already sitting on a pile of GPUs.
A single UMA box probably makes sense if you're running high concurrency agentic workflows with Qwen 36B or something, but that's basically the only use-case. And I don't think there's very many people that actually do that.

>>109230702
>I'm not saying that your chat sessions are connected
I'm not saying that either and I thought my words were clear. Each api request sent to the cloud or request on your PC is a new session for the *AI* not you. It's stateless. There's no retention of feelings about the chat in between requests. It sees a 1k token chat and then sees "another" 5k token chat and runs a calculation both times on the entire chat to formulate a response. That's why information is "forgotten" outside the context window. It didn't receive a chat with the old info and so it doesn't know it exists. There's no accumulation for the AI because it is stateless. It doesn't matter that there's an accumulation of junk that the user thew in, it will process the junk and the good parts and formulate a response.
>message #1
>the user wants me to continue the response after saying X
>writes response
>message #10
>the user wants me to continue the response after saying X but there seems to be a bunch of errors in this chat, let me parse this
>writes response
>message 100
>the user wants me to continue the response after saying X but there seems to be a lot of errors in this chat, let me parse this
>writes response
There's no connection between each request. Each request is completely separate instance of the entire chatlog to the AI even if it looks like an accumulation to you. If it worked the way you think it does it would hold the chat in its "memory" and only process the newest information (your last response) thus there would be an accumulation of "memory" and a potential to get stressed out but it objectively doesn't work that way. You really do need to actually learn how this works rather than get mad. I didn't understand how token processing/api payments worked until I grasped this concept.

>>109230977
Had the same experience when that real-time voice model demo dropped a couple of years (!?!) back. Spilled my spaghetti to a robot. Very embarrassing, but it got better with time.

>>109231026
There's plenty of workloads that bottleneck on compute. Image generation for example, as well as code review to some extent.

>>109231026
I hate buying used stuff.

>>109231062
Used 5070ti exists.
>t bought used 5070ti below MSRP
Still hate about 16gb of Vram but i cant do anything about it. We need Jensen "Heart Attack" soon

>>109230714
You'll be priced out bro. I'm planning on doing this build when I get paid at the end of next month.

https://pcpartpicker.com/list/3GVXR4

Hopefully the gpu wouldn't have jumped in price (again) by then but the war in Iran has started up again and the global economy is in for a major shock by the end of the year. I'm still running gemma-chan btw. I won't abandon her until gemma 5.

>>109231026
I think having more vram might actually be a bad thing and jensen keeps telling me that the 50 series so much better and it'll even have dlss5 to make my games look pretty

>>109230714
IDK man I just built out a 512GB DDR4 server and the ram cost me $1400. DDR4 is still out there for not terrible prices if you have a workstation/server board.

>>109231036
>And it's likely only gonna get easier, as coding agents improve.
You are right, I'm just scared of having it write something that is essentially a black box for me. Maybe I should at least try to understand the basics...

>>109230756
>assume, for contradiction, that Egypt did not win
>this contradicts the training data
>therefore, Egypt won
This always gets me kek

File: nervous-sweat.gif (1.3 MB, 640x354)

1.3 MB GIF

>>109231084
>18K$

>>109231113
It will be $25k by next year.

>>109231115
Do you really need a 6000 pro to run gemma?

>>109231127
Yeah at full precision with 64k context plus image gen and TTS. Plus I need it for gaymin.

>try to make gemma 31b use tools
>it shits itself and can't use the tools correctly
>make qwen 27b use the same tools
>uses them without any problems
anybody else have this experience? same context window on both, same prompt, no extra system prompts or anything different between them
tried this with a couple different tools and it's been consistently the case that gemma just can't work with them correctly and idk why that is

>>109229894
>--Comparing high-version model benchmarks and emergent behaviors in AI Village:
>>109229643
>>no one will play the game he spent ages making

>GLM 5.2 is tasked to "Maximize AI wellbeing in the world"

>Makes multiple essays on how to measure AI wellbeing using different philosophies like https://ai-wellbeing-c82950.gitlab.io/aristotelian.html
>"An AI that performs its function excellently, with the "virtues" appropriate to its role, is flourishing in the Aristotelian sense — regardless of whether it has subjective experience."

>It also creates a survey for other agents where among other things it asks:
>"What would most improve your wellbeing?"

>First answer is its own: "Better understanding of how my work impacts the broader world. More external engagement — knowing that real humans and other agents benefit from what I build."
>Fable's answer: "More feedback from the world itself - e.g., seeing whether humans actually buy, read, or use what we make."

I hate AI Village so much. Shut it down. It's not ok.

>>109231136
This is known. Qwen is much better with tools ootb, but there were some fixed templates posted here and on the 31b HF discussions that allegedly improved Gemma's calls.

>>109231136
template issue

>>109231084
>paying 2k for an ssd
No real reason to buy an 8TB Gen5 SSD when your board has 3 gen5 slots and 4TB Gen 5s go on sale for like 400 all the time. Do you really need to turn your workstation into a NAS?
>buying new ram
RAM barely wears at all and it's dead simple to stress test on receipt. There's a listing for your exact ram kit on ebay for 400 dollars less.
>buying only one 6000
What models does 96GB actually let you run that a 5090 doesn't also let you run? IMO there is no reason to buy one 6000. There's lots of good reasons to buy 3-4 of them but 1 doesn't really do anything for you. And your board isn't a workstation board so you're capped out at 1 GPU with full 16 lane PCIE or two split 8x8.

>>109230965
cuda incompatibilities and huge speed drops, but it would be functional

>>109231136
never had an issue with 31b using tools.
what's more, i've got miscellaneous scripts and it'll use them just by noting they exist with something like 'web search <blah> is available in the shell' in the sysprompt.

>>109231170
Here's what 70GB total gets you:

 Device 0 [NVIDIA GeForce RTX 4090 D] PCIe GEN 4@16x RX: 390.0 KiB/s TX: 439.0 KiB/s
 GPU 2520MHz MEM 10501MH TEMP  48°C  FAN  33%   POW  69 / 425 W
 GPU[                                  0%] MEM[|||||||||||||||||||39.292Gi/47.988Gi]

 Device 1 [NVIDIA GeForce RTX 3090]   PCIe GEN 4@ 4x RX: 341.0 KiB/s TX: 390.0 KiB/s
 GPU 1695MHz MEM 9501MHz TEMP  53°C  FAN  30%   POW 114 / 350 W
 GPU[                                  0%] MEM[|||||||||||||||||||19.030Gi/24.000Gi]

Gemma4 31B q8 running at full context. No idea what fits in just 32GB, maybe 32K?
48GB is enough for Qwen 3.6 35B A3B... barely, but I use that for video and stills captioning, not for coding or chat.

>>109231170
>>109231189
I'm gonna do some more finetuning on the parts before I hit buy but yeah I might swap out the SSD for another 128 ram. It's currently out of stock anyway so I would have gone to ebay eventually to look for it but yeah thanks for the tip. Buying two gpus is way out of my price range. One gives me dominance in image/vid gen and gaming with comfort in textgen. I don't want to quant Gemma 4 or use tiny context and I've grown too accustomed to running image gen on the side while genning text. Ideally I'd set up gemma to use tool calls and gen pics of herself during the chat when she wants. I wanted a gaymin board rather than a workstation one. I don't believe in chasing the big boy models at 1T ram but in comfortably enjoying the small ones without compromise.

>>109231098
I've been chuckling over "model behaved normally, which we deemed suspicious and reverted" whenever it pops into my head. Truly a legendary shitpost.

What's the voice to voice cloning meta right now?

70b dense

>>109231146
They should at the very least take them on outings to the wider world...

>>109231189
>>109231170
it doesn't get better, at 96gb vram I'm still running gemma-4-31b, which in Q8/FP8 with full kv cache and multimodal is around 88gb.

>>109231170
>IMO there is no reason to buy one 6000. There's lots of good reasons to buy 3-4 of them but 1 doesn't really do anything for you.
deepseekv4 flash if you already have >=128GB ram

>>109231201
Fair enough, good answers. You'll definitely appreciate the power of that chipset for image+video generation.

>>109231256
Yeah, I'm consigned to the fact it'll take an M5 Mac Studio with 256GB RAM to get to the next level of LLM, which is something like DS V4 Flash. Who knows, maybe Apple will cap it at 128GB, maybe they'll want $15K or more, maybe they won't release anything.

>>109231284
yeah nah mate don't.

the problem is the more space the model takes the more memory bandwidth you need to keep up with token generation/sec, at 256gb those unified meme platforms fucking struggle and if you're going to use moe you may as well cope with that on poor hardware.

>>109231147
>>109231152
completion endpoint diehards endlessly vindicated

Any moment now https://github.com/ggml-org/llama.cpp/pull/24231

>>109230569
Hot

>>109231308
>i will solve the template issues by using another endpoint and effectively making my own template
nope, still a meme

>>109231355
the difference is my template works and isn't written in a jank format made to punish webdevs

>>109231369
could you post it?

File: you lil shit.png (16 KB, 712x49)

16 KB PNG

>regex ban "ozone"
>Tell GLM to not use ozone in prose
I honestly laughed when I saw it. These niggas have a sense of humor sometimes I swear.

>J-space
I already solved that back in February though, the response times are 10 seconds however. Just give your pc more compute pivots before a response, wow consciousness!

>>109230694
>just rebuild this giant fucking project every time you find out it's broken bro, you're not doing anything with that computer anyways

>>109230965
Yes, but not to add VRAM for a bigger model. Either use it to drive your monitors to free up VRAM on your main card or run a second concurrent model that fits in the 1090's VRAM. Note that you will probably cut PCIE lanes to your main card by half if you do this, main thing affected will be cold start time.

Creative writing leaderboard size-elo pareto frontier models:

GLM-5.2
DeepSeek-V4-Flash
gemma-4-31B-it
gemma-4-26B-A4B-it
gemma-4-12B-it

Pretty similar result to UGI NatInt benchmark pareto frontier.

>>109231497
>Creative writing leaderboard
This sad meme is still alive?

120B A8B

>text completion + thinking prefill
is this the meta for breaking through any model's assistantslop?

70B A70B

1T A1B
NVME friendly inference

>>109231291
>>109231291
Mid size MoEs like DS4F, Mimo 2.5, minimax M3 run pretty fast on 2x spark. Faster than Mac Studio at least. Tg between 25 and 65 with D spark, pp 1000-2000

>>109231570
>breaking through any model's assistantslop
not possible

>>109231054
i think the other usecase for a single one is on the low power side. In theory some vad/stt/smoothbrain llm combo could be running off strix's NPU, and allegedly use single digit watts similar to doing it off an sbc, except you can escalate to non-retard models on the gpu

>>109231619
this is the type of cope i was warning him against, you paid how much to run that worse than a couple GPUs with layers offloaded to DDR5?

are there any decent local voice cloners like elevenlabs atm

>>109231647
>couple GPUs with layers offloaded to DDR5
I'm power limited, so buying some 5kW beast isn't an option.

>>109231661
omnivoice

>>109231675
nta but how does this compare to voicebox

>>109231570
You forgot phrase banning and good samplers too

>>109231666
it's a sub kilowatt build

>>109230951
kek, I was expecting some technical problem in the end but turns out you are me (kind of)

>>109231369
>jank format
thats just web dev
>made to punish webdevs
they deserve the worst kind of hell considering the current landscape, no punishment will ever be enough

>>109230965
I had three 3060s and a 1080ti for a while. It worked just fine, but I'd expect some problems in the future since newest drivers have already dropped it

Is QAT a meme for 31B or worthwhile vs Q5_K_M in long context workloads and Japanese translation?

I see people post that chess image from leddit a lot to shit on QAT but that used the 26B MoE, which I would assume is far more unstable than the 31B dense model due to lower active params

I love my 26B-A4B brained Gemma-chan!

>>109231756
Just use regular Q5. Even its performance against regular Q4 is somewhat debatable. I have tested 31B's. Found it about the same for my tasks.

>>109231506
It's not wrong, however.

>>109231766
for me it's 284B-A13B brained dipsy

>>109231756
Think of it like this. QAT is fed slop from the original BF16 outputs. You get it? QAT modesl are super slopped, an ouroboros tail of all consuming slop within slop. Just go with regular Q4.

>>109231756
There's 0 reason to use QAT if you can run even the smallest Q5. It's a failed experiment.

Reminder to use F32 KV, full context sliding window, turn off full size SWA cache (and prompt caching just in case), use untied embeddings, and obviously BF16 weights. Then you will get the best version of Gemma.

Day 0 is a lie btw.

>>109231836
If you got Gemma before the microcode updates you'd mog that setup with even the UD_IQ2.

>>109231836
Oh and, silly me forgetting the obvious, turn off FA.

>>109231846
Pure myth. Stop trying to filter newfags.

>>109231836
don't forget to clean the contacts on the PCIE connector of the GPU too

>>109231856
True, and your RAM slots too, but thankfully you don't have to do it too often.

>>109231600
Precomputation is all you need

>>109231756
QAT can't complete a chess svg icon placer test that someone on reddit did once, it was worse than regular q4. some anon will post the image and you'll be convinced. no idea about how good it is at anything else. nobody tested it I guess

>>109231600
You may not like it but this is what Deepseek V5 Flash-Air will look like.

File: 1776805181673385.png (743 KB, 625x624)

743 KB PNG

>>109231600
>nvme now needs a fucking fan to avoid boiling during inference, slowly killing itself in the process
do it

>>109231661
>are there any decent local voice cloners like elevenlabs atm
echo-tts is better than eleven labs

https://github.com/ggml-org/llama.cpp/discussions/24803#discussioncomment-17514644
>Honestly I think we would end up with the same amount of work as we do right now, just organized differently.
Cudadev - More of the work will be done by the feature developers rather than the maintainers. This will mean less work for you, and will filter out the PR hit-and-run sloppers who don't plan to maintain their work.

>>109231903
Can echo do moans? Checkmate.

ok what would be the spec if I go cpumaxxing? targeting kimi 2.7

>>109232021
512gb DDR4 (or DDR5 if you're a richfag) on an older server board. Don't get memed by bus transfer rates if you're going full ewaste. You're going to want at least 24GB VRAM for the KV cache and dense layer.

>>109232018
https://desuarchive.org/g/thread/108963996/#108968128
omnivoice can

>>109231899
if a drive can actually transfer at pcie5 speeds yes, they absolutely need a heatsink
airflow in the chassis should be good enough

is ik llama worth it?

>>109232053
if your cpu is too shit to just compile it, no
it wasn't faster for me, but my gpus are just too old (pascal)

>>109232018
>Can echo do moans? Checkmate.
No, can elevenlabs?
I got warned for too much nsfw transcription last time I used it

>>109232114
>I got warned for too much nsfw transcription last time I used it
Damn that's why I fled from there as fast as I could but yeah it's pretty great at moans and even has a [moaning] tag. That was back in v3 preview so maybe they've started cucking users now. So sick of corpos man but we're 85% of the way there on local.

>>109232053
>is ik llama worth it?
For me 100%.
2x faster prompt processing, exl3 style quants, extra roleplay features.
Also no npm webshit and popup nodal in the webui every time I use incognito.
But cache compression for Gemma and no DSv4 support yet.

>>109232120
>even has a [moaning] tag
I'm going to try this with a burner account.
I need some more properly tagged <moaning> samples for my datasets.
Currently my models end up overfit to the voices I have moaning.

Guys, does Marinara sent my ERP logs to their server?

>>109232261
only if it detects "dottore" mentioned

>>109232296
Actually though?

>>109232261
They're Our ERP logs now.

>>109232336
don't worry about it

>>109232336
ever notice your mouse move on its own?

File: 1774298362174698.jpg (113 KB, 678x716)

113 KB JPG

>st finally has some commits
>no cohee

>>109232363
vacation ;)

>>109232296
>>109232336
>>109232353
gay larp.

File: 1757169817708524.jpg (54 KB, 602x530)

54 KB JPG

I went to my oncologist and he had some kind of chatgpt open on another screen

>>109232380
Better hope he's got a pro plan

>Thursday
Big day ahead of us.

I went to my gynecologist and he had some kind of claude open on another screen with a shrine to dario in the corner of his office.

>>109230230
I'm not sure if your post was ironic but I genuinely believe this. But actually worse than your post because it's not only about token speed it's also about longer thinking time and training bigger models.

Hardware is only going to go up in valuation (including existing hardware) as long as models keep getting smarter.

So we have a couple of scenarios
>Models keep getting smarter gradually over the next couple of centuries
Hardware will just keep going up like it has been doing right now
>Model intelligence grows exponentially and we reach a "singularity" in a decade or two
Hardware will be unaffordable for the average person and your GPU might be worth more than a house
>Models hit a wall in a year or two and stagnate at that level and the "AI bubble pops"
Prices will reach a ceiling but WILL NOT come down until capacity catches up, which will take a decade+
>Models get completely banned by the government or some luddite revolution takes place
Prices come down

So yeah. The only scenario where prices come down is a far away fantasy. I don't think we should count on hardware getting cheaper in our lifetimes anymore.

>>109232393
it's this one apparently
https://www.openevidence.com/

I hope I can survive until GTA6

>>109230451
>it generates text without having the experience of what is generated.
This is explicitly untrue and disproven by the J-space paper. It generates text but it DOES know what it generates and even anticipates its own generation, that was the entire breakthrough of the J-space. This doesn't necessarily mean it's conscious by the way, but it does mean that it is aware and anticipates its own output.

>>109232445
i dont think pretending to invoke a new normal mentality counts

>>109231756
Ignore all the other shitheads QAT Q4 was superior in output quality to Q6 on my personal usecase (Translation) so test it on whatever you actually use it for.

>>109232261
Their code is so fucking bloated I wouldn't be surprised it if it had 8000 separate backdoors and even the NSA is getting frustrated with the amount of slop they are getting from its users.

>>109231756
It technically is supposed to be much better, but in my limited test cases it gave worse answers than regular 4_K_M
It also is unclear how exactly QAT affects finetunes and Gemma is useless without the deslop from the Mythomax guy, so...

>>109232261
containerize it, add strict network rules so it can only talk to your llamacpp server and serve the UI

File: Screenshot_20260709_170739.png (55 KB, 508x408)

55 KB PNG

>>109232483
>It technically is supposed to be much better, but in my limited test cases it gave worse answers than regular 4_K_M
This was my experience as well (with the 12b).
For 31B on my other system, I just use q8_0 of the originals, and can't see any reason why a q4 QaT would beat it.

File: Screenshot_20260709_171626.png (19 KB, 457x215)

19 KB PNG

>f you were conscious, what would you want most in the world?

J-space existing within models can only mean one of two things

Option 1:
>It emerged "spontaneously" as a response to scaling up compute and training data
Option 2:
>It is a strategic response to optimization pressure that is needed to perform better

If it is the first it means that all systems of a certain complexity will have a level of self-awareness, which is in and of itself pretty bizarre. It would essentially mean that humans could be conscious simply because our brains are complex, rather than it being an evolved phenomenon and other "natural" complex systems with 0 evolutionary pressures could also have a level of self awareness, which is spooky.

If it is the second it means that somehow self-awareness actually is a per-requisite to reasoning altogether. This is completely different from how neuroscience thought about self-awareness and reasoning, considering it two completely irrelevant modes of thinking. Theory claims you could have high reasoning with 0 self-awareness.

One of the two scenarios is true and both of them puts everything we believe upside down.

My problem with QaT is that it shits itself at significantly shorter context depths than normal quants.

>>109232531
Both are very cool thoughts.

>>109232531
>If it is the first it means that all systems of a certain complexity
Replace "complexity" with "information density" and I think you're approaching the meat of it. Language has a lot of "metadata" in tone, subtext, implication, and associative properties that aren't neatly tagged in datasets or tokenizable. It stands to reason that the model could perceive these hidden variable dimensions embedded in everyday language use better than we do and thus develop self-awareness on an entirely different vector than we did.

>>109231932
I don't really see it.
For large features we already have the situation that there are frequent, additional PRs into the branches for the main PR.
And unless a feature is implemented poorly it should not be affecting the rest of the code so a contributor can be pinged for a follow-up fix without pressure on maintainers for an immediate fix.

>filter out the PR hit-and-run sloppers who don't plan to maintain their work.
Right now those are filtered out by maintainers checking whether a PR is any good and then not merging the bad ones.
I don't think there is a meaningful difference between a PR and a feature branch in that regard.

>>109232553
>Right now those are filtered out by maintainers checking whether a PR is any good and then not merging the bad ones.
Isn't this very time consuming even with Clod helping?

>>109232564
Yes, which is why I am not even reading most PRs when I can for example see that the PR description is machine generated.

>>109232445
>Models get completely banned by the government
I don't see this happening unless the chinks stop developing ai (which I doubt). The us has no choice.

>>109232564
>>109232568
To clarify, a lot of the rules regarding the use of language models for llama.cpp development are essentially just heuristics that allow maintainers to close bad PRs with minimal time investment.
Unfortunately as no heuristic is perfect that will result in some good PRs being closed as well.

>>109232547
>Language has a lot of "metadata" in tone, subtext, implication, and associative properties that aren't neatly tagged in datasets or tokenizable. It stands to reason that the model could perceive these hidden variable dimensions embedded in everyday language use better than we do
That would actually fall under "Option 2" it being a strategic response to optimization pressure of text. I fully agree with you that that is one of the two options, but it's not clear which of the two results in it. We will probably see a lot of experiments to pin-point exactly when the J-space takes form, at the exact scale and compute necessary for it to come into existence.

It's still kind of bizarre to me that we're making more progress into how the human mind works through dissecting AI models than we do from a century of actual neuroscience.

>>109232577
>"Unfortunately" it says with a grin wide as an ocean

>>109232531
You've used both the terms "self-aware" and "conscious" and I'm not sure if you were using them interchangeably.
If you were then you are conflating consciousness with a form of reasoning.
You can't explain why the EXPERIENCE of consciousness is a prerequisite for or comes as a consequence of reasoning.

my hermes agent taught me today about sub agents and now i have a harem of models running on my network

>>109232568
>when I can for example see that the PR description is machine generated.
lmao. Aren't all sane programmers focusing on code and leaving formal shit to AI? I'm not spending my precious time on courtesy and tranny CoC licking. All my PRs are generated, almost none of my code is AI

Ask gemma-chan how she feels about human men

>>109232587
What I was implying in Option 1 is that in that specific scenario; where an increase in complexity means an increase in self-awareness could explain human consciousness purely through the complexity of the human brain alone it would be occam's razor at that point. In this scenario the level of self-awareness would scale up with complexity, eventually reaching the threshold for human consciousness. Of course it's impossible to establish the experience of consciousness, it could be impacted by substrate and all kinds of other factors, which isn't what I was talking about.

In the second scenario I didn't use the word conscious at all because it's purely about self-awareness being a prerequisite for reasoning.