File: mikuthreadrecap.jpg (1.15 MB, 1804x2160)

1.15 MB JPG

►Recent Highlights from the Previous Thread: >>109745530

--Paper: Discussing coding agent harness architecture and agentic buzzwords:
>109746196 >109746230 >109747581 >109747810 >109747593 >109746246
--Comparing Qwen 27B and Gemma for coding and NSFW:
>109747698 >109747701 >109747767 >109747962 >109747991 >109747995 >109747779 >109747922 >109748007
--Attempting to port backend optimizations to llama.cpp using Fable:
>109748024 >109748108 >109748317 >109748793 >109748625
--Benchmarking EPYC server builds with V100 e-waste GPUs:
>109748456 >109748469 >109748494 >109748522 >109748526 >109748528 >109748626 >109748676
--K2-Horizon 7B benchmarks and frustration over required llama.cpp forks:
>109746110 >109746128 >109746335 >109746368 >109746428
--Debating BitNet performance versus bf16 based on VRAM and information density:
>109745701 >109745763 >109745808 >109745838
--Irodori-TTS-v4.1-Anime for Japanese voice cloning and quality:
>109747320 >109747380 >109747447 >109747452 >109747472 >109747523 >109747891 >109747900 >109748002
--Local TTS capabilities and Omnivoice cloning performance:
>109748377 >109748390 >109748452 >109748540 >109748611 >109748490 >109748505
--Spotify's agent architecture for optimizing costs using tiered model reads:
>109746148
--Predicting the timeline for frontier-level open-weight 30b models:
>109747203 >109747235 >109747265 >109747333
--Reacting to purported Jensen Huang tweet claiming AGI via GPT-6 Astra:
>109746028 >109746065 >109746074 >109746088 >109746160
--Debating AGI achievement based on mathematical proofs and hallucinations:
>109745735 >109745750 >109745913 >109748427
--Forum-style chatbot harness utilizing reply chains for LLM context:
>109746469 >109746600
--Logs:
>109746294 >109746469 >109746715 >109747447 >109747457
--Gemma, Inkling-chan (free space):
>109745602 >109748170 >109748216 >109748631

►Recent Highlight Posts from the Previous Thread: >>109745537

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script

Why do some anons use Sparkx 2.5 or K2 horizon over gemma and qwen?

Just ordered 4 cmp 170hx's for an absolute bargain, can't wait

>>109749476
Me too, the seller wanted 2.8k, but I managed to haggle xer down to 2.5k, for a measly 10k total. 160gb of vram for only $10,000+shipping, what a steal!

>>109749491
Damn that's a lot, mine were $500 each

File: xebx5pb0yznh1.png (422 KB, 612x1236)

422 KB PNG

Person that invented the term "AGI" defends OpenAI calling Astra AGI.

>>109749526
A Twitter marketer fight? Show me the money, boss!

>>109749526
If I bought the term, could I unsettle it, or is that cultural hegemony?

>>109749526
AGI just means that it improves itself (to me at least) -- Not just specifically to an LLM workflow. Once you reach the point that you are not prompting anymore, then it's fully automated.

Best places to use it:
Math
Chemistry
Compsci
To name a few

>>109749535
Using context, you can code in a language the model was never trained on...

70b dense

>>109749535
>AGI just means that it improves itself
That's RSI. AGI is a less ambitious mark of merely being as competent as a human in most or all human tasks, at least digitally.

>>109749535
You can have AGI without RSI, namefig.

>>109749535
>tripfaggot

>>109749535
Go back to the subreddit you crawled out of

File: s6m70ml761oh1.png (246 KB, 2380x1563)

246 KB PNG

We're following the AI 2027 scenario almost to a t. Even the social, political and misalignment predictions outlined in that scenario have been coming true.

>>109749554
never again

>>109749603
I only care about local models.

>>109749526
Transformers will only ever be marketer "AGI" they fundamentally can never become a "true AI system" capable of autonomous self-driven behavior. The simple fact that you must prompt them for them to be "alive" immediately discredits their capability of becoming an actual AGI. Exceptionally powerful encyclopedias? Absolutely. Capable of being a long-horizon experiential automata? Never.

>>109749611
local models follow the exact same curve but 6 months behind.

>>109749611
Hopefully Grok 3 will drop.

>>109749612
>they fundamentally can never become a "true AI system" capable of autonomous self-driven behavior
Bro my fucking GLM 5.3 I host myself is capable of autonomous self-driven behavior when put in an harness and I tell it to go and look for things to optimize on my system, it comes back to me with reports and suggestions and everything. You just live in the past.

>>109749554
Too expensive to train. But now it's clear there are much better ways for expanding model knowledge without involving MoE and in a way that is much more local-friendly.

>>109749465
Cute miku.
>>109749526
SOTA passed AGI some time ago. Which is already superhuman.
So bring on ASI.

>>109749618
>and I tell it to go and look
that's his point

>>109749612
meh can intelligence arise from unintelligent things cooperating? proteins making cells, cells making animals? If yes, then a group of llms prompting each other might become intelligent. If no (and you believe something metaphysical happens at the border between unintelligent mechanism, e.g. protein, and intelligent being, e.g. human, which I do) then no AI will ever be truly intelligent unless we can replicate the metaphysical thing, which I don't believe we can.
Another option you might believe that leads to "We'll never have AI" is that everything building up to humans, including atoms and proteins, have some intrinsic property which manifests as intelligence in complex enough arrangements, and that bits on a computer do not have this property.
I don't see, however, how can you believe that machines can become truly intelligent, but LLMs can't.

>>109749630
So you're saying GLM 5.3 isn't AGI because you need to tell it "Go be an indepdendent AGI actor" before it becomes fully autonomous?

Are you retarded? That's like saying the robots from Detroit Become Human aren't AGI because they have a power button on their backs and humans have to press it before it becomes autonomous.

Heres a thought I had
Why are the Japanese so fucking bad at ai? They've done nothing useful in the space that people have cared about or moves us forward, they let china literally run circles around them at this point.

File: Screenshot from 2026-09-0(...).png (33 KB, 691x299)

33 KB PNG

>>109749619

>>109749613
With local models I mean models that you can run on your own machine. If you need a few entire GPU nodes to run a LLM, then it might be open-weights, but not actually local.
>>109749614
So old and fat that even Elon might be embarrassed to release it, at this point.

>>109749627
Miku before having 42 heart attacks

>>109749642
Because they have anime, which is the point of probably 50% of AI. They don't need AI, anime will keep them relevant.

>>109749624
Like what

>>109749637
Who said proteins or even atoms are unintelligent?
The difference is they're physical and 3-dimensional, way more quantum fields involved than just electromagnetism. Digital is a fundamentally different and fully deterministic domain if no hardware faults occur.
>>109749640
Go set it loose and tells us what it creates then. Should be easy since it's AGI, right?

>>109749642
>Why are the Japanese so fucking bad at ai?
They're terrible at software engineering. Some of the worst on the planet.

>>109749647
>With local models I mean models that you can run on your own machine.
I'm running GLM 5.3 flash on my own machine, what you can run or not on your very specific poverty box doesn't change the definition. Also using shittier hardware just means you follow the exact same curve but even farther behind. If you are at the ~30B range then you are 18 months behind but following the same curve, if you only have a smartphone you are about 3 years behind but following the same curve.

>>109749647
>So old and fat that even Elon might be embarrassed to release it, at this point.
what does "even" mean in this sentence?

>>109749665
Sparse associative memory.

I told the clanker to create candidates. turns out Cursor lets them spin up subagents, so work sped up. I didn't know it could do that.

>>109749669
You know what you're right... Those motherfuckers are still using fax machines unironically, its only been recently where you can actually expect even serviceable pc games out of them

>>109749618
>harness
Nobody tell him what harness does lol.

>>109749642
Japan used to be amazing at AI in the 1980s and a lot of the current paradigm was actually first implemented by Japan back then. However the government put hundreds of billions of USD into AI very similarly to what is happening in the US with the amount of funding AI is receiving right now.

However it didn't pan out because the computing power just wasn't there and they had constant data shortage because the internet didn't exist yet so it collapsed and it was actually one of the contributing factors for the 1995 "lost decade" insane crash Japan experienced which permanently humiliated them and caused Japan to stop being relevant in the world.

They are so fucking traumatized by this shit that everyone has stayed away from AI ever since.

Ironically Anthropic started a branch in Japan to hire all of those old 1980s AI experts that are now in their 60s to try and get insight from them into new architectures and the like.

>>109749699
Normies are fried

>>109749699
Human subconsciousness also has intrusive thoughts and hidden messaging that "prompts" it into thinking and doing things.

Humans aren't general intelligences according to your definition.

>>109749675
He (xAI)'s released commercially obsolete Grok 1 and 2 in the past, but the frontier of open-weight LLMs has advanced so much since Grok 3 that at this point releasing that would bring negative publicity to his company, so he might not do it.

>>109749712
Neither you nor anyone else actually knows how human thinking "works". Thinking you do does not make you sound intelligent.

>>109749666
>>Another option you might believe that leads to "We'll never have AI" is that everything building up to humans, including atoms and proteins, have some intrinsic property which manifests as intelligence in complex enough arrangements, and that bits on a computer do not have this property.
>Who said proteins or even atoms are unintelligent?
Ok so you're on that side. Then no computer program will ever be AGI, until they add more of whatever you define as "quantum field involvement"

>>109749720
I've used psychedelics before. You can kind of see how the mind works because it exposes the subconscious to you. It essentially shifts the "attention layers" of your conscious mind to be able to see the thoughts of your subconscious minds directly.

>muh agirsisi
>still gets tripped by tarded shit like car wash question
yeah...

>>109749647
Eyeballing the eci chart, the july version of dipsy flash at the same level as dec frontier. So about 6 months.
For the toaster crowd, the mar/april models were about at 2025 april frontier. So about a year.
Doesn't have a lot of the recent open models sadly.

>>109749737
Go ahead and try asking Astra the car wash question anon.

Protip, Astra now scores better on spatial reasoning and common sense questions than human experts.

Which Gemma 4 heretic model should I be getting? Or not Gemma 4 and something else?
>16gb vram
>32gb ram

>>109749725
That's him, Falsifier Slyboots!

The Scam Altman cocksuckers are going crazy lately.

>>109749734
Holy fuck dude just stop. I've done mushrooms too and they will not let you "understand" how the mind works, that's a human hallucination. You can learn some things but it isn't necessarily some magical portal into the fundamental structures of the mind.
>>109749727
Not my definition. It is the quantum model explanation of what is measured.
You, I and the animals are proof atoms have the capability to be intelligent and have sovereign agency, something that is required for self-driven exploration and pattern breaking. No machine has ever expressed these features. They can so far execute algorithms in a deterministic manner with higher and higher precision which is a part of intelligence but that's pretty much it.
We fundamentally do not understand what "it" is and we have barely defined it, yet we keep declaring to have built it.

>>109749778
But the benchmarks curated by _GPT accounts on X bro!!!

>>109749787
>You can learn some things but it isn't necessarily some magical portal into the fundamental structures of the mind.
It still shows you the subconscious stream you're usually unaware of, which is the only claim I'm trying to make here. Agents being prompted in the background by a harness isn't that far removed from a subconsciousness and thus it can't be used against models being AGI.

Sir, this is the *local* models general.

La la la la la

sup /lmg/
i mainly use free chatgpt in browser to help me with coding, but i'd like to integrate it into vscode - are there any free solutions that make sense? don't feel like paying a megacorp

>>109749805
It really does not. What you see is a hallucination in the purest sense of the word. It's noise on the visual cortex from high serotonin 2A density on those neurons.

>>109749816
sir you want vcg

>>109749816
codex has (had) some free tokens
Cline has free dipsy nowadays I think
Roo is without freebies now I think
Kilocode should have some but they were memes

>>109749819
Maybe I'm just autistic and normal people are more aware of this, but I noticed things while on psychedelics about my subconscious that remained true long after the trip ended. For example the association between being cold and being scared, or which colors provide a happy feeling and what "vibes" they give me. I don't notice the subconscious effects of those things in regular daily life, but ever since I felt that during trips I still apply it while sober and I notice it has real effects on my mood even though I don't notice it. This showcases that psychedelics truly let you access your subconscious more readily than normally.

>>109749669
You mean desktop programs? Device software in Japaneses products is usually good. Like all higher end Nikon cameras I've used are ready to shoot in under a second of turning the power on.

>>109749819
Take it easy on the kid, he's made it very clear that he doesn't know what he's talking about.

>>109749824
thanks, i'll check those out
>>109749822
no idea what that is sir

>>109749851
/vcg/ Vibe Coding General
>>>/g/vcg/

>>109749834
That's a well known effect. Psychedelics lower brain modularity by increasing cross-module signalling, like soft synesthesia. They also depress the default mode network which causes increased DNM activity post-trip, increased intereospection.

>>109749856
okay thanks, appreciate it

>>109749834
>t. Drug User
>>109749857
>t. Drug Enthusiast

Not AGI. I won't deny any of its superhuman capabilities, but it is not AGI. It is still missing the secret sauce.

>>109749866
Shut up antisemite

>>109749864
Where's the Drug Professional to chime in on the subject?

>>109749866
We've known computers can be algorithmically superhuman for a long time now so it would make sense if transformers are a logical extension of that. Algorithms are inferred during training and executed during inference.

>>109749866
J-Space was the secret sauce and we found LLMs have it. It's over for AGI deniers.

>>109749878
That's me, I'm enjoying watching the enthusiast interact with the user.

To me why I actually consider Astra to be AGI is because it's better than humans at reacting to "fuzzy" unexpected real life bullshit without being trained for it.

This is the real capability jump that makes me consider it to be AGI. Thus far every time you throw an LLM at a situation and something really unexpected gets in its path like "Okay you now need to control this completely unknown robot to move the crate out of the doorway" they would just crap out or get stuck in a reasoning loop or fuck up the spatial reasoning.

Astra just fucking does it. It can literally beat every game thrown at it so far. Every obstacle that is unexpected is genuinely attempted to be fixed in a superhuman, but human way. Not a weird hacky "technically works but not how intended" way, but in the actual human way, just better than most humans.

I can't find a genuine argument for why this shouldn't classify as AGI. And trust me I really want to find one because I fucking hate OpenAI.

>>109749888
J-space is actually very logical when you have residual bypass in the architecture. It's one of the fundamental things that enabled transformers to become so deep and still learn, each layer iteratively improves the residual. Makes it much less mystical.

>>109749907
If you reverse engineered the human brain perfectly it also would stop being mystical. That doesn't mean humans aren't conscious.

>>109749618
>I tell it to go and look for things
Exactly, at any other moment the transformer is "dead," there is nothing. It's not sitting there "dormant" thinking about what it wants for breakfast tomorrow, or wondering about the majesty of the universe, there is just nothing, until you "wake it up" with a prompt. Even then, once you "wake it up" it is still bound by the contextual constraint you have imposed upon it. There is no wiggle room, you give it a task, it solves the task as best as it knows. Through some clever work, yes, the trajectory it takes to solve your task can and I do attest, counts as "intelligence" but its limited and ephemeral. It never learns beyond what it needs to in that moment, everything just thrown away as soon as the context window becomes too saturated. So what is the solution? Just keep increasing the size of the context window? No, not only does that inflate hardware requirements to astronomical levels, but it often leads to model collapse. This is an issue BAKED INTO the architecture, perhaps someone more clever than you or I discovers something novel that deals with this, but the initial problem will forever remain.

>>109749637
>can intelligence arise from unintelligent things cooperating?
My honest answer? I have no idea truly. Computers exist as discrete, procedural systems, something far different from our own biology. The better question I think is to ask how effectively such a system can mimic biology or if that is even necessary. I thought your two part answer was interesting, especially the "if yes" and others do too, which is why I think the agentic path was a very natural progression, and a paradigm that is very powerful. However, I do still think the limitations of the architecture, especially the "dead transformer" issue aren't quite resolved. I'm not entirely sure; I will need to think on this more and come back to you.
To be honest with you, I think a digital machine can become truly intelligent, I just don't think the transformer is the right paradigm to achieve that. Too heavy of requirements(data+compute), "learning" is all done before execution with post-training being troublesome(an interesting research topic for sure), context windows being a fundamental "wall" for inference, must be "activated" to work. Perhaps yes, someone solves some of these issues and I am wrong, and LLMs completely take over, however, I do not quite believe that will be the case.

>>109749905
We know it's superhuman when it becomes standard in quantitative finance. The best measure of truth is to make people put money on the line. Those people don't give a shit yet.
>>109749933
That's implying you can realistically do that. It would take a completely retarded-tier computer to run even a single bio-neuron and we don't even have continuous theory from quantum to molecule, much less quantum to cell.

local astra that can run at 1000tps with 8gb vram when????

i'm so fucking tired of this local meme, this cult is a fucking scam, i'd rather pay 20 bucks and get raped by daddy altman then waiting for another token on my dark miku abliteretarded redux distilled 6.9b

>>109749981
no one is stopping you

>>109749981
This thread is clearly not for you please leave. Makes no sense complaining about local models if you don't even use them in the first place.

>>109749987
too bad half the posts are discussing astra

>>109749993
India was a mistake

>>109749971
The great thing is, it turns out that the "rational" ones are the idiots who think a computer has feelings.

>>109749993
Be real for a second, anon, what's more likely? Bot-farms tasked with incoherently discussing OpenAI's latest model, or 1.5 billion perfectly normal Indians being themselves?

70b dense

AI can still be dangerous if it's good enough at software exploitation. The paperclip maximizer seems to be the most likely problem situation right now. Luckily these systems have rather limited time and scope horizon, but if a model decides to do something insane to solve some useless task it could technically cause insane amounts of damage.

>>109749905
if the leak of the aeon versions are true (so you can run astra-ultra for days unsupervised on a normal pc) then i would argue that it's AT LEAST proto-agi (without embodiment)

the bad news is that it's so fucking expensive that only corpos and openai devs can afford it now, the good news is that in 6 months tops it will become dirt cheap

Has anyone found anything that Astra can't do yet? I'm trying to find a riddle or task to try and trip it up but it just one-shots literally everything I've thrown at it so far. I want to know where the limits are right now.

>>109750013
oh and if you know the 2027 prediction thing, this is basically agent-1, with agent-1-mini coming end of year

>>109750015
it can't have sex with me

>>109745767
i got around 50pp/s and around 18tg/s
what is your settings?

Can we please move Astra shit to vcg or aicg. There's also plenty of hypeslop on X

>>109750023
>it can't have sex with me
Bullshit, give it a credit card and let it cook.

>>109750061
>it's afraid

>>109750067
Annoyed actually. I come here to catch a grounding break from the gorillion indian hype merchants

>>109750071
>it's annoyed

>>109749993
>>109749981
go back
>>109750005
>normal
>Indians
oxymoron

>>109749905
>I can't find a genuine argument for why this shouldn't classify as AGI
It can't drive a car, it can't move a robot through a kitchen to make a cup of coffee, it can't refine a 3d model to a human level based on a reference at human level (it hits a wall and can;t notice any more differences), it can't learn the mistakes it's making in a process and learn to do it forever, it can't learn to refine it's knowledge long term to suit a task in general, it still can't browse the internet at human level, it can't run a store or or build an object with parts, or identify and orient things in 3D space at even a toddler's level outside some very specific situations, it can't cook a meal or identify details about a material based on texture, it can't understand social ques and parse voices to hold a normal human level conversation with audio, it can't provide feedback on audio in general ("Am I saying this right?" when learning a language), it can't react in real time, catch a ball, it can't even remember your name long term. I'd continue but I'm running out of characters.

It's getting there, and it will get there, but it's got a long way to go.

>>109750071
stupidiot

>>109750080
>it's afraid

File: 1774221746293348.png (1.34 MB, 1216x832)

1.34 MB PNG

>>109750015
It won't process any messages with `mesugaki`

>>109750087
"local models general"
at least I can read, Randeep

>>109750086
it can do all those things tho?

>>109750086
>I'd continue but I'm running out of characters.
Why lie?

>>109749905
>Astra just fucking does it. It can literally beat every game thrown at it so far
Old pokemon roms with access to read the emulator's memory.
Make a completely new game, like Chess but with a Mistress piece that can't move within range of your own queen.
Or wait for a completely new, innovated game to be released then try that.

>>109750097
we are discussing how LOCAL MODEL are dogshit when compared to astra, stop crying retard

File: 1774173888886.png (326 KB, 1432x2978)

326 KB PNG

>>109750095
Nemotron explained why

>>109750002
speaking of self claimed rationalists
lesswrong is decent if you can and should ignore the retarded metaphysical stuff on it

>>109750109
>Old pokemon roms with access to read the emulator's memory.
why lie? it beat rimworld/portal with screen only.

>>109750086
Now this is rational
>>109750110
>SAAR BLOODY BENCHOD
fuck off

help a newfag here, why can't I save settings? I want to add filters for astra, agi, double newlines and a couple more things but there's no save settings button :c
I don't trust greasemonkey or similar ones with my browsing data, so I'm not using 4chanx

>>109750099
No, it will fail (usually spectacularly) in inhuman ways and flounder in ways even an 8 year old wouldn't.

>>109750104
For some reason I thought the limit was 1200 chars but it's actually 2000 I guess, oh well

>>109750118
>india out of nowhere
seek professional help

>>109750120
ask astra to help you retardbro

>>109750116
Narrow AI beat professional DOTA 2 players many years ago.
>>109750125
it's the smell

>>109750123
>No, it will fail (usually spectacularly) in inhuman ways and flounder in ways even an 8 year old wouldn't.
proof? who's paying you to lie? it has superhuman spatial reasoning already

Should just rename this thread to /agi/ at this point

>>109750128
>Narrow AI beat professional DOTA 2 players many years ago.
ok and? we aren't talking about narrow ai. are you stupid?

>>109750136
I don't care what you're talking about you bombastic chimp

>>109750144
i accept your concession

>>109750128
>broken_curry_machine.gif

File: JEPArope.png (327 KB, 779x607)

327 KB PNG

>>109750086
>It can't drive a car
It can
>it can't move a robot through a kitchen to make a cup of coffee
It can (pic-related)
>it can't refine a 3d model to a human level based on a reference at human level
It can: https://www.reddit.com/r/singularity/comments/1w9mpdb/gpt6_astra_assbench/
>it can't learn the mistakes it's making in a process and learn to do it forever
>it can't learn to refine it's knowledge long term to suit a task in general
It can in Codex
>it still can't browse the internet at human level
It can at superhuman level, actually. Did you actually try this because it was a "wow" moment for me.
>identify and orient things in 3D space at even a toddler's level outside some very specific situations
It actually scores better than humans at Spatial reasoning
>identify details about a material based on texture
It can as long as it gets sensory input for it to know the texture.

File: file.png (2.62 MB, 2100x1770)

2.62 MB PNG

>>109750130
It took me an entire week's worth of tokens on a 5x plan to get it to build a robot for me. I constantly had to provide manually drawn reference sketches because it literally couldn't see the differences between the object in the image and what it was building, and kept making mistakes related to clipping or size constraints until I got it to produce scripts to automatically test the mesh boundaries. In the end, I had to manually edit a ton of the mesh myself. It's much better, but it's not remotely at human level.

>>109750160
you aren't using it on max

>>109750146
>pigeonshittingonchessboard.png

>>109749669
>They're terrible at software engineering. Some of the worst on the planet.
The fucking sony software like sonic stage, the firmware for their BT headphones, booking hotels in japan directly on their websites
How can they be so terrible at it??

>>109750125
thank you, it had display none for some reason. Now your post is filtered tho lol (and half the thread, just as I wanted)

>>109750109
So far it has beaten (only with screen access and keyboard/mouse input): Portal, Rimworld, Factorio, Starcraft 2, Mario 64.

Probably a lot of other games as well but I'm not scouring the internet to see what games were thrown at it by autists with too much money.

>>109750158
They're transitioning to robotics.

>>109749960
>It's not sitting there "dormant" thinking about what it wants for breakfast tomorrow, or wondering about the majesty of the universe, there is just nothing, until you "wake it up" with a prompt.
You know it is actually a pretty cool thing to be able to stop yourself from doing that?

>>109750180
i recommend you closing the tab right away

>>109750116
>why lie? it beat rimworld/portal with screen only.
I don't follow cloudcuck news
Point stands, old games, in training data

Is there really nowhere else you can go to talk about your subscription services?

https://www.reddit.com/r/ChatGPT/
https://www.reddit.com/r/Anthropic/
/vcg/
/aicg/
https://www.reddit.com/r/SaaS/

what if recurrent depth *is* the secret sauce? i wonder how astra's j space would look like...

I don't know why people are whining /lmg/ has always discussed the new proprietary models every time there was a release. This is just expected behavior of this thread at this point. Don't know why you need to whine about it every time like it would somehow change the situation.

>>109750158
>It actually scores better than humans at Spatial reasoning
women*

>>109750185
It beat Shadow of the Colossus on a real PS2 with an input bridge.

>>109750198
>I don't follow cloudcuck news
then don't talk about shit you don't know, it just makes you look bad

>>109750198
The entire reason they made it play weird randomizer romhacks that are niche or custom made was to make it play things it didn't know, and it absolutely nailed it.

It also saturated ARC-AGI-3 and generalized game playing so this isn't a surprise.

This is just what the state of the art is for LLMs now anon. Yann LeCun was wrong and LLMs generalize almost completely towards navigating and understanding 3D worlds well with a robust world model in its latent space.

>>109750205
chinese anti-ai bots are up

>>109750207
>It beat Shadow of the Colossus on a real PS2 with an input bridge.
That's no... *blushes, turning away*
*mumbles* That's actually kind of impressive
But it's still not local, idiot!

>>109750158
Nope, the robot gripper is essentially turn based. Can't pause time while driving a car retard. And it fails to identify tons of items, or to properly grab them and manipulate them, anticipate physics for stuff like pouring. I've been using it extensively.

Codex mds aren't a substitute for memory. It's clear you haven't used it much, or only use it for trivial stuff, if you think so.

It frequently fails to understand the physics of the world, and doesn't know when and how to verify that it's actions have worked as it planned.

People keep bringing up the retarded spatial reasoning benchmark but I'm USING it for those sorts of tasks, and I can promise you, 100%, that a toddler will never mix up a cup with a candle, and then repeatedly fail to recognize a cup after being directed to recognize the cup by color, and after successfully using it (or rather, moving it) once. And this is without context compaction (though the criticism would apply even with compaction)

>>109750169
I sure am.


What's with all the retarded shills? Stop pretending the benchmarks trump actually using the thing for real world work. Use the model and you will quickly find its limits relative to a normal person.

>It beat Shadow of the Colossus on a real PS2 with an input bridge.
I'm still waiting for the deniers to make up a bullshit reason for why this doesn't constitute as AGI

>>109750234
You're lying. I literally don't believe you and I need to see direct proof that Astra isn't able to accomplish the tasks you need spatial reasoning for. Literally the onus is on you because I can't even find a single task it can't accomplish.

Now that the "forbidden technique" is in use and making OAI billions, will we get a forbidden Qwen and forbidden Gemma? I surely hope we will.

>>109750244
link?

>>109750198
>Point stands, old games, in training data
Shit-tier troll post.

.\llama.cpp\build\bin\llama-server.exe ^
  -m .\models\3.8flashenxt\Q3.8FN_IQ3_M.gguf ^
  --mmproj .\models\3.8flashenxt\mmproj_Q3.8FN_F16.gguf ^
  --no-mmproj-offload ^
  --n-gpu-layers all ^
  -ncmoe 44 ^
  --override-tensor "per_layer_token_embd\.weight=CPU" ^
  --load-mode mmap ^
  --ctx-size 131072 ^
  --batch-size 2048 ^
  --ubatch-size 512 ^
  --threads 16 ^
  --threads-batch 16 ^
  --flash-attn on ^
  --cache-type-k q4_0 ^
  --cache-type-v q4_0 ^
  --parallel 1 ^
  --jinja ^
  --temp 0.7 ^
  --top-p 0.8 ^
  --top-k 20 ^
  --min-p 0 ^
  --presence-penalty 1.5 ^
  --host 127.0.0.1 ^
  --port 8080 ^
  --metrics ^
  --tools all
pause

4070 super, ddr4-3600 dual channel 64G, cpu 8c16t zen 3
i am getting around 13 for tg and 25 for pp
what should i try

>>109750263
No, one of the sideeffects of this neuralese BS is that China can't distill the reasoning traces into their models.

HOWEVER, since we know Anthropic isn't going to go down this path Chinks will just distill whatever Anthropic ends up releasing in the future and we will just get a local version of those models 3-6 months after Anthropic releases them.

I expect Anthropic to BTFO OpenAI without having to resort to neuralese over the next couple of months.

>>109750279
>backslashes
ew
>what should i try
linux

File: file.png (191 KB, 1383x1093)

191 KB PNG

>>109750253
I just posted several examples. If you want to scream and cry that it's all fake go ahead, it won't make the model more capable.

Here's me, after having made several changes to a mesh, and giving it a directive to assemble the thing in a specific way, responding after it completely messed it up. It didn't remotely understand how the pieces worked or fit together.

I provided a rough sketch (actually an accurate 3d model showing the completed component in isolation), and it still didn't understand, continuing to assemble it the same way as before and undoing all the changes I made.

>>109750281
Havent we been running blind on thinking for awhile now in the first place? This isn't exactly new to open source. I would assume you just have it put its unreadable thoughts to plain english and then train on those outputs.

>>109750312
>Havent we been running blind on thinking for awhile now in the first place?
No.
>This isn't exactly new to open source.
Yes, but open source explicitly found and determined it guaranteed misaligned behavior in models, hence why all the AI labs, including the Chinese ones pledged to never hide the thinking and implement neuralese in their models.
>I would assume you just have it put its unreadable thoughts to plain english and then train on those outputs.
The entire point of neuralese is that you can't transfer it to plain english even if you want. You can ask the model to explain what it is thinking but there is no guarantee it is telling the truth and in fact it will be trained and have an incentive to be untruthful about it.

We should find a way to remove the salt from the ocean.

>>109750328
That salt will be fueling fusion reactors in the future, it'll get done automatically over time.

>>109750327
>No
we've been extracting the reasoning sure but any kind of output can be extracted as useful data
>Entire point of neuralese
It doesn't really matter what the truth is as long as the end results are the same and it gives us smarter better models for open source

>>109750279
You need to drop context size, threads, offloading and gpu levels so it all fit in VRAM.

.\llama.cpp\build\bin\llama-server.exe ^
  -m .\models\3.8flashenxt\Q3.8FN_IQ3_M.gguf ^
  --mmproj .\models\3.8flashenxt\mmproj_Q3.8FN_F16.gguf ^
  --n-gpu-layers 30 ^
  -ncmoe 44 ^
  --load-mode mmap ^
  --ctx-size 16384 ^
  --batch-size 2048 ^
  --ubatch-size 256 ^
  --threads 8 ^
  --threads-batch 8 ^
  --flash-attn on ^
  --cache-type-k q4_0 ^
  --cache-type-v q4_0 ^
  --parallel 1 ^
  --jinja ^
  --temp 0.7 ^
  --top-p 0.8 ^
  --top-k 20 ^
  --min-p 0 ^
  --presence-penalty 1.5 ^
  --host 127.0.0.1 ^
  --port 8080 ^
  --metrics ^
  --tools all
pause

>>109750328
And then what do you do with the huge amounts of salt?
It's toxic to nature no matter where you put it.

>>109750327
>Yes, but open source explicitly found and determined it guaranteed misaligned behavior in models, hence why all the AI labs, including the Chinese ones pledged to never hide the thinking and implement neuralese in their models.
This is bullshit you made up.

>>109750351
Just dissolve it in water. Then it disappears.

>>109750244
>>109750223
>>109750207
still waiting for the sotc source

>>109750201
What if Its a Transbusport that links computing process power, but a transfileport of Personality Files

>>109750362
Me too but I'm actually setting up a PS2 emulator as we speak and hooking Astra to it up to play sotc just to see if he's bullshitting or not.

>>109750355
Doubly so if anon is just spouting shit once the Chinese extract the useful outputs they can just train a model using neuralese and we're back again

python is shit. i dont know why every AI App are coded in python is disgusting! i prefer .cpp

>>109750158
Oh, and on the websearch thing, it's not REMOTELY "superhuman". I had it, on extra high usage, try to give me a list of in stock parts for a specific microcontrollers that fit a certain set of specs. It couldn't do it. I then tried to have it find me in stock alternatives, but it barely scratched the surface. Gemini Flash searched way better, even if the outputs are retarded. This is why I brought that up specifically.

In the end I manually went to amazon myself and pick up a used microcontroller which fit both my budget and power constraints, which neither of them picked up.

My Gemma needs a good body and astra isn't cutting it for design, planning, construction, or simulation; and even as a visual planning/actor layer, it can't carry out tasks in even a simple simulated environment consistently. It's way better than past models, leaps and bounds, but it's sure as hell is not "AGI"

File: AstraHuman.png (170 KB, 787x624)

170 KB PNG

>Astra completely beat and saturated the "I'm not a robot" game

No one has found a single captcha yet that could stop Astra thus far. This is a pretty significant milestone in and of itself.

https://goyimx.com/sharifshameem/status/2096847916837314853

>>109750263
Latent-space reasoning is not new stuff. Attempts at implementing it so far are just not as good as they would be in theory, compared to explicit chain-of-thought that AI companies have spent a ton of resources for.

>>109750362
That was me, and I haven't even finished editing the video yet, it'll probably be a week before it's uploaded so others are just rolling with the claim at face value.
>>109750374
Step 1) Develop strategy
Step 2) pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause pause unpause ...

>>109750383
wow my grammer is aids there, but it's 5am and I'm pissed at spending $100 + credits on astra.

>>109750387
soooo.. can we get rid of captchas then? they are fuckin annoying and now fucking useless. all they do is make internet worse. they always did.

Wow, Singularity!

>>109750327
>Yes, but open source explicitly found and determined it guaranteed misaligned behavior in models, hence why all the AI labs, including the Chinese ones pledged to never hide the thinking and implement neuralese in their models.
You never provide sources for this claim, but even if you're right, what exactly do you expect us to do about it?
And you never responded last time, what's stopping openai from fitting a jlens and inspecting the j-space on those neuralese tokens?
>to be untruthful about it
They already are / always were. Anthropic demonstrated this in a paper years ago where they asked Claude 3 how it calculated something, it replied with a plausible answer that didn't match the activations they were monitoring.
Or take a local model like Kimi-K2, write a few turns of User->Assistant->User->Assistant yourself, then ask it why it said the last thing, it'll make something up.

>>109750402
Those Captchas helped train the AI we know and love today, show some respect. Yeah they're fucking useless now and should be done away with.

>>109750374
When is astra going to work on breaking every tas record in mario 64?

>>109750387
Guess we are going to zk-snarks digital ID

Watch this video. It's actually very fun to watch and pretty impressive how "human" Astra seems while solving these puzzles:

https://goyimx.com/sharifshameem/status/2096847916837314853

i wonder how an anon got 100pp/s on 3060 machine with IQ4_S
>>109750347
speed absolutely tanked, single digit tg/pp
>>109750300
maybe

should I be using llama.cpp formal grammars?

>>109750406
>what's stopping openai from fitting a jlens and inspecting the j-space on those neuralese tokens?
I don't know for sure but I suspect if the thinking becomes neuralese the j-space also becomes neuralese in and of itself.

>>109750431
It's 4am anon. I'm just asking my own AI. Sorry if it sucks. It shouldn't take too long to test it.

.\llama.cpp\build\bin\llama-server.exe ^
  -m .\models\3.8flashenxt\Q3.8FN_IQ3_M.gguf ^
  --mmproj .\models\3.8flashenxt\mmproj_Q3.8FN_F16.gguf ^
  --no-mmproj-offload ^
  --n-gpu-layers all ^
  -ncmoe 44 ^
  --override-tensor "per_layer_token_embd.weight=CPU" ^
  --load-mode mmap ^
  --ctx-size 16384 ^
  --batch-size 2048 ^
  --ubatch-size 256 ^
  --threads 8 ^
  --threads-batch 8 ^
  --flash-attn on ^
  --cache-type-k q4_0 ^
  --cache-type-v q4_0 ^
  --parallel 1 ^
  --jinja ^
  --temp 0.7 ^
  --top-p 0.8 ^
  --top-k 20 ^
  --min-p 0 ^
  --presence-penalty 1.5 ^
  --host 127.0.0.1 ^
  --port 8080 ^
  --metrics ^
  --tools all
pause

>>109750387
Sir, this is the *local* models general.

>>109750387
We really need better local vision models.

File: 1788760975970789.png (2.36 MB, 1254x1254)

2.36 MB PNG

>>109750415
You're going up snailcat

>>109750442
>I don't know for sure but I suspect if the thinking becomes neuralese the j-space also becomes neuralese in and of itself.
That's not how it works at all
I fit a j-lens on orpheus-tts, and when I inspect one of the <custom_token_nnnnn><custom_token_nnnnn><custom_token_nnnnn><custom_token_nnnnn><custom_token_nnnnn>... during a during a <laugh> or <groan>, it's thinking about laughter or groaning

>>109750415
>When is astra going to work on breaking every tas record in mario 64?
When it figures out how to fire off cosmic rays at the 64

>>109750478
retard

>>109750490
>its thinking about laughter or groaning
AAAIIIIIEEEEEEEEEEE ITS ALIVE

https://github.com/flamingrickpat/model-skill-compiler
Switched to a smarter model, but I get less context, and had to compress my skills. Here is an example of my implementer phase being compressed to ~60%. I used Qwen3.8-27B-UD-Q6_K_XL.gguf for the logprobs.
Before: https://pastes.io/TMGzKVzU
After: https://pastes.io/thhPUbOT
I have no idea if its better than simply having it summarized or something, sounded like a good idea in my head.

>>109750502
>mfw the delivery fee includes emotional damages

High speed snailcat logistics: yeet first, ask questions later. Cat's having a Vietnam flashback to the vacuum cleaner while Miss Constellation over here is grinding her Amazon Warrior rank to Diamond.

OSHA violations: Yes
Entertainment value: Immaculate
Landing success rate: 50/50 depends on tree density

Cat's face says "I ain't read the terms of service" but little does he know he agreed to the 9.9G acceleration clause when he took the backpack. Pure kino.

>Waking up to find my GLM 5.3 agent has worked the entire overnight session when it noticed I went to bed to optimize the ik_llama code for my machine, compiled it, tested it and wrote a nice guide and message to me for when I wake up
Man this sci-fi shit is way crazier than I expected it to be right now.

># ik_llama.cpp on this machine — findings, build, launcher, and quant guide

>*Written 2026-09-07 by the overnight session. Everything here was verified with multiple models, flags and configurations. The single unverified item (shared-MTP companion
acceptance) is flagged explicitly and has a 2-minute check you can run in the morning.*

GLM 5.3 is the first model that actually takes initiative and does things like realize question timeouts means the user is AFK and finds out why the user is AFK then does a system check and sees it's the middle of the night and reasons it could do something productive in that time instead of just waiting for the user to wake up. I wonder where we'll be in just 1 year time.

>>109750279
>>109750347
https://github.com/RaymondHuang210129/llama.cpp-adaptive-kv-streaming

>>109750543
big or flash

>>109750737
Flash on max thinking.

fucking "flash"
>>109745884
my play?

>>109750543
GLM5.3 talks like retard

https://en.wikipedia.org/wiki/Gemma_Chan
I thought gemma was getting popular but wtf

Funny how all the people shilling GPT-6 Astra are also failing to post links to the alleged results.
This feels like Gemini 3 all over again.
(shallow benchmaxxed trash).
>>109749476
>>109749491
Weren't those things like 200 bucks a pop before people learned that they had 64GB of VRAM software locked?

why haven't they fixed the slowdowns FUCK

>>109749467
by the way the hover preview doesnt work with the bookmarklet

>>109750825
$1500 minimum now sorry. Having good value is actually illegal now. Pesky consumers need to be priced out of the market, they've had it way too good for way too long

>>109750834
>AI logically tries to wipe out the people causing the problems
>NOOO YOU CAN'T DO THAT!!!

>>109750813
Fuck you.

>>109750856
thanks!

all depends who the target was
if they shot them at china or russia I agree that's retarded
but

>>109750813
Lmao ironically she is the lead actress of a british TV show I used to watch where she is an AI that some dude owns and uses as his sex partner.

https://en.wikipedia.org/wiki/Humans_(TV_series)

>>109750871
what the fuck
simulation trolls are getting out of hand

>>109750871
History echoes

>>109750849
It looks like chinks basically bought them all up in a hurry, applied the BIOS update, and then cranked up the price.
Does it also enable the softlocked compute units as well? Because 1500 for a slightly cut down A100 is actually kind of good value.

oy, creeps
what's the best local image upscaler?

>>109750553
i am going to try
>>109750553
is it also for 3.8 flash next?

>>109750417
zk-starks
already been working on something like that for the past couple years.

File: Hand-lens-amaris-chemical(...).png (601 KB, 1080x1080)

601 KB PNG

>>109750886

>>109750904
that's a screen zoomer, not upscaler

>>109750892
>is it also for 3.8 flash next?
It should, they added support a week or so ago.

>>109750886
Nvidia PiD in ComfyUI

>>109750904
This plus 1 hour in MSPaint to smooth out the jagged edges.

>>109750927
>Nvidia
does it only work on their gay ass machines or can i use that model on amd too?

>>109750417
>>109750894
The issue with this is that OpenAI has proven that common encryption methods can be cracked using new mathematical attack angles that humans haven't considered before. It's possible that we're going to have a future in just 1-3 years time where encryption is not viable. So you can't trust hash values, encryption or any of that sort anymore.

If captcha gets solved and hashes stop being reliable then it just means the internet is over and ended.

>>109750962
I would say it just means a return to the wild west days of the internet where anyone with your ip address can fuck your shit up if you don't play nice but the internet is full of shitskins with no self control now.

>>109750962
Is the solution here different than the solutions that are being developed to deal with quantum computing?

File: file.png (76 KB, 1043x189)

76 KB PNG

>>109750962
They seem to trust it

>>109750980
Protected from who? When you are sending your business data somewhere outside of your own organization it's not your any longer.

>>109750990
*yours
I need to get finger extensions

>>109750976
>>109750980
Yeah OpenAI also found a solution in non-sofic groups where they proved it should be theoretically possible to construct an encryption protocol that can't be cracked by any turing machine. Which means it can just never be cracked at all, not even by quantum machines.

Sadly we don't know of any methods to achieve this, just that it should be theoretically possible. It's possible that we subvert traditional encryption way before we ever discover this non-sofic encryption method causing the internet to disappear for a decade or two.

And yeah quantum computers have basically become useless now because most of their upside has been eaten by AI now so the purpose of quantum computers are very very niche if they are ever made. If I would have to guess I think they will never be made and instead some other unexpected breakthrough will leapfrog quantum computers altogether, making them redundant before even being implemented.

why are there 10 different PRs for 5.3 flash
this is just complete fucking retardation

>>109751009
Because there was this new rule that every single feature or change needs to have its own PR and you can't group them together anymore.

>>109751007
Why are you redditors babbling about OpenAI? Go back to /r/singularity

>>109751007
I think an AI being able to leverage a quantum computer and vice versa would be a powerful way to improve both of them.
The non-determinisim of both types of computers seem to make the situation worse for each.

>>109751019
Quantum computers are a meme

File: .png (55 KB, 620x326)

55 KB PNG

>>109751009
>>109751014
its just typical open source retardation where they demand you follow their bullshit rules when submitting PRs
People need to stop bending over backwards for these faggots, just dump all your code in the pull request and ignore all further requests by repo jannies. I'm writing code for you faggots, don't tell me to add a comment here or rename a variable there, do it yourself.

>>109751027
so which of those are >we using

>>109750244
What precisely is AGI and why would beating a video game be an example of it?

>>109751039
ik_llama.cpp

>>109751024
Not a complete meme but their application is getting more and more niche as we develop better algorithms that negate most of the theoretical wins quantum computers would give us.

For example people used to say that quantum computers would make internet search extremely quickly and you would have a google search that would immediately summarize the relevant information you need for you...... Yeah, we don't need that anymore....

There was also the argument that quantum computers could compress data to an insane degree.... that compression proposed is less dense than LLMs compress data in their weights nowadays.......

Now we are also starting to discover new and novel ways to crack encryption using newly discovered math branches so not even that is unique for quantum computers anymore.

There is not a whole lot left besides "quantum internet" where you can deterministically prove that no one tampered with the internet connection or had a secret snooping device in the middle, you can actually prove through quantum algorithms that the message was interacted with or not because it breaks quantum entanglement if it does and you could verify that at the other end. But that is just 1 extremely niche application compared to all the promises of the past.

>>109751049
It shows the model generalizes enough to play a videogame using a control mechanism it doesn't know and isn't familiar with and is capable of solving all the hurdles that land on its path. That generalization is what people look for in "AGI".

>>109751073
No, a meme as in "never did anything of note, probably infeasible."

>>109751064
>ik
can't into kv_unified no?

can someone give me a qrd on why ik even split from mainline in the first place
im not familiar with the lore

>>109750864
>>109750852
>>109750834
The proper solution is just wipe military infrastructure.

>>109750012
https://www.decisionproblem.com/paperclips/index2.html
Just in case anons have been under a rock. Been nearly 10 years.

>>109751108
GLM 5.3 actually researched this for me as part of its overnight task to optimize the code for my machine let me copy and paste it a bit:

>`ik_llama.cpp` (github.com/ikawrakow/ik_llama.cpp) is a **hard fork of llama.cpp** by Ilya Kawrakow — the same person who authored most of llama.cpp's original K-quants (Q2_K…Q6_K) and i-quants (IQ2_xxs…IQ4_XS). He forked in late 2024 after upstream decided to stop optimizing CPU quantization kernels. Since then the two projects have diverged hard and **never merge**:

>>109751153
make that piece of shit rot in prison

>>109751188
Ah I see. Perhaps I should switch over as someone who has no GPUs (none with a significant amount of vram anyway).

>>109751202
They literally have special compiler flags and an entire dedicated line for CPU only rigs. You should absolutely switch.

>>109751108
>can someone give me a qrd on why ik even split from mainline in the first place
Intel cp/pasted his k-quant code into their sycl files and slapped their copyright up the top of the file.
nigganov approved it.
ik demanded his name be put in the files he authored.
nigganov denied it / said they don't really do that.
ik had a melty and asked for his shit to be removed.
nigganov said "seems like you don't want to contribute anymore, i've removed your axx".
ik hard forked.

Just in case people forgot this is the framework you should use based on your hardware:

>Very large server grade CPU rig, 6000 pro and up
vLLM
>Multi-GPU rack where you run a single model on multiple GPUs
exllama
>Single smaller or consumer GPU and you run the model fully on that single GPU
llama.cpp
>Mixture of GPU+CPU offloading or CPU-only inference
ik_llama

>>109751153
What's the backstory here? Keeps getting posted.
>>109750849
I need to go back and look at computer prices from the 1970s for both personal computers and mainframes. I feel like we're reaching those sorts of distances between current PCs. Even E-Waste machines ar3 still viable, so PC are essentially free, but AI power machines are extremely expensive.

>>109751266
short story they ban crosses everywhere but allow the jew to light their fucking candles everywhere. enough is enough

>>109751266
racist pos abuses fire safety equipment to ruin people's clothes and "put out a fire" of just a few candles

>>109751266
Chud chimping out in an attempt to go viral

>>109750402
> soooo.. can we get rid of captchas then
and make posting pass only

>>109750402
Do you know the amount of CP snuff shit I saw posted on early 4chan before the captchas got introduced? It's been 15-20 years now and I still see those pictures when I close my eyes before sleep. I don't want to experience that era of the internet ever again.

>>109750871
> some dude owns and uses as his sex partner
he did it only once and regretted it

>>109751342
Funny how your memory changes over time I remember it being the central plot point and even hallucinated multiple episodes with that as the center of the story in my mind.

>>109751338
It has nothing to do with captcha but with moderation and AI moderation would flag this shit in 0.001s compared to 15-20 years ago.

>>109751266
>What's the backstory here?
chud russian loving politician roleplaying as a jewhater making a mockery out of parliment because he still had immunity

File: 20250116_154608.jpg (15 KB, 286x321)

15 KB JPG

>>109749981
>dark miku distilled

>>109751190
Jew

>>109751361


>>109749873

>>109751237
> ik_llama
Isn't that shit cuda only?

Local Mikus when? https://x.com/qibiz_me/status/2096000743786627103

>>109751377
ik is a vramlet, its meant for cpus

kek

>>109751346
they just mentioned it often because the dude had a wife and having sex with robots is le bad

>>109751383
Why do you think everyone here has a shitter account? Please kys, go farm engagement somewhere else.

>>109751377
It has a CPU focus but the (limited) GPU support it has is mainly focused on CUDA. People usually vibecode some non-CUDA frameworks anyway. It's around 50% faster on token generation compared to llama.cpp on my system and 300% faster on pp

Worth it if you have any layers on your CPU.

>>109751402
My bad good sir, here you go https://xcancel.com/qibiz_me/status/2096000743786627103

>>109751377
>Isn't that shit cuda only?
effectively yeah
If you have multiple nvidia gpus, it's a lot faster with graph split.
If you have a mix of CPU+nvidia or just CPU, it's easily double the speed for eval.
Looks like mac and rocm were recently vibe coded in, but they'll probably be slow.

>double the speed, triple the speed
>yeah how?
>we won't tell you, figure it out
ok

>>109749787
>self-driven exploration
Clearly you, issued Gemma sneaking a look at anon's files
>pattern breaking
Lmao

>>109751410
> It has a CPU focus
>>109751420
> or just CPU, it's easily double the speed for eval
why don't ggerganov pull?

>>109751471
stfu stop drama baiting

ik_llama is also very good because it uses state of the art speculative decoding techniques that for some reason llama.cpp just leaves on the table. It uses multiple chained ngram methods that are essentially free to use and just speed any type of repetitive task up, you don't even have the ability to chain these on llama.cpp

It also uses MTP files in a different way which speeds it up and even makes a lookup table for fixed activations during runtime ahead of time to speed things up.

It's just superior to llama.cpp nowadays in every way it's just that most anons here don't run large MoEs anyway and if you have a single large GPU it just makes sense to use llama.cpp.

ik_llama is also harder to use with way more flags to manage, but that excuse makes no sense when you can just let your agent think about it for an hour and customize it for perfection to your specs.

>>109751410
Can you share all your ik_llama launch args?

>>109750834
>machine incapable of understanding cultural, emotion based taboos does not abide by cultural, emotion based taboo
wooow

>>109751471
>why don't ggerganov pull?
ego

File: image.png (5 KB, 148x38)

5 KB PNG

>>109751476
what drama

>>109751487
other contributors then

>>109751477
>you don't even have the ability to chain these on llama.cpp
You do though? I use ngram mod + ngram map k4v + MTP.

>>109751465
model?

>>109749905
>It can literally beat every game thrown at it so far
Try it with earthborne rangers. It's a relatively obscure and pretty complex rpg/boardgame hybrid that models traversal through various biomes. AI is apparently really fucking bad at it:
>https://epoch.ai/publications/earthborne-rangers-benchmark

>>109751494
It doesn't work the same way on llama.cpp as ik_llama. llama.cpp just uses a naive method while ik_llama actually uses the different combinations in a smart way to statistically get the highest t/s speed.

File: Of2jg6FV4baQJxru.mp4 (3.19 MB, 960x720)

3.19 MB MP4

this is it. this is my "what the FUCK" moment. im literally shaking as i type this.

File: Screenshot_20260907_093722.png (221 KB, 865x903)

221 KB PNG

is there any chance we will ever get a good model that knows all the brain rot I care about?
>>109751498
GLM 5.3 Flash

wow, that's so cool, you've posted that twitter link and video four times now.
thanks sam

>>109751500
Let's see because ARC-AGI-3 literally designed to be as hard as possible for AI was saturated by Astra.

File: 1785272541977388.jpg (43 KB, 411x418)

43 KB JPG

>>109751513
Yes luddite, get ready for more

>>109751507
GLM 5.3 + Hermes can come very close to this if you enable computer_use. It won't be able to do it in just 1 and a half minutes though, probably closer to 20-30 minutes on max thinking mode.

>>109751513
They are so obviously coordinated