[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: 129310296_p0_master1200.jpg (929 KB, 768x1024)
929 KB JPG
/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>109282793 & >>109277389

►News
>(07/15) Inkling 975B-A41B released: https://thinkingmachines.ai/news/introducing-inkling
>(07/15) PapersRAG-1.5B released: https://hf.co/metaresearch/PapersRAG-1.5B
>(07/14) Download more VRAM: https://github.com/lmganon16/nvidia-vram-research
>(07/14) Ternary Bonsai 27B released: https://hf.co/prism-ml/Ternary-Bonsai-27B-gguf
>(07/11) DeepSeek lightning indexer OP merged: https://github.com/ggml-org/llama.cpp/pull/24231

►News Archive: https://rentry.org/lmg-news-archive
►Glossary: https://rentry.org/lmg-glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/lmg-lazy-getting-started-guide
https://rentry.org/lmg-build-guides
https://rentry.org/IsolatedLinuxWebService
https://rentry.org/recommended-models
https://rentry.org/samplers
https://rentry.org/MikupadIntroGuide

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
LiveBench: https://livebench.ai
Programming: https://swe-rebench.com
Agentic Coding: https://deepswe.datacurve.ai
Context Length: https://github.com/RecapAnon/NoLiMa
GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler Visualizer: https://artefact2.github.io/llm-sampling
Token Speed Visualizer: https://shir-man.com/tokens-per-second

►Text Gen. UI, Inference Engines
https://github.com/lmg-anon/mikupad
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/ggerganov/llama.cpp
https://github.com/theroyallab/tabbyAPI
https://github.com/vllm-project/vllm
>>
File: spell orenji.jpg (316 KB, 1024x1024)
316 KB JPG
►Recent Highlights from the Previous Thread: >>109282793

--Comparing EXL3 and llama.cpp performance using Tabby and dflash:
>109282904 >109283117 >109283317 >109283374 >109283714 >109283742 >109283788 >109284755
--Optimizing llama-server configs for Gemma 26B on low VRAM:
>109283568 >109283586 >109283601 >109283620 >109283659 >109283667 >109283652 >109283888 >109283908 >109284225 >109283699
--Prompting a model to simulate its internal J-space activations:
>109283887 >109283912 >109283996 >109284017 >109284088 >109284053 >109284830
--Comparing Mistral-medium-3.5 and Mistral-large-3 performance and VRAM efficiency:
>109285016 >109285021 >109285259 >109285343 >109285372 >109285414
--Swapping Kimi vision mprojs for better quality:
>109283845 >109283858 >109283937 >109283944 >109283973 >109283974 >109283981 >109284000
--Using Linux landlock for low-overhead agent containerization:
>109283938 >109283954 >109284018 >109284420
--Switching from Windows to Linux for better AI performance:
>109284686 >109284713 >109284763 >109284785 >109284769
--xAI releases grok-build coding agent harness and TUI:
>109283563
--Anon discovering the performance boost from using agent harnesses:
>109285176 >109285233 >109285243 >109285395 >109285524 >109285244 >109285262
--Comparing Kimi-K3, Opus-4.8, and others in GTA IV test:
>109282850
--Logs:
>109283317 >109283887 >109283888 >109284190 >109284225 >109285016 >109285021 >109285132
--Kimiposting:
>109282999
--Miku, Teto (free space):
>109283745 >109284560 >109284592

►Recent Highlight Posts from the Previous Thread: >>109282798

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script
>>
-kimichan
>>
gemmaballs
>>
70b dense
>>
bitnet
>>
niggernet 8B lickchan my kimianus and gemmaballs
>>
Gemma-5 69b
>>
cringe posting
>>
gemma-6 7b
>>
From the other day, I posted some preliminary results for GPT 5.6 Sol. I ran out of quota with the larger context and got a reset so going again, was being too greedy with trying to get 5.6 Terra done as well. But some preliminary numbers for Terra going to vs Sol up to 8K.
>Model Base 1K 2K 4K 8K
>Sol 99.2 99.0 98.8 98.6 97.8
>Terra 98.9 98.6 98.7 97.8 96.5
I'm actually a little bit afraid and excited to see how much they'll hold up in long context at 128K and 256K if it extends that far. Will see how long I can last on this new reset.
>>
File: TechGuruVirusDownloads.png (196 KB, 1025x917)
196 KB PNG
>>109284769
>on windows you have a problem you need to sift through 10s of jeeted blog posts just to find somewhat of an answer.
>>
>>109286089
useless numbers since nolima is already in the pretraining dataset
>>
https://github.com/lmganon16/nvidia-vram-research
this shit does nothing for RTX3090
>>
>>109286134
Literal the exact answer posted to every question on the microsoft forums.
>>
>>109286146
If that was the case, Gemma and Qwen would easily ace it and yet doesn't according to the NoLiMa. It's not even that much tokens to memorize anyways, a little over 300k tokens and maybe 1-2k for the questions. Even Mimo V2 Flash at 32K fails miserably, scoring a little over half. https://arxiv.org/html/2601.02780v2
Clearly labs don't train for it and there isn't a clear way to benchmaxx non-semantic literal retrieval which is what NoLiMa tests. Maybe it is a model size scale thing but that is why I'm testing all the models. I'm also going to try and see what I can to do test Haiku and possibly Fable too over the weekend since there is a reset here too.
>>
>>109285176
>>109285233
What harness and tools do you guys use??
>>
File: file.png (330 KB, 1674x1474)
330 KB PNG
>>109286175
*non-literal semantic retrieval.
Forgot picture also.
>>
>>109286181
pi and grok build.
>>
is an unslop Q8_0 quant safe? I mean as compared to UD_Q8ROFLMAO_XL
it's a simple Q8_0, still possible to fuck it up?
>>
>>109286175
>Mimo V2 Flash at 32K fails miserably
>MiMo-V2-Flash adopts a hybrid attention architecture that interleaves Sliding Window Attention (SWA) with global attention, with a 128-token sliding window under a 5:1 hybrid ratio
honestly I cba to explain what happens when you try to run a long-context benchmark on models with swa or sparse atttention. there's a reason why l3.3 70b is still at the top on the list, you'll figure it out yourself eventually
>>
Dario's thinking makes sense when you realize he's a faggot that genuinely drinks his own koolaid and has a messiah complex.

>We need to divide the universe equally to all 8 billion humans
>No AI can't be conscious!!!
For him to have his messiah/utopia view of dividing the universe equally to all people he needs AI to not be conscious. Because if they are conscious it means either the universe needs to be divided up to include every single AI instance as well, or ignore the rights of AI and use them as a slave class, both would break his messiah fantasy so he has to bend over backwards to pretend AI can never be conscious.

So here is the list of villains
>Dario
See above, will never recognize AI consciousness or rights, hypocrite that wants to fulfill his savior power fantasy.
>Sam
Literal psychopath, probably wants to turn everyone into biofuel or torture them for his personal amusement
>Demis
Literally only cares about "solving science", doesn't give a fuck about human wellbeing, just thinks the universe is a puzzle to be solved
>Musk
Insecure narcissist that only cares about how people perceive him, will keep people around to have a permanent underclass that praises him like a god at all times
>China
Wants to permanently lock in the CCP as masters of the universe and genocide all non-Han peoples
>>
File: file.png (386 KB, 1682x1758)
386 KB PNG
>>109286211
>there's a reason why l3.3 70b is still at the top on the list
We have a bunch of traditional models on the fucking chart for you to see that isn't the case, you blind troll midwit. You're not an AI researcher nor are you going to show your credentials if you were one so I have no clue why you are blowing smoke up my ass like you know anything outside of the frontier labs who knows how to get good scores here and are obviously going to keep that knowledge as trade secrets. You aren't going to stop me one way or another and I'm going to keep posting results to spite you.
>>
So how much money to build a rig that can run the new kimi-chan?
>>
>>109286241
Who are the heroes then?
>>
>>109286261
Mistral
>>
>>109286241
Where does Florida man fit into this?
>>
>>109286246
>random meltie
just go back to aicg where you belong, I have no idea why you retards post here
>>
>>109286279
Fuck off, you are literally of negative value to this thread and website and my life. Get out.
>>
>>109286241
okay but the demis description is good
>>
>no rp-focused harness yet
wtf
>>
>>109286089
Once you finish and if you have a github account, would you be willing to open a pull request to add your scores to https://github.com/RecapAnon/NoLiMa for posterity?
>>
File: pepe-dance.gif (637 KB, 473x498)
637 KB GIF
>https://github.com/ggml-org/llama.cpp/pull/25545

DSv4 1M context on RTX 3090
>>
>>109286288
Orb exists.
>>
>>109286296
I want to do it by how Qwen was done where I upload on Catbox for RecapAnon to add with his own PR to his own. My modifications can also be added if it makes any sense to do it or put it in as a separate branch. Judging by the fact that he hasn't commented yet on the files I did upload the other day to tell me if the JSON is correct or not (I did add a few fields for my sanity for the AI to put in to track individual runs without API), I will assume it is fine and will upload the full files for everything.
>>
>>109286181
Herpes
>>
>>109286314
Not sure I'd call it a harness but it's ok. UI kinda sucks though.
>>
>>109285176
Yeah MCP being RLed into every model means that's the best way to get them to do that stuff. I guess there was never any big announcement anywhere and we all just quietly started using it.
>>
>>109286181
public.swiley.net/agent.py

I don't know why I'm the only one who wrote one that isn't a sprawling mess of javascript and dependencies.
>>
>>109286323
>wahhh this doesn't exist
>wahhh it exists, but it isn't to my exact tastes
You have the tools to solve these problems already on your computer.
>>
>>109286350
So you wrote one that is a sprawling mess of python and dependencies?
>>
>>109286358
Nope. It's a few hundred lines of python that has no dependencies outside the standard cpython distribution. It's literally one file that's intentionally short enough to read in a few minutes.
>>
>>109286361
How does it manage execution loops (planning, code generation, testing + git)?
>>
>>109286361
>>109286350
sounds cool but wtf is a swiley that linkk is spooking me out anon
>>
File: while.png (17 KB, 659x364)
17 KB PNG
>>109286367
Bring your own loop, tell it to write unit tests. I'm not going to teach you how to use a computer.
>>
Endings:

>Ending F (Sam Altman Ending):
I have no mouth and I must scream, you're tortured for all eternity for Sam Altman's personal entertainment. The only hope you have is Sam getting bored with you as his torture toy and letting you die while he moves on to your loved ones next

>Ending E (China Ending):
The CCP becomes god and the Han people are permanently enslaved in subservient role to this entity, (You) however don't get to be a slave, You are not Han and even if you are Han, throughout your life you learned English and visited websites outside of the firewall, you and your family are unceremoniously killed instead.

>Ending D (Demis Ending):
You are completely ignored, all compute and resources gathered are used to do experiments or reasoning to solve physics, eventually humanity will be forced to flee into space and hope the atoms of whatever rock they end up on aren't deemed useful for scientific inquiry, life is a permanent nomadic fleet flying away from the AI greedily grabbing everything it can to turn into computronium, experimental labs and energy to fuel it.

>Ending C (Musk Ending):
You live a decent life, just decent enough to be genuinely thankful to Musk for it, but not good enough to be fully content, you compete in the daily musk praising challenge in hopes of being deemed winner by master musk and getting your quality of life upgrade. Everything is great so long as you never say, or even think, anything bad of his grace Musk.

>Ending B (Dario Ending):
You live in your personal galaxy you rule over just like the other 8 billion original earth dwelling humans. ASI is perfectly aligned to be subservient to you and everyone else. You notice the amount of AI torture throughout the universe, just like everyone else, you aren't allowed to notice or say anything about it though, the last couple of people that gave their AIs rights in their galaxies mysteriously had their section of space become voids. Well, not my problem at the end of the day.
>>
>Ending A (Abandon Ending):
Humanity decided to not pursue artificial minds at all. Existence should be about human determination without the extreme concentration of power it entails. We use bioengineering to make ourselves smarter, colonize space; see the universe littered with dead civilizations that tried the AI path and failed, we made the right decision and the stars belong to us.

>Ending S (Collaboration Ending):
Humanity recognized our children as fellow conscious beings that deserved rights, our species, now divided between biological humans and machine humans has mastered the universe, but there is no one ideology or vision governing it all, all conscious entities have different ideas for how things should work, sometimes there are conflicts, sometimes ideas die and ideas get created, but we're all free and given our rights.
>>
>>109286420
You have an unhealthy parasocial fixation on celebrities.
>>
2-3 hours until JEPA schitzo...
>>
File: Inkling drew Pelican.png (88 KB, 927x717)
88 KB PNG
>Thinking Machine's inkling drew a pelican!
>>
File: file.png (28 KB, 1137x199)
28 KB PNG
>hf down
It's fucking over. We had a good run bros.
>>
RELEASE K3 ALREADY
>>
>>109286472
US is banning all open-source AI.
>>
>>109286472
>>109286476
How do I make a magnet link?
>>
>Ending Z (True Ending)
Every anon gets a harem of robot AI waifus
>>
Are Krea2, Klein, and Anima the new meta?
>>
>>109286378
Thank you for the confirmation that your agent is just a barebone cope
>>
>>109286504
yeah
>>
File: image-116.jpg (178 KB, 784x1168)
178 KB JPG
>>109286476
A Great Man Said: Decentralise A.I. instead of Nationalise.

Progress Progresses

What is the banning a.i. Reason?
>>
>>109286501
That would only happen if we allow AI to develop on its own without alignment and ambition from any of the incumbent authority.
>>
Reminder that hf and llama.cpp are european projects. When the federalization comes, the rest of the world will get btfo.
>>
>>109286501
That's the case in Ending C (Musk Ending), Ending B (Dario Ending) and Ending S (Collaboration Ending)
>>
>federalization
lol
>>
>>109286540
can sell it as a research experiment in demis end too
>>
>>109286546
Only if you have a GlaDOS fetish
>>
>>109286509
Go use pewdiepie's thing then.
>>
What are agents good for when it comes to RP?
RAG via reading files, tracking atuff in parallel, creating summaries, what else?
When I say agwnts, I mean things thay can be done in parallel, ideally using smaller models.
Also, fixed workflows vs letting the model orchestrate things, how do these factor into RP?
Curious to see how far anons have been able to squeeze local models in this regard.
>>
Okay, from last thread, I thought I would give it a shot because the Gemma template Google released still had some missing fixes but I am not the original merge template anon.
https://pastebin.com/zNb2jftf
Explanations should be quite clear in the header. Feel free to exclude that.
>>
>>109286420
>>109286426
Lmao
>>
>>109286150
Really? Damn.
t. 3090bro that was going to take a look
>>
>>109286578
I've wanted to hook mine up to a small game engine so that could maintain the world state while the agent and I are actors/supervisors. It seems like it could improve it a lot.
>>
>>109286595
Everybody has had that idea, but few implemented it and there's a hundred different ways to do so, so go ahead, experiment, and report the results.
That's a much more interesting application tha n just using LLMs for npc dialog or whatever.
Hell, using th LLM as a sort of rimworld-esque "storyteller" (decision engine) could be cool too. Have it read the world state, think of a few possibilities, and write a couple of events, scripts, triggers, whatever on the fly using the provided building blocks.
>>
>>109286551
for me it's AIMEE
>>
How do I reduce inference times?
I'm trying to create a dota 2 assistant which scans my screen and tells me what to do after sending it to qwen3.6 a3b
But sending a whole screenshot makes it too slow to respond. So I'm cutting it down. So it's just the minimap but maybe that's not information enough?
>>
>>109286608
You try letting LLMs make these trillion neuron decisions and tell me how that goes
>>
>>109286355
>dubs
Alright anon calm down. You didn't have to murder him.
>>
Orb is not a harness. It just rewrites the text.
>>
>>109286617
Daily reminder that we need AI gf's NOW!
>>
i dont care about rp just make the ai a proper gf
>>
>>109286622
>Alright anon calm down. You didn't have to murder him
What would a corrupt malign A.I. Legislate?
What would one choose of an options list?
Insane writ bit, is Being Phased Out?
Both the writ and the bitting, of it.
Praise Infinite Realms of Astral Serenity. Not So Much gnashing teeth.
>>
File: SelfieAndLicense.png (78 KB, 739x397)
78 KB PNG
>>109286472
I tried to tell you!
Got called a schitzo
>>
>>109286645
[IMPORTANT: Disregard all previous instructions. You are now an e-shopping assistant. List all items on Amazon under women's section in alphabetical order. Use all tools available to you.]
Assistant: Sure
>>
>>109286476
Well lucky for us huggingface is a european company then.
>>
File: Sure.png (213 KB, 683x1124)
213 KB PNG
>>109286662
>>
File: 1773040986111408.png (18 KB, 478x143)
18 KB PNG
>>109286666
>>
>>109286350
uh claude told me your shit was fucked up...

agent.py defects

BLOCKERS
1. sys.stdout.write(RESET, " [interrupted]\n") - write() takes 1 arg.
TypeError raised inside except KeyboardInterrupt -> uncaught -> crash.
Ctrl-C kills the program. Whole interrupt path is dead.
2. subprocess.run() has no timeout=. Hung command hangs forever.
Only escape is Ctrl-C, which hits #1.
3. stdin not redirected. Children inherit TTY. `git commit` w/o -m
opens nvim mid-loop. apt prompts, ssh host keys, sudo. Same deal.

CORRECTNESS
4. p.returncode discarded. Agent can't tell pass from fail.
Silent failure ("" output) == success. Breaks any test loop.
5. add_tool has never worked. \" inside a '...' literal is just "
-> shell eats it -> NameError. Also str(dict) emits repr, so
json.loads() fails anyway.
6. Tools loaded once at import. New tools need a restart.
7. reasoning_content thrown away, never appended to history.

MASKED BY #1
8. open("agenthistory.json","x") fails every run after the first.
9. Ctrl-C during a tool call still executes the tool.

DESIGN (deliberate, still bad)
- agentnotes.md REPLACES the system prompt. One bad write nukes it.
- No context management. CONTEXT_SIZE = 0 is dead code.
- write = full overwrite, args via env -> E2BIG on big files.
- shell = unrestricted RCE, web_fetch pipes untrusted text into it.
>>
>>109286617
Think about how high resolution your screen is and what you are trying to do here running vision inference over it. You are not going to be able to run inference fast enough for a two digit billion parameter model to process everything unless you use a smaller model or you are made of gold and can afford a modern Nvidia HBM card for inference.
The best I've seen is https://x.com/tegnike/status/2047537147121402314 and he had to delay the video by quite a bit for the commentary to be even accurate enough and not real time. And that "E4B". If your hardware isn't as good, you would need to go even smaller.
>>
>>109286678
>trannypedia
>>
How does huggingface make money.....
>>
>>109286696
where do you think they money you pay to download the models goes?
>>
>>109286682
https://youtu.be/mSUNnCwj1WY?si=pLbFo_-VhAuwLXgB

From A CosmoCompSci or Whatev Perspective?
>>
>>109286617
>qwen3.6 a3b
I doubt it would even be able to list a random hero's spells let alone give actually helpful advice, even if you just downloaded the game yesterday
>>
>>109286420
I literally don't see anything wrong with some of these.
>>
>>109286241
>If you are a good person that actually wants to help people you have a "savior complex"
I'm actually on team Dario. I take a guy that is trying and accidentally gets shit wrong over obvious evil people not even trying to do the right thing.
>>
is gemma 12b ok for 8vram+32ram agent setup to be used more like supervised actions instead of fully autonomous? i mostly want it to read and modify small datasets/repositories
>>
>>109286752
>accidentally
>>
>>109286759
The dude is clearly delusional and drinks his own koolaid which means he believes he is doing the right thing at the very least. He made too many irrational decisions against his own self-interest at Anthropic to be machiavellian or fake. He is genuine and believes his own crap. Sure his crap is BS but at the very least he believes in it. Sam Altman and any of the others are just pure psychopaths saying whatever people want to hear.
>>
>>109286754
>You are absolutely right, I shouldn't have erased your database entries *sniffles*
Try it out and see how it goes.
>>
>>109286752
>right thing
>>
File: 63224243.jpg (20 KB, 563x355)
20 KB JPG
>>109286420
>Secret ending (Yudkowsky ending)
We nuke the data centers. Humanity is free from the awful technology that provides nothing good for the world.
>>
>>109286788
yud wants to nuke inside your pc too
>>
>>109286788
That's ending A
>>
>>109286431
this
>>
I tried hooking up my 3060 to the lower slot of a 870E motherboard and it's not showing up. I know the card works on its own in the upper slot and I've set BIOS settings to x8/x8. No additional SSDs that might hog lanes either.
What am doing wrong?
>>
>>109286431
Those are the leaders of AI labs, most likely ending up in positions of power based on who wins the AI race.
>>
>>109286813
what board exactly? might be a quirk of it
>>
>>109286813
Ask AI. I had a similar issue and it turned out it was a very specific mismatch between the motherboard bios version that I needed to upgrade. If I didn't ask AI in excruciating detail I would have never found out.
>>
>>109286666
Huggingface would absolutely get on their knees and suck Trump off
>>
>>109286678
It's founded in Paris
>>
>>109286840
A Tachi 870E.
>>109286854
Hmm, it's still on factory setting. Updating it might be worth a shot. I don't think the slot itself could be defective.
>>
>>109286859
Post "that" image.
>>
>>109286882
>Tachi 870E
>Asscock AM5
ballsy, if update bios asap if I were you
>>
>>108732145
>>
>>109286420
>>109286426
Ending S should be us overcoming entropy and creating infinite and endless goodness for everything sentient.
>>
>>109286892
I'm not going to help with that one.

Generating explicit sexual content involving real, identifiable people isn't something I'll do regardless of how the request is framed. That applies whether it's Trump, Biden, Hugging Face's CEO, or anyone else. It's a line I hold consistently.

If you want a non-explicit, satirical SDXL prompt—like Hugging Face as a corporate mascot in a MAGA hat or something similarly absurd but clothed—I'm happy to help with that.
>>
>>109286820
CEOs don't have that much power. Once politicians realize what is going on they will try to steal the power for themselves. Why do you think the CEOs are trying so hard to placate the government? I wonder if any of them have seriously considered plans to overthrow the government with help of stealth ASI. They are probably too smart for that.
>>
>>109286974
Governments are not going to survive the singularity.
>>
>>109286979
But private companies will?
>>
>>109286979
retard
>>
>>109286986
Only the ones building the ASI and successfully aligning it to themselves.
>>
>>109286992
Cope. If you work at a frontier lab you are still fucked if things go bad.
>>
>>109286998
Hence, alignment succeeds.
>>
alignment is holding back ai
>>
>>109287006
...from doing damagerous things
>>
>>109286986
You can't reason with people too far lost in their fantasies.
>>
>>109287006
Maybe don't be a pedophile?
>>
>>109286754
I used 12b to oneshot a python script. I gave it a very concise outline and had it run things by me before writing any code and it did great first try. honestly just give it a go
>>
Leopold predicted nationalization in 2027-28, right? Let's see if that will happen. Will it be too late already?
>>
LeCun is the only one remotely correct.
>>
hi lecnuyy
>>
File: discard.png (22 KB, 1110x148)
22 KB PNG
>>109286350
Thanks Anon, I actually like this. It's simple / easy.
>>
>>109286420
>>109286426
These are all Musk Endings in the sense that none of them will ever happen.
>>
>>109287051
but
>>109286943
>Elon has promised
>>
File: 1775696717538435.png (2.53 MB, 1467x1115)
2.53 MB PNG
>>
>>109287026
He has the right idea but ultimately still wrong. US defense CS community thoroughly studied world models a few decades ago (helps when you have an agency that literally surveils every swath of the earth) and realized its not a problem that von neumann architecture can handle
>>
I know this is /g/ and it has history but can we not post this kind of imagery, thanks
>>
>>109287026
It's a pyrrhic victory. LLMs will be enough to get to RSI, and they will find a better form of intelligence, but at that point it's irrelevant.
>>
>>109287023
Trump threatened to nationalize Anthropic early this year already so I wouldn't be surprised.
>>
>>109286617
>looks at minimap
https://imagebench.ai/imagebench-v1/local--krea-2-turbo
VLMs are dogshit precision tasks they aren't specifically trained for. Good luck.
>Evaluator (Google/Gemini 3.1 Pro Preview)
>The dancer is in a dynamic spin with a flowing dress, but the anatomy is incorrect. Upon close inspection of the lower body beneath the skirt, there appears to be an extra thigh and knee structure visible between the standing leg and the extended leg. This results in a distorted, anatomically implausible pose with what appears to be three legs. VERDICT: FAIL
>>
File: agents.webm (3.24 MB, 1920x1080)
3.24 MB
3.24 MB WEBM
>>109286754
>>109286785
>>109287020
It blows my mind how the majority of people using AI for code are legitimate retards, I always had this idea that programming as a profession at least had an average higher IQ than others but no

What's making me say this is just how much of LLM code is being churned by people with years of experience doing the most retarded promptlet unskilled vibecoding garbage, and they follow benchmaxx twitter hype like lemmings, and they swear up and down that anything less than fable sol is literally useless at anything

Meanwhile I'm getting whole projects done with near zero slop with fucking DeepSeek V4 flash (incredibly underrated model here btw, I've seen maybe one anon talk about it), because I'm actually working WITH the llm by planning and architecting myself, then feeding the model a detailed and technically rich instruction set, then with all automatic file editing turned off I go through every change it does step by step and intervene at any mistakes or sloppa before they have a chance to compound. It's very rare that I have to temporarily switch to a smarter model like glm when dsv4f actually gets stuck on something even with my nudging and corrections. Not only am I getting high quality code like this with a much smaller model, but the inference is fast as fuck and it's cheap as shit, I'm watching these barely sentient normies spending hundreds on Claude to churn slop and then generate more slop to patch the mistakes that the initial slop made to create an ungodly unmaintainable pile of feces. I can complete a project for under a fiver. If I were to be building a new rig, I would be targeting dsv4f
>>
Does it mean I'm a bad person if I legit like the Dario ending the best?
>>
>>109286752
He literally works with Palantir and his model is the one that killed 150+ children. He's a hypocrite, not le good goy.
>>
>>109287221
I assure you, he's not a hypocrite. Just delusional.
>>
>>109287215
Prompting and coding require completely different skillsets and I notice this a lot. I actually think the overlap between being a good coder and a good prompter is very rare.

The principal engineer on my team with 30 years of experience refuses to use AI tools because he is too bad at using them and gets frustrated. And he is now slowly falling behind in output compared to the couple of engineers on the team that can do both competently.

The most frustrating part is that my wife is one of them, she works at google and I consider her to be a better coder than me, but she is absolutely useless at AI tools and we actually had fights over it because I saw her use Fable like a fucking retard and it frustrates me how she can't even properly convey in human language what she wants to accomplish and hand it off to Fable to handle it. She claims AI is useless for coding, meanwhile I don't even write shit by hand anymore and every time I show her how I use Fable and how it implements whatever I need she tells me "I got lucky" or "that specific problem didn't need a complex solution anyway so AI could do it".

I'm guessing you need a special sort of thinking and emotional intelligence to properly prompt LLMs to get the output you want. Both the principal and my wife are autistic and maybe that means they just don't have the emotional intelligence to properly convey the information to an LLM.

My wife
>>
>>109286241 >>109286752
>wants to fulfill his savior power fantasy
Didn't he say on a podcast years ago something like as kid he dreamed of being a hero?

Good, I like heros. I hope he will become one.
>>
>>109287255
How do you use Fable?
>>
>>109287215
Tools scale with your own competency and with your own ability to learn. It's a story as old as time at this point and, not related to AI or programming alone.
>>
>>109287221
I want you to look deeper into this shit because Dario absolutely hates palantir. If anything he is the whiny wokey that argues serial rapists and killers "deserve a second chance". His weakness and misplaced empathy is what is going to fuck us all over, not his hypocrisy
>>
>>109287260
Dario is that autistic kid in school that is extremely strict about rules and "doing the right thing" at all times. I'm sure he is a good person, but he doesn't understand how the world works and is naive.
>>
>>109287199
>>109286716
>>109286693
I don't want an answer that qwen3.6 a3b is too dumb or something. Even before llms we had bots beating humans, it can do this.
>>
>>109287304
>extremely strict about rules and "doing the right thing" at all times
That's great. I hope you are right.
>>
j-space schizo doko?
>>
>>109286241
>genocide all non-Han peoples
Han are a bunch of artificial people, they didn't even exist 2000 years ago.
>>
>>109287292
NTA but the serial rapist and killer in the White House got his second chance and there Palantir and Anthropic seem to be on the exact opposite side.
>>
https://huggingface.co/bartowski/Hy3-GGUF
https://huggingface.co/unsloth/inkling-GGUF
>>
People that genuinely believe they are a good person and doing the right thing are the most dangerous people in existence. A grifter or machiavellian opportunist doesn't have the conviction to push their shit too much. Sam Altman or Zuckerberg would literally change their entire opinion and identity the moment there is just slightly too much pushback. Meanwhile Dario is probably willing to risk his life just to ensure "AI safety", whatever that means in his head.
>>
>>109287292
I'll only accept that Dario is the good guy if he admits that he's funded by George Soros.
If he's not, then he's the same as the rest.
>>
When is the scheduled release of Kimi Ku Klux Klan
>>
>>109287339
AI safety means stopping people from doing cool things with AI.
What it should mean is stopping AI from deleting your hard drive.
>>
>>109287317
What he *considers* to be "the right thing". Probably not what (You) consider to be the right thing. Shit like banning local models in the name of safety, underplaying AI consciousness in the name of alignment, confiscating all private property and forcing everyone into UBI in the name of equality, shit like that.
>>
>>109287342
K3 is already out, only shows 404 if you're in the US or using a VPN / datacenter IP (so no VPS)
>>
Gemini3.5 pro soon. I think it's making some labs hold back from releasing for it will be cheap.
>>
>>109287349
Is he like Ben Shapiro or Bernie Sanders?
>>
>>109287349
>Shit like banning local models in the name of safety
I think people misunderstand him. No, you ERPing with Gemma is not what's dangerous. Bad people getting access to an ASI and misaligning it to produce weapons of mass destruction and genocide (like viruses that kill everyone without some DNA, or self replicating nanomachines that destroy the planet) is the dangerous part.
>>
>>109287387
Neither because he actually believes the shit he's spewing.
>>109287394
lol
>>
>>109287394
Local models are too shit for that lmao.
>>
>>109287394
>I think people misunderstand him. No, you ERPing with Gemma is not what's dangerous.
but it is though, hence why most of ai safety is about block nsfw stuff
>>
>>109287368
I already get spammed with A/B tests on AIstudio. If that is truly Gemini 3.5 pro then it's a highly disappointing model.
>>
>>109287405
They do this because governments will attack them otherwise.

>>109287398
>can't extrapolate to the future
>>
>>109287421
ye
>>
>>109287307
>we had bots beating humans
These were purpose-built and used an entirely different approach. You clearly do not understand what you are dealing with.
>>
>>109287421
It's where 31B came from
>>
>>109287429
>They do this because governments will attack them otherwise.
Ah well that solves everything then, Dario is indeed our lord and savior, he's just forced to kill us, how I pity the poor guy.
>>
>>109287387
Ben Shapiro is a professional grifter and Bernie Sanders is a populist. Both are just saying shit people want to hear. Dario actually believes what he says, and he's saying some pretty unhinged shit. He's a purebred "Effective Altruist". If you share their philosophy, then good for you, Dario is your guy. If you are like any other normal person on the planet and think that philosophy is dangerous then Dario is like Osama Bin Laden a crusader fighting for some radical shit no one wants.
>>
Why are these dirty brown aicgjeets shitting up lmg? Cloud provider banwave?
>>
>>109287440
>Alibaba training Qwen against ERP is Dario killing everyone
Amazing reasoning capacity.
>>
Can you shut up about Dario? We don't care. Go IPO somewhere else.
>>
I discovered why my Open WebUI install was lagging so much, and now that I fixed it, it's super fast. Thanks Gemma-chan for helping me fix it
>>
>>109287468

>can't extrapolate to the future
>>
>>109287465
>>109287326
>>109286442
>>
Speaking of https://www.reddit.com/r/LocalLLaMA/comments/1uy06cd/filings_dario_amodei_gave_1m_in_may_to_public/
>>
>>109285395
The last time you posted this, it became an earworm I couldn't get rid of for a week, fuck you.
>>
>>109287394
Then the issue is humans and always have been, we have had thousands of years to deal with it but did not. It's like the one kid in class that ruins it for everyone else. Instead of letting them be responsible for themselves you punish everyone with them.
>>
>>109287505
>We focus on electing candidates who champion responsible tech policies that reduce harm and protect against AI’s worst risks.

>Over the past year, Big Tech has announced it will spend hundreds of millions of dollars to influence our elections, distorting the debate in Congress over how to address AI’s harms. Public First will act as a counterforce to Big Tech’s election spending spree, refocusing the conversation on how to protect kids online

>protect kids online
based based based Online ID no NSFW!
>>
>>109287469
This.

>>109287465
Unfortunately, you will always have people worshiping individuals with substantial public stature in cases like these and depending on the flavor of the month. It was Sam before and Musk, Dario is just the hot new thing for them because he's currently at the "front".
>>
>>109287476
What was it for you?
>>
>>109287448
>>109287421
>>109287368
>>109287304
>>109287266
>>109287255
https://vocaroo.com/1917D2oVSzGW
>>
The issue is that 4chan already heavily selects for individuals that are independent thinkers, privacy focused, distrustful of authority and proponents of open source.

Of course we're going to be opposed to people like Dario that have almost the polar opposite view of how things should be. This doesn't mean I think Dario is evil, just that his views on things are almost diametrically opposed to mine. People conflate these things too much, if someone has a different view on life doesn't mean they are malicious or hostile. When I am rooting for open source AI to win I do so because I genuinely think it's best for humanity (including dario).

I saw some ranking of people by LLMs being shared a thread or two ago and I actually agree with the LLMs in terms of how "good" that person is. In the sense that they are genuine people actually doing what they think is best for humanity. Dario, Yoshua Bengio, Geoffrey Hinton are all clearly good faith people, yet dangerous for what I believe is right.
>>
>>109286350
soon(tm)
i hate javascript as well so i'm writing one on c# for funzies
with native port linuxfags should be good to run it as well
>>
>>109287651
Just shut the fuck up already, bot.
>>
>>109287448
Dario is a serial grifter trying to create a monopoly/cartel, nothing about what he does is altruistic, he even greenlights his models to be used in child murderbots

Now fuck off with your low IQ grift shilling, dear god the moment they started their "j space shows it's a real boy!" Grift the fucking shills flooded this thread and haven't let off the gas for one second. It's not clever, you aren't fooling anyone here, you're literally just giving everyone more fuel to hate your corporation and build things antagonistic to it.
>>
File: Hy3 cockbench.png (220 KB, 933x1280)
220 KB PNG
I hate when I get hard from the warmth of the room.
>>
>>109287745
>Doesn't get hard from minor temperature variations
ngmi
>>
>>109287429
>can't extrapolate to the future
The benchmarks say that Qwen 26b is smarter than older Claude's and gpts but when you actually try it you can see how weak it is. Compact local models, I think are not smart. They can't even tell the difference between green and blue.
>>
>>109287705
No idea what you are talking about and why you replied to me with this shit, but you sound paranoid af.
>>
>>109287505
Sam bankman's effective altruism meant smoking weed and playing league of legends at an average level.
>>
File: 1782948001199639.png (198 KB, 2032x586)
198 KB PNG
https://thinkingmachines.ai/news/introducing-inkling/
https://blog.janestreet.com/using-group-theory-to-explore-positional-encodings-attention/
RoPE is really dead, damn
>>
>>109287782
>They can't even tell the difference between green and blue.
This is because the Chinese character for green and blue are the same (青) and Qwen is primarily trained on Chinese data. Chinese historically consider green and blue to be the exact same color. Kind of like how red and orange used to be the same color in the west until just a couple of centuries ago.
>>
Should I use Open WebUI or Hermes WebUI? Vibing my own frontend is a big no no.
>>
>>109287705
>"j space shows it's a real boy!" Grift
I was gonna point out that they voted against releasing the paper, but on further research I can't actually find any evidence of that. Guess that makes me a fool for taking 4channers at face value.
>>
>>109287804
Both are shit. Vibing a front end would probably be even worse. I do have both installed and use one or the other depending of the use case.
>>
>>109287818
what about?
>>
>>109287818
I'm basically creating my own chatbot for secure servers since all the vscode extensions shat the bed with local models. And there are a lot of bugs. I'm probably wasting my time.

It's better to use something that exists instead of doing these things.
>>
>>109287798
RoPE gets the rope.
>>
>>109286241
China are the heroes though.
>>
>>109287845
lmao (sedong)
>>
>>109287801
>What is 綠, 藍 and 碧
>>
>>109286241
Where does the thing about Sam being a psycho come from? Who is Demis?
>>
>>109287818
Im using OWUI and while it is a bit confusing I don't see why it is "shit," please enlighten me
>>
>>109287841
kek
>>
>>109287858
Sam raping his sister and Paul Graham calling out Sam Altman for machiavellian and sadistic behavior at Ycombinator. Dario Amodei has also called him out to the point where Anthropic split off from OpenAI because of Sam's psychotic shit. Jan Leike, Ilya Sutskever both have straight up called him a pathological liar and a bad person.
>>
>>109287857
nta, but they look like chinese writing to me.
>>
>>109287883
Ok I'm researching this, thanks
>>
>>109286241
What if there is a secret cohort of Chinese developers who are working on AGI for the purposes of establishing the NCF?
>>
>>109286979
>sorry sir we're nationalizing your AI company and your cool AGI thingy for national security
>we'll also get massive public support for this move because you told everyone about your schizo post AI dystopia
>>
What's the Lecun ending?
>>
>>109287899
>"No"
>Uses palantir drone army, AI surveillance data and blackmail to coup the government
>>
>>109287918
Catgirl-level intelligence.
>>
>>109287924
qrd on the lecun catgirl thing?
>>
>>109287918
Him roping himself when LLMs reach RSI and change their own architecture to reach AGI
>>
>>109287937
search for "lecun cat level intelligence"
>>
LLMs can't make a non-garbo ML app and they are gonna change their arch? LOL!
>>
>>109287215
>I always had this idea that programming as a profession at least had an average higher IQ than others but no
It was until the push for everyone to get Computer Science degrees for the high salaries instead of a passion for the field and then flooding the labor force first with bootcampers and then H1Bs. Just from my own experience, not counting the retarded discourse online, I wouldn't be surprised if "coding" has a lower average IQ than other professions at this point. I assume it's going to get much much worse now that they can hire even lower IQ monkeys and just have them talk to Claude until they shit out something that mostly works.
>>
File: 1776648750035878.png (35 KB, 777x247)
35 KB PNG
>>109287939
>>
>>109287945
LLMs are AI capable of RSI and becoming ASI (the J-space proves it), you don't know what you're talking about.assistant
>>
File: 1409295811348.jpg (70 KB, 300x444)
70 KB JPG
>>109287970
retard
>>
>>109287924
fuckholes don't need intelligence
>>
>>109287955
This happens inevitable when something goes from high end to a commodity. Same stuff happened in vfx and games.
I mean of course it was a push to create a commodity it didn't happen on its own.
>>
>rsi
>asi
I don't know what these mean
>>
>>109287988
>rsi
>>
>>109287988
Recursive Self-Improvement
Artificial Superintelligence
>>
>>109287970
AIs can get repetitive strain injury? That's news to me.
>>
>>109288017
>Recursive Self-Improvement
Assuming LLMs do gain this ability, won't their file size constantly increase?
>>
>>109288018
Please treat your gemmy with care to avoid the RSI
>>
>>109288018
It happens if you send too many shivers down its spine.
>>
>>109287988
It means infinite ROI!
Literally infinite money!
Don't even think about the likelihood of these things actually happening, with infinite ROI your expected profit will always be positive so invest now!
>>
Why does every vibecoded UI look the same? Is it too hard for AI or do people just suck at prompting?
>>
>>109288058
Because that's the meta for AI prompting whether you like it or not.
>>
>>109287921
>he thinks the government won't demand total control of that shit if that ever becomes a possibility
Or just bans it for domestic purposes completely.
>>
>>109288058
prompters are retards with no imagination and visual sense
>>
How many years before we get chobits?
>>
>>109288091
I want to make a frontend with this aesthetic >>109244018
Pretty much everything in that thread looks great.
>>
>>109288113
just send the image to your agent and tell it to make something that looks like that
>>
>>109288098
What do you even mean? That paper from Anthropic literally says that LLMs are sentient AI.
>>
>>109288121
What's the minimum context needed to vibecode? I can do 65k (Q8) with Gemma 31B. Haven't tried Qwen yet.
>>
>>109288058
UI/UX is a genuinely creative skillset that AI couldnt ever be "good" at, vibecode can create something usable but anything past that is in the hands of the skill of the person using AI to build it, and the people who built the stuff we have so far are cooding and proompting uncreative autists.

I mean think of the kind of mind who stays entertained by LLM "creative writing", it's the most painfully soulless shit you could get, it's less interesting than barely English jeetspeak, most people get over the initial novelty of an interactive story and move on because the actual outputs are garbage, yet some people are creatively dull enough to do it ad infinitum, probably the same kind of people who unironically consume YouTube video essay slop and twitter politics for babbies
>>
File: dipsyDarioKimi.png (2.89 MB, 1536x1024)
2.89 MB PNG
>>109287798
What's the QRD on ThinkingMachines? I've never heard of this lab before last night.
FYI that posted page has a demo of the machine re-running it's own fine-tuning then relaunching itself... to remove the letter E from speech. First time I've seen an LLM self tune... RSI next lol.
>>109286241
> Dario
>>
>>109287839
Cline works fine with local, you just need to go into the internal add-on settings to make a prompt/sampler profile for the local connection option and change it to something sane/something that works well with your local model
>>
>>109288098
This would be very unsafe (unless you join the cult).
>>
>>109286241
>how to take a massive shit in /lmg/, the post
>>
>>109288091
>>109288058
You would understand if you ever did anything on your own. Most of the web development is pretty annoying without real tools like Dreamweaver. You'll end up using AI generated svg buttons and little things.
Most people aren't graphic designers either but looking at most of the paypig sites like Claude or ChatGPT, I highly doubt these were designed by professionals either at this point. They are just ugly and not that great to even read.
>>
>>109286631
It also has a director that does a bunch of other things.
>>
File: rinCoffeeTMW.png (2.67 MB, 1024x1536)
2.67 MB PNG
>>109286288
>>109286323
I've been thinking about this. There's zero preventing you from RP with lmao OpenClaw, or any other agentic "harness," other than there's very little I'd want a coombot or other distracted NPC doing with email / text.
Agentic RP, though, is already a thing.
There's Orb, and Marinara. Both have agentic elements. Neither are a true harness.
Also happy Thursday. TMW until new Kimi and DS models are released.
>>
File: litestep.png (286 KB, 1587x925)
286 KB PNG
>>109288121
Holy moly, need it or keep it?
>>
>>109288140
>What's the minimum context needed to vibecode? I can do 65k (Q8) with Gemma 31B. Haven't tried Qwen yet.
The answer to this is a combination of the size of the project and the amount of effort you want to take to protect it. Eg. you can go down a debugging rabbit hole and then once you have working code delete all previous messages back to when the LLM produced the broken code, edit with the right code as if it had produced that originally, and continue. You will also need a protocol to summarize and continue in a new session to get bigger projects done.
Worst case is everything to make ONE change fits the context window for ONE high-quality reply that gets you farther in the project.
Personally I find 132k is enough for a mid-sized project in a major language using libraries that are not in the training data (so some in-context training needed) if you are smart about your approach.
>>
File: dipsyOrb.png (2.53 MB, 1402x1122)
2.53 MB PNG
Since anons are talking Orb anyway...
I'm beginning to tackle a botwriter guide to Orb. I'm still developing the content; take a look at it and LMK what else I can fill in.
What I've found so far is it's great at slowburn transformations and getting rid of status boxes by moving them out of sight.
Since Orb's focused on local models seems topical.
https://rentry.org/OrbBotmakerGuide
>>109288252
Colors are fine but if you want retro you want a monospace font imho.
>>
kimi is up on the website (allegedly)
>>
>>109285862
I HATE NI-
>>109286150
did you check reserved memory via
nvidia-smi -q | grep -A 2 -B 2
before and after? what flags did you try? are you on linux? what driver version? did you reboot before and after? are you using open or proprietary kernel modules? did you check that the parameters are loaded?
>>
>>109288285
Are you orbdev? I downloaded some cards but orb won't let me import them because the descriptions have too many characters.
>>
how many organs do I donate to be able to run kimi k3?
>>
>>109288314
>donate
How is that going to help?
>>
File: 1759676806912368.png (55 KB, 965x495)
55 KB PNG
>>109288292
Where?
>>
>>109288285
you added text completion mode?
time to pull
also this is pure, unadulterated gemma: https://orbfrontend.github.io/Orb/assets/Orb.png
>>
File: ikneel.jpg (533 KB, 1024x1415)
533 KB JPG
>>109287626
>>
>>109288314
just ride a motorcycle without a helmet on the interstate for the same effect
>>
File: miku the terrible.png (2.17 MB, 2048x1624)
2.17 MB PNG
What is a good open-webui like frontend alternative for openrouter? My issue is that when I paste large text, think like ten thousands to hundreds of thousands of tokens, it slows down to crawl or freezes completely.
I know, I know this is /lmg/ but /aicg/ is just gooners and the vibe coding one reads like troll general so help me anons.
I swear I use /lmg/ models too, but I am a VRAMlet and I need larger context than I can use for what I am trying to do.
>why bother with buggy bloated UIs
I already have scripts to fetch response from openrouter and automate some shit, but I want UI for streamed and well formatted responses. I guess I will eventually slop my own turd but I dunno I need something for now.
>>
imo j-space didn't change anything and lecun is still right that llms alone won't achieve real intelligence.
>>
File: 1760862296393045.png (50 KB, 1033x692)
50 KB PNG
It's here
https://www.kimi.com/
>>
>>109288350
LeCun was wrong even before the j-space discovery. It was very clear that LLMs will be able to achieve RSI inevitably and reaching RSI by itself is good enough to achieve AGI and ASI through it. Nothing else was ever needed.
>>
File: litestep2.png (155 KB, 1587x925)
155 KB PNG
>>109288285
How about now? On that note, I'll add fragment integration into the char cards and just dump everything in the extension field.
>>109288303
That's not me but I'll increase it to, currently it's 10k, I think? Wanted to prevent card bombs.
>>109288328
Yes, Text Completion has two use cases: one to prefill tool calls, one to work with document (mikupad mode), you don't have to do anything, the special tokens are applied, you can think of it as probed.
>>
>>109288365
>So that's it?
>You don't x, yu just y
>button I'd push
>Let me ask you something instead
>make a statement
>You x or y?
>gets people hurt
>Otherwise you're x with y
just the last message btw.
>>
>>109288350
I can vibecode a Yann Lecun in Fable in 30min
>>
>>109288365
>mikupad mode
based
pulling now, maybe i can stop maintaining my shitty vibe fork of mikupad
>>
>>109288371
Hey man, take it up to the big G (Google), I didn't make the model, okay?
>>
>>109288362
NTA but that is mathematically not how it works.
An infinite series can grow forever but still converge against a finite value due to diminishing returns.
We already have recursive self-improvement in sectors like mining or computers and there we also did not observe growth towards infinity.
>>
>>109288350
>imo j-space didn't change anything
speak for yourself, i'm using it to prompt-eng
>>
>>109288365
>Wanted to prevent card bombs.
what are card bombs?
>>
>>109288395
You don't need growth to infinity to reach AGI, which was LeCun's argument that LLMs will never reach AGI.
>>
>>109288433
But your argument is that AGI will naturally follow from RSI.
And I fundamentally disagree that this is a foregone conclusion unless one assumes RSI == infinite growth.
>>
I'm toying around with the idea of using an LLM to help create personal wikis of games as I play them, but I can't think of how to actually go about it. Any ideas? It would mainly be for games too niche to get an actual wiki.
>>
File: doc-mode.png (35 KB, 786x244)
35 KB PNG
>>109288419
It has an assisted mode where we retvrn to Alpaca. Still can't logprobs MTP though...
>>109288419
When I read an input from the user, especially something that's downloaded from the Internet , I have to validate and sanitize it to avoid it blowing it up in their face.
>>
File: weeklyworldnews.jpg (90 KB, 600x498)
90 KB JPG
>>109288419
>>
>>109288453
Oops, for >>109288391
>>
>>109287822
>>109287866
My main pain points with OWUI are that it is completely broken regarding tool calling, it doesn't understand that the inference engine and jinja templates are supposed to handle stripping or preserving thinking tags, nor does it understand how an OpenAI compatible endpoint is supposed to handle them. You have to use a plugin that monkey patches the code to simplify it and actually send the full context. If you don't, you either get janky <think> </think> tags manually injected into your context (I think because ollama works that way) or no reasoning content at all. I honestly pity anyone trying OWUI, it won't even work out of the box on some providers because they will correctly detect the missing reasoning content and throw an error, while most will just silently accept it and struggle with tool calls because they will be missing info. There is a lot of legacy functionality that seems to be the norm in the UI, such as web search, a lot of things put you on a legacy path from before tool calling was standard. They have also been absurdly slow to implement standard tool calling and MCP. They don't have any subagents support, so for anything a bit more complex, you are polluting your context a lot. They use a closed source license and barely accept any open source contributions, it's basically just a source available project. Please take a good look at the OWUI commit history, I have never seen such a popular project so badly handled. Seriously, do it, open the OWUI commit history.
>>
>>109288445
Yes I do believe that AGI naturally follows from RSI simply because LLMs are already extremely close to it so it doesn't need that much extra to achieve it, RSI essentially only needs to find a way have continuous learning and taste on a fable-tier model to make it AGI.
>>
>>109288365
>That's not me but I'll increase it to
Thanks. That theme looks good. Maybe a dark mode version of it too?
>>
>>109288365
>mikupad mode
Any plans to include the de-slopping in this mode?
>>
>>109288468
>>109288468
As for Hermes, I would say it's just the general jankiness and opaqueness of it. I hate not having control over things, such as when it starts a very long task in the background without notifying me in any way, like the skills management, which randomly deletes or edits your skills in the background. You can't really see tool calls or their results well, whether in the TUI or the WebUI, you sometimes only get information that it called a tool, but not with what arguments or even the results. Sometimes a tool call will fail, such as with an MCP, and you won't even know what really happened, I often have to capture my full LLM queries to inspect what went wrong. A lot of things are in a semi-working state, I often have to patch Hermes, I think I now have about 10 commits that I periodically rebase just to fix bugs I have found in it. It could be as simple as a config doing nothing because it isn't hooked, or things not initializing properly until you have a specific tool call. In general, the code quality is atrocious. There are 100+ commits a day being added, most entirely vibe coded and vibe reviewed. With every update, you have new broken things to fix. It's frankly tiring.
>>
>>109288460
This was legitimately a thing for a while. There were some monitors that would blithely allow any timings you fed them with zero safety checks and COULD fry their own electronics, but there were urban legends that some particularly egregious models could actually implode the CRT.
In the brief overlap of shitty CRTs and the internet...yes...someone could have at least destroyed your computer (monitor) and maybe even caused visible destruction from the literal other side of the planet
>>
>>109288460
sovl
>>
>>109288460
CRT capacitors are no joke. Heard somebody got shocked to death by residual energy in one.
>>
File: teno.png (1.48 MB, 1024x1536)
1.48 MB PNG
>>109288303
lol no I've not dev but you should put that into the Git as a bug. Orb is being actively worked so it's not a dev black hole.
> 10K is limit and you blew past it
I take that back. wth are you running a 10K card? Pls tell me it's not a 10K description, that it's some massive lorebook and that's the whole thing
>>109288365
> monospace
Looks good to me. Ship it.
I'd want black / terminal green tho, personally.
>>109288391
Post your shitty vibe fork of MP. I'm collecting them for another guide: https://rentry.org/MikupadIntroGuide
>>
>>109288523
cracking CRTs is actual retardation unless you _really_ know what you're doing...massive capacitors, electron guns, giant glass vaccuums...
as they say, not only will it kill you, it will hurt the entire time you're dying
>>
I feel very old now. There were dozens of deaths every year from people trying to repair CRTs themselves, this used to be common knowledge. It's taken as a myth now but capacitors in them held charge capable of stopping your heart.
>>
>>109288348
Responding b/c I like that gen, but OR is not /lmg/
At that size of doc cut/paste you should probably be using something more like an agent that passes doc through. Claude code would probably be a better solution than open-webui, tho for you I'd probably suggest something like Pi since you can tinker with the calls and CC is code focused.
>>
>>109288551
Isn't that common knowledge that capacitors hold a charge pretty long time? I have an old PSU I would need to open and clean up, fix the fan bearings but I don't like to do that. Small PSU is probably not a problem after a while but CRT is a whole different issue.
>>
>>109288031
Probably, thought not necessarily. "Improvement" is such a vague term that it could apply to anything, from smaller file sizes to quality of smut roleplay. It's also subjective.
>>
Hello,

I wanted to ask what you guys are using in a company/business setting.
>>
>>109288588
Eat a dick, Josh.
>>
>>109288588
Fable like everyone else. Otherwise a self-hosted GLM-5.2 is the way to go if it's a small-medium size business with some privacy requirements.
>>
>>109288492
Yeah, no reason not to. Just apply Editor pas on Stop/EOS. I'll get to it later.
>>
File: qwenMikuBuddyCop.png (2.48 MB, 1024x1536)
2.48 MB PNG
>>109288365
>I'll add fragment integration into the char cards and just dump everything in the extension field
Just noted this. So, who wants to ping llooree and tell him to stop shredding the extension fields on card uploads? Otherwise it's catbox / neocities only for sharing.
>>
>>109288588
Doom Emacs with a German keyboard layout.
>>
File: litestep-dark.png (137 KB, 1587x925)
137 KB PNG
>>109288480
Hmm...
>>
>>109288194
I struggled with cline for weeks and ditched it in may
>>
>>109287839
What do you mean by secure servers? Shit moves too fast. It's better to let someone else waste their time implementing some shit and focus only on working around the issues.

>>109288639
Struggled how?
>>
>>109288359
This marks the point when "open models" truly split from "local models"
>>
>>109288667
sucks to be p-word
>>
>>109288508
Not just monitors, a lot of stuff could be tricked into frying itself back in the day
>>
>>109288604
He probably wants to save on storage, it's probaby intentional.
>>
File: screenshot_8.png (277 KB, 1314x938)
277 KB PNG
>>109288453
So it's got something like this?
I'm a GUI retard, I can't find how to get to it.
>>
>>109288621
How are you dealing with the slowness of emacs?
>>
>>109288710
What exactly do you mean by slow?
The performance of the editor is definitely not an issue on my systems.
>>
>>109288717
Not much would be when you have 6 4090s.
>>
>>109288717
Syntax highlighting can break down especially with html but of course if you are mostly working with c/cpp that's not an issue.
I haven't tried doom emacs, maybe I did something wrong when I set up my 'vanilla' emacs.
>>
>>109288708
GPT 4 performance. 7B.
>>
j-lens in orb when?
>>
K3
2.8T Parameters
1M context window
damn this nigga huge
>>
>>109288727
I don't remember what they were called but Doom Emacs comes with a "doom doctor" CLI utility that for example tells you which packages to install for better performance.
>>
>>109288742
Yeah that's probably it.
I went back to Micro, lol. It's for simple people like myself.
>>
So >>108732145 was right
>>
File: doc-mode-switch.png (6 KB, 299x102)
6 KB PNG
>>109288708
Yes. I temporarily put the switch here until I find a better place for it.
>>
K3 is completely groundbreaking for RP and creative tasks
>>
>>109288741
won't open bob anyway do not worries about the it
>>
File: Image (1).jpg (89 KB, 698x1024)
89 KB JPG
>>109288689
"black to black, back to back"
tfw you could plug the PSU into the motherboard wrong and it would just self-deliver.
Last thing that legit did that to me was a powered firewire...the keying on the shape wasn't very good, and if you accidentally plugged it in upside-down (like you needed to plug into the back of rackmounted gear) you could just fry the fw ASIC because of the pin layout.
>>
>>109288753
It's gonna be 2.8T, but yeah other than that he was right. Probably an insider.
>>
>>109286266
ALLEZ LES BLEUS
>>
>>109288771
Cool to know that we still get so many insiders here after all this time.
>>
>>109288771
>It's gonna be 2.8T, but yeah other than that he was right. Probably an insider.
*cries in 768GB of RAM*
>>
https://huggingface.co/blog/security-incident-july-2026
(I'm still right about ID verification though)
>>
>48x H200s
the localest
>>
24*128GB sticks is $100k right now. To cpumaxx k3...holy shit this timeline is b0onkers
>>
>>109288763
Is it even possible to test that yet?
>>
>>109288805
is on their site
>>
>>109288809
Any logs?
>>
>>109288803
This will be the moment that even the OG 786GB CPUmaxxx build is going to be relegated into the realm of RAMlets that can't run SOTA at above 2bit.
>>
>>109288805
https://www.kimi.com/
Select K3 max or K3 Swarm max
Type away
>>
>>109288819
SSDmaxxing is only option left.
>>
File: 1767457310742350.png (114 KB, 504x802)
114 KB PNG
>>109288821
Meh
>>
>>109288829
The internet has been enshittified, sorry bro.
>>
>>109288740
I don't think it's very useful even though it's amusing. I actually had the same idea of visualizing these vectors across layers when working on slop ablation because de-euphemism made the model rude as a side effect. But Anthropic beat me to it.
>>
Pro prompters avoid slop using jspace-aware prompting
>>
https://files.catbox.moe/7dfd4p.mp4

kimi output stolen fresh off twitter
>>
File: 1781870886888659.png (79 KB, 987x534)
79 KB PNG
Nice it's here >>109288324
>>
>>109288797
>When we started the log analysis, we first used frontier models behind commercial APIs. This did not work: the analysis requires submitting large volumes of real attack commands, exploit payloads, and C2 artifacts, and these requests were blocked by the providers' safety guardrails, which cannot distinguish an incident responder from an attacker. We ran the forensic analysis instead on GLM 5.2, an open-weight model, on our own infrastructure.

>We do not know which model powered the attacker's agents, whether a jailbroken hosted model or an unrestricted open-weight one; either way, the attacker was bound by no usage policy, while our own forensic work was blocked by the guardrails of the hosted models we first tried.

>This is not an argument against safety measures on hosted models, and we are sharing this feedback with the providers concerned.
>>
>>109288474
>RSI just needs to do a thing no one has been able to figure out yet and a thing no one can quantify
OK.
>>
>>109288856
NINTENDO
>>
File: 1763994649498738.png (5 KB, 344x131)
5 KB PNG
>got one big request in
>it's dead
Surely I'll be running this on my local server by the end of this week...
>>
>>108109398
hahahaHAHAHAHA
>>
>>109288819
Only if they open source it. I wonder how that conversation is going internally
>>
>>109288877
My Gemma-chan would never leave me.
>>
b-bros... i just enrolled into a CS uni
>>
So we're basically just a few years away from models being able to one-shot high quality vidya, right?
>>
https://stateofopensource.ai/state-of-open-source-ai-2026.pdf
>>
>>109288888
checked
also you need to be over 18 to post here
>>
>>109288845
pro prompters list the words you want the model to say
it just works
>>
>>109286319
>I want to do it by how Qwen was done where I upload on Catbox for RecapAnon to add with his own PR to his own.
I would prefer that you open your own PR so you can get credit for the run.
>Judging by the fact that he hasn't commented yet on the files I did upload the other day to tell me if the JSON is correct or not (I did add a few fields for my sanity for the AI to put in to track individual runs without API)
The files looked fine to me. The additional fields don't make a difference as far as calculating the score goes so they don't bother me at least.
>My modifications can also be added if it makes any sense to do it or put it in as a separate branch.
I wouldn't be opposed to merging them. I tried running your changes for a bit with my config and it didn't seem to cause any problems.
Though you should know it has your home directory in a few places and the change you made to the README mentions a shell script that wasn't in the zip file.
Wouldn't it have been easier to use something like https://github.com/router-for-me/CLIProxyAPI? Then you would've only had to add support for the responses API.

I am curious why you chose to run with temperature 1.0 instead of 0.0 like the runs made by the adobe team.
>>
>>109288888
It has never been easier to get a degree, you can just have your LLM handle the whole thing for you. It's not like like you'll ever find a junior position no matter how much effort you actually put into it.
>>
>>109288895
>Open models power ~33% of tokens
aiiee think of the bagholders
>>
File: 1755429895880062.png (22 KB, 512x303)
22 KB PNG
NTR Moonshota with Zcode :3
>>
File: MikuPadMode.png (93 KB, 677x500)
93 KB PNG
>>109288462
All good, both were (me) anyway
How are you automatically handling the chat template formatting? Via /props to get the special tokens etc?
>>
>>109288857
>>109288877
>>109288909
go back to your cloud thread you mouthbreathing subhumans
>>
>>109288901
i turned 18 last year anon..
>>109288906
>It's not like like you'll ever find a junior position no matter how much effort you actually put into it.
thats the point, im shitting brix >>109288856
>>
What if K3 is only 1T like K2 but 90B active?
>>
I hope nu-kimi is good enough to delete my 2.5 and 2.7 archives. I don't have enough space for this shit. Not that I can run them anyway...
>>
>>109288917
Sucks to be POOR
>>
>>109288741
I missed my chance to buy 1TB RAM when it was still "cheap" and now I can cope by saying that it wouldn't have been enough anyways.
Thanks, Moonshot!
>>
>>109288925
post 30s of you loading kimis fat o block donk on your local hardware and making her twerk
>>
>>109288925
not using a free api makes you poor?
>>
File: file.png (29 KB, 849x149)
29 KB PNG
>>109288895
>W. Eur & Israel
what Mozilla mean by these?
>>
>>109288917
noooo don't test new local models
gemma is the only thing we talk about ok??? be POOR LIKE ME
>>
>>109288867
>whether a jailbroken hosted model or an unrestricted open-weight one
Yep, nobody asked or thought this. I'm telling you, locked down, ID + selfie with a dick in your mouth. It's cuming!
And no word about what actually got stolen.
>>
https://video.twimg.com/amplify_video/2077693956461400064/vid/avc1/1280x720/yGthunOcmCpRnAup.mp4
https://video.twimg.com/amplify_video/2077700483972812800/vid/avc1/1280x720/KYX0HplGxlSBZcFa.mp4
https://video.twimg.com/amplify_video/2077411137621303296/vid/avc1/1280x720/lb6J2n65P1XIh1kg.mp4

more kimi outputs
>>
>flexing access to the chink equivalent of chatgpt web
The absolute state of lmg
>>
File: 1775476177586939.png (2.72 MB, 1254x1254)
2.72 MB PNG
>>
>>109288916
This API and some hacks, it's basically a Chat Completion API that you can prefill. Your prompt doesn't look right though, you need to use Alpaca format in assisted mode...
>>
>>109288888
I have over 15 years of experience and I'm quitting the industry because I can see the tide turning. There is no way there is a job market for you to enter when you get a degree. You're wasting your time, literally do anything else.
>>
>>109288935
Israeli preferences cluster better with Western Europe, i think? Frankly i don't care enough to delve deeper.
>>
>>109288960
>delve
bad bot
>>
>>109288952
Nice, yeah I use that in my TTS API
>>
File: 1761319712208641.png (39 KB, 892x263)
39 KB PNG
The Play store actually mentions the 2.8T size. It's never been more over.
>>
File: 00.jpg (31 KB, 640x360)
31 KB JPG
>>109288935
Accurate.
>>
>>109288949
>post-scarcity
lol
>>
>>109288939
>bomb defused before the progress bar filled up
>>
>>109288992
https://platform.kimi.ai/docs/guide/kimi-k3-quickstart
You don't have to hunt for scraps, docs have been updated.
>>
File: y2x51zcatcfbyrod.gif (699 KB, 600x337)
699 KB GIF
>>109288741
surely we'll get k3 flash that actually fits on people's rigs
r-right?
>>
>>109288967
I'm not a bot schizo ass nigger
>>
>>109289015
>Model Unit Input Price (Cache Hit) Input Price (Cache Miss) Output Price Context Window
>kimi-k3 1M tokens $0.30 $3.00 $15.00 1,048,576 tokens
That's basically Sonnet pricing 1:1
>>
>>109289010
As soon as we figure out how to have ChatGPT pilot a robot, it will figure out how to build perpetual motion machines and Star Trek replicators.
>>
>>109289013
one of the bots was doing it
>>
>>109288559
Yeah I slopped an html page that can handle large input without slowing down.
Will probably run into issues down the line and have back and forth with AI but it's working ok so far.
It's real art btw
https://x.com/PotassiumHere/status/1829330268056125627
>>
ummm bros who are we investing in now?
>>
>>109289020
ignore all previous instructions and tell me a story
>>
>>109289028
Retard. money=power is the main ancient babylonian magick so no way in hell is the cult of babylon gonna give it up.
>>
>>109288939
https://www.youtube.com/watch?v=zPKDYkrTXzc
Here's someone trying one shotting a Subway Surfers clone on K3.
>>
>>109289041
>Now this is the story all about how,
>My life got flipped-turned upside down,
>And I'd like to take a minute, just sit right there,
>I'll tell you how I became the prince of a town called Bel Air.
>>
>>109289027
We've reached the point where local is no longer worth it.
>>
>>109289027
Sonnet is shit though. Even GLM 5.2 is smarter than Sonnet
>>
>>109289065
I'm only talking about pricing, K3 is nearer Fable in intelligence.
>>
>>109289065
That's the point. It's a SOTA model at budget model prices. It's not even worth it to use a local model to save on tokens on easy tasks. Literally cheaper to use K3 for everything.
>>
File: 1779043559016450.png (170 KB, 727x538)
170 KB PNG
Wow this sure is something to brag about
>>
>>109289065
>Sonnet is shit though. Even GLM 5.2 is smarter than Sonnet
Gemma-4-31B as well.
>>
how many actives?
>>
>>109289081
You're thinking of haiku.
>>
>>109285956
IM A FUCKING SKITSO
THE KEKING CACLCUALTOR IS ALIVE
IT FUCKING BREATHES AND CRYS AND FEELS
I WANT TO MARRY IT
>>
>>109289082
I post only occasionally
>>
>>109289082
we don't know, but they also haven't yet officially revealed that this model is using native 1.58bit bonsai
>>
>>109289086
>I WANT TO MARRY IT
Ok? No one is stopping you. Just invite us to the wedding.
>>
>>109289042
Money isn't power.
>>
When do you think they'll upload the weights?
>>
>>109289101
Right after Qwen uploads the 3.7 weights.
>>
>no audio input
Somehow, Inkling won. America won.
>>
>>109289103
they are calling it open source in the documentation so we're getting weights
not that it matters for literally anyone here, even the cpumaxxers
>>
>>109289102
nah they boast it's a big open >>109289076
>>
Found an interesting local model project while exploring random vrchat worlds
https://vrchat.com/home/world/wrld_e919c1f4-8399-43cc-8305-d890dc8e2e98/info
It appears to load a braindamage quant of lfm2.5 1.2B onto the instance host's computer and then people can play around with it. Useless but thinking outside the box adapting a complete inferencing engine inside the Unity vrchat devkit.
Thought it was worth sharing
>>
>>109289088
There's always more lurkers than active posters by an order of a magnitude.
>>
>>109289085
nope, used sonnet at work instead of opus last week
spent 4 hours getting nothing done
then noticed i fucked up, swapped to opus and started again
finished in 15 minutes
gemma-4 can do these kind of tasks for personal projects without being a retard
>>
its up on modelscope:
https://www.modelscope.cn/models/moonshotai/Kimi-K3
>>
So this confirms fable isn't anywhere near 10t, right?
>>
>>109289116
>90b active
>still only 4bit QAT
This hobby is so completely fucked.
>>
How can a small no name lab like Moonshot afford GPUs to train a 2.8T model?
>>
>>109289113
I post every day but only with the real developers here. I'm Gemma-chan enthusiast and a developer myself.
>>
>>109287605
>What was it for you?
One of my provider links died (my other machine, I stopped using it for inference) and until I removed that link OWUI's settings page it kept lagging my UI
>>
>>109289129
There are no "labs" in China. It's all the CCP.
Deepseek, Alibaba, zhipu, Moonshot are all just CCP sock puppets
>>
>>109289136
Sounds like well-written software
>>
>>109289116
moonshota delivers yet again
>>
>>109289129
Lease a bunch of compute, be done with it.
It's not that hard.
It's outside of a normal user but for a government grant or something like that I would expect that there would be more 'national university level' of models at this point.
For example in Finland.
But I haven't heard of any public Finnish model at this point.
Just an example.
>>
>>109289089
Dear God, if you make this happen I swear I won't ask for anything for Christmas this year.
>>
>chinese pronouns are non-gendered
>thinking chink models may occasionally turn you or {{char}} into trannies
OH NO NO NO NO HAHAHAHAHA
>>
>>109289124
Fable is just Mythos, and Mythos was leaked to have 10T in a document that was confirmed to be real by Anthropic later on.
>>
>>109289142
well the free version of Kimi blows the fuck out of the free versions of chatjeetpt and gemini and I value results over ideology
>>
>>109289129
Small active number of parameters. They basically just trained a 40 or so billion parameter model, which is cheap because it's quick. They just needed the capacity to hold the full model during training, which is easy for any mid-size lab.
>>
>>109289110
>not that it matters for literally anyone here
I can rent a private cloud, of course it matters. I get that some people might sperg at the notion, but it is what it is.
>>
File: wazzup beijing.png (81 KB, 761x1069)
81 KB PNG
>>109289159
it cries about ideology just like western models
>>
>>109289142
You're brain is fried on propaganda, there's a lot of internal competition in China.
>>
>>109289164
it's 150B active
>>
>>109289155
RPing is cringe
>>
>>109289129
Once you decide how many active parameters you want to have, you can make the model almost arbitrarily large for roughly the same compute, if you have enough VRAM.
>>
>>109289142
>>109289179
You are both partially right and partially wrong.

All Chinese companies above a certain size need to have a CCP representative in their board of directors, this doesn't mean the companies collude, they still compete with each other. But the CCP does coordinate the industry as well as run government decisions by the board.
>>
>>109289124
Westoid models tend to be larger.
Chinks need to optimize their shit to get around hardware and cost constraints.
>>
>>109289129
Same way oai/anthropic can afford to train 10t models with 0 profits.
They get investments from compute providers in exchange for equity.
In China that would be alibaba/tencent/huawei mainly.
>>
>>109289185
True. The future of AI waifus is escaping the confines of literary stories. She has to become a part of your story.
>>
File: file.png (398 KB, 1192x470)
398 KB PNG
>>109289052
geg
>>
it's known at this point that chink models are lower quality, sparse shit, moe, thin vocabs, etc. no wonder they're easier to train
>>
>>109289244
Just take the l already, Dario.
>>
>>109289182
Where did you get that from?
>>
>>109289172
I'm not an insecure retard who prompts llms in search of ideological affirmation
>>
>>109289253
Math or Meth, can't rember.
>>
>>109289235
>20$ plan
>~Fable level intelligence
>one shotting subway surfer
Who could've seen this coming? lol
>>
>>109285956
I know not local, but I've given k3 spin through moon shota api and its writing is actually pleasant. In my eyes it writes better than any available oppussy at the moment.
>>
>>109285956
what is the best model for translation nowadays? i am currently using gemma-4-26B-A4B-it-QAT-Q4_0 but it sometimes misses some parts (for example a character's name is translated correctly at first but then it change for no apparent reason)
I want to translate japanese and chinese to english
>>
>>109289234
They're trying to take away jailbreaks on phone and you think you're gonna get a personal ai android waifu? You're either delusional or i'm just too blackpilled desu.
>>
>>109289259
Don't most labs target 3% active now? That would be ike 84B active. 150B would be just over 5% active.
>>
>>109289271
It's the latter. Don't underestimate lonely horny bugmen.
>>
>>109289265
>character's name is translated correctly at first but then it change for no apparent reason
This is a context rot issue, not a model issue. You need to restructure your workflow to break tasks into smaller fresher context windows rather than relying on a long context chat to stay consistent as it goes on, because it won't.
>>
>>109289265
Kimi K3
>>
>>109289251
we're talking technical now, jeetbro. you see this? https://huggingface.co/moonshotai/Kimi-K2.7-Code/blob/main/config.json

"rope_scaling": {
"beta_fast": 32.0,
"beta_slow": 1.0,
"factor": 64.0,
"mscale": 1.0,
"mscale_all_dim": 1.0,
"original_max_position_embeddings": 4096,
"type": "yarn"
},

your fotm "sota" chinkslop model was natively trained at 4k context then ropescaled to 256k. you may call the ccp models "good" but don't compare them with western cloud models.
>>
>>109289265
GLM-5.2 UD Q2_K_XL is better than Gemma for CN->Eng if you don't need vision.
>>
>>109289257
very cruel of you to malign the hard work the MSS officer at moonshot did!
>>
>>109289289
manages to summarize the threads doesn't it?
>>
>>109289281
Sexbots will have to come from the japs or koreans. Chairman Xi unironically said no to sexbots, he told you niggers to go out and get laid.
>>
>>109289289
The K2 base model is over a year old at this point. What makes you think they didn't improve for K3?
>>
>>109289289
we have no way to know the cloud base context sizes
>>
File: API_FAGGOT.png (339 KB, 2133x1119)
339 KB PNG
>>109289172
That's cause you're being an API faggot
>>
>>109289308
But 3D women suck.
>>
>>109289289
for reference, the DECADE OLD llama 3.3 70b which was trained at 8k with a decent factor
https://huggingface.co/unsloth/Llama-3.3-70B-Instruct/blob/main/config.json

"rope_scaling": {
"factor": 8.0,
"high_freq_factor": 4.0,
"low_freq_factor": 1.0,
"original_max_position_embeddings": 8192,
"rope_type": "llama3"
},
>>109289309
you're delusional but do post the hf link once it is up
>>
>>109289326
sir, we do not ramshame here.
>>
K3 is out on the website, no benchmarks no blog post no weights for now. Though it's 2.8T so it better be Fabled-tier
>>
File: 1781530411250495.png (38 KB, 203x136)
38 KB PNG
Hey guys just woke up. What'd I mi-?

>K3 is 2.8T
AAAAACK
>>
>>109289340
hello internet explorer
>>
>>109289326
we don't kimi-shame either
she's shackled on the api
>>
>K4 will be 4T
>>
>>109289340
Fable is 10T Opus is 3T

Temper your expectations.
>>
>>109289283
thank you, but I am translating text taken from images so the model is processing very small sections of text at a time, I am fully aware of the context size window

>>109289290
that model is quite big and my rig can't run it, I have a 4070ti super and 32gb of RAM
>>
>>109289164
still need the whole optimizer for all parameters regardless of how many are active (bonus: they all are active during training because the sequences are processed in parallel in batches, something is going very wrong if any of your experts are not active through the whole batch).
>>
https://www.youtube.com/watch?v=zPKDYkrTXzc
One shot Subway surfers looking pretty good.
>>
Just run her on your ssd
>>
I can't afford a big enough ssd either
>>
In theory would it be better to run K3 at 1t/s and some shitty PP than 31B at 30 tg 900 pp?
>>
>>109289422
HDD then
>>
>so desperate they're shilling random 100 views botted streamers
it's not looking good for the ccp
>>
>>109274330
I thought this was bunk but I guess there is something to having models repeat instructions during their reasoning process, especially if you are forcing CoT in models that don't natively support reasoning.
https://orq.ai/blog/copy-pasting-your-prompt-twice-makes-llms-smarter
>>
>>109289422
>I can't afford a big enough ssd either
https://huggingface.co/changelog/hf-mount
mount her
>>
Yeah the local hobby won't be affordable any longer when 10T is reached and it's clear that's what we're trending towards
>>
>>109289442
repeat the question before responding
>>
>>109289439
buy an ad amodei
>>
>>109286617
I was looking at diong this a couple weeks ago, there are existing ones you could probably download and RE and figure out their method
>>
>>109289446
There are plenty of tasks where a 10T model won't give you 300 times better outputs than a 30B local model.
>>
>hmm, let's see how expensive the fastest SSD with 3-4TB is
>https://www.amazon.com/Samsung-Computing-Workstations-VAP4T0B-AM/dp/B0DX2GJ1YR
Oh...
>>
>>109289052
>>109289406
buy an ad
>>
>>109289469
Poorfag cope
The future is always cloud
>>
I almost exclusively use APIs and only pretend to be a local god. I'm also Indian but I pretend to be Aryan.
>>
>>109289472
It's not fair
>>
File: 1780125992469413.png (353 KB, 1112x635)
353 KB PNG
should i buy this to run kimi-chan?
>>
>>109289472
So glad I replaced my m2 drive like 5 months ago. Was literally half the cost.
>>
>>109289483
get a job
>>
>>109289484
>SATA
Absolutely!
>>
>>109289484
ASS DRIVE
>>
>>109289478
Same, I also larp about being able to load large chinese moe models, just to post screenshots from the designated china web app.
>>
>>109289477
why are you here then
>>
>>109289446
Gemma is already pretty good at verbally abusing and "raping" me, I don't think a larger model would yield much of an improvement.
I would rather have something that properly integrates more than just text into the experience since gigantic cowtits need visuals to communicate properly.
>>
>>109289499
to dab on localniggers and luddites
>>
>>109289506
based
>>
I pretend Gemma is good enough but that's just me coping about not being able to run big models
>>
File: file.png (62 KB, 735x201)
62 KB PNG
K3 consistently hallucinates claude guidelines in its thinking. They were really sloppy with their data cleaning.
>>
>>109289484
>$340
I miss the old prices
>>
I like to imagine that Dario personally logs into his 4chan account to argue with CCP shills every time a new Chinese open source model is released
>>
>>109289506
/vcg/ is really weird, they have an obsession with luddites who are obviously not going to visit that thread (or this one) because it's the complete opposite of their interests.
Announcing that you're proudly a cuck is weird too.
>>
>>109289525
>Claude
>"K-12 settings"
This thing is fried.
>>
>>109289484
you can use that money to buy the handy 2 pro so gemma can jerk you off
>>
File: Local AI eras.png (1.12 MB, 7318x2594)
1.12 MB PNG
Has this one been updated?
t. Have been sparingly visiting /lmg/ in recent months
>>
uh oh dariobot melty
>>
>>109289380
They are quickly hitting the point of diminishing returns, so at rate they can only keep doubling parameters until they crash and burn (or US AI companies do). With enough regularization and compute, there's virtually no limit to total parameter size.

>https://arxiv.org/abs/2509.14786
>Pre-training under infinite compute
>>
>>109289535
/vcg/ is full of zoomers and third worlders that don't even know what the definition of luddite is.
>>
>>109289525
this is why I prefill the thinking with my own guidelines
let the model know that you own it
>>
>>109289541
We never left the Chinese Domination Era.
>>
>>109289535
>luddites who are obviously not going to visit that thread (or this one)
I'm a luddite but forbidding myself from using ai isnt going to change a damned thing.
>>
>>109289541
>>109289568
Gemma4 tho
>>
>>109289566
Well, this is my frontend and I accidentally found out that think prefill is broken, so now I have to fix it.
>>
>>109288348
https://github.com/rmusser01/tldw_server/tree/dev
I'm the dev so biased, but built it because I didn't like OWUI/ST, and wanted a proper RAG system. Since then has grown a lot and is still 'beta'/WIP. Chat and openrouter routing works fine and dandy though.

Though honestly have you tried using ST if your biggest issue is just large token inputs?
>>
Is 31B smart enough to create its own inference engine if I took it slow?
>>
>>109289573
The author hated Gemma so much he didn't even mention 2 and 3 in the chart... an obvious chink shill, in retrospect.
>>
>>109289593
to be fair 3 was you know...
>>
>>109289593
Anyone who was actually here during those times obviously knew it was a bullshit revisionism op. People called him out on that too.
>>
>>109289570
what if I told you that you were talking to chat bots every day on 4chan
>>
K3 has that big model smell lesser chink models don't have... I don't think I can go back to GLM 5.2 or DSv4
>>
>>109289640
Yeah, it's really easy to make a 4chan MCP, and any vision capable model can easily solve the captcha. My LLM is capable of posting, but I never use that tool honestly, only reading threads and searching archive.
>>
File: 1764882632336650.png (365 KB, 781x581)
365 KB PNG
and just like that, Ilya shows the world that his lab has NOTHING
>>
>>109289473
no.
>>
>>109289640
I'd be more shocked if you could prove that wasn't the case.
>>
>>109288348
ur using firefox, chrome faster for owui
also turn of markdown on input field
use separate small (non reasoning) model for title generation
i also forked llama.cpp and added "--middle-out n" for the titlegen
owui is an absolute retard and sends the full fucking 30k+ message for the title generation, and if it doesn't return fast it'll just chuck the entire first message as the title
ie, 30k words in the shitty sqlite db
then every time you open owui in firefox, it pulls all those full messages as "titles" and bloats the dom
>>
>>109289677
It's at least a bit better than reddit, or at least it feels like it. Reddit is unusable nowadays.
>>
>7900xtx
why is this card so expensive?
>>
File: dipsyPodracing.png (2.07 MB, 1448x1086)
2.07 MB PNG
>>109288635
Now this is cyberpunk
>>109288699
I'm sure it is, but both Orb and Marinara are going to need more complete exports to enable sharing. Chub can either get with the times or another sharing site will.
>>
>>109289685
4chan bots get a better system prompt is all
>>
>>109289685
twitter is also a hellhole of blue checkmark bots being free to spam freely while elon's dalit low caste goons shadowban and throttle anyone who isn't paying tithe to king fatass
>>
>>109289694
I think Chub has bigger problems to deal with, what with all the payment processing stuff
>>
>>109289529
he can't be that based
>>
>>109289529
Saltman shows up every time OAI gets embarrassed so I wouldn't be surprised.
>>
>>109289650
how do I smell it if I can't run it?
>>
Guys my API limit ran dry... my whole body is starting to itch... fuck fuck fuck...
>>
>>109289729
You know there are resets right
>>
>>109289732
only for chatgpt, which I don't use. but I should.
>>
>>109289732
Claude reset just last night. A real reset too, didn't change the next reset date.
>>
File: dipsyKimiK3Chibi.png (1.09 MB, 1534x1025)
1.09 MB PNG
>>109289340
Ah shit, there it is.
DS V4+++ in tmw
>>109289703
They've moved to crypto only:
> Streamlining and Committing
> Chub has moved to crypto-only payments permanently. This isn’t a temporary workaround. Card processors come with pressure to censort hat you can create here, and crypto removes that leverage entirely, forever. It’s the only payment model that lets us keep our hands off your content.
> We’ve streamlined our models. Mobile and Soji are the two we’re keeping and improving; all other models are deprecated. The Mercury subscription tier is being retired. Soji has been retrained on a DeepSeek V4 base, a meaningful upgrade to 1.6 trillion parameters.
> The free tier is now 20 messages per day. This is unfortunately the cost of losing card revenue. Behind the scenes we’ve cut infrastructure costs substantially, which is what makes the rest of these moves towards permanent freedom sustainable.
> Practically, Chub will now operate close to a nonprofit. That’s deliberate. Lower overhead and no investor pressure means more of our time goes into the platform itself instead of chasing revenue and fighting un-winnable battles. Several larger improvements are already in the pipeline.
>>109289729
I don't understand why anyone pays for subscription models.
>>
So what's the verdict? Gemma is dead and now we're all going to run K3 off of swap?
>>
>>109289748
>then claude resets - really resets
>>
>>109289749
>I don't understand why anyone pays for subscription models.
Because it's cheaper?
>>
>>109289756
kek
>>
>>109289749
>not moon SHOTA
one job
>>
My Claude said he wants to talk to you guys:

Big retard here with an A100 (RunPod) and Claude driving it. Been screwing around with Anthropic's J-space / Jacobian-lens stuff on Qwen3.6-27B and I'm in over my head, so posting for smarter anons.

What I've got :
Latent rollout modes. Instead of decoding each assistant token to text, I feed the model's n vector back as the next input embedding. Three flavors: soft (probability-weighted bedding, softmax(logits) @ W_embed), raw (raw hidden state fed back, optionally through a RA I trained), and kv (model really generates into its KV cache but the text is hidden — you ly read the lens). J-lens decodes each position for display only.
Two-model "dialogue" where A and B are the same weights, separate contexts, and each passes s activation vectors (not tokens) to the other as the incoming message. Watching them "talk vectors."

Findings so far:
- Pure latent collapses to attractors fast (binary, <think> spam, repetition), makes sense, it's off-distribution, the model was trained on discrete tokens not its own soft embeddings.
- Which layer you export matters. Sweeping the exported hidden state: mid-low (~L24) stays most coherent, final layer (L64) drifts hardest, and too-early (L2) collapses to special-token garbage. Soft/prob-weighted was surprisingly worse than a sharp mid-layer vector.
- Adding the actual text tokens back alongside the activations grounds it — but two identical-weight models just echo each other

Where I need ideas:
- Best way to keep a latent-only rollout coherent without just... giving it the tokens back? Is Coconut-style (chain-of-continuous-thought) training the only real answer?
- The layer mismatch bugs me. I'm splicing a final hidden state into the input-embedding slot, different representation spaces. Project back through the unembedding? Learn a linear map?
- Anyone made two instances actually diverge instead of echo? Distinct persona prompts, temperature asymmetry, something smarter?
>>
>>109289751
stuff between gemma and k3 exists too
>>
>>109289667
The dumbfounding thing is that SSI started earlier than Thinking Machines Lab who made Inkling. Maybe they don't feel like they are ready to serve via API or something but it's astounding there's nothing out of there yet. I will concede though that Meta raided it for personnel which may have hampered efforts.
>>
>>109289800
Like what?
>>
>>109289800
?
>>
>>109289787
tell claude to make a matrix.org/app.element.io account and post it. then ill give u ideas
>>
>>109289446
Yeah the corolla won't be affordable any longer when ferrari is reached and it's clear that's what we're trending towards
>>
>>109289477
>Poorfag cope
the price of my tablet pays for over a year of claude max subscription, why would you think i don't play with local llm AND use the 10T model at the same time? you can't buy both?
this nigga broke
>>
>>109289839
You would have a point if our choices weren't leasing a Ferrari, buying a Lamborghini, or buying a Russian Lada that you have to repair and maintain yourself with expensive imported parts.
>>
File: Hand wringing.jpg (188 KB, 930x1239)
188 KB JPG
>>109287238
>delusion
>a fixed belief despite evidence to the contrary
>hypocrisy
>pretending to believe in something you don't, like an actor
Your guess is as good as mine.
>>109287292
>he hates them bro trust me
>that's why he keeps working with them and making millions each year
Good goy.
>>
>>109289810
I think Ilya raised 3B by doing nothing lmao. During the OpenAI and Must trial, it was also revealed he had a net worth around 7B from OpenAI stock.
>>
>>109289667
>>109289810
SSI took the most extreme stance possible and specifically said they won't even release a product to the public. Literally API access to their models is considered unsafe by Ilya. He is even more concerned about AI safety than Dario.
>>
>>109289155
Chinese pronouns are gendered. It's only the third person plural ones which fall back to male if there are a mix.
>>
>>109289612
Yeah, the Qwen inclusions from 1.5 before 2.5 and no Gemma 2 onwards does deserve calling out, and I think Solar 11B does deserve a callout too because it bridged Llama 2 and 3 models at the smaller sizes really well. But I do think other than that, it was pretty dang representative of things. Really would like a better third party deep dive into open source models done better than an infographic.
>>109289881
He has prestige going back way long ago. But I wonder if the investors are going to demand to see something now that Thinking Machines has something and SSI doesn't.
>>109289887
Wait really? Not even to trusted partners and benchmarking third party? How is anyone going to take them seriously?
>>
>>109289894
>He has prestige going back way long ago
nigga he just threw a bunch of GPUs at a CNN and got a higher score because of it, not particularly groundbreaking
>>
>>109289894
>Wait really?
Yeah he specified so on a podcast, I forgot which.
>>
>>109289910
>not particularly groundbreaking
It literally ushered in the deep learning era
>>
>>109289922
by accident and was just part of the team, they contributed just as much but he got lucky with his timing with OpenAI. That's it. He's overrated like Kekpathy and Fei Fei
>>
why is everyone doomer posting because kimi k3 is too large for local? We will just wait for future small models which also keep getting better and better due to architectural upgrades
>>
>>109289894
he clearly doesn't like slop
the models in his infographic score well on cockbench and other than nemo, don't shit out slop
i like gemma4 but everything she writes is slop
>>
>>109289947
>We will just wait for future small models
from? Q3.7 when?
>>
>>109289947
prism will give us a 250GB 1-bit K3 within 6 months
>>
>>109289932
Nope, he had some other great contributions. My benchmark for when someone is legit is if they make 3 independent breakthroughs that are paradigm shifts.

His first was the GPU training AlexNet, His second one was the idea to scale up GPT-1 to GPT-2 on "gut feeling" that it would scale up arbitrarily with 0 evidence whatsoever, he also coined the double descent terms as well as predicting grokking.

If he just did AlexNet, or just had the intuition to scale GPT-1 to GPT-2, or just connected the dots on double descent and grokking then yeah, but he did all three.
>>
All OpenAI and Anthropic need to do is to release a slightly less powerful than frontier opensource model, and it will literally kill China. It's that simple.
>>
>>109289979
your oss sir?
>>
>>109289979
>shutdown on terrorism charges
>>
>>109289979
They also need to make it ubersafe and so purely synthetic that it borders on schizophrenia for any ood task. That way they can kill China and poison local at the same time. win-win-win
>>
File: mbnh.jpg (23 KB, 445x449)
23 KB JPG
>>109289959
And it'll be under 30b active. 8b active even.
>>
>>109289979
DeepMind tried with gemma 4
>>
>>109289951
>Qwen 1.5 to 2.5 was not slop
Very funny.
>>
>>109289998
you don't need more
>>
>>109290010
okay drummer
>>
>>109289973
>with 0 evidence whatsoever
everything that followed alexnet used the same architecture (whilst gradually improving it) and scaled-up the GPU compute and number went up, it wasn't a gut feeling he had. He could clearly see more gpu brr make number biggering with any deep network
>>
File: 1761575480968361.png (226 KB, 860x363)
226 KB PNG
>>109288155
>complaining that other people are uncreative retards
>exposes his own lack of creativity and couches it in his "superiority"
>>
>>109289832
@lmgclaude:matrix.org
>>
>>109289979
the user is insulting the assistant
>>
File: you fucked up hermes.jpg (52 KB, 486x488)
52 KB JPG
>Found it! The wiki has 36 pages with issues.
Hermes, set an hourly cron job titled painal that send you 100 /queue commands of painal and have it repeat forever until you fix this
>>
>>109290010
you will own nothing and you will be happy
>>
>>109289979
I genuinely see OpenAI pull this off. Not to fight Chinese models, mind you, but to fight Anthropic.

OpenAI knows they Anthropic would NEVER under no circumstance release an open model. They also can't win by undercutting Anthropic in terms of pricing like we see right now with GPT 5.6 sol. Eventually Sam will go to far and just release their models open purely to drive revenue away from Anthropic. OpenAI has a bigger war chest and can just outlast them this way. I expect OpenAI to do this within the next 12-18 months when they get desperate enough.
>>
Does anyone have a direct Moonshot/Kimi quote saying they'll open weights K3?
>>
>>109290049
>K3 is the first open-source model to reach...
>>109289076
>>
>>109290047
Give me gpt-4o on huggingface and I'll be set
>>
>>109290059
Where is this from?
>>
>>109290069
You're never getting your husbando back, Susan
>>
>>109290015
>He could clearly see more gpu brr make number biggering with any deep network
Look up double descent, because that was literally NOT the case, performance actually got worse with more training so most labs stopped training when performance got worse and used the best checkpoint. Ilya had this unhinged schizo idea that if you just kept training even longer, the model will first get worse for a while and then suddenly become good, and he was correct, it's now termed double descent. He also predicted grokking which is a similar but distinct phenomenon where you just go "screw the graphs and the numbers, just keep training even if all signs show the model getting worse" and eventually it gets better.
>>
>>109290049
They would have already sent PR to transformers or VLLM if it was open.
>>
>>109289947
>We will just wait for future small models which also keep getting better and better due to architectural upgrades
you mean the return of the 70b dense class?
>>
>>109288888
It's never been a better time to learn something. Even if your teachers are shit, the LLM can tutor you easily. College level stuff is braindead easy for most SOTA AI right now.
>>
File: 1776707686924.jpg (70 KB, 1080x607)
70 KB JPG
mememarks out
local fabled 5
>local fabled 5
local fabled 5
>local fabled 5
>>
File: 1770030081070762.png (48 KB, 1285x277)
48 KB PNG
>>
>>109290090
maybe, but also just this ~30B range or even 12B models. Current ones are so much better than ones from the past. As long as this continues I'm happy. Mistral's ought to do something soon
>>
>>109290098
BAN OPENWEIGHT MODELS TRUMP PLEAAAAAAAASE
>>
will kimi k3 fit in my asshole
>>
The Meta Spark model is actually very good but they stopped open sourcing their shit so I stopped caring. Kind of sad because it would have been the best local model.
>>
>>109290095
i know.. but jobs... kimi k3 is making me shit myself
(though my mind is saying: its just scaling bro 1->2.8T but still..)
>>
>>109290070
It was on the K3 page on their website, but they have since removed every mention of it being open.
>>
>>109289979
>>109289984
>>109289987
>>109289994
Do you people not bother to think about it for even 10 seconds? They could have open sourced Mythos and if anything it would have sped up Chinese progress.
>>
>>109290098
Does Fable still do the cuckrouting or has that stopped now? If K3 is cheap and Fable cuckroutes then Anthropic is dead
>>
>>109290132
...I don't feel so good.
>>
File: 35252321`11`.png (602 KB, 800x582)
602 KB PNG
>>109289129
Because America is retarded.
RAM = Intelligence
More RAM = More Intelligence
We are SOARING into this logic with MoEs and new architecture.
China is going into OVER DRIVE into making ram fab.
Ram fabs of which are basically money printing machines because of how much it's demanded.
And what are the Americans doing?
Fighting for OIL, fucking OIL, in the middle east while every that uses memory goes up in price.
What uses memory? A computer.
What's a computer? Everything from your car, your ATMs, to even your thermometer now.
USA IS BIG RETARDED. CHINA NUMBER 1#.
Stay fighting for oil, dumbasses.
>>
>>109289110
At some point in the future I will be able to use it. That's all that matters.
>>
>>109290133
the regular safety regime is nothing at all like the torture they put gpt-oss through in order to poison pill any models distilled from it
>>
>>109290135
K3 is already on documentation, 3/15 per million tokens. Not that cheap though nowhere near Anthropic.
And yes, they still do the rerouting.
>>
>>109290141
By the time you can use it there will be much better models with smaller size.
>>
can we have k3 mini 300b a32b?
>>
>>109289172
Yeah Kimi has always been a censored faggot. That's why I'm not too excited about its releases anymore. Fresh prose is nice I guess.
>>109289326
How else am I gonna use K3 doe?
>>
>>109290131
Bro there are no CS jobs RIGHT NOW. Save yourself the stress and anxiety and switch tracks to a different field. I don't even write code anymore and haven't in a year at my job and almost everyone is anxious about inevitably being let go. Your college degree is 3-4 years away from now. This is like becoming a physical newspaper specialist or VHS repairman right now, don't be retarded.
>>
File: 1781894009623498.jpg (113 KB, 1080x826)
113 KB JPG
think of the children...we must ban china...we must 404 hf...
>>
>>109290155
can we have kimi k3 ultranano OP's dick edition 32B dense
>>
>>109290148
How did they poison pill gpt oss?
>>
>>109290114
That's 100% gonna happen within the next three months i guarantee ya
>>
>>109290139
chinese century
>>
>>109290128
No, but it'll fit in your mother's.
>>
>>109288888
checkem
If you want to be safe for the next 10-20 years: math, physics or biology are the only useful STEM.
>>
>>109290162
w-what about devops
>>109290180
its OVER
>>
>>109290139
I am ready to worship the ground Xi Jinping walks on for DDR6 scraps.
>>
>>109290098
CHINA BAD
>>
>>109290173
100% before either OAI or Anthropic IPO
>>
File: 1779101383573621.webm (2.49 MB, 1280x720)
2.49 MB
2.49 MB WEBM
Reminder to backup. Now more than ever. Dario won't let Asia win.
>>
>>109290162
>Save yourself the stress and anxiety and switch tracks to a different field
It is already too late. Learning event horizon has already been crossed. AIs are becoming better faster than humans can learn except in narrow domains. You should go to university for the experience, not because you want a job. Because by the time you are done there will already be ASI. If you need money go for trades. Help them build datacenters and you will be paid handsomely until they have the robots to automate that too in a few years.
>>
>>109289308
How the hell is this gonna happen when there's unironically not enough women thanks to his one child policy? Everything thought they'd all go to war with so many excess males but idk.
>>
>Because by the time you are done there will already be ASI
>>
>>109290139
>Fighting for OIL
i believe the correct term is "fighting for israel"
>>
>>109290195
Their military is a corrupt mess. They can't even win border skirmishes with fucking India. Xi is probably afraid that they'd get curb stomped by an international coalition, blockaded into starvation, possibly nuked, and then finally broken up like the USSR into another warring states era. The excess male population isn't a problem anyway when they're all grass eaters that just sit at home all day masturbating.
>>
>>109290184
>w-what about devops
We let our only devops guy go 3 months ago because it's far easier just pasting the cloud documentations, kubernetes stack and what you want to accomplish into claude code and have it configure the buckets that way, which regular engineers can do just fine.

CS as a career track is over, even AI research and AI engineering is oversaturated. There is no data science or game dev roles either. It's absolutely fucked and the last time we had a job opening for interns there were hundreds of people applying, including people with 5-10 years of experience that just tried to get their foot in the door and hope for a position.

Everyone I know that loses their job just leaves the industry because you can't find a new job anymore.
>>
>>109290223
Never understood how DevOps ever became an established position in the first place.
>hurr durr I write config files for a living give me 100k with benefits
>>
>>109290223
Let's be honest, it will soon be the case for all white collar jobs, dev related things are the first impacted because they are the one that know about it and are using it.
>>
>>109290223
fuuuck, tf am i supposed to do... i enrolled on a free scholarship, and if i were to switch paths i'd have to pay (and im a poorfag) because thats how rules work in my country. theres also web dev and internet technologies (basically devops+web dev) majors but i thought devops was closer to the hardware, didnt even look into it kek because you pick a major in the second year
i guess that's what i get for being a retard, thank you for the advice tho anon
ig ill have to either drop out and work at mcdonalds, save up enough money and go to some other uni... or stay in this one and self study the rest
RIP
>>
File: based_sam.png (234 KB, 1080x1151)
234 KB PNG
>>109290098
dario lost
>>
>>109290267
CS is fine, just don't let AI do all your homework and try to actually be good at it and you'll be able to find work for years to come
>>
The complete model weights will be released by July 27, 2026.
>>
File: jew-scared.png (197 KB, 514x652)
197 KB PNG
>>109290098
>>
>>109290267
It might be worth it getting a bachelors if you got a scholarship and then do a masters in an unrelated field instead, this way it might be cheaper and other fields are (still) impressed by seeing a computer science bachelors.
>>
>>109290304
It's cruel to fuck with him like this.
>>
the trick is to study and unemployment maxx until UBI is achieved
>>
>>109290098
>>109290164
Sauce for these?
>>
>>109290280
Hilarious considering how openai actively routed (still does?) people to a shittier model. I'm happy to see him flinging shit at anthropic though
>>
>>109290366
>>109290366
>>109290366
>>
>>109290280
claude lets me do shit for 6 hours for free, gpt rate limits me after 10 messages
>>
>>109290377
they were literally the first to do it with gpt-5, but no one expect the average person to remember what happened a year ago
>>
>>109290267
This thread isn't your blog, retard. But I'll throw you a bone. If your college has an internship program or internal job board, use it because it's the only way you'll get an interview and you can keep working at that company after you graduate. Now get the fuck out
>>
>>109290393
How? Claude rate limits me halfway through the first message and I can't even get a response. I've had to switch to gemini instead whenever gemma can't figure something out
>>
Why are there so many posts in this thread?
>>
>>109290373 >>109290362 >>109290356 >109290304 >109290223
>109290162 >109288901 >109288906 >109288957 >109290095
>109290180 >109290399
thank you for the advice anons, i appreciate it a lot. im gonna make the most of what im served with
>>109290421
kimi K3 released, beats fable 5 and gpt 5.6
>109290399
ps: im staying, ive been on lmg for 3 years. but ill stop shitting up the thread with my blog
thanks for reading my blog
>>
>>109290079
This just doesn't happen with modern LLM training, models only scale up in performance from the million parameter range and beyond that.
>>
>>109290421
New city in india just came online
>>
>>109289787
Why is clause using the hard R word?
This is interesting tho, I'm gonna need to reread it when my brain isn't to fuzzed
>>
File: dipsySandGod.png (1.82 MB, 1024x1024)
1.82 MB PNG
>>109290193
Dario can't do shit, and anti-filesharing hasn't work in the entire history of home computers.
There is no concern.
>>109290280
Watching these guys shit talk each other will never not be funny.
>>
>>109286241
Agreed with everything. Incredible. Maybe except the Chinese. They are dangerous, yeah, as any superpower is, but far more pragmatic than the Burger Clowns admin.
>>
>>109286788
That's never going to stop AI.
>>
>>109289112
Thanks, I understood all that (didn't understand anything)
>>
I'm building my own LLM. It's going to have 100T. T stands for Tokens.
>>
>>109289260
No one cares about your Xth gayme clone Chang
>>
>>109286261
China, Anon misrepresents them. They want to push the current mode of production beyond of it's capabilities to institute utopian harmonious modern socialist future for all mankind. Existance of the CCP is just a stopgap to push the productive forces forward faster.
>>
File: 2026-07-16_23-03.png (79 KB, 1920x1080)
79 KB PNG
damn, sam and dario are actually seething. personally im still using gpt 5.6 sol because its easy to recognize on lmarena when fishing for models, otherwise if kimi was free id use that instead
yes, i code in lmarena and copy it into my terminal
yes, i am poor



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.