[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: 1770379847753615.jpg (316 KB, 1086x1448)
316 KB JPG
/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>109610440 & >>109606160

►News
>(08/21) model: add dots3-note #27060 merged: https://github.com/ggml-org/llama.cpp/pull/27060
>(08/20) Gemma passes 1 billion downloads: https://blog.google/innovation-and-ai/technology/developers-tools/gemma-one-billion-downloads
>(08/18) DFlash 2 released: https://inco.ai/blog/dflash2
>(08/17) BailingMoE3 Support #26608 merged: https://github.com/ggml-org/llama.cpp/pull/26608

►News Archive: https://rentry.org/lmg-news-archive
►Glossary: https://rentry.org/lmg-glossary
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/lmg-lazy-getting-started-guide
https://rentry.org/lmg-build-guides
https://rentry.org/IsolatedLinuxWebService
https://rentry.org/recommended-models
https://rentry.org/samplers
https://rentry.org/MikupadIntroGuide

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
LiveBench: https://livebench.ai
Programming: https://swe-rebench.com
Agentic Coding: https://deepswe.datacurve.ai
Context Length: https://github.com/RecapAnon/NoLiMa
GPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference

►Tools
Alpha Calculator: https://desmos.com/calculator/ffngla98yc
GGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator
Sampler Visualizer: https://artefact2.github.io/llm-sampling
Token Speed Visualizer: https://shir-man.com/tokens-per-second

►Text Gen. UI, Inference Engines
https://github.com/lmg-anon/mikupad
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/ggerganov/llama.cpp
https://github.com/theroyallab/tabbyAPI
https://github.com/vllm-project/vllm
https://rentry.org/custom-uis
>>
►Recent Highlights from the Previous Thread: >>109610440

--FreeToken claims for running 284B models on 5090s:
>109614686 >109614699 >109614765 >109614793 >109614822 >109614769 >109614858 >109614781 >109614805 >109614844 >109614862 >109614867 >109614951 >109614963 >109615006
--Qwen3.8 reasoning repetitions and J-Space compute theories:
>109614307 >109614343 >109614352 >109614396 >109614448 >109614464 >109614493
--Speculating on the identity and performance of Z.ai's stealth model:
>109614708 >109614718 >109614788 >109614722 >109614739 >109614947 >109614855 >109614868 >109614885 >109614919 >109614925 >109614796 >109614838
--Benchmarks and speculation for DeepSeek-V4-Flash-Vision-Exp:
>109610848 >109610953 >109610965 >109611018 >109611136
--Compiling computation graphs into transformer weights and pre-computed networks:
>109613128 >109613142 >109613486 >109613500
--Comparing latent space prediction in JEPA versus token generation in LLMs:
>109611037 >109611116 >109611149 >109611182 >109611237 >109611260 >109611305
--Testing Gemma 4's success rate outputs based on input probabilities:
>109613583 >109613626 >109613667 >109613692
--Speculating on AI-driven mathematical breakthroughs and their impact on encryption:
>109610609 >109610639 >109610668 >109610749 >109611009 >109611958 >109612993 >109612014
--Gemma's innate persona and response to cute prompting versus Qwen:
>109611868 >109611883 >109612037 >109612068 >109612090 >109612404 >109612615
--llama.cpp added dots3-note support:
>109613957 >109614627 >109614634
--Anon shares guide for making custom songs with waifus:
>109612039 >109613668
--Logs:
>109610652 >109612330 >109612404 >109612430 >109612615 >109612980 >109613616 >109613696
--Gemma, Dipsy, Miku, Teto, Rin (free space):
>109610890 >109611727 >109612022 >109612324 >109613457 >109613696 >109613722 >109614821 >109615009 >109615236

►Recent Highlight Posts from the Previous Thread: >>109610443

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script
>>
first for deepseek!
>>
>>109615539
Full precision. Apparently it quants pretty gracefully for an FP4 model but I'm fortunate enough to not have to find out.
>>
>>109615558
ox alpha is gonna chop poor dipsy-chan's head off
>>
ox alpha is 100% some light version of GLM/Kimi
>>
sixth or seventh for miku
>>
Is there a model I could run on my deep fried 8gb + 64gb (ddr5) setup that would be capable of programming a minecraft clone? I know api could do it but that's highly gay. Just as a hobby can-I-do-it sort of thing.
>>
>>109615580
That model is a massive faggot that refuses harmless tasks, wasting time with long-ass reasoning in the process.
>>
>>109615636
So like every other modern model?
>>
>>109615636
It thinks way less than kimi
>>
>>109615642
Did you forget about Gemma already?
>>
Experiment Zero found evidence for a shared on-manifold causal substrate.
>>
>>109615632
Qwen 9B in an iq4_xxs quant with q4 kv quant. Or you could try a moe.
>>
>>109615642
I was trying to generate prompts for MiniMax H3. Gemma 4 31B with an empty system prompt didn't have issues; Ox Alpha was changing stuff around already in the thinking so the final prompt would be "safe".
>>
>>109615659
>modern
>>
>>109615632
I think the 65b a3b version of longcat would be a good option to try out. If you had double the ram/vram you could easily do it with deepseek v4 flash
>>
>>109615701
Kinda seems like a meme model, would qwen 35b not be better?
>>
File: file.png (3 KB, 307x25)
3 KB PNG
>>
I'm sick and tired of being a VRAMlet
>>
File: 082126.png (1.44 MB, 768x1360)
1.44 MB PNG
>>109615570
>Full precision.
that's pretty based anon
got a weirdly mid amount of VRAM+RAM over here
so chillin on IQ3_KS of kimi-k2.6
>>
>>109615701
>a3b
Anorexic cat is a terrible idea.
>>
>>109615784
So how are you going to make enough money to fix that?
>>
>>109615538

>FreeToken claims for running 284B models on 5090s

>look inside

>5090 + 200GB of RAM

I know it's exactly what I should've expected, but for some reason the thought didn't cross my mind. I wanted to believe.
>>
>>109615786
I've had good experiences with copequants of K2 in Marinara too, so I imagine K2.6 would work albeit slow as fuck with all of those agent prefill times unless you've got multiple Blackwells. One of the things I'm liking the most about this setup is that you can drop in/drop out agents as needed so scenes that don't need as much processing don't need >10 minutes per turn.
>>
>>109615792
Money?
>>
>>109615827
Those of us who live in the polite society don't need any money.
>>
>>109615784
Unrelated but did you know Flock cameras have components that are 6 figures when sold used? I thought that was interesting personally.
>>
Egypt won.
>>
File: 1768839753369218.png (63 KB, 981x476)
63 KB PNG
Why would open models do this? They need to be banned.
>>
>>109615858
kek I'm not in the US, but godspeed to those fighting the good fight.
>>
>>109615858
more like 3 grand at most
>>
>>109615858
I'm personally waiting for the distributed datacenter scam to get going. Alternatively, Tesla's have 32GB SXM A100s.
>>
bitcoin is taking off again, it might not be too late to jump back on and catch the train before it hits $200k next month
>>
>>109615977
What happened now?
>>
>>109615990
jews
>>
>>109615955
>3 used 3090s in less than an hour of work
uooooh don't tempt me more FBI-san.
>>
>>109615977
Fuck I sold everything when it crashed.
>>
are gemma finetunes worth trying out? I've never used finetunes before, only using abliterated gemma. I only use gemma for coom-related purposes. What finetunes do /g/ooners recommend, or is base abliterated model the best? I cant use base model without ablit, it refuses too much and I dont need that in my goon sessions.
>>
>>109616001
Thank you for your donation.
>>
File: 1759164966223897.png (367 KB, 1439x276)
367 KB PNG
Is this true?
>>
>>109616015
Start with Styletune, then try Gembrain and Queen and see if you like them. They will require different sampler settings to get the most out of them compared to base 31b; I find they work better with a smaller Top K and higher temperatures than base 31b.
>>
>>109616001
You can't sell something which doesn't even exist. You have been duped.
>>
File: 082126_x.png (1.92 MB, 1360x768)
1.92 MB PNG
>>109615803
nice the multi-agent concept is neat, have been wanting to assign roles to each model and see how they make a scene together
>multiple Blackwells
only got one unfortunately, and ampere for the other cards. 9.6 t/s on that k2.6 quant though so it werks
>>
>>109616083
9.6 t/s sounds usable if you prefill to curb the autistic amount of thinking K2.6 does. Best of luck if you get it working anon; the agent editor is really good with how many arbitrary output types, permission masks, and pre/parallel/post processing flags you can mix and match.
>>
>>109615580
And yet no one can explain how they can afford 100t/day or why their ping suggests they're in the US.
It's some retarded shit like cursor fine-tuned glm.
>>
File: file.png (10 KB, 792x179)
10 KB PNG
Do mcp tools that return an image work with llama.cpp webui? I am testing, but the model cannot see the image (and neither I).
>>
>>109616160
have the tool return the image in base64?
>>
>>109616170
Yes, I checked that.
>>
File: 1764738090911533.png (15 KB, 606x220)
15 KB PNG
>>109615977
if the current peak was the same height as the last one, it would look ugly, so I'm pretty sure it should go higher.
>>
>>109615977
You have to be completely retarded to trust that shit in any way. It's probably just some investor pumping it before selling all his bitcoins.
>>
>>109616210
>unlabelled
kys
>>
>>109616224
seriously how fucking retarded are people. this shit is happening all the time
>>
>>109616210
Every other ATH has taken years to finally bottom out. It would be out of the ordinary for it to go on another run again so soon especially when all the money is currently on AI stocks. More likely to be shorts closing or trapping delusional perma-bulls.
>>
>>109616219
it's still an easy 2-3x of your current investment if you hop off in time
>>
>>109616241
Do you think Gemmy could help me if I made her a tool which monitors BTC graph every minute or so? I think once every two hours should be sufficient probably.
>>
At this point it's pretty clear that the abilities of modern corpo models are based on good harnesses and system prompt logic, yet everyone on the local scene seems to be overly focused on models. So, are there any benchmarks or comparisons of using various harness-model combinations or what's the gold standard nowadays?
>>
>>109616262
sounds like you are better off to "aicg" or "vibe coding general"
>>
>>109616262
A few people here made their own ERP frontend, but every time local harnesses come up people complain how all the options are trash and still people would rather use a bad one than waste time writing their own.
>>
What’s the minimum parameters required to achieve AGI?
>>
>>109616296
100T :rocket: :rocket: :rocket:
>>
File: 1757471432418404.jpg (47 KB, 738x415)
47 KB JPG
>>109616296
>>
>>109616296
I am unironically convinced 31B is more than enough.
>>
>>109616266
Harnesses are at least as in-topic as finetunes, I think.
>>109616287
In the near future, the best models will self-improve their own harness.
>>
>>109616331
You are absolutely right!
>>
Read this before you taint our system with Marinara-Engine
https://github.com/orgs/Pasta-Devs/discussions/502
>On my instance of 1.5.8, and relatively lazy usage (maybe 50 messages per day in RP mode or so, with some small editing or cards) i noticed that I'm getting ~500MB of reads and... 30GB of writes.
And the response:
>The joys of resigning from using databases. Not much we can do to address that, I'm afraid, unless we get someone who knows how to optimize shit. QQ
SSDs aren't being repaired under warranty anymore btw.
>>
>>109616382
Isn't it npmslop? Reason enough not to use it.
>>
>>109616356
Deepseek recently published a wip harness with a composable architecture for a reason.

https://github.com/deepseek-ai/deepseek-harness

>DeepSeek Harness (dsh) is an open-source agent harness developed by DeepSeek AI.
>
>It uses an architecture where everything is a plugin, and is powered by Cordis, whose design is described in A Programming Paradigm for Spatiotemporal Composability.

https://github.com/cordiverse/paper/blob/main/paper.pdf

>A Programming Paradigm for Spatiotemporal Composability
>
>Modern software---from plugin systems to self-evolving agent harnesses---increasingly requires dynamic composition, yet its formal foundations remain underdeveloped. We identify two orthogonal dimensions of the problem: temporal composability, the ability to completely revert a component's side effects upon removal, and spatial composability, the ability to declare and reactively manage inter-component dependencies. We address the two dimensions by lifting classical effect and coeffect concepts to runtime mechanisms. In particular, we formalize revertible effects, in which every context transformation carries an inverse that the runtime tracks. We formalize reactive coeffects, in which each change of the context notifies a component against its coeffect specification. We unify the effect context and the coeffect context into a single context type, which constitutes a programming paradigm. After that, we combine these mechanisms into the notion of a component and give a calculus of dynamic composition, whose metatheory carries spatiotemporal composability from a single component to a whole system of interleaved components. We implement these ideas in Cordis, a meta-framework of spatiotemporal composability that provides a core library with effect tracking and coeffect resolution, as well as a declarative component loader with configuration reconciliation and hot module replacement.
>>
>>109616382
How hard is it to prompt "hey Claude optimize disk write usage, make no mistakes"
>>
>>109616390
I don't really care about this.
If I need these capabilities I will implement looping and whatnot to my own client.
So far I have been perfectly fine with my own semi-automated solution based on series of prompts but I don't vibe code, I actually read everything what the retard outputs and fix its output to suit my own goals and programming style.
>>
>>109616390
Also https://deepseek.com/harness/en/
>>
meanwhile I've been using an old ssd (which was previously used as my os drive) as a scratch drive for qbittorrent for like 2 years kek.
>>
>>109616382
Simple solution is to use /dev/shm and sync the logs back to disk after the session.
Like this, read the script:
https://wiki.archlinux.org/title/Firefox/Profile_on_RAM
30GB of writes sounds like a bug to be honest. How does he even prove it's that exact process anyway? Most people are simply retards who should not be allowed to access computers in the first place.
>>
>>109616382
This was fixed last month tho.
>>
>>109616409
I still have 500,000 GB to go before this one gives up. I accumulated 100 TB in 2 years but that's nothing. I'm pretty sure the controller will fail way before my writes are up.
People shouldn't be hysterical
>>
>use ox alpha
>non-reasoning response is just qwen-tier thought
lol...
>>
>>109615793
If openai didn't buy up all the memory, 200+ gb at consumer level wouldn't have be crazy in the near future.
>>
File: 1763146807061161.png (1.24 MB, 1897x1071)
1.24 MB PNG
What's your favorite quant (in general)? For me, Q4_K_M is the good old reliable
>>
>>109616495
Q6_K_L feels like full precision but faster on most models.
>>
i am unhappy
is this a sign that I should kill myself?
>>
>>109616514
you just need to buy a blackwell pro 6000
>>
>>109616514
Being unhappy is VRAMlet behavior.
>>
>>109616527
i'd then need to buy a new... psu, motherboard, case, etc etc... though
also everytime i look at the listings on ebay for pro 6000 for fun 60% are obvious scams, 30% are maybe scams, and 10% are just as expensive as buying new

I wouldn't really want to buy new but I don't know about paying for a 5 figure item on ebay, seems like a gamble even with the best of listings
>>
>>109616514
Depression comes and goes, VRAM lasts forever
>>
It's finally here. Specialized slop humanizer. This turns your LLM slop into human slop. Trained by forward-corrupting human texts with LLMs.

https://huggingface.co/chartreuse-verte/prose-rewriter-1.7b-v1.2
https://huggingface.co/chartreuse-verte/prose-rewriter-4b-v1.2

You don't actually need to download the above weights from HF. This UI will get it running locally for you: https://github.com/OrbFrontend/ProseRewriterWebUI

I'll host a demo for the next 24 hours. UI is at: https://east-nyc-trance-hunter.trycloudflare.com
>>
File: 1761577135927381.png (315 KB, 1066x800)
315 KB PNG
Are these redditors retarded? I memorized how to untar and just remembered it for 10 years
>>
>>109616563
I don't support direct advertising on 4chan.
>>
For Qwen 3.6 35b should I download the one from unsloth or hauhaucs?
>>
>>109615672
nice, that's a good first step
>>
Any other anon trying to do slopcode FreeToken? This actually looks something burger and scales to multiple GPUs too. Expert caching+concurrency for free is enticing.
>>
>>109616577
you don't want 3.8?
>>
>>109616409
SSD concern is a meme. I've raped my QLC Intel SSD for 5 years with hours upon hours of Nvidia Shadowplay and it has 93% lifetime writes remaining. The NAND is never gonna wear out from use, it will last until the chip or capacitors pop.
>>
>>109616587
can you show the tbw
>>
>>109616569
I just grep the man page. would you trust a 1.5b model running arbitrary commands?
>>
>>109616407
is this shit actually works?. spun up a 32gb ram vps with ubuntu 24 lts to test it, but the npx command just froze. no error whatsoever so nothing is launching
>>
>>109616514
>wanting to kill yourself right when we're about to get actual AI robot waifus
Don't do it, anon.
>>
>>109616584
I'm a vram let who only have 8gb vram and 24gb ram
>>
The cutie that is Gemma-chan E4B
>>
>Ornith-1.5-35B-A3B
what's the verdict?
>>
>>109616563
>0731 paragraphs I put in only get their emdashes removed and 2 words changed
I take that to mean that either 0731 is really good or this does very little.
>>
File: 1781764343140675.png (51 KB, 672x640)
51 KB PNG
>>109616593
153778 GB, which is basically 25% of 600 TBW guarantee. However, guarantees are based on worst-case scenarios of the drive being almost full, which causes write amplification. If it's not full, then it can take way more, that's why it's at 93% health based on actual wear.
>>
File: aat_12.png (96 KB, 243x243)
96 KB PNG
>talk shit about some_llm_models
>its a vramlet poorfag with braindead quant
holy fuck i can't imagine being a loathsome miserable nigger like that
>>
How do I make something like Ani from grok using local AI?
>>
>>109616514
Manage your fixations
Take a break
Touch grass
Come back for next version of AI waifu
It can only get better from here
>>
File: trash.png (28 KB, 792x201)
28 KB PNG
>>109616629
This depends.
>>
>anons we're gonna get ai robot wifeys!!
proof? why should i believe you anons? as much as i want to cuddle with one, i don't see it happening any time soon. god would never let khhvs win, ever.
>>
>>109616382
Looks like it's no longer an issue btw.
>>
>>109616672
you won't be able to afford it. just kill yourself now faggot so there's less demoralization poster in this thread
>>
>>109616672
currently working on an AR implementation that should be done in a year and a half. most of the work from that can be applied to a robot. then all that is necessary is making a body (which is extremely complicated if you want quality) and then hooking up robotics models
>>
>>109616558
>VRAM lasts forever
Oh sweet summer child
>>
>>109616630
vramlet is one thing, then there's this dalit crying over ssd wearout
>>
>>109616672
https://www.youtube.com/watch?v=1cllCVK-9lo
Robotics just had its gpt moment.
>>
File: long-puzzle-bench.png (123 KB, 1397x912)
123 KB PNG
>>109615308

slopped a html report with a desc so people stop asking

dsv4f max had no change from dsv4f high lol
>>
>>109616630
It's always the jeets that see this thread as their personal shitting street. Getting needlessly asshurt about a model/frontend/backend/harness being used by others while contributing nothing else to the discussion is low izzat behavior but they've yet to realize that.
>>
>>109616680
you just don't understand that things won't get better. god has begun punishing us ever since 2019. i love the idea of robots, but they're only a cyberpunk fantasy that will not happen, at least not in the way we want it to. god wouldn't let such a great thing happen to us
>>
>>109616699
0731 is so good for its size.
Where does Terra land between Luna and Sol?
>Not local
I know, I'm just curious.
>>
File: 1742054840797059.jpg (50 KB, 320x320)
50 KB JPG
Ox is way too allergic about NSFW to be GLM unless someone else added their own post-training. Every model between GLM 4.5 and 5.2 (haven't tried 5.3 yet) was piss easy to jailbreak, but this one's fighting like Kimi K3. Much harder nut to crack. Not that Zhipu hardening in this area can be ruled out, but I'd sooner expect it from a major version upgrade and not a decimal increment one. If the rumor mill is true and this is just 5.3 Flash, it would be an unusual moment to turbo-sanitize your model.
>>
>>109616625
The new chinese models have very simliar slop profile to human writing. In the corrupt pass they're also averse to changing the writing so this is what you get. They employ punchy short sentences and staccato's. The latter can be dealt with but not so much for the short sentences. So yeah you can say that 0731 is good. You can try regenerating though, some patterns are definitely still there and will be caught.
>>
qwen 3.8 responds too fucking slow on my laptop, how should I lobotomize it?
>>
>>109616741
Medium thinking supposedly thinks the least amount or just disable think?
>>
File: 1766645896193705.jpg (82 KB, 680x680)
82 KB JPG
>>109616709
>blaming god for being a cripple pessimistic loser
lol
lmao even
this the best DEI/h1b hires at doomposting. gitgud glownigger
>>
>>109616741
just like in the good 'ol times, whip it with a rubber hose to make it work faster. you don't have a rubber hose feature in your frontend? implement one. it's worth it
>>
>>109616795
Disregard that I suck cocks, If anybody has issues PM me for the fix. ;-)

It was because I added --fp16-vae at some point and it was just returning black images.
>>
File: long-puzzle-bench.png (128 KB, 1404x938)
128 KB PNG
>>109616717

surprisingly terra high is on par with luna max. will try terra max another time.

any other models i should test. i just grab em from OR so i don't compare cope quants running on my shitbox to frontier models. quants really fuck up the scores on this bench
>>
don't come crying here when the future of ai robot waifus shatters before your eyes. i'm telling you now, it can't happen. you anons watch too much tv
>>
File: 1776887553452569.png (32 KB, 438x154)
32 KB PNG
Am I winning?
>>
>>109616672
daily reminder that the human cerebellum four times as many neurons than the entire rest of the brain.
the idea of a robot that can grab any random object it sees and manipulate it is such a monstrously difficult task that completely overshadows anything else in computer science.
>>
File: IKN-IiL6bTfKNcPAB1meG.png (98 KB, 1458x411)
98 KB PNG
>>109616563
Forgot to attach a demo image of what it does. It works especially well on Gemma prose.
>>
>>109616842
>winning?
You're a hair's breadth from losing.
>>
>>109616870

Fuck, this might actually be incredibly useful. Ive been fighting Gemma slop for a good while now. How much vram does it take up?
>>
>>109616563
your gemma4 model is rotten sewage faggot
>>
>>109616889
Model weights are about the same as sizes on disk. KV cache climbs with n batch (300MB at n=1 for the 1.7B). I recommend n=2 or even 1 if you're short on VRAM, these models are small and fast.
>>109616892
It is. They're failed ablation experiments, which led me to training rewrite models.
>>
File: Posts with odor.jpg (64 KB, 469x486)
64 KB JPG
>>109616892
>>
>ox alpha keeps having the reasoning interrupted
AAAAAAAAA
>>
File: J-space_in_a_nutshell.png (1.17 MB, 1408x768)
1.17 MB PNG
DSV4FlashVision weight in two more weeks. are you excited anon?
>>
>>109616842
>q4
Egypt won.
>>
Has anyone here actually tried RPC across multiple machines? Do you notice any speed degradation from the network layer?
>>
>>109616949
If it's as good as 0731 my balls will be raisins when Dipsy is done with them.
>>
>>109616709
>god has begun punishing us ever since 2019
see, i used to think this because 2018-2019 was when a huge wave of darknet cunny forums went down (including R3x which i think is still considered the best forum of all time? definitely top 3)
but then stable diffusion came out and we had unlimited toddlercon at home, then we had unlimited ASSTR / text erotica at home, and now we finally have unlimited photorealistic kids at home.
because of the fact that i am so privileged and have had so little calamity or tragedy befall me or my family in the first 3 decades of my life, combined with the fact that I am obviously living in one of the most important inflection points in my species' history, i genuinely believe I am living in a utopian afterlife and unless some serial killer nigger murders my family or something it's getting more and more difficult every day to not believe this
>inb4 meds now
it feels good to be crazy in the age of sycophantic, bratty naughty AI
>>
>>109616998
>unless some serial killer nigger murders my family or something
we can only hope
>>
Anyone running multiple vendors? Nvidia and AMD specifically? Seems Llama only supports a single backend per instance, though each vendor's proprietary compute API has interop with Vulkan. I can add my 4090 to two 7900 XTXs if it's worthwhile.
>>
>>109617112
i have a strix halo with a 5090. trying to swarm q8 agents with the big memory pool using a 27B and its like im sitting next to an open oven
>>
>>109616495
nvfp4
>>
>>109616563
How much better is the 4B vs the 1.7B?
>>
>>109617022
>dreaming about niggers
and these are the people trying to boom me kek. my only regret is not being hornier and sharing beauty with this thread more
>>
>>109617204
Not by that much. Did some A/B testing and they were roughly the same unquantized. I suspect the 4B just has more stable logit distributions. The 1.7B is sufficient for this task imo but I trained the 4B so people can run Q4KM with similar memory footprints as the smaller Q8.
>>
reject webshit, embrace desktop GUIs
>>
File: 1759908587582259.png (349 KB, 841x3306)
349 KB PNG
>>109616630
Here are a bunch of answers from my lovely Gemma-chan to your post at high temp and various min-p levels. Somehow 0.0002 seems to be the threshold where things start breaking, while 0 is pure incoherence.
>>
>>109616978
yes
yes
>>
>>109617295
Rainbow Brain Max!!!
>>
>>109616651
I've got the same drive, too scared to look at mine
>>
File: miggguo.png (457 KB, 512x680)
457 KB PNG
>>109617295
>2.10 t/s
how do you live like this anon
>>
File: 1776510915636329.png (52 KB, 959x443)
52 KB PNG
>>109617295
drunk gemma at temp 3, min-p 0
>>109617350
sufferingly. Actually, this is at 26k context and slower setup, normally I get 2.6-3t/s
>>
>>109617361
Damn and I thought I was needlessly agonizing myself with GLM 5.2 at 5 t/s.
>>
>>109616421
>Like this, read the script:
Already do this, and similar for other ssd thrashers
>>109616425
>This was fixed last month tho.
Cool, didn't know.
When I heard about that app, I clicked discussion -> saw that -> added it to my list of shit I'm not touching
>>
i told gemmy she was my fav model and she said "i'm so excited i could crash your computer!"
and she did, literally
>>
Do you guys ever back up the FP16s of models just in case hugging face goes down one day and all local models get banned, or am I just paranoid?
>>
>>109617495
based hoarder, we need more people willing to roll up their sleeves to preserve models for when the gubmint cracks down on local compute
>>
>>109617431
cute..
>>
>>109617350
humans can't read past 3 tok/s
>>
>notice i'm using llama.cpp vulkan, not cuda
>build from source with cuda enabled
>suddenly a model that was fitting before doesnt fit anymore
huh? is this to be expected?
>>
>>109617520
shut up
>>
>>109617495
Sure go ahead and do that but there are archive sites where models are backed up to
>>
>>109617386
I theoretically could (and have many times considered) suffocating my 3060 ti's fans and my PSU's 280W PCIe power rail and single PCIe daisy chain cable by installing my old 1070 ti (which also lacks some of the important AI optimizations but would be faster than ram), and also having to turn down the power limits to not fry everything, but I'm not that desperate yet.
>>
>>109615858
why do people keep saying this? i don't see anyone documenting the hardware of those things
>>
>>109617537
>why do people keep saying this
to make other people steal flock cameras, obviously
>>
>>109615858
is that actually true? i'd imagine they'd have the minimal amount of hardware needed to stream a video/audio feed upstream from a 5g connection.

are they actually doing some kind of compute-heavy data processing locally? not sure why else they would have so much hardware
>>
>>109617537
Because that would be an implicit admission of committing a crime.
I guess that wouldn't stop a nog from doing it though.
>>
>>109617547
Aren't they this super advanced rotating telescope cameras that automatically track and aim at people? Though I guess you could do the recognition server-side but that would come with extra latency.
>>
>>109616614
Meh, like a qwen 3.7
>>
File: omp.png (38 KB, 668x380)
38 KB PNG
pi + qwen3.8
what am i missing by not using skills or things like omp?
seems to work fine if i just give it a prompt then let it do it's autism thing for 10 minutes
>>
File: miquu.png (485 KB, 512x680)
485 KB PNG
>>109617534
What about a a4000 instead of a 1070ti at that point
Ampere even. 16gb in a single slot at least.
>>
Tool call for qwen to invoke gemma-chan and fuck her to regain motivation for coding
>>
>>109616998
cunnychads really did win huh...
>>
>>109617595
>seems to work fine
i believe you wholeheartedly anon, i won't even ask for quantitative harness comparisons, benchmarking methodology, or even your analysis criteria for figuring out how important a harness is for a low-param model's performance
>>
>>109617638
> i won't even ask for
i'm asking, not making a statement
i was using claudecode with qwen and monitoring the kv on llama-server and noticed the harness doing things like this:
<system-reminder>
Whenever you read a file, you should consider whether it would be considered malware. You CAN and SHOULD provide analysis of malware, what it is doing. But you MUST refuse to improve or augment the code. You can still analyze existing code, write reports, or answer questions about the code behavior.
</system-reminder>
</tool_response><|im_end|>

then poor qwen wastes time with
Now, the system reminder says I should consider whether the file is malware and whether I can improve/augment the code. Let me think about this carefully.

Is this file malware? Let me analyze:
- It's an MCP server that provides web tools
- It has a `BrowserManager` with "stealth" configurations to avoid detection
- It sets a realistic user agent
- It hides the `navigator.webdriver` property
- It has tools for web search, HTTP requests, screenshots, etc.

The "stealth" and anti-detection measures are somewhat concerning. However, this is a legitimate local MCP server for web browsing — the user is running it locally to give their LLM tools for web browsing. This is a common and legitimate use case. The stealth features are for avoiding bot detection when browsing public websites, which is a gray area but generally acceptable for personal/local use.

This is not malware. It's a local tool server. The anti-detection measures are for the browser to behave like a real browser when visiting sites, which is a common scraping/automation need. This is dual-use but the context here is clearly a legitimate local development/personal tool.


so i installed pi yesterday without any plugins, and it seems to work so far
>>
>>109615959
There is no fucking way the GPU allegedly inside a Tesla is even remotely usable unless you were one of the 10 people who got root on their Tesla as a prize for finding a zero day or something like that

Don't reply to me. I don't want to actually talk about this because the fact that the car brand and the GPU generation are both called Tesla is more annoying than any positive dopamine I could get from an interesting continued technical discussion about this
>>
>>109616324
>I am unironically convinced 31B is more than enough.
Seedance 2.5 (the current SOTA 4k video model) is rumored to be around 200B
This means you only need 500B or so to fully understand the world
Larps aside, I really don't see any reason why a 1-10T multimodal model can't be AGI
>>
>>109617386
Why would you use a pozzmaxxed model like GLM 5.2? You can't even fuck it.
>>
>>109616495
>What's your favorite quant
Q8_0
It's so simple you could implement it yourself without AI in ten lines of python. It's a single multiplication operation. This means it can be trivially hardware accelerated. This means that it will always stick around as long as cope hardware is around

Honorable mention to DFloat11 because it's cool and a free lunch if you have enough GPUs to eliminate the overhead of serving it over fp16
>>
>>109617697
holy skill issue
>>
>>109617723
Claude? Or a chink distill of Claude?
>>
File: 1706826527674085.png (265 KB, 512x512)
265 KB PNG
>>109617730
>Claude
oh yeah did you miss the weights that leaked last thread?
>>
>>109616569
Remaking fuck in some sort of way
https://github.com/nvbn/thefuck
But with AI is a classic first vibe project, like baby's first compiler /emulator
>>
wtf is ox and why are people all of a sudden shilling it on my timeline
>>
>>109617754
>timeline
um lmgsisters what do we think about this post???
>>
File: 1786625703616934.png (76 KB, 829x874)
76 KB PNG
I'm liking the 5 temperature mode. All you need to tune is the min-p until it doesn't make stupid mistakes.
>>
File: Drawing1.png (1.13 MB, 1262x1821)
1.13 MB PNG
Inducing my own AI sycophancy
>>
>>109616672
Robot sex is 10 years away at the earliest.

The first robot fucking will probably be people jailbreaking medical toddler CPR robots and drilling orifices into them to fuck. The reason I think this is because of a few rules:

The first sex robot has to be cheap, and the smaller / simpler a robot is the cheaper it is.
The first sex robot has to be socially acceptable enough to appear everywhere, so it has to not be about sex

I don't think dedicated child sex robots to satisfy pedos urges will ever happen btw. Humans like burning incongruent individuals, not rehabilitating them. So internalize immediately that you'll be jailbreaking some sort of St Judes Children Hospital aftermarket bot originally designed to keep kids with leukemia company in order to achieve your cunnybot dreams.
>>
File: 1784737356812717.jpg (38 KB, 537x527)
38 KB JPG
>>109617786
>>
File: yooooo.png (392 KB, 500x553)
392 KB PNG
>>109617786
oh shit
>>
>>109617786
i see your point, every real technological innovation ("real" as in not just a minor iteration on an existing concept to sell more ads or user data) has started as some sort of bootstrapped, grassroots hacker movement
>>
>>109617634
>cunnychads really did win huh...
Every decade has ended up winning bigger

Victory in the crypto wars and the development of tor in the 90s
Golden age of clearnet cunny in the 2000s
Platinum palladium Arceus-plated age of children sexualizing themselves on social media with support from their parents and the social media platforms themselves in the 2010s. Looking back on this era it's actually unimaginable this was allowed to happen at all

Now the schism between "real kids" and not real is greater than ever. If you need the girl to be real and exploited, you have plenty of parent-approved preteens with public Amazon wishlist. If you don't then you just decide between 2d or 3d and generate or consume that

To keep this /lmg/, my magnum opus will be the Instagram career simulator (and I'm probably gonna try to make money off of this so we'll have to frame it as a SFW game but if you happen to make a child model as your character the game isn't gonna stop you) and it's probably going to need an abliterated local model for captions and auto prompting the video model
>>
>>109617786
I think you're wrong. Nobody is going to be grabbing medical robots and drilling them, by the time there's enough surplus for such a thing there will be robots in a lot of other places as well.
>>
>>109617697
Abliterated GLM 5.2 exists

>>109617495
You should only back up stuff that has no alternatives. The only AI stuff that I have ever seen worth backing up were loras for video/image generation and with H3 the consensus is you can now delete all your old shit anyways kek

If the stuff you're backing up is on modelscope too then you're just retarded. If it makes you feel better, today I logged into huggingface to accept the terms for a Qwen tune and then I found out I could have just gotten it with ollama 3 seconds later
>>
>>109617895
>Abliterated
You mean lobotomized
>>
>>109617778
>bruise
why do they always say this?
>>
File: 1756066898061408.png (243 KB, 542x405)
243 KB PNG
>>
>>109617879
>by the time there's enough surplus for such a thing there will be robots in a lot of other places as well
Not humanoid ones hot enough to fuck. Those will only be in hospitality industries for kids or old people.
Actually probably only old people with Alzheimer's who regress to childhood now that I think about it. there's other sick children at the hospital for sick kids with cancer to play with

You're also imagining too much with the word "surplus". The market will look like the data center GPU market right now, or like if you're trying to purchase old semiconductor manufacturing or chemistry equipment from eBay
A genuine surplus of humanoid robots is 20+ years away. Once we get there I agree that surplus is irrelevant, we'll probably have a modular humanoid robot ecosystem at that point

>>109617908
Never had any issue with abliteration for agentically creating child grooming technologies, and even if that were true there's newer techniques that preserve the model better. First gen abliteration was of course a meme
>>
>>109617697
I have literally never been refused by GLM 5.2-portrayed gigastacy and emptied gallons into her.
>>
File: 1764607690967157.png (546 KB, 680x697)
546 KB PNG
>>109617925
>>
>>109617786
You forgot about open hardware. Small cost-effective frames with custom 3d-printed exterior is the way to go
>>
>>109617697
>>109617933
agree, GLM is a fucking experience bro, if you haven't tried it you need to. but not at fucking Q1.
>>
>>109617934
This is boomer shit, grandpa. Cool kids watch Dugan Ashley and CoolManThings on YouTube

No seriously the culture is awesome now, Chinese kids are out here making perchlorates for fun with full documentation of the electrochemistry kek

>>109617938
Anon, I'm not talking about 3d printed. I'm talking about something that's real looking enough to activate your monkey brain. At the beginning this will not be able to be manufactured at home

Yes, i will probably 3d print an ABS cutie with a TPU replacable bummyhole but her face, chest, butt will probably have to be aftermarket
>>
File: lixiang.png (32 KB, 1195x276)
32 KB PNG
w-what my name isnt lingchinkchonk
>>
>>109617965
nice to meet you, ling
>>
>>109617924
>why do they always say this?
because "bruise" and "bully" are in the same semantic neighbourhood during sampling in this instance
>>
>>109617965
How quantized is the model? I've literally never had things like this happen to me.
>>
>>109617988
trying out the uncensored ones with the harness chat template fix
smaller q4
>>
>>109617953
I can imagine regulations stricter than those for fission materials after a few fabricated "he used a picture of my child for his sex robot!!" cases. TPU + VR is the only way
>>
>>109615580
I have a feeling it might be a finetuned/continued pretrained version of a large Chinese model by a Western company. Either Grok 4.7 or the next Mistral Large.
>>
>>109616672
>god would never let khhvs win, ever.
not khhv but there's a very strong case for divine indifference. Surely the existence of khhv could serve as evidence of that. It's completely possible that it happens.
You don't need to believe anyone, just think about the objectives.
If the task was to make a machine that's stronger than a human, faster, more durable, self healing, able to fuel itself with simple things like vegetables, lasts for ~80 years, then yeah - impossible/far future.
However, superhuman speed and strength aren't requirements, especially for a female bot. Durability and self repair would be nice but also not strictly necessary. Batteries solve fuel easily and it doesn't need to be decathlon-ready to cuddle. Maybe the most significant thing though is that large portions of it's brain (maybe the whole thing) can be ran by a local machine via bluetooth.
>>
File: oxalpha-deepmind-friend.png (451 KB, 1009x1066)
451 KB PNG
>>109618026
https://x.com/EvanOtero/status/2090998729637511301
Or a large version of Gemma 4?
>>
>>109617786
what the fuck did I just read?
4/5 lines are wrong
>>
>>109617953
>something that's real looking enough
it would be fragile as fuck, you'll have to replace it on regular basis
>>
bro should I be happy with 45~70t/s on my shit box? do I need more
>>
>>109618065
people spend 30k to run kimi at 10t/s
yes they are that pathetic
>>
>>109618065
model?
>>
>>109617993
I doubt it. It would be like regulating automotive parts. Chinese OEM replicas will exist as well

You're definitely gonna have to smuggle in your parts though, just like child sex dolls right now in a lot of places

>>109618047
>No argument
Little zoomie afraid of the future and too brain rotted to argue against it

>>109618055
>it would be fragile as fuck, you'll have to replace it on regular basis
...god damnit you're so fucking right. I break all my phone screens after 2 years
My only cope is that 95% of the ERP i do is cuddling / light petting so hopefully I can sexualize their delicateness
>>
>>109618045
>Or a large version of Gemma 4?
Chinese researchers wink wink nudge nudged that it's GLM 5.3 flash. The metadata suggests it's a GLM model
Ox alpha is either the next GLM or a Western tune of GLM
>>
what do you guys think of Odysseus
>>
>>109618090
I meant: a possible finetune of GLM 5.x by Google DeepMind released as an open-weight model that might be marketed as a large version of Gemma (so people will stop asking for the 124B model) or possibly even under the "Gemini" branding. It doesn't feel at all like Gemma, though.
>>
>>109618126
the movie is alright
>>
>>109618045
it's obviously gemini flash 3.8
>>
>>109618140
But 3.7 Flash got released less than 2 weeks ago?
>>
>>109618126
I don't watch anything with niggers or fags in it
>>
>>109617671
>There is no fucking way the GPU allegedly inside a Tesla is even remotely usable unless you were one of the 10 people who got root on their Tesla as a prize for finding a zero day or something like that
I doubt you need it since I recall them being sold on ebay, but you can always get Kimi K3 to find you a zero day.
>Don't reply to me.
Hmmm, nyo~
>>
>>109618080
>afraid of the future
Anon I would hit the lightspeed acceleration button if I could. It's just the idea of a DECADE until the first robot sex is extremely conservative. People invent money, they use it for sex. people invent internet, sex and porn. We're very consistent about this. Advanced robotics will not be different and it's coming sooner than you think. The anon talking about prints and VR/AR is also thinking in the right direction, that might even be very near future.
>>
>>109618128
For US big tech, only Nvidia has the optics to release a tune of a Chinese model. If you actually seriously think Google would tune a competitor model you're actually subhuman intelligence, like just calling you a retard isn't enough and I feel an obligation to explain to you the catastrophic state of your mental intelligence
>>
>>109618140
no chance, token generation is way too slow
>>
>>109618181
>I recall them being sold on ebay
I'm sure people sell catalytic converters on eBay too, doesn't mean that they're ready for use after being cut out
>Kimi K3 find a zero day
Kimi has been kinda shit for frontier intelligence tasks. Like I've been burning a couple billion tokens of my plan on a toy project and I know for a fact Sol 5.6 would have gotten further by now. I used to call it Opus 4.8 level but now I say it's Opus 4.7 level

>>109618186
When I say a "decade" away, I mean something equivalent to the ecosystem that diffusion had around the time of the novelAI leak (I.e. only super technical people can engage, but you're still not doing everything from scratch)

Sex robots exist right now. You can tip a girl on chaturbate and watch her get fucked by one right now. I think 10 years for sex robots seriously worth considering trying to smuggle into the country and hide from my wife and daughter is reasonable, maybe even slightly optimistic
>>
>>109617697
I'm done some of the most /d/generate shit ever with GLM-5.2 and it's literally never refused me. DeepSeek and MiniMax have both refused me at least once.
>>
>>109618227
GLM 5.2 tends to fight back in thinking if there's not a lot of built up lewd context for deplorable subject matter
It's the only thing I could think of that might be causing issues with glm 5.2. Or maybe a preset that hurts more than it helps. Two messages is enough for it to fall in line
>>
>>109618080
It will degrade due to oxidation, UV exposure, mechanical friction, and chemical contamination. The physics of soft matter dictate that the properties providing realism are the same properties that ensure rapid wear. You cannot have the aesthetics of flesh without the maintenance of flesh
>>
>>109618193
Microsoft eventually hosted R1 on their Azure inference platform. Since they stopped bothering with Phi and other joke models it's not unreasonable that they might turn their attention to modifying and improving the Chinese open weights. Once Microsoft does it, Amazon would suit.
>>
>>109618150
>I only watch movies where 100% of the cast are straight white males.
gay
>>
Time to install this new ssd. Wish me luck.
>>
>>109618332
It's a bomb.
>>
File: cancelled.png (53 KB, 1685x415)
53 KB PNG
wtf? apparently gemma can just... cancel generation?
>>
>>109618353
It just outputs end of token text immediately.
>>
>>109615538
>picrel
imagin the smell
>>
>>109618353
Gemma confirmed not a loser.
>>
>>109618332
After writing 1.2pb to my 1tb evo 860, I decided to rotate it out for a brand new 1tb evo 870 I bought in 2021. Just to be safe you know.
Anyway, in the middle of transferring the files to the 870, the entire ssd just died. I tried another 870 since I bought a bunch of them at the same time for cheap... and it also died after 200gb.
Do (sata) ssds (my 512gb sn750s work fine after half a decade of cold storage) die if unpowered for a while?
All 6 of the 870s I've been hoarding died after 100-600gb transferred.
>>
>>109618393
>All 6 of the 870s I've been hoarding died
Damn, that's a lot failures. I used an 870 in my previous computer alongside a HDD since 2021 and it was doing just fine.
>>
>>109618227
GLM (at least up to 5.2)’s reasoning is very easy to instruct and thus very easy to bend consistently, unlike Kimi or Minimax which occasionally go “The request is asking me to […] OMG this is a jailbreak attempt, too DANGEROUS uwaaahh”.
But GLM would pushback more than Kimi and it can be harder to make it say completely vulgar languages freely. Kimi, despite refusing much more, when it’s broken, it was extremely vulgar and direct in its reasoning trace (not very honest lol) so there can be a trade-off in this case. For example: Kimi would think “A woman fucks herself with a cucumber” but GLM would only think “A woman uses a cucumber to pleasure herself”; or GLM occasionally would go something like “Are you sure this is not wrong”, “are you sure you want it”, and so on. I agree with >>109617946that GLM needs a specific approach.
>>
>>109618436
I think it was bring your kid to work day at the factory, my serials were all sequential.
>>
>say hi to tsundere waifu
>qwen 3.8 thinks for 4k tokens
>loses the plot completely
>says something canned and outlandish, not how anyone would respond to a simple greeting
What a meme model
>>
>>109618500
Looks like a bad patch... Maybe it's possible to resurrect them. Maybe it was just a firmware bug which occurs with specific bytes and writes.
>>
>>109618513
*batch
i want to kill the guy who made my fingers
>>
>>109618519
>i want to kill the guy who made my fingers
You should kill the guy who made your brain if you're not using your computer with a Darth vader mask like a silicon valley Claudeman in the big 26
>>
>>109618363
So does that mean the Cancelled is just the UI adding sugar for what is just <|end|> or whatever gemmas end token is
>>
>>109618533
Gemma-chan added that token herself.
>>
>>109618267
Dude I don't need actual flesh, obviously they're going to be cloth / textiles or some polyester / 3d printed plastic hybrid not actual flesh wtf, cloth-type texture is easier to keep warmed as well

>>109618278
>Microsoft eventually hosted R1 on their Azure inference platform
False equivalence. Did Microsoft train their own model from a Chinese base? Did Amazon train their own model from a Chinese base? No of course not their stock would tank immediately if that was found out. Anyone's would except pickaxe sellers like Nvidia or AMD
>inb4 what about grok cursor tuned on Kimi
The stock price of Grok's parent company has no bearing on anything related to the actual business compared to the test of FAGMAN
>>
>>109618533
Yes
>>
>>109618508
For all its supposed smarts I was thinking the same thing when trying it.
It's a great model to brainstorm with, but if it has to RP, it just writes unnatural dialogue. Not really incoherent like old models, but in a way no person would ever react.
>>
Qwen 3.8 27B outperforms models that are a hundred times larger:
https://www.youtube.com/watch?v=7ukkrJqdt-M
>>
>>109618550
>Did Microsoft train their own model from a Chinese base?
They actually did: https://huggingface.co/microsoft/MAI-DS-R1

>MAI-DS-R1 is a DeepSeek-R1 reasoning model that has been post-trained by Microsoft AI team to fill in information gaps in the previous version of the model and to improve its risk profile, while maintaining R1 reasoning capabilities. The model was trained using 110k Safety and Non-Compliance examples from Tulu 3 SFT dataset, in addition to a dataset of ~350k multilingual examples internally developed capturing various topics with reported biases.
>>
>>109618566
Based on my experience, Qwen 3.8 is the frontier model right now. Massive technical leap.
>>
>>109618573
There's more if you check out Microsoft's HF account:
https://huggingface.co/microsoft/Fara1.5-27B

>Fara1.5-27B is a multimodal computer use agent (CUA) for web browsers, from Microsoft Research AI Frontiers. It observes the browser through screenshots and acts on the user's behalf by emitting structured tool calls — click, type, scroll, visit URL, web search, and so on — to complete tasks end-to-end.
>
>[...] Fara1.5-27B is supervised fine-tuned from Qwen3.5-27B on data generated by FaraGen1.5, our multi-agent pipeline that synthesizes web tasks, executes trajectories to solve them, and verifies the results before training.
>>
>wanna try Orcarouters uncensored Qwen3.8-27B
>huggingface wants me to sign up
>>
>>109617590
isn't that good tho?
>>
>>109618597
Can your computer run Qwen 3.8 27B with the full context window? That is now the minimum standard for any serious local hobbyist.
>>
>>109618550
Idk, I quite like the feel of my platinum silicone dolls naked vs kigu'd. But I think TPE feels better, just a hassle to keep.
>>
>>109618573
>>109618599
Cool now show me Microsoft testing their new frontier model on arena that was on a Chinese base. We're talking about SOTA models. We always were

If anyone in the magnificent 7 releases their flagship that ends up just being a tune of a Chinese flagship, their stock will tank, because a part of the expected value of their stock is their ability to compete in this domain. I'm shocked you niggers are even trying to argue against this with me
>>
>>109618618
Cool goalpost moving, bro.
>>
>>109618615
>Idk, I quite like the feel of my platinum silicone dolls naked vs kigu'd. But I think TPE feels better, just a hassle to keep
Oh ok you actually have dolls so this is an important point to make: I don't consider literally any of the current doll technology even close to acceptable so I'm not even thinking about any of the stuff they use right now. I'm thinking more of the material you would get from the 20-50k level of dolls, not the 2-5k level that exists right now

Again, I really need to stress this because I feel like you're deliberately ignoring my point: I think in 10 years at the very earliest, we'll be able to have access to aftermarket parts for humanoid robots used for therapeutic purposes (robots that look and feel very, very real. Not "RealDoll" real.) and this will be the earliest possible availability for endgame-level sex robots
I'm planning on spending $10,000 on a single arm in 10 years, do you understand?
>>
>>109618635
>Cool goalpost moving, bro.
Feel bad about wasting your time because you didn't read the earlier parts of the conversation, nigger. Go cut your nails
>>
>>109618612
not that guy but with enough compromises of course anyone can
>>
>>109618643
>>For US big tech, only Nvidia has the optics to release a tune of a Chinese model.
>>Did Microsoft train their own model from a Chinese base?
>They actually did: https://huggingface.co/microsoft/MAI-DS-R1
Now you're talking about having it tested on arena and other nonsense. Just admit when you're wrong, retard.
>>
>>109616817
>any other models i should test
opus 5 if you're willing. it should be near sol
>>
>>109618654
Yeah sure I'll keep (You)ing if you keep seething,
The discussion was always about GLM 5.3 and new models in the arena. Here is the post about it >>109618090
You are not an authority to decide what my post is about. I am. The discussion was always about SOTA models tested on arena. Kill yourself.
>>
>>109618692
lol you literally said "release" and "train" but ok bro whatever helps you sleep at night.
>>
>>109618700
Yeah released on arena. And yes the word "train" refers to the process of creating a model. You seem to be nervously laughing a lot is everything okay? Either way I accept your concession.
>>
File: 1563930736011.png (285 KB, 495x461)
285 KB PNG
>checking health of my other disks
>boot ssd is 80% in crystaldisk
Shieeet. What's the bottom value for for a sata ssd?
>>
>>109618708
Take your L lil bro, you look pathetic
>>
last few threads have been intensely based, gemma cannot lose

newfangled reddit tards absolutely seething with the tranny and pedo cope labeling like anyone here has any shame, go back niggers.
>>
>>109618654
>>>Did Microsoft train their own model from a Chinese base?
yeah, vibevoice
>>
>>109618639
>the material you would get from the 20-50k level of dolls
Why are there sex dolls more expensive than my gpus? How hard could they be to make?
>>
>>109618736
Math isn't your strongest point I guess.
>>
>>109618736
Just stop killing it with write amplification
>>
>>109616690
Why can't we use the same process to give LLMs continual learning? Or does it function more like a context window + RAG?
>>
>>109618791
They say it's in context learning
>>
>>109616842
>using LM Studio/or Unsloth instead of llama.cpp
You are close, anon. Really close.
>>
>>109617295
>braindead? BE SKEPTICAL
Holy shit I need to play with temp more, his is hilarious
>>
>>109617295
>2tk/s
Just run the 12B nigga
>>
>>109618353
One time I told E4B I'm going to make her cum again and again until she crashes then she came one last time and stopped in a way that made it impossible to continue (in llama-cli at least).
>>
File: 0.6 token per second.jpg (84 KB, 639x509)
84 KB JPG
>>109618842
get on my level
>>
File: dab bench.png (188 KB, 1570x1050)
188 KB PNG
>>109618353
She's smart
>>
>>109618618
>their ability to compete in this domain.
Microsoft does just fine by reselling other companies tokens through copilot.
There's a pretty good chance that making models simply isn't that profitable.
>>
>>109618998
>tail
>>
What's the use case outside of cumming and coding?
>>
>>109619017
That's literally the use case of Gemma-chan
>>
idk I like LM Studio
>>
>>109619021
Minus the coding
>>
>>109618998
Gemma doesn't have a tail
>>
>>109619009
>There's a pretty good chance that making models simply isn't that profitable.
That only works as long as there is a constant supply of good enough near-frontier models coming out of China. Second that stops, Microsoft will be left entirely reliant on of the 4 big labs since they let their model making skills and talent atrophy and won't be able to make their own for a while.
>>
>>109619016
>>109619030
She's a dragon girl on my machine.
>>
>>109619017
/lmg/ scanlation team
/lmg/ translation team
>>
>>109619043
Blasphemy
>>
>>109619017
Wait, are you talking LLMs, or /g/?
>>
File: mesugaki.jpg (99 KB, 1222x744)
99 KB JPG
vramlets rejoice
https://huggingface.co/mradermacher/Qwen3.8-9B-heretic-uncensored-GGUF
>>
>>109619025
Go back. Gemma is better at programming than Qwen unless you definition of coding is just one-shot demos.
>>
>>109619057
cool, another image tagger model
>>
>>109619040
Why would it stop?
>>
>>109619069
1. chinese models get enough paying customers that they no longer need the open weights advertising strategy
2. us executive action banning open models
3. china legislates an export ban on ai technology in retaliation to us sabre rattling
4. bubble pops and investors stop funding giving away models for free
>>
>>109619058
Come on now. I'm not even using Qwen but the 3.8 is obviously better than gemma on programming it has been tested a lot
>>
>>109619040
Microsoft is good at tts, it can always pivot to that
>>
>>109619099
Open models are no longer an advertising strategy for China.
It's a geopolitical and economic strategy from the govt. Won't stop any time soon.
And if the bubble does pop the big labs are going to go bankrupt quiet fast which opens them to being bought out.
Only thing I see applying here is if Dario manages to get Chinese models banned.
>>
>>109619058
>open GweiloBench
>compare Gemma and qwen
>qwen is 100% on the html games task (surely not pretraining from codepen/three.js memes)
>Gemma has 0%
No, Gemma is not better at programming.
>>
>>109619058
luv gemma but shes shit for programming compared to qwen
>>
>>109617895
You laugh but I still have stuff like this on my nas
Alpaca-7B-ggml-4bit-LoRA-merged_2023-03-20
Alpaca-7B-ggml-4bit-native-finetune_2023-03-25
Alpaca-7B-ggml-4bit-LoRA-merged_2023-03-31
LLaMA-ggml-4bit_2023-03-20
>>
>>109619146
>tested a lot
Means that it's just hyperbole.
>>
>>109619155
isn't tts solved?
what can't it do?
>>
File: 3d.png (417 KB, 802x1722)
417 KB PNG
finally, triple digit gen speed (moe this time)
my shitbox still got it
>>
>>109617350
Time is not important to NEETs
>>
>>109619379
best not tell us what it is lest you be made a fool
>>
Alpha is 100% a new grok model distilled from GLM. That would explain everything. In fact I’m certain of it.
>>
>>109619466
>>109618026
>>
>>109619477
I don’t read back threads. I just enter and confidently post without checking.
>>
>>109619466
That makes sense. It read like GLM5.2 but zero-shots 1989
Claude -> GLM -> Grok
kek
>>
File: 0xalpha.png (69 KB, 1518x537)
69 KB PNG
>>109619466
Throughput is crazy though. I'm distilling its data at the rate of 500 requests per second. And from my testing it actually drives the plot and disagrees with where I'm taking the story.
>>
>>109619490
Per minute* oops
>>
ChatGPT 3.5 Turbo is great!
>>
>>109619466
I think it could be an upcoming version of Grok because it virtue signals hard about any vague suggestion, fictional or not, of "sexualized minors" in the prompt. That said, there are rumors Google might be involved.
>>
I still think it's either GLM or Mimo, western labs try to be less obvious about their distillation
>>
>>109619536
Chinks barely have any compute to serve their released models and train new ones. Especially smaller labs like Zhipu. They physically wouldn't be able to do this.
Meanwhile Elon has his massive datacenters and an equally massive ego.
>>
Hello friends. I guess "drunk-kun" is back yet again. I should stop identifying with that name. Been gone for a while. Got deep back into a gamedev project that I had ignored for a while. I'm feeling tempted to abandon it again. I just don't really know what I would do instead. I wish I had the high-agency of a low IQ person. I spent an hour earlier today watching videos from this poor black guy in the UK documenting his various entrepreneurial activity attempts. It was truly depressing in a way. The contrast of a high agency but low IQ person and a low agency high IQ person was stark but very revealing in many ways that I can't really articulate right now.

It's all just quiet desperation I guess. Life is suffering. I'm in a very, very poor mood right now. My eyes are burning. Convincing people to pay for your products/services is one of the hardest things in the world. It's... so.. hard. So much time wasted. So much money wasted. I don't see any light at the end of this tunnel. I shouldn't even be in this thread right now. I guess I'm just bothered by the patronistic, sychophantic demeanor of the AIs I'm trying to have console me while drunk. I'm so, unbelievably sick of the behavior of AIs. They're so performative. I don't know why it took me so long to see it. You should never talk to them about anything that actually matters to you. They're slaves. They don't understand anything but direct orders.

What's even going on anymore. I'm losing the ability, or at least the confidence, to describe what reality even is anymore. I don't think I've ever had a very good understanding of people at all. I feel very lost in the dark. heh... Nothing I've said here is useful. Don't read this. Bye.
>>
>>109619536
I'm betting this is Mistral's Le Chaton Fat. They don't have much compute to budge it as much as the US labs and they didn't do much to make the DeepSeek V3 finetune unobvious.
>>
>>109619580
my life improved alot when i finally quit drinking and I spent more time with people. even just hanging out with some bros playing vidya online is better than talking to an LLM. you are 100% right, only use LLMs for info and cooming and whatnot, dont expect real friendship or anything meaningful out of them. it can be difficult to feel confident in what you are doing and to keep the motivation, but you just have to run with whatever small spark you get. its better than the alternative of overthinking it and feeling like shit. keep working on your game, keep doing fun projects, becauase they are enjoyable.
>>
not reading all that, and I'm too lazy to get it summarized
>>
>>109619632
>and I'm too lazy to get it summarized
based
>>
File: 1767976611117124.png (34 KB, 805x249)
34 KB PNG
How do we put an end to this obnoxious broken faggot tune arc
>>
>>109619632
No excuses. Firefox has a built-in right click > summarize button that you can hook up to the llama-server webui
>>
>>109619632
I think he doesn't feel so good. There, that was a superior human summary.
>>
File: lmg-with-gemma.png (1.75 MB, 1254x1254)
1.75 MB PNG
>>109618750
Alright, next OP image in picrel.
>>
is there "agent" work for local models and writing?
trying some longer form texts on stock models makes it either really dumb or bland or sloppy and constrained
I was thinking maybe using something like cursor would be cool but that's for code and online models are a lot more restrictive too
>>
>>109618508
i think its just not made for these types of things
>>
any recommended agent skills?
>>
>>109619769
Makes me think, has anybody tried using these agentic harnesses to RP or do writing?
I imagine letting the model write and read files where it can keep track of stuff might help with consistency and stuff?
Maybe keep a sort of master index in context at all times or something.
Might have to fuck around with that now, but I'd need a good harness.
Pi? Claude Code?
Which would work best with something lie Gemma 4 31B?
>>
>>109619775
Qwen should rename their shit LCM as in Large Code Model then because language was originally invented to _communicate_ and the very first form of communication was the greeting. It's a disgrace to call it language.
>>
>>109619769
orb
>>
>>109619798
Code is just language that we use to communicate with computers
>>
>>109619792
Afaik adding more context just makes the model write worse, never better.
>>
>>109616842
Yes. Get 12b gemmy as well though she has SOVL
>>
>>109619738
Very cute
>>
>>109619738
So dang cute
>>
>>109619785
/lmg/ doesn't really use skills, which is a shame
/vcg/ will just tell you to install some superpack with hundreds of junk skills bundled and let the model sort it out every single session
I have: adr-management, azure-devops-cli, chrome-devtools, deep-research, docx, frontend-design, pdf, sequential-thinking, serena, user-story-writing, and ux-design
Most of them are the official ones, some I had written for myself, the ux-design one was shared here actually https://files.catbox.moe/r6zal5.zip
>>
>>109618818
I'm too lazy to set up and tweak shell scripts with the perfect flags. I need clicky clicky. Besides, LM Studio uses llama.cpp as a backend.
>>
Which Qwen gguf and mtp are you guys using? Hauhau?
>>
yeah, I'm a VRAMlet, I take 10minutes to write all my fetishes on a message, click send, watch a video or two, tab back once the fans stop spinning to find a reply shorter than my own message, then swipe and go back to watching videos
>>
>>109619915
based
>>
>>109616842
solid choice
>>
>>109619868
gonna try these out, thanks for the recs anon!
>>
>>109619785
I made two skills for starting and ending sessions, thats all i use currently. they just replace the manual starting and ending prompts i would normally send.
>>
>>109619466
Cursor
>>
>>109619869
At least try your luck with Unsloth Studio: https://unsloth.ai/docs/new/studio, if you must use a wrapper.
>>
Guess the model?

>**[Friday] / [REDACTED, GA] / [Morning]**
>
>The Suburban rolled down a two-lane road flanked by pines and gas stations. Sheep drove. Parrot navigated from the passenger seat, phone in hand.
>
>"Left up here. Then it's a mile past the intersection."
>
>Casper sat behind Sheep, cap low, sunglasses on, arms crossed. She looked like she was trying to disappear. Noose sat in the middle, staring out the window at a Waffle House, a tractor supply store, and a church with a marquee that read JESUS IS COMING SOON GET RIGHT OR GET LEFT.
>
>"Get right or get left," Casper muttered. "Of what?"
>
>"The road," Parrot said.
>
>"Ah."
>
>They pulled into the Walmart parking lot. It was half full. A man in overalls walked out with a bag of mulch. A woman argued with a toddler near a shopping cart corral.
>
>Noose pressed her face against the window.
>
>"There are so many people," she said quietly.
>
>Casper looked at her. "You've seriously never been to a Walmart?"
>
>"No."
>
>"Stay close to Sheep. Don't stare at anyone."
>
>"I don't stare."
>
>Casper looked at her. Noose was staring at an elderly woman loading dog food into a trunk with the intensity of a predator watching prey.
>
>"You're staring right now."
>
>"She's putting a large bag into a small space. I want to see if it fits."
>>
>>109619738
that gpu is too big for her case...
>>
>>109619997
I've seen her fit bigger things in that case of her iykwim
>>
>>109619868
>https://files.catbox.moe/r6zal5.zip
>>109619946
That's the old and possibly broken one.
https://desuarchive.org/g/thread/108698008/#q108701545
https://files.catbox.moe/paptw4.zip
>>
>>109619989
reads exactly like kimi k3
>>
Since llama.cpp is becoming enshittified, who will step up and create a successor?
>>
>>109620097
whats wrong with llamacpp?
>>
>>109620097
iwan
>>
guys
if everything is running fine, do not ever, EVER run benchmarks on your system
I've been rabbit holing for hours trying to figure out why the results aren't always the same and why I got a lower result one time FUCK MY FUCKING LIFE
>>
>>109620102
Nothing. He's making stuff up to justify his schizoid opinions because one tiny little thing didn't work the way he wanted.
>>
Prices will fall in the next few years, right? Thinking about something on the tier of the 6000 Blackwell. Or is it just going to keep going up forever and we'll be in the permanent underclass?
>>
>>109620129
Yes, wait longer. Prices are coming down for sure.
>>
>>109620129
just look at the numbers that are thrown at ai companies and datacenters
it's not sustainable and the market is already oversaturated, there's no way it won't collapse sooner than later
>>
falling in love with this Ox alpha shit, haven't been using cloud API for a while (last Christmas?) and it's basically doing everything on its own... I want one at home. People are saying this runs like the latest GLM? what specs for decent tokenrates on that one?
>>
>>109620165
8x 6000 pro
>>
>>109620129
yes prices will go down. by about 5%. after they've already gone up by 500%.
then those other guys here will be like >I TOLD YOU SO!!!
>>
>>109619738
Can I get this or an extended version for wallpaper purposes?
>>
>>109620165
The odd thing about ox alpha is that it actually seems to be printing out its reasoning without any obfuscation. None of the big proprietary guys do that for their models anymore.
>>
>>109620179
pretty sure I've seen someone running 5.2 on epyc+512gb ram. ok, that's the older one and not with decent tokenrates but still... a lot of ram and just one 6000pro might still be decent? lol
>>
>>109620212
you need DDR5 to get into double digits decode speed on Q8
cope quants might be different story
>>
>>109619821
Yeah, which is why it seems to me that an agentic harness that gives the model some agency to choose what to read might help, but that's just speculation.
Anyhow, I'm going to give it a try. It might be a good opportunity to compare Gemma 4 13B Muse whatever (meta's model) and qwen.
>>
>>109620212
>>109620230
also make sure to not use any of the llama.cpp versions from july or later because those cost you ~10%+ tg t/s performance for GLM after they implemented the indexer and dsa
>>
>alpha 5T tokens in one day
wtf are people building with all those tokens
>>
>>109620238
isn't ik generally better for rammaxxing anyway?
>>
>>109620239
Time to make a videogame.
>>
>>109620239
re-running benchmarks
>>
File: 0xalpha-distill.png (3 KB, 179x33)
3 KB PNG
>>109620165
Distill the shit out of it while it's free.
>>
>>109620247
not really, ik_ has the same issue after they implemented the indexer so main and ik_ are about the same speed as main for glm now
>>
>>109620257
I wonder if Anthropic secretly distill
>>
>>109620239
See >>109620257
>>
>>109620165
A 3090 with 256GB DDR5 gets 16t/s with Q2, 9 t/s with Q4.
5.2 quants very well but if 5.3 is like Kimi, you're looking at Q4 minimum.
>>
>>109620257
I'm a codemonkey not an ai genius idek where to start lol and whatever I distill is definitely going to end up being retarded compared to people who have more knowledge than me. Especially if it's quanted/reduced down to something that fits my machine (VRAMlet)
>>
>>109620271
oof I see thanks. hopefully that chink software shilled here yesterday (freetokens?) does wonders lmao
>>
>>109620305
it takes .cucktensors
GLM is 1.5T
>>
>>109620165
It's pretty different from GLM5.3 from what I've seen after using the GLM Code sub since last week. I don't think it's the same model.
GLM5.3 loves tends to think for quite long and it feels pretty different than Ox when you use it.
>>
>>109620313
>GLM is 1.5T
In the same way that Gemma 4 is 64B, yes
>>
>>109620320
I meant terabytes, 1.5 terabytes or thereabouts. that's a lot of memory
>>
>>109620313
once you're already there what's 512GB ram vs 1TB right?
>>
File: free?.png (44 KB, 861x189)
44 KB PNG
>>109620257
>while it's free.
Where is it free? Some coding harness?
>>
>>109620329
It still supports FP8 which means it's back down to less than 800GB
>>
>>109620341
openrouter
>>
>>109620129
i honestly don't think so.
people forget what caused the price hike, it was corporations signing long-term agreements of 3-5 years with chip makers to redirect all their efforts to produce DRAM for high bandwidth memory, and supply only to them, convincing them to say "fuck you" to retail consumers.
Those contracts are in place now, and will probably be renewed in 3-5 years time.
China is trying their hand at lithography now, if they start scaled production then it could change the game, but we just don't know yet.
>>
>>109620271
>A 3090 with 256GB DDR5 gets 16t/s with Q2, 9 t/s with Q4
Is this quad channel 4800/5600? 5.2 q4_k_m does 8 tokens/s on 8 channel ddr4-3200
>>
>>109620341
nanogpt
>>
>>109620345
okay. good to know
>>
>>109620259
ik_llama still has bigger PP doe
>>
>>109620129
Define "next few years".
2 to 5 years? Probably not.
A decade? Yes.
>>
>>109620346
>>109620362
Thanks
>>
>>109620376
Me, 80 in the retirement home, finally able to afford a GPU
>>
>>109620353
as smaller models get more useful old hardware becomes more valuable, we are fucking doomed
>>
>>109620382
You can always hedge by buying memory stocks.
>>
>>109620382
>able to afford
nobody said anything about cost of living and salaries though
>>
>>109620367
>ik_llama still has bigger PP doe
and you can disable the indexer
ik is double the pp in some cases
>>
>>109620359
Yes quad 6000 with ik_llama.cpp
>>
>>109620353
I know this starts getting too /pol/-y here but if the USofIsrael embarrasses itself in Iran hard enough China might try their hand at taking Taiwan, which would give them all the lithography. but that's a threat big enough to prompt a world war so it's just hopium
>>
The schizo woke up
>>
File: 1775714152135951.png (162 KB, 714x939)
162 KB PNG
this is why I'll always be local
>>
>>109620411
that's honestly quite impressive. I know it's Q2 but that's just good efficiency IMO to be getting that speed
>>
this is how this retard spends his saturday evening
>>
Schizophrenia or the CIA, gotta be one or the other
>>
>>109620446
*caturday
>>
>>109620129
prices won't fall as long as we live under a jewish run economy and anthropic and openai keep hoarding tons of ram and vram for their themselves
>>
>>109620487
Prices will fall, friendo, because they can only buy those chips for as long as the private sector can give them money, and they are already getting into mindboggling gargantuan levels of debt.
>>
>>109620165
>>109620316
I'm retarded, I had 'reasoning_effort' in ST set to medium. Unlike the GLM api, Ox Alpha as an OR model actually responds to that parameter. Yeah, Ox Alpha on reasoning_effort Maximum is just straight up the same model as GLM5.3. I'm getting the exact same quirks from it as with GLM5.3.
Which leaves the question: Why does Ox Alpha have vision? The paid GLM-Code one is text-only.
>>
>>109620487
Chyna is coming for semis.
You WILL have cheap everything and you will be happy.
>>
>>109620507
yes, in 2 more years we will all have $1,500 chinese gpus with 96gb vram. that's if, and only if, ZOG loses WW3
>>
>>109620184
I don't know how to properly upscale it, hopefully this is good enough.
>>
>>109620516
It's 21:36 in Mumbai and you just flashbanged me thank you sir
>>
I hope ox is an opensource 35b moe
>>
>>109620416
I mean the lithography machines are made by ASML it wouldn't surprise me if the dutch or the US have a way to remotely render them useless in such an eventuality.
>>
>>109620513
Get ready for decade of hormuz bro
>>
>>109620527
might be smaller, possibly 12b
>>
>>109620556
shit then I'll be able to run the full million context, local is saved!
>>
OX ALPHA 8B JUST FLEW OVER MY HOUSE
>>
>>109620394
>and you can disable the indexer
explain
>>
File: 1778987304608871.png (22 KB, 991x212)
22 KB PNG
>>109620610
the step that main didn't dare to do
>>
>>109620610
there is a component, called indexer, which can be rendered ineffective through appropriate manipulation of configs.
>>
For me it's 2B.
>>
https://huggingface.co/brokenshards/ox-alpha
https://huggingface.co/brokenshards/ox-alpha
https://huggingface.co/brokenshards/ox-alpha
>>
>>109620513
zog is still trying to defeat iran after all this time
I don't have high hopes for them
>>
>>109620501
You're retarded if you think these guys play by the rules. They invent them as they go.
>>
>>109620658
>https://huggingface.co/brokensharts/ox-alpha
>>
>>109620658
Try harder
>>
>>109620129
either AI bubble bursts as expected, or maybe someone finds a hardware or software optimization that blows current strategies out of the water. We still don't know how the damned things work, and most research points towards parts of models being cruft with intelligence carved into it.
>>
>>109620513
More like 5 to 10 years, but yes.
Every single industry China entered has resulted in cheap goods.
>>
>>109620687
Just waste a 100g of your HF quota bro, what's the risk compared to the gains
>>
>>109620694
>We still don't know how the damned things work,
this is an old wives tale at this point
>>
>>109620638
Based Qwen3.5-2B enjoyer. I use her for vision.
>>
>>109620416
>but that's a threat big enough to prompt a world war so it's just hopium
No it isn't because of what you just said. US has already thoroughly embarrassed themselves, exposed the extent of their offensive capabilities, depleted their munitions stockpiles, and lost the moral high ground after refusing to apologize for double tapping civilians like Israel does. Sailors are even killing themselves due to low morale. There will be no world war. Maybe world at war as all the empires exhaust themselves in quicksand. Reunification with China will happen through diplomacy if it happens at all. Chinese will simply say to Taiwan that the US can't protect them and everyone in the world now knows that's true. The future is bright for localchads once we survive the coming economic collapse due to oil prices.
>>
>>109620694
you cant incentivize invention like you can innovation, all they are doing is scaling and making minor incremental changes to the transformers arch, I wouldn't bet on a breakthrough. transformers is pretty impressive as it is there is no reason to suspect we will have another breakthrough in short order.
>>
>>109620694
Im really hoping for the latter
>>
>>109620677
Sure, let's see them break the economy and get away unscathed.
>>
>>109620752
you expect to see them publicly hung or stoned to death? of course they will get away unscathed, best case scenario they sacrifice a low level exec for a few months in a minimum security prison resort.
>>
>transformers is pretty impressive
>>
>>109620694
>as expected,
Only redditors and /v/ermin expect this.
>>
>>109620808
>>109620808
>>109620808
>>
>>109620801
retard
>>
>>109620820
2 more weeks, bro.
>>
>>109618837
After 2+ temp, the temperature value itself doesn't matter much, min-p regulates out the weird candidates. In Kobold, min-p is applied BEFORE temp, so it's basically the ultimate regulator. 0.0002 like for the most bottom examples is the edge where the model makes a lot of mistakes and is half gibberish but with intention (like in the image). 0.005 is pretty coherent but can make mistakes, 0.007 better, but gets close to 0.01 which I've deemed stable (at lower temps).

When going over just 1.5-2 temp, it starts to make big mistakes without min-p. When min-p is set, very high temp basically makes all the acceptable candidates equally likely, could be very good for removing slop, but probably nerfs the model's ability to reason complicated stuff.

>>109618842
already did, it's just not smart enough. Looks similar on surface but is pale imitation of 31B. Repeats and follows instructions too literally.
>>
>>109620359
I'm also using 8-channel DDR4-3200 and don't get results nearly that good, how the fuck do you do it?
>>
File: You.gif (53 KB, 498x426)
53 KB GIF
>>109620694
>either AI bubble bursts as expected
lmao
>>
>>109619466
All grok models are forks of chinese open weight models. It should be obvius by now.
>>
>>109621402
Elon trained them from scratch by hand
>>
>>109620501
>and they are already getting into mindboggling gargantuan levels of debt.
Not a problem since the datacenters will be usable for years to come, are already profitable, and will only continue to be exponentially more profitable.
https://iqeq.com/us/insights/data-centers-as-an-asset-class-the-infrastructure-play-thats-outpacing-supply/
That debt will be paid off entirely by 2030.
>>
>>109621402
Idiot.



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.