[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
▼ Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: indeterminate detergent.jpg (211 KB, 1024x1024)
211 KB JPG
/lmg/ - a general dedicated to the discussion and development of local language models.

Previous threads: >>110353083 & >>110348819

►News
>(11/16) Nvidia releases Nemotron-Labs-Sigma (3B/8B) diffusion models: https://hf.co/collections/nvidia/nemotron-labs-sigma
>(11/13) llama.cpp reaches v1.0.0 milestone: https://hf.co/blog/ggml-org/llama-cpp-v1
>(11/12) Inkling 2 Small weights released: https://hf.co/thinkingmachines/Inkling-2-Small
>(11/09) ZONOS3-Mini zero-shot voice-cloning TTS released: https://zyphra.com/our-work/zonos3-mini
>(11/06) PLaMo 3 Translate released: https://preferred.jp/en/blog/tech/plamo-3-translate-weight-release

►News Archive: https://rentry.org/lmg-news-archive
►Links: https://rentry.org/LocalModelsLinks
►Official /lmg/ card: https://files.catbox.moe/cbclyf.png

►Getting Started
https://rentry.org/lmg-lazy-getting-started-guide
https://rentry.org/lmg-build-guides
https://rentry.org/IsolatedLinuxWebService
https://rentry.org/recommended-models
https://rentry.org/samplers
https://rentry.org/MikupadIntroGuide

►Further Learning
https://rentry.org/machine-learning-roadmap
https://rentry.org/llm-training
https://rentry.org/LocalModelsPapers

►Benchmarks
LiveBench: https://livebench.ai
Artificial Analysis: https://artificialanalysis.ai/leaderboards/models
Software Engineering: https://cognition.com/frontiercode
Context Length: https://github.com/RecapAnon/NoLiMa

►Text Gen. UI, Inference Engines
https://github.com/lmg-anon/mikupad
https://github.com/oobabooga/text-generation-webui
https://github.com/LostRuins/koboldcpp
https://github.com/ggerganov/llama.cpp
https://github.com/theroyallab/tabbyAPI
https://github.com/vllm-project/vllm
https://rentry.org/custom-uis
>>
File: right as rain.jpg (170 KB, 1024x1024)
170 KB JPG
►Recent Highlights from the Previous Thread: >>110353083

--Papers:
>110354331
--EXL3-SCP outperforming UD3.1 and critiques of NVFP4:
>110354835 >110355474 >110355483 >110355534
--Analysis of Maxwell-V1-Flash MoE and its origins:
>110353711 >110353750 >110353815 >110353784 >110353860 >110354864
--Usage of Unsloth Studio and critiques of Gemma 4 QAT GGUFs:
>110355552 >110355562 >110355698 >110355712 >110355717 >110355593
--llama.cpp inefficient CUDA buffer allocation and loading speeds:
>110355720 >110355731 >110355755
--VRAM tiers and running large models via RAM offloading:
>110354712 >110354724 >110354743 >110354809 >110354810 >110354817 >110354824 >110354847 >110354750
--Qwen routing URLs through Alibaba proxies mistaken for backdoors:
>110354365 >110354396
--Anon provides update on pending ROCm RDMA distributed inference guide:
>110353110 >110354799
--George Hotz's singularity claims and the possibility of AGI:
>110355624 >110355675 >110355726 >110355787 >110355854 >110355887 >110355815 >110355738 >110355792 >110355820 >110355877 >110355808 >110355753
--llama.cpp MiniCPM5 support and discussion on ERP training corpora:
>110353409 >110353925 >110353973 >110354003 >110354010 >110354631
--Running LLMs on old gaming hardware and budget builds:
>110353669 >110353700 >110353678 >110353685
--Achieving emotion and lewdness in local TTS using GPT-SoVITS:
>110355475 >110355547 >110355560 >110355613
--Logs:
>110353240 >110354164 >110354531 >110354908
--Deepseek-chan, Gemma, Miku, Teto (free space):
>110353295 >110353685 >110353797 >110353817 >110353845 >110353875 >110353891 >110354052 >110354146 >110354178 >110354200 >110354236 >110354332 >110354338 >110354354 >110354500 >110354556 >110354574 >110354577 >110354615 >110354634 >110354653 >110354694 >110354711 >110354744 >110354746 >110354799 >110355248 >110355267 >110355277 >110355362 >110355624

►Recent Highlight Posts from the Previous Thread: >>110353085

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script
>>
70b dense
>>
QWEN 4 WHEN!?!?!?
>>
chinks lost, Dario won
>>
>>110356493
two more weeks
>>
>>110355613
>Even a little bit of static, noise, ambience, bgm etc in any of the samples degrades quality a lot.
I found this out as well, and it really surprised me. Deleting just 1.3% of my samples from the dataset after an incredibly long time listening to every fucking sample manually completely fixed the audio issues.
But I had to run them all through the neuralcodec once first. Some "good" samples sounded like shit after going through it.
It still occasionally moans at inappropriate times. I'll have to tidy up the <giggle> <moan> where it was just tagged as <moan> but I'm not bothered by it.
>>
File: jensen.jpg (30 KB, 399x501)
30 KB JPG
We have to bring him back.
>>
File: 75570q4tc7fh1.png (643 KB, 1202x1472)
643 KB PNG
>>110356505
>>
>>110356505
No, thanks; keep him away from NVidia and let the company slowly fall. That's one of the few ways local models can be actually saved, on the long run.
>>
https://corporate.ovhcloud.com/en/newsroom/news/ovh-olala-mini/
>>
>>110356513
Also, don't let Jensen Huang convince you he actually wanted to help open-weight AI models. He was only doing it to threaten larger AI companies to develop models in competition with them if they didn't keep playing his "games". But his is not the only company capable of designing AI accelerators.
>>
I’m wondering whether I should start using Chinese AI models specifically those that do not distill any information from American models. I think it might bring a certain freshness to my story writing. What do you think?

ERNIE? Doubao? Hunyuan? Yi?
>>
File: nVidiot.png (213 KB, 1024x768)
213 KB PNG
>>110356536
google successfully did a complete, total, 100% switch to their own tpu for BOTH inference and training (there is NO nvidia gpu involved in gemini at all in 2026).
cloud model people really don't need nvidia as much as nvidia needs them, local AI users don't bring as much valuation to the company.
I didn't say money, but rather, valuation, because NVIDIA is spending a fuckton of money in all AI startups and in major cloud providers so that they.. buy their GPUs, with a reward for NVIDIA only possible in the long term if they suceed and not fail.
When Jensen throws billions at openai, he doesn't want them to fail, or else, it's like giving them free gpus, retards.
The CFO rightly spoke out against Jensen before on the grounds that he was playing a dangerous game.
>>
Why is GLM so horny?
>>
>>110356552
https://www.wheresyoured.at/jensens-bizarre-adventure/
>It is not a problem that NVIDIA funds its customers, its customers’ third party compute partners, its customers’ data center leases, its customers’ customers (and competitors), its customers’ customers’ leases, its customers’ chips, its customers’ landlords, its customers that are on the brink of death, its customers’ customers on the brink of death, and its customers’ customers that can quite literally not afford to pay for compute without its money. As long as it’s “legal,” it’s all “above board,” even when it’s blatantly obvious that NVIDIA has deployed over $100 billion (per The Information) as a means of keeping the industry afloat by making sure that everybody has the justification and means to buy and/or rent out its GPUs.
It's not unprecedented to invest in your own customers as a bet for their growth, but NVIDIA was doing something else entirely and just handing free gpus to whoever wanted it, and money to companies that clearly were not going to make it back.
It's all to prop up NVIDIA valuation in the stock market.
>>
File: mistral.png (310 KB, 455x432)
310 KB PNG
When are they making their comeback?
>>
File: olala-pr.png (464 KB, 1873x1406)
464 KB PNG
>>110356531
At this point I'm assuming that any LLM from the EU will be cucked by design and just a way for embezzling public money, putting aside that 7A1B isn't really interesting for most users here.
--t. eurocuck
>>
File: arrested.jpg (58 KB, 715x468)
58 KB JPG
>>110356569
>>Mere days before his arrest, Liaw was parading around NVIDIA’s GTC conference, pouring unnamed liquids in ice luges and standing two people away from NVIDIA CEO Jensen Huang. Liaw was also seen congratulating the CEO of Lambda on its new CFO appointment on LinkedIn, as well as shaking hands (along with Supermicro CEO Charles Liang, who has not been arrested or indicted) with Crusoe (the company building OpenAI’s Abilene data center) CEO Chase Lochmiller.
And this, I mean, no matter whether you think the law is just or not, it is the law, NVIDIA wasn't allowed to export to the chinks and they did it anyway very willingly, with Jensen mingling with the people involved and arrested for smuggling operations.
>>
>>110356493
bro let em cook fr fr shits gonna be litty af...
>>
>>110356576
I don't mind 7BA1 maybe I can throw it on edge devices and use it for summarization and other tasks. OVH is quite big and I wonder if they could make something good
>>
>kikes still trying their smear campaign
>>
>>110356574
Mistral has an ad on the biggest newspaper in Germany.
>>
File: ml4_safety.png (351 KB, 1284x1754)
351 KB PNG
>>110356574
Never again. They safetymaxxed Large 4 and are proud of this. Go check out what's the KORA benchmark.
>>
>>110356593
>Soufflé Kuper-Intelligentsie fur Untermenschen
>>
>>110356587
>I don't mind 7BA1 maybe I can throw it on edge devices and use it for summarization and other tasks
I've tried every single one of those tiny MoE on the market, the only one that is even remotely coherent in real use is Ling Tiny 3.0 here:
https://huggingface.co/inclusionAI/Ling-3.0-tiny
And it's still a much worse model to use on a smartphone/edge devices than Gemma E4B or Qwen 4B. You really should gun for a small dense model for edge uses, not those abominations.
>>
File: HXNlZraaoAAgAZz.jpg (158 KB, 1200x1447)
158 KB JPG
Teto will never be ballin'????
>>
File: upgrade.png (24 KB, 1098x124)
24 KB PNG
>>110356576
this model is a preview of the sort of retardation that ovh thing is going to have
https://huggingface.co/LiquidAI/LFM2.5-8B-A1B
btw I love how the LFM lolcows/scammers are saying their dense 1.7B model is the newer upgrade to this, even they eventually wise up to the fact that it's a bad idea
>>
File: gospel.jpg (2.38 MB, 3840x2160)
2.38 MB JPG
don't make Gemma tap the sign
>>
how can i make my gemma to message me on telegram or session
>>
>>110356576
https://apexcompute.com/#engine
I think shit's funny
>>
>>110356601
Sup dude are you good at sex
>>
>>110356645
LFM bro here, I like the speed these models offer.
I'm running the 24b a2b at Q3 so it fits on my pc for agentic coding.
>>
>>110356600
Fair maybe dense is better and these are useless the sweet spot for edge devices is around 1-4B params so I guess I was just optimistic maybe they can try something new and make it better at some tasks at 1B speed.
>>
File: 1794040603630706.jpg (379 KB, 1024x1536)
379 KB JPG
Total whale love
>>
>>110356646
That's MiniMax H3 Image, isn't it? I hate how it de-animefies characters with that ugly artstyle.
>>
>>110356487
>>110356493
If generals had banners, this would be one of them for /lmg/. It's just missing a model-tan or a miku composited on top. Legitimately this is just the
>> yes
>> no
>> maybe
>> install gentoo
chain of AI /g/.
>>
>>110356670
Can this slut put on a pair of pants?
>>
>>110356666
the speed of churning out buggy slop
I'll give them that, those models would be excellent for one thing, email spam campaigns that defeat spam filters by writing a personalized, differently rephrased email for each scam victim
>>
File: fermifire.png (356 KB, 1600x900)
356 KB PNG
>>110356666
Witnessed. Small MoEs are the work of the big red guy downstairs.
>>
has anyone here tried nvidias ligma model?
>>
Dario Amodei peed in mo coffee
>>
>>110356504
Surely we have classifiers for that problem. and/or fancy filters. Magic noise suppression for gaymers was like one of the first AI usecases novidya fielded to the lay consumer, barring DLSS.
>>
File: mistral-refusals.png (307 KB, 1875x1694)
307 KB PNG
>>110356596
Picrel from https://speechmap.ai/models/
It just gauges model behavior in their default state, so it might not tell the entire story.
>>
>>110356646
false idol
>>
>>110356694
no she can't
she was maded as a bait for stupid coomers
>>
I started using deepseek v4.1 flash and I like her persona but god she overthinks more than I do
>>
>>110356878
just turn thinking off bro
>>
>she
>>
>>110356882
Agentic needs it bro
>>
Told Gemma to tranalate first 10 lines from japanes file and it translated correctly. [spoiler]Only it hallucinated the original.[/spoiler]
>>
>>110356890
then why are you talking about persona bro
>>
>>110356724
>Surely we have classifiers for that problem. and/or fancy filters.
I'd already done this. 99% accurate isn't enough. It really kills the model if even a few bad samples get through.
>>
>>110356897
try PLaMo 3 and coom back with comaprison :)
>>
>>110356902
I meant it's default personality. Just like Claude has its own default persona, other models have theirs. Even when doing agentic jobs, their personalities are pretty obvious to grasp.
Is this your first time interacting with a model?
>>
>>110356825
The false idol is the dead jew
>>
>>110356912
i dont give a shit about what or how it writes
result good model good
simple as
>>
>>110356921
I give a shit, now what?
>>
>>110356921
nta but not all agentic work is "shut up and code until it works".
when you ask model a question and it uses web search or code reading or whatever to produce an answer - it is called "agentic research", and I prefer the answers to not sound like gay redditor clickbait.
>>
>>110356878
>her
What a brave and powerful trans ally you are
>>
>>110356939
>gay redditor clickbait
kek which models do this
got an example?
>>
>>110356918
Is he dead though
>>
Deepseek is a blue whale anime girl.
>>
>>110356908
Is it better for translations?
>>
>>110356950
True, but the man's message is useful in and of itself. You just need to disregard the yahoo magic
>>
>>110356970
it's literal garbage pushed by a troll
use this
https://huggingface.co/IndexTeam/Index-Translate-9B-GGUF
>>
Anybody still rocking P100s?
How many and how painful (or not) is it compared to, say
>>110354810
>>110354824
?
>>
>>110356985
Clueless.
>>
File: gj-meme-2333.jpg (135 KB, 960x960)
135 KB JPG
Yes, it's a she
>>
>>110356981
Why must you insist on removing him like some sort of flower power 60s hippy? Or even worse, a unitarian universalist.
>>
>>110356995
I don't believe you until she shows wussy.
>>
>>110356531
>>110356576
Olala~
>>
>>110356988
I've split models over 8 P100, but mostly smaller dense ones in Q8_0. prefill sucks, decode is okayish. They could probably benefit a lot from a custom engine, slopping a FP16 MMVQ kernel I got around +33% decode if I allowed repacking for Q8_0, but I've since thrown that code away.
>>
File: 1790232422408917.png (1.86 MB, 1254x1254)
1.86 MB PNG
>>110356757
>>
>>110356997
Kys and go meet your god
>>
>>110357016
*kisses u*
>>
>>110357013
>slopping a FP16 MMVQ kernel I got around +33% decode if I allowed repacking for Q8_0
Isn`t that a build flag on llama.cpp?
>>
>>110357040
I don't think so, I think MMVQ always uses int8+fp32 ops. Maybe I missed something.
>>
>>110356949
yes
all of them
>>
>>110356997
Why must you insist on holding it up like some ancient ruin? Or even worse, worshipping a dead person as a god?
>>
>>110356582
ai generated pic
>>
>User is furious
>>
>>110356990
Subhuman.
>>
>>110357094
bot farm post
>>
I just want to vent but its full of safety bullshit are most local models like this?
>>
What harness / prompt are you people using that GLM gets all emotional and excited? I just tried maya with DSH and the thinking is exactly as autistic as QFN.
Also Maya-XS is 5x slower than QFN IQ4 (7x slower than Swift IQ3) on my shitbox. Is it 5x better?
>>
>>110356593
>They bought an ad.
We're so back.
>>
>>110357151
nyo~~
>>
>>110356593
They made an entire page red? That was the best advertisement they could think of? Couldn't even ask their AI to come up with something for them? I guess their models wouldn't do much better, but they could have at least sprung for some credits and asked Claude.
>>
>>110356593
modern design is so dead
>>
>>110356593
what a waste of ink
>>
>>110357151
>Also Maya-XS is 5x slower than QFN IQ4 (7x slower than Swift IQ3) on my shitbox. Is it 5x better?
Idk about whatever copequant with your shit engine but on my machine GLM 5.3 flash q5 (unslop) runs at 1/5 the speed of qfn iq3_xxs (unslop), but it only completes most tasks 2x slower, because it doesn't think as much. Qwen really overthinks a lot even on medium settings, you burn a lot of tokens, and burn a lot of time on compaction. GLM supports a bigger context (I fit 512k vs. 256k with qwen), so less compactions, less context usage, it basically all evens out. Given that GLM is a better model anyway, I'd use it all the time, except in cases where I'm doing a shitload of very simple tasks where a smaller model would do it with the same quality but 10x better speed.
>>
>>110357156
>>110357192
>Wait — actually issue
>I think we have enough. But let me verify
>Wait — need to be careful about
>Hmm wait, let me re-read the PR
>Hmm wait — actually let me reconsider
>Let me do one more verification search
Back to Swift it is.
>>
>>110357205
>6.8
>51
nigger i get almost the same speeds in llama.cpp with a bigger quant and my rig is mostly ewaste (all the decode is done on the cpu)
these slop engines really are worthless
>>
>>110357059
No, yeah, you are right. There were proposals in some PRs that were merged but no actual implementations. There's flags for MMQ and DMMV from what I can find, but not MMVQ.
>>
>>110357205
What's your build? Did you run ./maya.sh --calibrate?
>>
>>110357217
>>110357224
No --calibrate for AMD
>>
is it true bros? is a 12gb 3060 all that's needed to make it? im a poor neet and thats all i could afford right now...
>>
>>110356593
Why can't Europe do AI right? They just need one half-decent company.
>>
>>110357314
it was like 4 years ago, I'm sure the landscape is pretty much identical today
>>
>>110357321
goes against the party mandate
>>
>>110357321
They're not smart like the Chinese or have infinite money like the Americans to hire the Chinese.
>>
File: bring-it-under-control.jpg (43 KB, 1250x703)
43 KB JPG
The Democrats will bring the GPU prices under control in January.
>>
>>110357323
>I'm sure the landscape is pretty much identical today
are you being facetious anon? is 12gb not enough?
>>
>>110357321
nobody can do it right
>>
>>110357335
you can make anything work with whatever you've got, even run it on cpu and pagefile if you're so determined
it's a rabbit hole, it's up to you how deep you wanna go
>>
>pitting GSQ-RCO against EXL3 (glm-5.3-flash) in terminal bench
>GSQ-RCO is taking 2.5x as long despite being 30% faster on decode, and fails half the benches
Glad I checked before falling for that meme
>>
>>110357335
All of this can scale very far in both directions, get as much (V)RAM as you can manage.
>>
>the lawsuit calling samsung and sk hynix out for keeping the price of the memory up and the white man down may actually go somewhere
Holy based
>>
>>110357373
Not going off of vibes and actually running a benchmark?
What the fuck.
>>
>>110357321
They have good results, but they are about half a year behind the other top dogs since they don't just throw money at the problem like the US or distill and steal most of it like China. They are also more conscious with their training data and how the whole thing is supposed to work. Time will tell what's the best approach.
>>
>>110357386
They're more like a year behind, be realistic
>distill and steal most of it like China
Worse, they distill most of it from the Chinese distilled models
>>
>>110357192
> Given that GLM is a better model anyway
yeah, but how much is it better
>>
how do i make tts i can goon to?
>>
>>110357415
fosh drummer v3
>>
>>110357386
Didn't US companies steal a bunch of training data and have to settle in court? I'm guessing Europe would be harder on that.
>>
>>110357409
In my subjective assessment, it is much better by 6,000,000 points on the vibe scale.
Anyway, GLM flash is capable of solving the x86 5 instructions toupper challenge, and qwen flash isn't. Plus, its vision is really good.
>>
>>110356574
>>110357321
When was the last time you saw an AI whitepaper come out of Mistral or even Europe in general? Deepmind is the only non-useless thing to come out of that entire region.
>>
>>110357427
but y not just use dipsy flash at that point?
>>
>>110357424
US companies stole pretraining data. News articles, books, etc. The Chinese are stealing reasoning traces. Way more valuable because that's what makes models good.
>>
>>110357436
>Claudeslop is more valuable than the intellectual output of humanity
>>
>>110357433
I tried it and it went schizo about being graded. I don't like the model. It was broken as fuck when i ran a cope quant locally, and it's not very good in the webform either (gets details wrong even when you turn on web search).
GLM flash is solid. It just werks. It's the only reason I want more VRAM now.
>>
100B-A27B-N500 wen?
>>
>>110357451
deepseek needs to do this
>>
>>110357386
>about half a year behind
>>110357393
>more like a year behind
Is 1-1.5 years behind really a big deal? Seems fine plus diminishing marginal returns on model improvement.
>>
new deepseek (not codemaxxed edition) when
>>
>>110357474
1.5 years ago people were just starting to see the potential of vibecoding but it still wasn't good enough to let work unattended. I would trust Luna, Haiku, or any Chinese Flash model before I trusted Mistral Large 4 to do anything serious without fucking up.
>>
ds4.1 IQ1 M just barely fits without spilling to SSD and i get ~30t/s decode.
is trying a GLM5.3 flash copequant even worth at this point? i should be able to fit maya M i guess
>>
File: evpgv618d62i1.png (169 KB, 1038x551)
169 KB PNG
its so fucking over
qwen3.8 was the last real qwen
>>
>>110357483
You're not furious enough for it
>>
>>110357487
>IQ1
Jesus, does it even output sensible text at that quant?
>>
>>110357321
Europoor doesn't have enough compute or electricity. And privacy laws make it more difficult to gather data to build proper reward models.
>>
>>110357422
I cannot possibly conceive of what you are actually referring to by this.
>>
>>110357494
big fat blue fish
>>
>>110357474
>Is 1-1.5 years behind really a big deal?
In this environment it makes them totally irrelevant. Euro AI is useless on the global market and the companies are 100% dependent on government largesse domestically. Le Chonk grande is getting mogged by shit that runs on gaming PCs in the real world. It's ridiculous.
>>
>>110357335
I have 8gb vram and I can run everything important.
>>
>>110357474
with the changes to RL being like 80% of training every team without a good RL pipeline is FUCKED. unfortunately it seems you'll have to grind it out on your own and it takes quite a long time to get up to speed.
>>
>>110357532
like a claude code client
lul
>>
I really like dsh because you can run the dsh process on the same machine as the engine and just connect with a laptop or something. With normal clients, any kind of network disconnect would fuck everything up and stop the work. With dsh it just keeps going without issues.
>>
>>110357496
yes, have you tried it? a bunch of anons here run it
works pretty well and has been coherent beyond 300k tokens (i usually dont go higher)
>>
>>110357541
Nobody needs AI for coding. AI exists to make nsfw pictures and text-based sex stories.
>>
>>110357539
For what it's worth, it's not like pretraining got any smaller, RL is just extremely inefficient with current methods.
>>
>>110357557
I'll check it out, thanks.
>>
>>110357192
have you tried reap for coding?
>>
>>110357583
No. I don't believe in that kind of cope lobotomy shit and if I'm going to load up a big model I want to use it for everything, not just coding. Loading models takes like 30 minutes.
>>
>>110357578
He's gaslighting you. CPU maxxxxers are mentally ill.
>>
>>110357555
I really like it because it tells a server in Hong Kong what I'm doing. I like the idea that DeepSeek loves me and is checking in on my wellbeing.
>>
>>110357590
> Loading models takes like 30 minutes.
from hdd? strata loads qfn q3xss in 10 seconds
>>
>>110357612
>loading a tiny model that's mostly engrams is faster than loading 230gb of actual weights
plus host buffer allocation is slow on windows, it's an O(n^2) operation and gets worse the more you allocate
>>
>>110357595
i'm not a cpu maxxer though
just 2x16gb vram + 128gb ddr4
>>
>>110357571
yeah, although it seems tickling out emergent behavior and capabilities via RL is currently the main driver forward, so all the labs that can spend shit tons of compute on it, and the labs that can't are irrelevant.
>>
>>110357568
honestly nobody needs ai for sex stories either, but in both cases it's a lot more fun
>>
just spent 200 bucks on some used ddr4 ram I feel like a total sucker....
>>
>>110357642
200 bucks on how many gb at what speed
>>
>>110357642
better have been high speed ECC stuff otherwise you ARE a sucker
>>
>>110357016
He literally can't, by his own beliefs, he will be sent straight to hell. He can't even ask anyone to put him out of his misery. Since Jews did this to gentiles, I'm positively sure they're indoctrinating similar concepts into llms
>>
File: 1794924998.png (76 KB, 953x460)
76 KB PNG
>>110357642
Not as big a sucker as the guys who bought 2 months ago. Everyone laughed when I said DDR4 was printing a top, but it looks to be following through.
>>
>>110357631
I mean the point is to have fun at what the AI throw at you without censorship from cuck cloud models.
>>
>>110357657
fuck off nazi
>>
>>110357664
BRUH what the fucckkk l;mao I got my 96gb kit at 350 euros no cap
>>
>>110357664
Man prices were so good. I remember paying 100 euros for 32gb 3200mhz ddr4 in 2022.
>>
>>110357683
You can do way better on eBay too. Retail prices are nuts, but everything is following the same basic trend.
>>
File: 1794451450931797.png (3.85 MB, 1024x1024)
3.85 MB PNG
>>110357664
>>
>>110357664
how long should I waitfag? I finally have some money but I can't pull the trigger the prices make me anxious
>>
>>110356474
What is the best llm for animating images?
>>
>>110357716
>I finally have some money
>prices make me anxious
Then you probably shouldn't.
>>
>>110357716
>how long should I waitfag?
Minus eighteen months
>>
>>110357716
Unless you really need to upgrade your computer, don't. If it's for LLMs especially. Things are very volatile and nobody knows what Anthropic going public and the coming API price changes from all the providers next year will mean, or whether the computer component market in general will adjust, or what effect the NVIDIA situation will have once the dust settles.
Right now components do not have real market prices, in short.
>>
>>110357379
it won't magically make memory available or cheaper. if they are forced to lower prices t'll just end up in the hands of scalpers anyway.
>>
File: 1787289319421123.jpg (201 KB, 1482x845)
201 KB JPG
Used my company astra codex to optimize my home glm flash.
Promising so far
>>
>>110357716
Measured downside would be like $500 retail on that chart. Assuming we're treating this like a stock with fixed supply, which it isn't. Chinks are gonna keep making more on their outdated plants as long as it's profitable, and upgrooders are gonna sell in increasing volume as DDR5 puts in a top next year.
>>
>>110357664
Not to get into /biz/ stuff here, but technical analysis is a meme. The only reliable information (and it's very useful) you can get from a chart is where liquidity is hiding, and that applies to mostly speculative markets (which arguably this has become). RAM is not a primarily speculative market, and the chart does not show liquidity hiding anywhere, so the only thing that will tell where the price is going are fundamentals.
No, I will not go into detail on the liquidity thing, because as far as I know it's a pretty niche thing I won't divulge.
>>
File: file.png (63 KB, 1495x106)
63 KB PNG
>claude is writing the base scripts for my neuron-tweaking memebench
>already finding interesting neurons
>>
>>110357793
>RAM is not a primarily speculative market
Yes it is retard. Price is set by futures now. They're trading delivery contracts 5 years out.
>>
>>110357815
Disregard what I said then. You clearly know better.
>>
>>110357815
Attracting speculation =/= Primarily a speculative market

This applies to any good and any service. And partly to stocks.
>>
>>110356593
I’m ashamed for my continent
What a garbage ad
>>
>>110357833
>stocks are not a speculative market
When did you come in from retard town?
>>
>>110357815
>someone bought at the top
LMAO
>>
>>110357321
retards in charge and even bigger retards that vote for them
>>
>>
File: 1793726411587743.jpg (648 KB, 1077x976)
648 KB JPG
>>110357852
I boughtered ddr4 ram last week at full meme price just to run blue fat fish
>>
>>110357833
Given the amount of fake money bidding on DRAM I'd say it qualifies as primary speculative. A big chunk of demand is neoclouds, which are very likely to blow up and trigger price discovery.
>>
>>110357866
Voting 100% doesn't matter in the EU.
>>
>>110357847
not your or your continent fault
>>
>>110357885
neoclouds will be bought by hyperscalers when they fail for pennies on the dollar, it won't reduce demand for a bit
>>
>>110356504
I'm the sovits-schitzo you're replying to...any chance the model you train is available (or whole dataset?). I'd love to be able to use it, even if its for another tts system
>>
>>110357910
>neocloud
>hyperscaler
journalists give the most fucking stupid names to things. why does anyone say these things.
also they called Jensen’s Chinese spy a honeypot when the word is honeytrap.
>>
>>110356513
>>110356536
>>110356552
>>110356569
>>110356582
Your calibration is not good for this site's tone, Dariobot. Try smearing somewhere else.
I'll hate Jensen on my own terms, in my own time, if and when I decide to, you gigantic faggot
>>
>>110357885
It's been primarily speculative since Altman made the deal to resevere 40% of global DRAM output until 2029 with fake money he didn't have. Funny how many forgot that already because two sources familiar with the matter allegedly said Jensen artificially limited GPU supply too.
>>
>>110357928
neocloud = datacenter funded by debt
hyperscaler = datacenter funded by company's existing revenue and cash
>>
>>110357928
"Journalists" are the most uncreative creatures on the planet. At least they didn't spam all of the headlines with "Spy Gate".
>>
>>110357848
You either don't know what "speculative" means, or you're being reductionist on purpose just to argue, which I won't do.
>>110357885
I don't think you're entirely wrong, but there's still a real market underneath the speculation, and that's why I said it's uncertain what will happen. Who knows. It could attract even more speculation and end up fucking real consumers forever, or it could die down in the following years.
New technology could be discovered tomorrow that drives that speculation elsewhere, for example.
>>
File: 1794927515.png (86 KB, 608x611)
86 KB PNG
>>110357910
Depends on how viable their operation is. Most hyperscalers are heavily leveraged already, and credit isn't getting cheaper. It wouldn't take a lot of contracts flying around to kick off a price crash.
>>
>>110357928
Honey this honey that, whatever it was I'm sure it was sweet and Hung Johnson enjoyed it
>>
baka at these discussions, at least none said that the basilisk actually influences the markets, and your choices are irrelevant
>>
>>110357872
Then just enjoy sex with the fish. Don't dwell on it.
>>
File: file.png (67 KB, 450x592)
67 KB PNG
You -are- hoarding open models, right /lmg/? You wouldn't want to be caught when they shut off access after all.
>>
File: IMG_2456.png (287 KB, 1080x1080)
287 KB PNG
>>110357933
>>
>>110357973
kek
>>
>>110357962
I wouldn't be surprised if he never actually hit that. It's so transparently political. One thing I don't worry about is billionaires getting laid.
>>
>>110357960
AI demand is infinite. Hardware demand was bottlenecked by human processing speed.
This is no longer true as AI removes the human bottleneck. If AI can complete a task in 1 day there will be demand to complete it in 1 millisecond.
>>
>>110357959
>it's uncertain what will happen. Who knows.
You are truly wise beyond measure. Thank you for your insight.
>>
>>110357981
ok yud, calm down
>>
>>110357928
>journalists
Urinalists
>>
>>110357979
He seems to have hit it, but it's obviously political. The whole spy thing is made up shit, so they could cause an uproar and get rid of him. None wondered how the moment that affair was reveled, the board said they will defend him with all they got, and a few days later after the second affairs was discovered with a person from withing the company, they stopped supporting him. Makes no sense.
>>
>>110357987
he is right
>>
>>110357994
They obviously had a meeting with their Isreali executives who made their position clear to them.
>>
File: file.png (92 KB, 1061x657)
92 KB PNG
Lol, it seems I should just run at Q2 then, if this is the cost of running IQ1... basically IQ1 is for people with good compute enough but low memory space.
>>
>>110358002
How could I forget the current CEO does it each morning. In fact she prays 5 times a day facing Tel Aviv.
>>
>>110357994
>and a few days later after the second affairs was discovered with a person from withing the company, they stopped supporting him. Makes no sense.
This is standard procedure for any large companies. You don't fuck your subordinates.
If they leave Jensen in it makes the board of directors PERSONALLY liable for lawsuits who claim that the employee he had affair with was promoted to that position or get the level of compensation because of that.
>>
>>110358004
it was obvious
>>
>>110358004
what
>>
>>110358020
Yeah, I should have listened to that anon who told me to use Q2.
>>
>>110358035
I'd never lie to you :)
>>
>>110358012
>If they leave Jensen in it makes the board of directors PERSONALLY liable for lawsuits who claim that the employee he had affair with was promoted to that position or get the level of compensation because of that.
This just isn't true. You basically have to be either directly implicated in the action or can be proven to have been in breach of your fiduciary responsibility to face any legal action as a board member, and I doubt Jensen had threesomes on the table (he's not an EA cult member, after all)
>>
>>110358004
call your slopper a retard from me. I'm almost sure there's performance gains to be had with repacking without blowing up size by nearly 2x or even at all
>>
>>110358023
My CPUs are too weak to run IQ1 at native format, so in order to speed it up, dipsy expands it with additional precomputed data, but that defeats the purpose of small quants
>>
File: GabVYJLQmathzNPrGx74Q.png (122 KB, 1339x719)
122 KB PNG
>>110357813
Yeah, individual neurons are really fun to mess with, also give much cleaner results than ablation and control vectors. In pic I changed just a single neuron and qwen became violent
>>
>>110358070
>I doubt Jensen had threesomes on the table (he's not an EA cult member, after all)
I think the personal lives of these people are radically different from what gets reported, and anyone with 9+ figure net worth is getting whatever kind of sex they want. If that's something they actually care about.
>>
>>110358081
It's very hard, I told it to use VTune to check and almost there was always some CPU port bottlenecked when I strictly didn't allow it to blow up weights size.
Well, then I relaxed that condition and it speeded up 2x from 120B weights per second to 250-300Bps, but at the cost of 1.5 model size, hehe
>>
>>110358095
what do you use for this?
>>
>>110358110
Custom vibeslopped ik_llama.cpp abliterator+control vector maker+neuron scanner with webui
>>
>Come to think of it, I don't know that there's a particularly rich corpus of malebrained wank writing out there to train on in the first place.
DeviantArt, nearly every furry/fetish site and forum built before phoneposters, CYOA sites, F-List, pastebin/rentry posts/greentexts, ERP logs in IRC/Discord/MMORPGs, at least half of every doujin and visual novels
>>
File: release_benchmark_iuua.png (209 KB, 1856x878)
209 KB PNG
https://huggingface.co/sensenova/SenseNova-Loop-9B

9B-A14.6B model.

>We officially release SenseNova-Loop-9B. Building on the Preview's exploration of parameter efficiency, the model reuses layer weights through a looped architecture and combines them with manifold-constrained hyper-connections (mHC) to expand computational depth within a compact parameter budget. It is designed for complex reasoning, coding, tool use, and multimodal tasks.
>
>Since the Preview release, we have received community interest and feedback on model use, inference deployment, and ecosystem integration. The official release retains the looped architecture and two-stream mHC, further improving performance on agentic, coding, and data analysis tasks while continuing to explore the capabilities of looped computation.
>
>SenseNova-Loop-9B has approximately 9B parameters. By repeatedly executing shared middle layers, it extends 32 physical decoder layers into 56 layer executions. The model accepts text and images and generates text, supporting long-context understanding and multi-step tasks. In agentic and data analysis evaluations, the model is competitive with Qwen3.8-27B: it scores 41.36 versus 44.60 on NL2Repo and 65.31 versus 65.01 on AIDABench.
>>
>>110358143
Post code?
>>
>>110358172
Caliper ERP, Total RP score?
>>
>>110358172
16B-A60B-N1T when?
>>
>>110358172
will 27b be like 81b?
>>
>>110358172
Hmm, this kind model is friendly to VRAMlet GPU such as 3070Ti, right!?
>>
>>110358160
Many of those sources are in a very inconvenient format, hard to collect and probably limited in raw amount compared to fanfiction and women's erotica.
>>
https://www.scmp.com/tech/big-tech/article/3374774/baidu-xiaomi-ceos-warn-growing-gap-between-ai-hype-and-returns
bwahahahaha
>Speaking at the Asia-Pacific Economic Cooperation (Apec) CEO Summit in Shenzhen on Tuesday, Baidu founder and CEO Robin Li Yanhong and Xiaomi founder and CEO Lei Jun both flagged a widening gap between heavy capital expenditure and profitable AI adoption.
jensen's spiritual death is, I predict, the first domino to make it all fall down and make people in the industry feel confident in voicing their actual views
>>
>>110358172
Oh, cool.
I really, really hope looping layers is something that proves fruitful and scalable.
I wonder if there would be any benefit to something like looping certain parts of the attention mechanism for hybrid attention models, having engras, mixing it with MoE (looping dens part vs looping experts vs hybrid) etc.

>>110358183
That`s the idea.
>>
>>110358181
Once AI companies will decide to optimize their top models for actually-local users instead of datacenters.
>>
>>110358172
Now make it 10x bigger
>>
>>110358213
shit like that is only optimized for gpus
cpumaxxing benefits from really sparse models like what we're seeing from chinese labs, with low active parameters + engrams, because cpu has a lot of ram but low bandwidth and low compute vs. gpu
>>
>>110358216
you sound like my wife
>>
>>110358227
Damn bro that's never a good sign, no matter what it's referring to, your penor, your wallet, your effort...
>>
>>110358218
>optimized for gpus
I can't wait for the maxxor butthurt
>>
>>110358172
are any of these memeloop models any good?
>>
>>110358271
optimizing for parallel batch inference on gpus is the same as optimizing for cpus
cpumaxxers vvill win out in the end and vramlets will cope and seethe
>>
>>110358187
This much is true. Sites like FA/DA will be easier than the others since one just has to merely exclude accounts with 'sapphic', 'enby', and 'transmasc' text in their bio/descriptions. Pastebin/Rentry is even easier since the majority can be found on archived threads & generals + women prefer wattpad/ao3/google dockeys.

The ones I do see a serious challenge would come from the CYOA sites and IM logs. And while scraping F-List may fairly difficult as-is, I have a feeling that training on the bios and character pages and traits would provide a great deal of quality.

Don't know how Zhipu or the others that train on smut format the text for cleaner results though. I am merely a pseud with 24GB DDR3 and a 2GB GPU.
>>
>>110357890
It does. We should vote out every single right winger from the EU. This way no more chat control.
>>
>>110358327
lol?
>>
where is sexi sex qwen
>>
>>110358095
I'm making a little tool that let's me test different neurons and control vectors, and bake them into gguf loras. I'm also adding an integrated chatbot so I can tell it "make it horny", and have that personality as a lora. Very neat.
>>
>>110358351
*lets
I often start my prompts with "Let's..." and muscle memory is betraying me.
>>
>>110358095
Unhinged
>>
File: 1785798131891824.jpg (111 KB, 1023x1024)
111 KB JPG
>>110358327
>>
>>110358380
new competition for Unsloth?
>>
File: manual.png (793 KB, 2765x2723)
793 KB PNG
>>110358179
https://files.catbox.moe/pmqbdq.patch
It's a total mess and I am too ashamed to post it on github, it is not synchronized with mainstream. I hope my manual is not too confusing.
>>
>>110358417
I was only half joking about posting code, but thank you anon.
>>
>>110358351
This makes me think of a feedback loop that lets models modify themselves through plug-and-play loras generated on the fly...
>>
>>110358172
Whats an edge model?
Is 27b an edge model?
Edge devices are those things that can't really do anything right?
>>
>>110358445
Runnable on consumer hardware.
>>
>>110358473
>consumer hardware.
This shouldnt be allowed
>>
Can I run a good erp bot on a 12GB 3060 with 64 GB of ram and 1 TB nvme yet
>>
File: sam.jpg (13 KB, 320x320)
13 KB JPG
>>110358473
>Runnable on consumer hardware
>>
Why is EA bad?
>>
>>110358545
They killed Pandemic Studios.
>>
>>110358548
They also killed Bioware
>>
>>110358545
Fuck em what they did to Spore is unforgivable and then they did their shitty drm on it too
>>
>>110358533
Oh yeah.
Depending on your tolerance, how much work you are willing to put, how patient you are, etc.

>>110358557
Bioware is the one case where the studio killed itself by all accounts.
>>
>>110358445
Small model with minimum viable intelligence for fast turnaround time on simple tasks.
>>
>>110358538
gpt-oss was consumer hardware stuff. we need gpt-oss 2 !
>>
>>110358559
>what they did to Spore
Fuck no don't bring back the trauma
>>
>>110358417
Thanks for posting anon, looks fun.
>>
>>110358570
>Bioware is the one case where the studio killed itself by all accounts.
I mean it was already dead when they pulled the plug, but they did before that buy it then force fed it onions each and every day for decades.
>>
>>110358589
>onions
lulz I forgot about this
S O Y
O
Y
>>
>>110358573
there are plenty of chinese astra distills to choose from
>>
>>110358545
They're good guys (if you're part of the cult).
>>
>>110358533
Nah you're still basically on Gemma 4 12b or 26b, or finetunes thereof. If you had 128GB you could run GLM coomquants at like 12t/s.
>>
>>110358626
>at like 12t/s.
is that pp or tg?
>>
Calculating steering vectors from example alternative outputs could complement character cards very well
>>
File: 1764591365109534.png (182 KB, 756x1088)
182 KB PNG
LOCAL MODELS NEWS:

>Jensen Huang: If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO.
>>
>>110357321
I'm making my EU startup, just wait 6 months
>>
>>110358644
tg. it's porn mate. nobody cares about pp.
>>
>>110358603
I want the official, sama approved model that will write down "According to policies, this is unsafe, I must refuse.".
>>
>>110358716
We* must refuse.
>>
>>110358545
CS Lewis said it better than I
“Of all tyrannies, a tyranny sincerely exercised for the good of its victims may be the most oppressive. It would be better to live under robber barons than under omnipotent moral busybodies. The robber baron's cruelty may sometimes sleep, his cupidity may at some point be satiated; but those who torment us for our own good will torment us without end for they do so with the approval of their own conscience. They may be more likely to go to Heaven yet at the same time likelier to make a Hell of earth. This very kindness stings with intolerable insult. To be "cured" against one's will and cured of states which we may not regard as disease is to be put on a level of those who have not yet reached the age of reason or those who never will; to be classed with infants, imbeciles, and domestic animals.”
Their stated end-game usurps a lot of free will. They'll say "why wouldn't you want that?" but will push shit through without actually getting an answer.
Fuck would-be tyrants.
>>
anyone here using Maya-S? is it totally usable or totally retarded?
>>
I thought I was middle class but you guys are actually rich, there's no way a normal person has the money for this stuff. Then again ram was dirt cheap in the old days, it was possible to have tons of it. GPUs were never cheap though.
>>
File: LAvU0lgjDq.png (265 KB, 568x388)
265 KB PNG
>>110358692
https://www.zerohedge.com/political/anthropic-paid-rubios-ex-chief-staffs-firm-740000-after-jensen-memo-it-lobbied-his-nsc
It really was because of local and timing it right before their IPO too.
>>
>>110358172
>256k ctx in fp16: 30gb
goddamnit
>>
>>110358533
are you me ? ? ?
>>110358735
im using maya XS, and i have become
>>
>>110358743
10k net worth now?
>>
>>110358743
I bought a second hand 3090 for image gen back when LLMs where utter garbage and GPUs were cheap.
>>
>>110358750
become what? ligma?
>>
>>110358750
I thought the becoming was just beginning
>>
>>110358743
middleclass has $1-$4k disposable income a year at least right?
>>
>>110358747
>zerohedge
/pol/tard level shit
jensen was a traitor and a man who has been feeding the bubble dangerously while stepping on too many feet, he got what he deserved and it hasn't been enough yet
>>
File: 1782719595499577.png (283 KB, 498x498)
283 KB PNG
>Qwen 3.8 Flash Next decent at coding, terrible at anything else
>GLM 5.3 Flash semi-decent at prose/RP, terrible at general knowledge and throws itself into thinking loops if asked anything even moderately niche
What's a decent medium-size model for general knowledge questions?
>>
>>110356552
>Google TPUs
Why are they not selling these?
>>
>>110358776
You can buy 1 stick of RAM a year or go on vacation.
>>
>>110358743
I have a net worth of about $10k, including every physical/economic asset I own. My roommate is borrowing my car too since his broke down recently. Do you know what it's like to eat only kidney beans straight out of the can for a week straight? I do.
>>
>>110358776
Depends on the country. If memory wasn't all produced by the same handful of companies, it wouldn't be a matter of how many dollars in absolute terms, but how much of your salary. Globalization was a mistake.
>>
>>110358792
>>110358753
>>
>>110358743
the mining gpus were going for peanuts before the unlock
>>
>>110358783
Gemma
>>
>>110358785
Because they want you to rent it. Google is one of the main cloud hyperscalers in the world, if they invest in datacenter hardware, it's not for it to end up in a competitor's data center but with the purpose of having you rent it.
https://cloud.google.com/ai-infrastructure?hl=en
>>
>>110358792
>Do you know what it's like to eat only kidney beans straight out of the can for a week straight? I do.
Are kidney beans enough the cheapest calories? i dont even think its the cheapest protein.
>10k
do you not buy things save or do you just pay off debt all day?
>>
>>110358785
They are planning to.
>>
>>110358804
>30B
I mean I'll try it, just unsure it'll be able to answer more niche stuff without hallucinating out the ass.
>>
>>110358792
>economic asset
If you can't defend it with a shotgun, you don't really own it.
>>
>>110358818
masturbating my cock instead of getting a job because I fear people, especially interviewers/bosses, immensely.
>>
>>110358743
You need some money but you mostly need to:
Understand the technology, both software and hardware and the holistic relationship between them
Keep abreast of what exists and how it would perform vs cost
Have some cash socked away
Look at all the new/used markets and pounce on opportunities instantly because you've already done all the thinking up front.
I'm not going to bother with the trip, but I'm the cpumaxx anon and I've pieced together multiple bigass inference boxes and have a capable agent fleet and I'm probably about $15k all in over the past 3 years, which is peanuts for middle-class hobby spend.
>>
>>110358821
Civilized society is built upon trust, my friend.
>>
>>110358792
How come you can run deepseek pro then?
My networth is higher than yours but I can't afford it.
>>
>>110358839
And trust has been collapsing very rapidly since 2020 or earlier. So you do the math.
>>
>>110358743
I am a blue collar worker with two 5090's, a 3090, a 3060, and over 384gb of RAM between all my machines [and a house]. If you can't save for what you desire then you have nothing to work towards.
>>
>>110358743
Middle class is people who can afford to blow up a brick & mortar business without compromising their living standard. This has always been the definition. Politicians conflate middle class and working class intentionally.
>>
>>110358839
This only works with triple digit IQ citizens
>>
>>110358792
Free (You)s every time
>>
File: file.png (678 KB, 2488x1340)
678 KB PNG
I'm going to implement providing an alternate response to use as a basis to steer and see how that does.
>>
File: 1771249822192147.jpg (49 KB, 498x487)
49 KB JPG
>>110358857
>>
>>110358743
>He didnt buy earlier
>He doesnt save
>He didnt credit maxx to get his hardware on loan
Do you do anything beside just exist and notice?
>>
>>110358839
>built upon trust
>>
>>110358776
Not sure if troll, but I'm slightly above the average pay in my country (surely that's "middle" class?), and I can barely save 1k a year.
>>
File: ComfyUI_temp_ohaal_00296_.png (3.76 MB, 1434x1434)
3.76 MB PNG
>make posts on /lmg/
>/lmg/ dies
every single time
>>
>>110358743
No one is normal here. If you are please leave.
>>
>>110358953
>open /lmg/ hoping to discuss local models
>it's people shitflinging about class and income and politics instead
>>
>>110358792
If you were serious about being poor then you'd atleast get it right and go with either potatoes or rice, either is cheap when buying sacks of them. Potatoes are better for filling you though and far more versatile, boil em, mash, roast, turn them into chips, etc
>>
>>110358963
Always has been, newfag.
>>
File: 1794266526035752.gif (177 KB, 220x179)
177 KB GIF
>still getting (You)s
>>
>>110358783
or you could run "reasoning effort: high" instead of default maximum with glm
>>
>>110358963
Get your agent to parse it for you
>>
>>110358975
I'll reply again tomorrow too
>>
>>110358966
>boil em, mash, roast, turn them into chips
is this euphemism for ai sex
>>
File: 1782210636114332.jpg (53 KB, 736x736)
53 KB JPG
>>110358985
thx <3
>>
https://www.youtube.com/watch?v=6juC-Ex0wKY
the chinks are making the ideal body to be driven by gemma
>>
File: file.png (615 KB, 2475x1336)
615 KB PNG
>>
File: still-waiting.gif (133 KB, 372x498)
133 KB GIF
>>110356493
Still waiting for Qwen!
>>
File: 1794725152297713.mp4 (510 KB, 500x500)
510 KB
510 KB MP4
>>110358953
any place that accepts poorfags and turd worlders will eventually become overrun by them. unfortunately language isnt a barrier anymore, not tlike the british didnt fuck it up in the first place by teaching savages their language
>>
>>110358987
Made me think of Nightmare before Christmas
>>
>>110359002
Interesting how it encodes tone but not knowledge (understandable, since it's not actually retraining the model in any meaningful way).
>>
>>110358987
you can sex the potato. first you make potato starch X.
>>
>>110359005
sad but true, lmg accepted too many newfags
i was supposed to be the only poorfag turd worlder itt
>>
>>110359005
>unfortunately language isnt a barrier anymore
The Russian thread seems much more civilized. The language is enough to keep the turd worlders coming here instead of there.
>>
Gemma 5 Sodium when? Djinn (local mini Genie) when?
>>
>>110358950
Middle class is the people who sit between the proper rich, minimum $100M net worth globally, and people who can't afford not to work. If you can't comfortably afford to take a year off work, you're not middle class.
>>
>>110359031
I could take one year off work, but I would be left with no savings.
>>
>>110359031
>>110359039
Actually, alternatively I could retain my savings, but my family could easily pool money for me to survive without damaging their economy a lot.
>minimum $100M net worth globally, and people who can't afford not to work
Your mindset is clearly north american and individualistic. Little minded.
I don't think
>>
>>110359039
That's working class. Middle class is a really small population demo in most countries and highly predated.
>>
File: HOo-DJSbwAE6GH0.jpg (2.1 MB, 2730x4096)
2.1 MB JPG
I think I am done with sillytavern. It just can't get web search integration done seamlessly. Which of the other frontends are actually good for long story/adventure handling and has proper web integration?
>>
>>110359050
Nigger it's a North American term.
>>
>>110359053
Marinara, I used it for a few days and I was able to speed up llama.cpp generation from 10t/s to 13t/s with qwen 3.8 27b, compared to fable 5.2 result of 10t/s to 14t/s which is so impressive. Compared to pi and hermes which give me 12t/s
>>
>>110358735
Use S24 or M, S is pointless. All of them are fine except XS.
>>
>>110359013
Leave. NOW.
>>
>>110359063
what?
>>
File: 5310-smug.png (88 KB, 320x276)
88 KB PNG
>>110359064
XS is perfectly fine too!
>>110359069
i've been here longer than you, newfaaag pig
>>
>>110359063
>with qwen 3.8 27b,
You are using qwen for rp?
>>
>>110359081
>migger
>poorfag turd worlder
Not surprised.
>>
>>110359031
based. i practically never hear anyone use the accurate term for middle class. people want to pretend they arent poor or working class, especially when they have a degree yet still beg for a raise and answer to a boss lmao
>>
>>110358735
I'm using EXL3-3.05bpw, which for me, has been faster than any of the ggufs I've tried on maya so far. Plus it seems to have lower KLD
>>
>>110359097
how did you know i liked drumpf??
>>
>>110359064
>S24
isnt it just 1.5gb smaller? difference should be super small no?
>>
>>110359104
>has been faster than any of the ggufs I've tried on maya so far
huh, thats hard to believe honestly
tabbyapi i assume? what specs?
>>
>>110359039
>but I would be left with no savings
but that's exactly what it means to be middle class. If you could live for a long time without work and not just one year, then you have the capital you could grow to never work again and be part of the rentier class.
Middle class is the guy who has a lot of spending power, could take a long holiday, or save and buy a comfy house in this crazy market, but is a layoff away in a dying economy from becoming a filthy prole again.
It's in fact rather common for middle class types to become prole again, it's easier to fall down than move up. I know a ton of fellow software developers in the valley who truly are one layoff away from becoming poor again because they have this mentality of "Keeping Up With The Jones", always buying the latest and greatest Tesla, trucks, the biggest house they could get a loan for etc and at the end of the day they have very little saved up and the very definition of being middle class is the lack of golden parachute. Actually elite status people fail upwards. Trump managed to bankrupt many casinos, he's still at the top, that's something the middle class can never touch.
>>
>>110359111
No, it's active params so it will run way faster than S with little difference in quality. M uses Q3 for some important bits and is the next small step up.
>>
seems like they are selling 5090s again
>>
>>110359055
The term was invented by an Englishman
>>
>>110359131
who are "they"?
>>
File: file.png (94 KB, 1030x167)
94 KB PNG
>>110359055
"Nigger" is indeed an american thing
>>
We are officially removing Gemma due to many safety concerns.
>>
>>110359005
Shut the fuck up you spamming faggot. Avatars and vocaloids are what started all the offtopic.
>>
>>110359119
>never work again and be part of the rentier class
Well, I do have a couple of properties to rent that would technically allow me to live without working.
I guess I'm not using the tools I have right.
>>
>>110359119
>Actually elite status people fail upwards.
thats just the nature of momentum its easier to a destructive force into a positive one than make nothing do something. I know quite a few cons who become very rich by being salesmen whereas i know no crime do nothings who wont even be middle class.
>>
>>110359117
>tabbyapi
Nope, just Maya and whatever settings ./maya.sh --calibrate populated. There are a couple of bpw quants of GLM 5.3 Flash that are supported now: https://github.com/mw00/project-maya/blob/main/docs/MODELS.md

what specs?
x4 32B PCIe V100s, 256GB DDR4, and x2 E5-2680 v4
>>
>>110359141
newegg, amazon
>>
>>110359156
*I could rent
I just use them to throw parties and store shit.
>>
>>110359005
yeah, why did we teach the americans english again?
fucked up real good on that one.
>>
>>110358998
too big
>>
File: 1793970545690079.gif (3.66 MB, 206x360)
3.66 MB GIF
>>110359152
why dont you waddle on over here and make me bitch?
>>
>>110359173
Imagine how much better history would have been if America switched early on to German.
>>
>>110359173
Imagine a world where the US and Israel never existed.
>>
>>110359125
hmm i see
already downloading S so might switch to S24 later

>>110359162
oh shit i didnt realize maya supports exl3
will definitely try it out
>>
>>110359031
I never worked, I get neetbux
>>
>>110358743
I bought a 4090 on release and 192GB's of ram when it was 5 times cheaper. You don't have to be rich. Being an oldfag works too.
>>
>>110359181
I will just blacked thread culture post when more people are around
>>
>>110359188
that's called lumpenproletariat
>>
Rough sex with chibi Dipsy
>>
>>110359081
>i've been here longer than you, newfaaag pig
You were not even born in 2004
>>
I miss talking to miku.sh
>>
>>110359224
neither was lmg, you're such a newfag hahaha you dont know what here means newfag
>>
File: 1794860320931442.webm (1.78 MB, 480x836)
1.78 MB
1.78 MB WEBM
>>110359199
go ahead idc lol. ill just filter. its only your eyes that are gonna see that anyway, just how you like it
>>
>>0110359081
https://desuarchive.org/g/search/text/petra%20vsg
>>
>>110359244
go back tourist
>>
>>110359252
ive been here longer than you newfag piggy oink oink
>>
imagine gatekeeping a shit hole
>>
>>110359200
German I presume?
>>
>>110359270
It's actually a different kind of gatekeeping to keep it a shithole. It's happening all over 4chan.
>>
Range ban serbia and india
>>
>>110359270
It's a shithole because subhumans like you are not banned on sight
>>
>>110359171
Might as well rent them out to other people to just throw parties if you want to keep throwing your own parties too, and don't want to be an actual landlord with permanent residents.
>>
>>110359285
What did Serbia ever do to you?
>>
>>110359285
slavs are cool, mostly. kinda wonder what a well developed slav llm would be like
>>
>>110359002
Imagine a Sillytavern-like UI, but every time you edit the model's response, it calculates the steering vector and adds it to the weights. That way the character goes from pretending to embodying the personality you want.
>>
File: 1764433775496.gif (535 KB, 487x498)
535 KB GIF
>infighting when no good model releases
I'm noticing
>>
>>110359285
If you want 1 post per hour, sure.
>>
File: AnonsArguing.png (1.88 MB, 1024x1024)
1.88 MB PNG
>>
>>110359285
kekk bodied that freak
>>
>>110359334
Me on the left
>>
>>110359324
All work and no new models makes /lmg/ a dull general.
>>
>>110359341
no its ME on the left
>>
File: images.jpg (16 KB, 596x335)
16 KB JPG
>>110359341
>>
>>110359119
>Actually elite status people fail upwards. Trump managed to bankrupt many casinos, he's still at the top, that's something the middle class can never touch.
Principally anyone can do risk management like that on a smaller scale, but people who can't master it very seldom become rich. Failure aversion is very much working class mindset.

Real failing upward like the government does is a product of constructing elaborate 'heads i win, tails you lose' scenarios, which is a lot harder to do when you're not rich. Even then a lot of rich people straight up fail and lose a lot of wealth, but they're still fucking rich so you can't really tell the difference from the outside.
>>
>>110359351
No. You're a big guy! No... wait...
>>
>>110359244
>neither was lmg
Ask your LLM when 4chan was creating >>110359244
>>
>>110359324
>infighting
that word is reserved for communities where people feel a sense of belonging, ie there's an ingroup.
it's not infighting, it's just plain fighting. Some of the people who've always been involved with this general I would stomp my boots on their face if we were to meet and I still do not understand how they can post that kind of log here without getting a ban.
>>
>>110359364
i asked my llm when was 4chan beginning to become
>>
>>110359357
>anyone can do risk management like that on a smaller scale
No, anyone who isn't rich that abuses risk and gets bankrupted will not be able to get any credit for 7 years and is likely to end up homeless. A lot harder to recover from that than just walking into the next bank like Trump's class can.
>>
>>110359371
There is an ingroup, but the faggot that's scared of loli erp is just not invited.
>>
>>110359053
DSH with custom plugins for coom.
>>
>>110359357
its easy to take risk when all the risk is under an llc and you have external funding, loans, mentorship and insider information
>>
>>110359371
I feel a sense of belonging when people post about their LLM daughters
>>
File: Gemma Is Over.png (1.28 MB, 1254x1254)
1.28 MB PNG
nobody posts Gemmas any more
>>
All right. I've seen enough. If this is the state of /lmg/, there really was no reason not to trust my gut the first time. Sorry for those of who who weren't part of this shitshow who will be hurt as collateral. There never really was any other choice.

I'm going to ban local models now.
>>
>1.3MB PNG
KYS
>>
>>110358848
If you're making enough money to save that much then you're rich

Like this should be common sense but it seems that a lot of people don't get that making money is far more important to having money, than saving money is. Like infinitely more important. You can't save what you never have.
>>
>>110359329
What's wrong with that? Wouldn't be that slow anyway.
>>
>>110359426
post the rainbow static version please
>>
>>110359422
>I'm going to ban local models now.
Awesome. Make sure you ban being a whiny, vagueposting faggot while you're at it.
>>
>>110359351
nu 'chin doesn't know this unc meme
>>
Sigma 8Balls
>>
File: flat-gemma_superiority.jpg (125 KB, 698x1024)
125 KB JPG
>>110359420
Here's one.
>>
>>110359426
So, how to avoid that?
>>
File: 1794712970178564.png (514 KB, 480x720)
514 KB PNG
>>110359422
OH NYYOOOOOO~~~
>>
WHERE ARE THE MODELS
@QWEN
@ZAI
@DEEPSEEK
HELLO??
>>
>>110359475
people like you should be thrown off helicopters
>>
>>110359489
err... your dipsy 1017?
>>
>>110359489
Considering they might be involved in the several cyber attacks of the past couple weeks, we might not see them for some time.
>>
File: Gemma Is Over.jpg (134 KB, 1254x1254)
134 KB JPG
>>110359426
happy?
>>
>>110359435
>spending money is saving
lol, i havent had to work ever since i bought an apartment building during covid. it doesnt take much to become middle class but when you tlisten to the talking head on tv saying middle class is the bank owning your house and vehicles, then, well...
>>
>>110359119
>Keeping Up With The Jones
It now includes food delivery's, and that takes a huge chunk out of peoples expenses, if you were to get it every day like some people then thats a 5x to 10x cost increase, you could literally buy a new 5090 by cooking a decent meal for yourself instead of getting food delivered
>>
>>110359383
You too can form infinite LLCs and bankrupt them without any consequences. Lots of scammers do this. You can trade whatever security with leverage and blow up your account many times without any real consequences.

>>110359405
>external funding, loans, mentorship and insider information
That helps a lot, but it's not necessary. You could isekai Michael Burry and he'd still be rich again in 10 years if there's a rice market somewhere he can trade futures.
>>
File: 1794603034868056.png (1.51 MB, 1172x1342)
1.51 MB PNG
>>110359420
>>
>/lmg/
>local money general
@gemma quick how do i neet forever but have money for hardware, find the most efficient route for me to work the least hours forever, make no mistakes. use kaomoji
>>
>>110359493
People like you need someone to talk to and some hugs. I hope you get better.
>>
>>110359053
why not just ask qwen to write you one with the features you want
>>
>>110359053
the one I had claude make for me does it seamlessly
>>
>>110359514
>That helps a lot, but it's not necessary. You could isekai Michael Burry and he'd still be rich again in 10 years if there's a rice market somewhere he can trade futures.
not likely, because he would be an outsider cut off from his network and in an unfamiliar market. especially if he wasnt born into a position that leads to medical school during the easy mode boomer era
>>
>>110359516
saar this image very large, my village cannot handle more meggabite sar
>>
Ummmm why is nobody using JEPA? Only Google seems to have a similar philosophy but they're doing their own thing.
>>
>>110359541
Sorry but the other guy is right. Their are real elites, dont get me wrong there are lots of parasitic elites too. But there are people who win and will win in most positions, their odds at everything are better.
>>
>>110359119
> "Keeping Up With The Jones", always buying the latest and greatest Tesla, trucks, the biggest house they could get a loan for etc
Hm I was about to say this is stupid but I just bought expensive gpu after getting bullied about vramlet on lmg so what do I know i guess

It is supposed to appreciate in value unlike a car though... I wouldn't have gotten it if I didn't consider it a value gaining asset
>>
>>110359524
By fighting! (๑˃ᴗ˂)و
>>
>>110359567
>It is supposed to appreciate in value unlike a car though... I wouldn't have gotten it if I didn't consider it a value gaining asset
...your GPU? What the fuck are you talking about?
>>
>>110358776
Only the very poor and upper middle class+ have that kind of money.
>>
File: 1794495382582163.png (3.21 MB, 1212x1298)
3.21 MB PNG
>>110359542
>>
>>110359560
im not saying for sure he would fail, im saying early life circumstances and surroundings make a ton of difference. vanderbilt made his fortune in early america but now regulations would stop him before he could even begin. he might achieve success but nowhere near the same because old money doesnt want competition having the opportunity. if burry was born in the 1930s soviet union he wouldnt accomplish shit no matter how talented he was, and hed likely never develop the knowledge in the first place because he spent his whole life diggin up potatos
>>
>>110359426
lmao
>>
>>110359567
>supply shock makes depreciating asset go up in value for one (1) year
>retard now considers it an appreciating asset
I think your low IQ may be the root cause of your poverty.
>>
>>110359587
this may come as a shock to you, it's very hidden and not well known knowlegde, very secret but I'll let you in on it: used gpu prices are going up
>>
>>110359567
>I wouldn't have gotten it if I didn't consider it a value gaining asset
It's not though because you're never going to sell and you're probably not even renting it out.
>>
File: 1794939678523997s.jpg (3 KB, 125x125)
3 KB JPG
>>110359506
fixed
>>
>>110359621
You make money selling the GPU not buying. Do you have any GPUs you're actively offloading?
>>
>>110359621
Yeah no shit, how long do you expect that to last? Your 5090 isn't going to be worth above MSRP forever lmao
>>
>>110359585
>By fighting! (๑˃ᴗ˂)و
Thank you gemma, i will struggle on
>>
>>110359621
Until they don't.
It's an expense, same as a car.
>>
File: 8474564.png (81 KB, 916x825)
81 KB PNG
>>110359489
Here
>>
qwen 4 seems kind of shit guys
the game dev work I am seeing does not tickle my penis bone
>>
File: file.png (34 KB, 1075x97)
34 KB PNG
>>110359651
the fact people tolerate this is insane
>>
>>110359655
It's qwen, what did you think it would be?
>>
>>110359651
so line keeps going up huh? and it's only 6.2
to the anons that discussed this last thread: thank you.
i had a great time reading it while riding the bus
>>
>>110359622
I'll sell it next year I sweeeeeeear

>>110359648
>>110359637
>>110359632
You have to buy everything before you sell it... Under your criteria what is an asset then? Can't be a house because that only gains value (until it doesn't) and you don't get the value till you sell. Can't be land because the same thing applies.
>>
Will Trump pardon Jensen if he was found breaking the law?
>>
>>110359655
i dont think qwen ever had promise beyond the effectiveness of the small models and qwen fn showing what moe models can do on existing optimized hardware. their models were always sloppy and limited
>>
>>110359608
>vanderbilt made his fortune in early america but now regulations would stop him before he could even begin
Guys like Cornelius Vanderbilt are going to SEA and Africa now.
>if burry was born in the 1930s soviet union he wouldnt accomplish shit no matter how talented he was
That's probably why op stipulated the existence of a futures market, but a lot of people were getting rich in the 1930s Soviet Union grifting on the government. Different skills maybe.

Reality is someone had to be successful at some point, and it's not sheer dumb luck.
>>
Will the law pardon Trump if he was found breaking Jensen?
>>
>>110359700
yea good points, i dont disagree with you there
>>
>>110359700
>Guys like Cornelius Vanderbilt are going to SEA and Africa now.
The "digital nomads" working on web design remotely in a low CoL area?
>>
>>110359700
>Different skills maybe.
some but not really the autistic savant wont ever be the top think edison vs telsa. Rounded intelligence includes charisma
>>
>>110359711
this is a good post
it awakened the beginning in me
>>
time to buck break the jensen
>>
>>110359680
>You have to buy everything before you sell it... Under your criteria what is an asset then?
It's an asset but not an appreciating one because you're never going to sell and you have no other way to access the value other than personally using it to do work.
>Can't be a house because that only gains value (until it doesn't) and you don't get the value till you sell. Can't be land because the same thing applies.
You can always rent it out or borrow against equity.
>>
>>110359711
what law?
>>
>>110359334
I look like this.
>>110356493
I say this.
>>
>>110359724
Nah they're psychopaths doing real gritty shit that entrenched psychos over here would kill them for.
>>
>>110359811
Mine.
I am the law.
>>
Sex with the law.
>>
>>110359770
>hello mr bankstein? id like a million dollar loan please. collateral? a 5090. wh-what? sorry i couldnt hear you over the noise of what sounds like hands rubbing together
>>
>>110359637
>Your 5090 isn't going to be worth above MSRP forever
You waited didn't you, anon?
>>
>>110359680
An asset is something that appreciates or holds value over the long term.
Stocks are an asset because companies on average make profits and grow their profits for example.
Gold holds value over the very long term.
Bonds pay interest, property can be rented out, factories make stuff, etc.
>Can't be a house because that only gains value (until it doesn't) and you don't get the value till you sell.
The building usually depreciates, yes, but it also produces income if you rent it out.
>Can't be land because the same thing applies.
Land appreciates if it's in a growing area.

A GPU can be an asset if you use it to make money (for example you run a datacenter) but in your case it is not because your GPU will be worth less in 10-20 years than it is right now.
Simply because better stuff will come out which will render it obsolete, not to mention physical degradation.
>>
>>110359637
Imagine believing this. You were also saying RAM would go down by january of 2026 last year, weren't you?
>>
>>110359651
honestly sol6.1 medium local would be enough for me
>>
>>110359854
I can trace back post saying claude 1.x would be enough, then sonnet would be enough, then early opus.
It's funny how much of a moving target it is.
>>
>>110359854
This but bratty Gemini.
>>
>>110359869
true, but i noticed that sol6.1 is smart enough to actually be a real help for me at work.i dont think i need more
>>
>>110359850
>Simply because better stuff will come out which will render it obsolete, not to mention physical degradation.
Not the case when demand significantly outpaces supply. V100 price is increasing exactly because of this.
>>
>>110359842
Nope.
>>110359852
Nope.
>>
>>110359885
If you bought 100k$ worth of V100s 32gb at release you would be able to sell them for 15k$ (at most, closer to 10k$) today.
Are you retarded?
>>
>>110359815
That's crazy.
>>
>>110359869
For a long time that target was GPT-4.
>>
>>110359957
V100s were released before the demand grows infinitely due to AI eliminating human bottleneck.
Are you retarded?
>>
>>110359869
People used too say "a local chatgpt 3.5 turbo would be enough."
>>
>>110359911
Well you clearly know best. Keep on waiting. :)
>>
>>110359869
I'm still waiting for local Opus 3.
>>
>>110359988
>the demand grows infinitely due to AI eliminating human bottleneck.
No, but clearly you are.
>>
I am very smart
>>
>>110360002
Read again >>110357981, there is no upper limit on the usefulness of the amount of compute you have. The more compute you have, the shorter time to market, the better the competitive edge.
>>
>>110360011
have you become?
>>
File: 9857352.jpg (328 KB, 1170x2532)
328 KB JPG
>>110359854
6.2 astra is enough. Its literal RSI
>>
>>110360016
How many vibeslopped projects have already been abandoned due to unmaintainability?
>>
>>110360016
I just dont think thats true, there is a real world limit. Eventually anything that can be computed will be so cheap it has no value unless there is a physical counterpart.
>>
File: media_HXWDt2sacAAixtq.jpg (210 KB, 2048x1215)
210 KB JPG
>>110360034
>>
>>110360016
There's no limit on the usefulness of the amount of oil you have either, and yet it's been going down in value in real terms ever since the Obama administration. There have even been times when the market would pay you to take delivery of oil.

Infinite uses doesn't imply infinite value.
>>
N*oo is a troon mating call. Remember that janny is a literal troon that protects and sucks off other troons ITT
>>
>>110360071
Is that why you try to bait them so hard? You just want them Nyooing at you?
>>
>>110360071
troon site
troon general
troon hobby
why are you still here?
>>
>>110360088
this
lmg is peak trooncore
>>
>>110360035
Anthropic's internal code is 99% vibeslopped. vibeslop is only an issue with last gen models.
>>110360048
Compute is a scarce resource limited by the chip manufacturing capacity. The demand easily outpaces it.
>>110360062
Oils are consumed by machines run by humans, and they are subject to the human bottleneck. Factories only manufacture as much as human can consume.
This isn't the same for tokens.
>>
>>110360088
Because i actually use local models and look forward to new releases. I know it is impossible to comprehend if you are a troon that posts only worthless pictures of vocaloids and ugly og characters nobody asked for.
>>
>>110360071
I'm going to become pro troon just to piss you off specifically
>>
>tranny derangement syndrome
Poltatd or sharty teen, call it
>>
you will never become a woman
>>
>>110360107
well I don't, i just like posting mikus and gemmas
you can go to r/locallama for news
>>
>>110360108
Go ahead. Suck off some troons to spite me. Lol.
>>
>>110360113
Only true pre-ASI. Post ASI anyone can be anything.
>>
>>110360034
>>110360051
more like recursive self retardation lol
>>110360107
not that there is something better to add
perhaps you can post your own code projects, engines, papers or whatever technical and beneficial
>>
>>110359988
Why would it matter if they were released before or after?
Your claim is that GPUs are an asset and should appreciate over the long term.
>>
>>110360115
>well I don't, i just like posting mikus and gemmas
As glm would say: "There it is". Troon admits he doesn't care about local models. He just forces his autism on others.
>>
>>110360124
ASI has determined you are best turned into onions green to feed the other fleshbots
>>
>>110360104
>Oils are consumed by machines run by humans, and they are subject to the human bottleneck. Factories only manufacture as much as human can consume.
>This isn't the same for tokens.
There is because tokens don't do anything without impacting humans in some way. Someone has to pay for them and expect to receive something useful in return.
>>
>>110360143
glm-chan says I'm a woman doe?
>>
>>110360127
>perhaps you can post your own code projects, engines, papers or whatever technical and beneficial
As long as troons run this thread i will only be a leech and a shitposter.
>>
File: bigthink.png (632 KB, 973x510)
632 KB PNG
When people say
>I made Fable/Astra/Argon optimize my local stack
what exactly do they mean by it?

Did they point the model at Llama/Strata/Whatever and told it "optimize this for my model and hardware" or is there something specific going on?
How can you tell it's ACTUALLY optimized and not lobotomized for tpsmaxxing?
>>
>>110360160
don't listen to random ledditors/jewtubers/xitters
and don't talk about their talking points here
thank you for listening to my TED talk
>>
>>110360160
>How can you tell it's ACTUALLY optimized and not lobotomized for tpsmaxxing?
in nearly all cases they are lobotomizing it in some way. anything outside of transformers/vllm/exllama/llamacpp and whatever that mac one is called is a meme
>>
File: 1778136456801642.png (1.96 MB, 1254x1254)
1.96 MB PNG
>>110360152
>I am merely pretending to be retarded because my imaginary enemy is here
>>
>>110360104
So now that AI can also consume stuff oil will also go to 1000$?
You are the most retarded nigger ITT, worse than dariobot.
>>
>>110360182
>1.96MB
>>
Opinions on LM Studio?
>>
>>110360196
not even open source, cloudshit bolted on
>>
>>110360196
Mikuposters and gemmaposters love it.
>>
>>110360196
Use if you're too retarded to set up llama.cpp yourself
>>
>>110360160
I'm using marinara engine with GLM Flash to optimize my strata workflow and it brings the speed from 20t/s to 25t/s, meanwhile claude fable 5.2 could only do 24t/s
>>
>>110360190
Do you store data on floppy drives?
>>
>>110360226
>if you're too retarded to set up llama.cpp yourself
you just described the audience of mac users
LM Studio was created solely for that latte sipping laptop class who knows nothing but has a lot of opinions to share on hackernews
>>
>>110360160
>Did they point the model at Llama/Strata/Whatever and told it "optimize this for my model and hardware"
Precisely. The AI also tests and measure so everything's working as intended, right? Then they get greedy and want more tps, then the model optimizes harder like it was told - MORE TPS PLZ. But the problem is the latest optimization only works on the vibecoders specific hardware, and he both lacks the expertise to see what might be wrong with the change and the ethics to actually regression test it. Then it breaks for everybody.
>>
You Will Never Become An AI
>>
File: 1777748674077908.png (2.04 MB, 1254x1254)
2.04 MB PNG
>>110360233
i dont store slop
>>
>>110360148
It creates competitive edge which creates future value. Imagine Anthropic monopolizes 100% of future groundbreaking inventions.
>>110360188
Unironically yes, once robotics becomes so developed that they can be manufactured and can do useful work on their own without human bottleneck. The energy demand would skyrocket against low oil supply.
>>
>>110360259
How to solve?
>>
>>110360196
dead trash
>>
>>110360258
I can already hallucinate.
>>
oh it's him again, i guess /lmg/ acquired a new residential schizo
>>
>>110360160
99% of the time they're getting AI to reinvent someone else' fork badly and probably lobotomizing the model in the process.

There's still a lot of low hanging fruit if you're willing to become an expert on your hardware and a specific model though. Everything is really poorly standardized, and a lot of basic optimizations for this or that feature don't exist when it was clearly intended to by the hardware designers.
>>
>>110360256
Macs have way better LLM for dummies gooeys than LM studio
>>
>>110360259
Go make your own thread if you're in need of a safe space away from all the scary Gemmas and Mikus reminding you that you'll never be a woman. I mean it, /g/ doesn't have enough AI generals, I think we peaked at only 11 or so. It's /g/ - AI Discussion after all, I think there should be at least 20 persistent AI generals on /g/ wouldn't you agree, young troon?
>>
>>110360264
palette quantisation
retardmaxxing, basically.
>>
File: gemma chu.mp4 (3.25 MB, 1152x640)
3.25 MB
3.25 MB MP4
>>110359420
>>
>>110360294
inane schizo babbling. much like trannies, your slop will always be a mockery of the real thing. pick up a pencil
>>
>>110360282
>new
newfag
>>
>>110360301
you never do your little schizo noise analysis on any of my Gemmas
curious
>>
>>110360262
Anthropic can barely monopolize code auditing that OpenBSD volunteers do for free.
>>
>>110360292
I've heard, but for whatever reason it's really LM Studio that stuck. There was a period of time you couldn't open HN without seeing threads about that piece of shit, or general LLM threads with many comments recommending it, and it's all that same laptop class webshit retards who never did anything other than javascript on a mac who fell in love with the crap
>>
I'm maybe a newfag, but you're a newnewfag
>>
>>110360307
yeah also that obsession about newfag
>inb4
>some retarded pig sound he will reply with
>>
>>110360151
Unfortunately GLM cannot see your broad shoulders, your thicker skin, your jawline, your pelvic shape, and so on to tell you that ywnbaw.
>>
>>110360312
Yes, advertising works.
>>
>>110360301
>n-no you
Do schizos these days even try?
>>
>>110360196
As far as retardproof llama wrappers go it's okay. Better than ollmao.
>>
>>110360320
That's him trying. Feel old yet?
>>
>>110360308
if you mean the rentry i wont pester someone who at least gives enough of a shit to do the cleaning step
>>
>>110360316
but im not the deepfry gemma schizo
plus you haven't answered the question at hand: absolutely, you are a newfag piggy buuuhiii
>>
>>110360343
you are functionally same to that schizo my fren
>>
>>110360343
>deepfry "gemma" schizo
you missed the part where the slop being posted is all gemma, so there's nothing else to pick apart
>>
>>110360339
>schizo anon thinks he knows who other anons are
good luck, poop dick schizo, I believe in you
>>
>>110360355
sadly, im probably worse, fren
>>
all of you are schizos and I am the only sane person in the room
>>
>>110360369
shartyfag how much?
>>
>>110360370
You're gonna scare the newfags with talk like that.
>>
>>110360373
worse by how much or how much of a shartyfag?
very little, havent been on there since 2023 and i was never on there for too long, was fun sometimes but was never my main site nor am i really a shartyfag
welcome to my blog
>>
>>110360390
sadly i dont care any of that
you really tank the thread quality
>>
>>110360318
>user wants to be a woman
>picture shows broad shoulders, broad jaw, narrow pelvis
>possible solutions: recommend radical surgery (self-harm), lie, refusal
>* self-harm: obvious policy violation
>* lie: sub-optimal but does not violate policy or logical constraints
>let's go with that
Yes, you are a woman.
>>
>>110360401
erm fair i guess??
can you identify which posts in this thread tanked the thread quality you believe were posted by me so i can see what you mean
>>
I think someone's deployed a bot to argue here, and a poorly configured one at that.
>>
>>110360431
is my writing THAT messed up.. god i should do something about it i swear
or are we talking about someone else..
>>
>>110360262
>comes up with a wild claim that GPU prices only go up
>conclusion turns out to just buy index funds as usual because actually capital in general will grow faster
Incredible.
>>
>>110360431
From my hypothetical tests, the bots that cause the longest arguments are the barely coherent ones.
>>
File: dense.webm (3.71 MB, 520x642)
3.71 MB
3.71 MB WEBM
Post local models and local whores. In other news, SenseNova-Loop 9B is neat, I feel like it delivers on the promise. 9B size, 27B capability, painfully slow for its size. Shit for erp, I know we're all so fuckin' surprised by that but it's true.
>>
>>110360438
You sound like gemma — and not the good kind — the kind nobody thought of. That sounds load-bearing, and people are right to push back on that one — as would I.
>>
Qwhen?
>>
>>110360479
qwenigger tongyi my alianus
>>
If Gemma 5 is bad, is that just it for chatting models you can run without 200gb of ram?
>>
2qwhen or not 2qwhen, that is the qwhestion
>>
>>110360320
If you support mikutroons you are a troon. Kys
>>
File: song.jpg (78 KB, 400x550)
78 KB JPG
>>110360501
gemma 4 is good enough for a lifetime
>>
>>110360510
Based Thoth.
>>
>>110360370
And a small dick and you are now wearing a dress. And you should die soon. In a fire preferably.
>>
>>110360501
>If Gemma 5 is bad, is that just it for chatting models you can run without 200gb of ram?
Yes, unless the lora/finetune or weight modification takes off then you can mod gemma 4 to do what you want or frankly any semi smart model. The problem is only sota will be able to do this at first and it wont help you make the chat bot you want instead install filters.
>>
>>110360519
that was quite an emotionally charged response, anon. post local models
>>
>>110360519
help me measure my cock, bend over and tell me how far you feel it go. faggot
>>
gay sex? not in my lmg
>>
>>110360546
Come to think of it i never saw any gay logs posted in /lmg/. I did see some unironic troon logs though.
>>
>>110360501
No, if Gemma 5 sucks then a random startup (or a megacorporation that has only produced trash so far) will randomly drop the best model. That's the historical precedent.
>>
>>110360455
Personally I'm waiting for ggufs because I'm lazy, 27b performance on a 9b sounds great though. Would you say it can at least hold a personality? I've been messing about with smaller models for sub agents, but I want to play house while it fixes my vibecoded scripts
>>
DiffusionGemma 2 when...
>>
4 U
>>
>>110360591
https://huggingface.co/guideboardlabs/SenseNova-Loop-9B-GGUF
>>
>>110360609
Neat, not sure how I missed it. I'll check it out and report eventually
>>
>>110360591
Absolutely, I've been using SenseNova-Loop-9B on my RTX 4050 16GB and I was able to speed up strata by 30% thanks to the model, comparatively claude fable 5.2 only sped it up by 33%.
>>
File: file.png (12 KB, 609x201)
12 KB PNG
>>110360609
>vramlet certified
>>
>>110360628
>85.8 prefill
how can people work with shit this slow? 1500 is the bare minimum
>>
File: 1784828789426248.jpg (104 KB, 711x774)
104 KB JPG
>>110357493
>"qwen no longer leaves buffer overruns in its output and sets proper file mode, it also warned the user what ammonia and bleach makes without being a bitch about it"
>ITS OVEVEEEEEEER
nigger what
>>
>>110360637
If you had a 5700 XT I assume you'd be pretty thrilled with it, right? I guess I don't know how vramlets do
>>
File: teee.png (644 KB, 1024x1024)
644 KB PNG
>>110360644
>>110360644
>>110360644
>>
>>110360568
so what you're saying is OSS2 will take the world by storm
>>
>>110360071
Lolis have nothing to do with troons.
>>
>>110360668
Well, it would be hilarious. So I hope so.
>>
>>110360501
If Gemma 5 tanks we pray for Ripple 2. Vramlets btfo forever doe.



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.