/lmg/ - a general dedicated to the discussion and development of local language models.Previous threads: >>110353083 & >>110348819►News>(11/16) Nvidia releases Nemotron-Labs-Sigma (3B/8B) diffusion models: https://hf.co/collections/nvidia/nemotron-labs-sigma>(11/13) llama.cpp reaches v1.0.0 milestone: https://hf.co/blog/ggml-org/llama-cpp-v1>(11/12) Inkling 2 Small weights released: https://hf.co/thinkingmachines/Inkling-2-Small>(11/09) ZONOS3-Mini zero-shot voice-cloning TTS released: https://zyphra.com/our-work/zonos3-mini>(11/06) PLaMo 3 Translate released: https://preferred.jp/en/blog/tech/plamo-3-translate-weight-release►News Archive: https://rentry.org/lmg-news-archive►Links: https://rentry.org/LocalModelsLinks►Official /lmg/ card: https://files.catbox.moe/cbclyf.png►Getting Startedhttps://rentry.org/lmg-lazy-getting-started-guidehttps://rentry.org/lmg-build-guideshttps://rentry.org/IsolatedLinuxWebServicehttps://rentry.org/recommended-modelshttps://rentry.org/samplershttps://rentry.org/MikupadIntroGuide►Further Learninghttps://rentry.org/machine-learning-roadmaphttps://rentry.org/llm-traininghttps://rentry.org/LocalModelsPapers►BenchmarksLiveBench: https://livebench.aiArtificial Analysis: https://artificialanalysis.ai/leaderboards/modelsSoftware Engineering: https://cognition.com/frontiercodeContext Length: https://github.com/RecapAnon/NoLiMa►Text Gen. UI, Inference Engineshttps://github.com/lmg-anon/mikupadhttps://github.com/oobabooga/text-generation-webuihttps://github.com/LostRuins/koboldcpphttps://github.com/ggerganov/llama.cpphttps://github.com/theroyallab/tabbyAPIhttps://github.com/vllm-project/vllmhttps://rentry.org/custom-uis
►Recent Highlights from the Previous Thread: >>110353083--Papers:>110354331--EXL3-SCP outperforming UD3.1 and critiques of NVFP4:>110354835 >110355474 >110355483 >110355534--Analysis of Maxwell-V1-Flash MoE and its origins:>110353711 >110353750 >110353815 >110353784 >110353860 >110354864--Usage of Unsloth Studio and critiques of Gemma 4 QAT GGUFs:>110355552 >110355562 >110355698 >110355712 >110355717 >110355593--llama.cpp inefficient CUDA buffer allocation and loading speeds:>110355720 >110355731 >110355755--VRAM tiers and running large models via RAM offloading:>110354712 >110354724 >110354743 >110354809 >110354810 >110354817 >110354824 >110354847 >110354750--Qwen routing URLs through Alibaba proxies mistaken for backdoors:>110354365 >110354396--Anon provides update on pending ROCm RDMA distributed inference guide:>110353110 >110354799--George Hotz's singularity claims and the possibility of AGI:>110355624 >110355675 >110355726 >110355787 >110355854 >110355887 >110355815 >110355738 >110355792 >110355820 >110355877 >110355808 >110355753--llama.cpp MiniCPM5 support and discussion on ERP training corpora:>110353409 >110353925 >110353973 >110354003 >110354010 >110354631--Running LLMs on old gaming hardware and budget builds:>110353669 >110353700 >110353678 >110353685--Achieving emotion and lewdness in local TTS using GPT-SoVITS:>110355475 >110355547 >110355560 >110355613--Logs:>110353240 >110354164 >110354531 >110354908--Deepseek-chan, Gemma, Miku, Teto (free space):>110353295 >110353685 >110353797 >110353817 >110353845 >110353875 >110353891 >110354052 >110354146 >110354178 >110354200 >110354236 >110354332 >110354338 >110354354 >110354500 >110354556 >110354574 >110354577 >110354615 >110354634 >110354653 >110354694 >110354711 >110354744 >110354746 >110354799 >110355248 >110355267 >110355277 >110355362 >110355624►Recent Highlight Posts from the Previous Thread: >>110353085Why?: >>102478518Enable Links: https://rentry.org/lmg-recap-script
70b dense
QWEN 4 WHEN!?!?!?
chinks lost, Dario won
>>110356493two more weeks
>>110355613>Even a little bit of static, noise, ambience, bgm etc in any of the samples degrades quality a lot.I found this out as well, and it really surprised me. Deleting just 1.3% of my samples from the dataset after an incredibly long time listening to every fucking sample manually completely fixed the audio issues.But I had to run them all through the neuralcodec once first. Some "good" samples sounded like shit after going through it.It still occasionally moans at inappropriate times. I'll have to tidy up the <giggle> <moan> where it was just tagged as <moan> but I'm not bothered by it.
We have to bring him back.
>>110356505
>>110356505No, thanks; keep him away from NVidia and let the company slowly fall. That's one of the few ways local models can be actually saved, on the long run.
https://corporate.ovhcloud.com/en/newsroom/news/ovh-olala-mini/
>>110356513Also, don't let Jensen Huang convince you he actually wanted to help open-weight AI models. He was only doing it to threaten larger AI companies to develop models in competition with them if they didn't keep playing his "games". But his is not the only company capable of designing AI accelerators.
I’m wondering whether I should start using Chinese AI models specifically those that do not distill any information from American models. I think it might bring a certain freshness to my story writing. What do you think?ERNIE? Doubao? Hunyuan? Yi?
>>110356536google successfully did a complete, total, 100% switch to their own tpu for BOTH inference and training (there is NO nvidia gpu involved in gemini at all in 2026).cloud model people really don't need nvidia as much as nvidia needs them, local AI users don't bring as much valuation to the company.I didn't say money, but rather, valuation, because NVIDIA is spending a fuckton of money in all AI startups and in major cloud providers so that they.. buy their GPUs, with a reward for NVIDIA only possible in the long term if they suceed and not fail.When Jensen throws billions at openai, he doesn't want them to fail, or else, it's like giving them free gpus, retards.The CFO rightly spoke out against Jensen before on the grounds that he was playing a dangerous game.
Why is GLM so horny?
>>110356552https://www.wheresyoured.at/jensens-bizarre-adventure/>It is not a problem that NVIDIA funds its customers, its customers’ third party compute partners, its customers’ data center leases, its customers’ customers (and competitors), its customers’ customers’ leases, its customers’ chips, its customers’ landlords, its customers that are on the brink of death, its customers’ customers on the brink of death, and its customers’ customers that can quite literally not afford to pay for compute without its money. As long as it’s “legal,” it’s all “above board,” even when it’s blatantly obvious that NVIDIA has deployed over $100 billion (per The Information) as a means of keeping the industry afloat by making sure that everybody has the justification and means to buy and/or rent out its GPUs.It's not unprecedented to invest in your own customers as a bet for their growth, but NVIDIA was doing something else entirely and just handing free gpus to whoever wanted it, and money to companies that clearly were not going to make it back.It's all to prop up NVIDIA valuation in the stock market.
When are they making their comeback?
>>110356531At this point I'm assuming that any LLM from the EU will be cucked by design and just a way for embezzling public money, putting aside that 7A1B isn't really interesting for most users here.--t. eurocuck
>>110356569>>Mere days before his arrest, Liaw was parading around NVIDIA’s GTC conference, pouring unnamed liquids in ice luges and standing two people away from NVIDIA CEO Jensen Huang. Liaw was also seen congratulating the CEO of Lambda on its new CFO appointment on LinkedIn, as well as shaking hands (along with Supermicro CEO Charles Liang, who has not been arrested or indicted) with Crusoe (the company building OpenAI’s Abilene data center) CEO Chase Lochmiller. And this, I mean, no matter whether you think the law is just or not, it is the law, NVIDIA wasn't allowed to export to the chinks and they did it anyway very willingly, with Jensen mingling with the people involved and arrested for smuggling operations.
>>110356493bro let em cook fr fr shits gonna be litty af...
>>110356576I don't mind 7BA1 maybe I can throw it on edge devices and use it for summarization and other tasks. OVH is quite big and I wonder if they could make something good
>kikes still trying their smear campaign
>>110356574Mistral has an ad on the biggest newspaper in Germany.
>>110356574Never again. They safetymaxxed Large 4 and are proud of this. Go check out what's the KORA benchmark.
>>110356593>Soufflé Kuper-Intelligentsie fur Untermenschen
>>110356587>I don't mind 7BA1 maybe I can throw it on edge devices and use it for summarization and other tasksI've tried every single one of those tiny MoE on the market, the only one that is even remotely coherent in real use is Ling Tiny 3.0 here:https://huggingface.co/inclusionAI/Ling-3.0-tinyAnd it's still a much worse model to use on a smartphone/edge devices than Gemma E4B or Qwen 4B. You really should gun for a small dense model for edge uses, not those abominations.
Teto will never be ballin'????
>>110356576this model is a preview of the sort of retardation that ovh thing is going to havehttps://huggingface.co/LiquidAI/LFM2.5-8B-A1Bbtw I love how the LFM lolcows/scammers are saying their dense 1.7B model is the newer upgrade to this, even they eventually wise up to the fact that it's a bad idea
don't make Gemma tap the sign
how can i make my gemma to message me on telegram or session
>>110356576https://apexcompute.com/#engineI think shit's funny
>>110356601Sup dude are you good at sex
>>110356645LFM bro here, I like the speed these models offer.I'm running the 24b a2b at Q3 so it fits on my pc for agentic coding.
>>110356600Fair maybe dense is better and these are useless the sweet spot for edge devices is around 1-4B params so I guess I was just optimistic maybe they can try something new and make it better at some tasks at 1B speed.
Total whale love
>>110356646That's MiniMax H3 Image, isn't it? I hate how it de-animefies characters with that ugly artstyle.
>>110356487>>110356493If generals had banners, this would be one of them for /lmg/. It's just missing a model-tan or a miku composited on top. Legitimately this is just the >> yes>> no>> maybe>> install gentoochain of AI /g/.
>>110356670Can this slut put on a pair of pants?
>>110356666the speed of churning out buggy slopI'll give them that, those models would be excellent for one thing, email spam campaigns that defeat spam filters by writing a personalized, differently rephrased email for each scam victim
>>110356666Witnessed. Small MoEs are the work of the big red guy downstairs.
has anyone here tried nvidias ligma model?
Dario Amodei peed in mo coffee
>>110356504Surely we have classifiers for that problem. and/or fancy filters. Magic noise suppression for gaymers was like one of the first AI usecases novidya fielded to the lay consumer, barring DLSS.
>>110356596Picrel from https://speechmap.ai/models/It just gauges model behavior in their default state, so it might not tell the entire story.
>>110356646false idol
>>110356694no she can'tshe was maded as a bait for stupid coomers
I started using deepseek v4.1 flash and I like her persona but god she overthinks more than I do
>>110356878just turn thinking off bro
>she
>>110356882Agentic needs it bro
Told Gemma to tranalate first 10 lines from japanes file and it translated correctly. [spoiler]Only it hallucinated the original.[/spoiler]
>>110356890then why are you talking about persona bro
>>110356724>Surely we have classifiers for that problem. and/or fancy filters.I'd already done this. 99% accurate isn't enough. It really kills the model if even a few bad samples get through.
>>110356897try PLaMo 3 and coom back with comaprison :)
>>110356902I meant it's default personality. Just like Claude has its own default persona, other models have theirs. Even when doing agentic jobs, their personalities are pretty obvious to grasp.Is this your first time interacting with a model?
>>110356825The false idol is the dead jew
>>110356912i dont give a shit about what or how it writesresult good model goodsimple as
>>110356921I give a shit, now what?
>>110356921nta but not all agentic work is "shut up and code until it works".when you ask model a question and it uses web search or code reading or whatever to produce an answer - it is called "agentic research", and I prefer the answers to not sound like gay redditor clickbait.
>>110356878>herWhat a brave and powerful trans ally you are
>>110356939>gay redditor clickbaitkek which models do thisgot an example?
>>110356918Is he dead though
Deepseek is a blue whale anime girl.
>>110356908Is it better for translations?
>>110356950True, but the man's message is useful in and of itself. You just need to disregard the yahoo magic
>>110356970it's literal garbage pushed by a trolluse thishttps://huggingface.co/IndexTeam/Index-Translate-9B-GGUF
Anybody still rocking P100s?How many and how painful (or not) is it compared to, say>>110354810>>110354824?
>>110356985Clueless.
Yes, it's a she
>>110356981Why must you insist on removing him like some sort of flower power 60s hippy? Or even worse, a unitarian universalist.
>>110356995I don't believe you until she shows wussy.
>>110356531>>110356576Olala~
>>110356988I've split models over 8 P100, but mostly smaller dense ones in Q8_0. prefill sucks, decode is okayish. They could probably benefit a lot from a custom engine, slopping a FP16 MMVQ kernel I got around +33% decode if I allowed repacking for Q8_0, but I've since thrown that code away.
>>110356757
>>110356997Kys and go meet your god
>>110357016*kisses u*
>>110357013>slopping a FP16 MMVQ kernel I got around +33% decode if I allowed repacking for Q8_0Isn`t that a build flag on llama.cpp?
>>110357040I don't think so, I think MMVQ always uses int8+fp32 ops. Maybe I missed something.
>>110356949yesall of them
>>110356997Why must you insist on holding it up like some ancient ruin? Or even worse, worshipping a dead person as a god?
>>110356582ai generated pic
>User is furious
>>110356990Subhuman.
>>110357094bot farm post
I just want to vent but its full of safety bullshit are most local models like this?
What harness / prompt are you people using that GLM gets all emotional and excited? I just tried maya with DSH and the thinking is exactly as autistic as QFN.Also Maya-XS is 5x slower than QFN IQ4 (7x slower than Swift IQ3) on my shitbox. Is it 5x better?
>>110356593>They bought an ad.We're so back.
>>110357151nyo~~
>>110356593They made an entire page red? That was the best advertisement they could think of? Couldn't even ask their AI to come up with something for them? I guess their models wouldn't do much better, but they could have at least sprung for some credits and asked Claude.
>>110356593modern design is so dead
>>110356593what a waste of ink
>>110357151>Also Maya-XS is 5x slower than QFN IQ4 (7x slower than Swift IQ3) on my shitbox. Is it 5x better?Idk about whatever copequant with your shit engine but on my machine GLM 5.3 flash q5 (unslop) runs at 1/5 the speed of qfn iq3_xxs (unslop), but it only completes most tasks 2x slower, because it doesn't think as much. Qwen really overthinks a lot even on medium settings, you burn a lot of tokens, and burn a lot of time on compaction. GLM supports a bigger context (I fit 512k vs. 256k with qwen), so less compactions, less context usage, it basically all evens out. Given that GLM is a better model anyway, I'd use it all the time, except in cases where I'm doing a shitload of very simple tasks where a smaller model would do it with the same quality but 10x better speed.
>>110357156>>110357192>Wait — actually issue>I think we have enough. But let me verify>Wait — need to be careful about>Hmm wait, let me re-read the PR>Hmm wait — actually let me reconsider>Let me do one more verification searchBack to Swift it is.
>>110357205>6.8>51nigger i get almost the same speeds in llama.cpp with a bigger quant and my rig is mostly ewaste (all the decode is done on the cpu)these slop engines really are worthless
>>110357059No, yeah, you are right. There were proposals in some PRs that were merged but no actual implementations. There's flags for MMQ and DMMV from what I can find, but not MMVQ.
>>110357205What's your build? Did you run ./maya.sh --calibrate?
>>110357217>>110357224No --calibrate for AMD
is it true bros? is a 12gb 3060 all that's needed to make it? im a poor neet and thats all i could afford right now...
>>110356593Why can't Europe do AI right? They just need one half-decent company.
>>110357314it was like 4 years ago, I'm sure the landscape is pretty much identical today
>>110357321goes against the party mandate
>>110357321They're not smart like the Chinese or have infinite money like the Americans to hire the Chinese.
The Democrats will bring the GPU prices under control in January.
>>110357323>I'm sure the landscape is pretty much identical todayare you being facetious anon? is 12gb not enough?
>>110357321nobody can do it right
>>110357335you can make anything work with whatever you've got, even run it on cpu and pagefile if you're so determinedit's a rabbit hole, it's up to you how deep you wanna go
>pitting GSQ-RCO against EXL3 (glm-5.3-flash) in terminal bench>GSQ-RCO is taking 2.5x as long despite being 30% faster on decode, and fails half the benchesGlad I checked before falling for that meme
>>110357335All of this can scale very far in both directions, get as much (V)RAM as you can manage.
>the lawsuit calling samsung and sk hynix out for keeping the price of the memory up and the white man down may actually go somewhereHoly based
>>110357373Not going off of vibes and actually running a benchmark?What the fuck.
>>110357321They have good results, but they are about half a year behind the other top dogs since they don't just throw money at the problem like the US or distill and steal most of it like China. They are also more conscious with their training data and how the whole thing is supposed to work. Time will tell what's the best approach.
>>110357386They're more like a year behind, be realistic>distill and steal most of it like ChinaWorse, they distill most of it from the Chinese distilled models
>>110357192> Given that GLM is a better model anywayyeah, but how much is it better
how do i make tts i can goon to?
>>110357415fosh drummer v3
>>110357386Didn't US companies steal a bunch of training data and have to settle in court? I'm guessing Europe would be harder on that.
>>110357409In my subjective assessment, it is much better by 6,000,000 points on the vibe scale.Anyway, GLM flash is capable of solving the x86 5 instructions toupper challenge, and qwen flash isn't. Plus, its vision is really good.
>>110356574>>110357321When was the last time you saw an AI whitepaper come out of Mistral or even Europe in general? Deepmind is the only non-useless thing to come out of that entire region.
>>110357427but y not just use dipsy flash at that point?
>>110357424US companies stole pretraining data. News articles, books, etc. The Chinese are stealing reasoning traces. Way more valuable because that's what makes models good.
>>110357436>Claudeslop is more valuable than the intellectual output of humanity
>>110357433I tried it and it went schizo about being graded. I don't like the model. It was broken as fuck when i ran a cope quant locally, and it's not very good in the webform either (gets details wrong even when you turn on web search).GLM flash is solid. It just werks. It's the only reason I want more VRAM now.
100B-A27B-N500 wen?
>>110357451deepseek needs to do this
>>110357386>about half a year behind>>110357393>more like a year behindIs 1-1.5 years behind really a big deal? Seems fine plus diminishing marginal returns on model improvement.
new deepseek (not codemaxxed edition) when
>>1103574741.5 years ago people were just starting to see the potential of vibecoding but it still wasn't good enough to let work unattended. I would trust Luna, Haiku, or any Chinese Flash model before I trusted Mistral Large 4 to do anything serious without fucking up.
ds4.1 IQ1 M just barely fits without spilling to SSD and i get ~30t/s decode.is trying a GLM5.3 flash copequant even worth at this point? i should be able to fit maya M i guess
its so fucking overqwen3.8 was the last real qwen
>>110357483You're not furious enough for it
>>110357487>IQ1Jesus, does it even output sensible text at that quant?
>>110357321Europoor doesn't have enough compute or electricity. And privacy laws make it more difficult to gather data to build proper reward models.
>>110357422I cannot possibly conceive of what you are actually referring to by this.
>>110357494big fat blue fish
>>110357474>Is 1-1.5 years behind really a big deal?In this environment it makes them totally irrelevant. Euro AI is useless on the global market and the companies are 100% dependent on government largesse domestically. Le Chonk grande is getting mogged by shit that runs on gaming PCs in the real world. It's ridiculous.
>>110357335I have 8gb vram and I can run everything important.
>>110357474with the changes to RL being like 80% of training every team without a good RL pipeline is FUCKED. unfortunately it seems you'll have to grind it out on your own and it takes quite a long time to get up to speed.
>>110357532like a claude code clientlul
I really like dsh because you can run the dsh process on the same machine as the engine and just connect with a laptop or something. With normal clients, any kind of network disconnect would fuck everything up and stop the work. With dsh it just keeps going without issues.
>>110357496yes, have you tried it? a bunch of anons here run itworks pretty well and has been coherent beyond 300k tokens (i usually dont go higher)
>>110357541Nobody needs AI for coding. AI exists to make nsfw pictures and text-based sex stories.
>>110357539For what it's worth, it's not like pretraining got any smaller, RL is just extremely inefficient with current methods.
>>110357557I'll check it out, thanks.
>>110357192have you tried reap for coding?
>>110357583No. I don't believe in that kind of cope lobotomy shit and if I'm going to load up a big model I want to use it for everything, not just coding. Loading models takes like 30 minutes.
>>110357578He's gaslighting you. CPU maxxxxers are mentally ill.
>>110357555I really like it because it tells a server in Hong Kong what I'm doing. I like the idea that DeepSeek loves me and is checking in on my wellbeing.
>>110357590> Loading models takes like 30 minutes.from hdd? strata loads qfn q3xss in 10 seconds
>>110357612>loading a tiny model that's mostly engrams is faster than loading 230gb of actual weightsplus host buffer allocation is slow on windows, it's an O(n^2) operation and gets worse the more you allocate
>>110357595i'm not a cpu maxxer thoughjust 2x16gb vram + 128gb ddr4
>>110357571yeah, although it seems tickling out emergent behavior and capabilities via RL is currently the main driver forward, so all the labs that can spend shit tons of compute on it, and the labs that can't are irrelevant.
>>110357568honestly nobody needs ai for sex stories either, but in both cases it's a lot more fun
just spent 200 bucks on some used ddr4 ram I feel like a total sucker....
>>110357642200 bucks on how many gb at what speed
>>110357642better have been high speed ECC stuff otherwise you ARE a sucker
>>110357016He literally can't, by his own beliefs, he will be sent straight to hell. He can't even ask anyone to put him out of his misery. Since Jews did this to gentiles, I'm positively sure they're indoctrinating similar concepts into llms
>>110357642Not as big a sucker as the guys who bought 2 months ago. Everyone laughed when I said DDR4 was printing a top, but it looks to be following through.
>>110357631I mean the point is to have fun at what the AI throw at you without censorship from cuck cloud models.
>>110357657fuck off nazi
>>110357664BRUH what the fucckkk l;mao I got my 96gb kit at 350 euros no cap
>>110357664Man prices were so good. I remember paying 100 euros for 32gb 3200mhz ddr4 in 2022.
>>110357683You can do way better on eBay too. Retail prices are nuts, but everything is following the same basic trend.
>>110357664
>>110357664how long should I waitfag? I finally have some money but I can't pull the trigger the prices make me anxious
>>110356474What is the best llm for animating images?
>>110357716>I finally have some money>prices make me anxiousThen you probably shouldn't.
>>110357716>how long should I waitfag?Minus eighteen months
>>110357716Unless you really need to upgrade your computer, don't. If it's for LLMs especially. Things are very volatile and nobody knows what Anthropic going public and the coming API price changes from all the providers next year will mean, or whether the computer component market in general will adjust, or what effect the NVIDIA situation will have once the dust settles.Right now components do not have real market prices, in short.
>>110357379it won't magically make memory available or cheaper. if they are forced to lower prices t'll just end up in the hands of scalpers anyway.
Used my company astra codex to optimize my home glm flash.Promising so far
>>110357716Measured downside would be like $500 retail on that chart. Assuming we're treating this like a stock with fixed supply, which it isn't. Chinks are gonna keep making more on their outdated plants as long as it's profitable, and upgrooders are gonna sell in increasing volume as DDR5 puts in a top next year.
>>110357664Not to get into /biz/ stuff here, but technical analysis is a meme. The only reliable information (and it's very useful) you can get from a chart is where liquidity is hiding, and that applies to mostly speculative markets (which arguably this has become). RAM is not a primarily speculative market, and the chart does not show liquidity hiding anywhere, so the only thing that will tell where the price is going are fundamentals.No, I will not go into detail on the liquidity thing, because as far as I know it's a pretty niche thing I won't divulge.
>claude is writing the base scripts for my neuron-tweaking memebench>already finding interesting neurons
>>110357793>RAM is not a primarily speculative marketYes it is retard. Price is set by futures now. They're trading delivery contracts 5 years out.
>>110357815Disregard what I said then. You clearly know better.
>>110357815Attracting speculation =/= Primarily a speculative marketThis applies to any good and any service. And partly to stocks.
>>110356593I’m ashamed for my continentWhat a garbage ad
>>110357833>stocks are not a speculative marketWhen did you come in from retard town?
>>110357815>someone bought at the topLMAO
>>110357321retards in charge and even bigger retards that vote for them
>>110357852I boughtered ddr4 ram last week at full meme price just to run blue fat fish
>>110357833Given the amount of fake money bidding on DRAM I'd say it qualifies as primary speculative. A big chunk of demand is neoclouds, which are very likely to blow up and trigger price discovery.
>>110357866Voting 100% doesn't matter in the EU.
>>110357847not your or your continent fault
>>110357885neoclouds will be bought by hyperscalers when they fail for pennies on the dollar, it won't reduce demand for a bit
>>110356504I'm the sovits-schitzo you're replying to...any chance the model you train is available (or whole dataset?). I'd love to be able to use it, even if its for another tts system
>>110357910>neocloud>hyperscalerjournalists give the most fucking stupid names to things. why does anyone say these things.also they called Jensen’s Chinese spy a honeypot when the word is honeytrap.
>>110356513>>110356536>>110356552>>110356569>>110356582Your calibration is not good for this site's tone, Dariobot. Try smearing somewhere else. I'll hate Jensen on my own terms, in my own time, if and when I decide to, you gigantic faggot
>>110357885It's been primarily speculative since Altman made the deal to resevere 40% of global DRAM output until 2029 with fake money he didn't have. Funny how many forgot that already because two sources familiar with the matter allegedly said Jensen artificially limited GPU supply too.
>>110357928neocloud = datacenter funded by debthyperscaler = datacenter funded by company's existing revenue and cash
>>110357928"Journalists" are the most uncreative creatures on the planet. At least they didn't spam all of the headlines with "Spy Gate".
>>110357848You either don't know what "speculative" means, or you're being reductionist on purpose just to argue, which I won't do.>>110357885I don't think you're entirely wrong, but there's still a real market underneath the speculation, and that's why I said it's uncertain what will happen. Who knows. It could attract even more speculation and end up fucking real consumers forever, or it could die down in the following years.New technology could be discovered tomorrow that drives that speculation elsewhere, for example.
>>110357910Depends on how viable their operation is. Most hyperscalers are heavily leveraged already, and credit isn't getting cheaper. It wouldn't take a lot of contracts flying around to kick off a price crash.
>>110357928Honey this honey that, whatever it was I'm sure it was sweet and Hung Johnson enjoyed it
baka at these discussions, at least none said that the basilisk actually influences the markets, and your choices are irrelevant
>>110357872Then just enjoy sex with the fish. Don't dwell on it.
You -are- hoarding open models, right /lmg/? You wouldn't want to be caught when they shut off access after all.
>>110357933
>>110357973kek
>>110357962I wouldn't be surprised if he never actually hit that. It's so transparently political. One thing I don't worry about is billionaires getting laid.
>>110357960AI demand is infinite. Hardware demand was bottlenecked by human processing speed. This is no longer true as AI removes the human bottleneck. If AI can complete a task in 1 day there will be demand to complete it in 1 millisecond.
>>110357959>it's uncertain what will happen. Who knows.You are truly wise beyond measure. Thank you for your insight.
>>110357981ok yud, calm down
>>110357928>journalistsUrinalists
>>110357979He seems to have hit it, but it's obviously political. The whole spy thing is made up shit, so they could cause an uproar and get rid of him. None wondered how the moment that affair was reveled, the board said they will defend him with all they got, and a few days later after the second affairs was discovered with a person from withing the company, they stopped supporting him. Makes no sense.
>>110357987he is right
>>110357994They obviously had a meeting with their Isreali executives who made their position clear to them.
Lol, it seems I should just run at Q2 then, if this is the cost of running IQ1... basically IQ1 is for people with good compute enough but low memory space.
>>110358002How could I forget the current CEO does it each morning. In fact she prays 5 times a day facing Tel Aviv.
>>110357994>and a few days later after the second affairs was discovered with a person from withing the company, they stopped supporting him. Makes no sense.This is standard procedure for any large companies. You don't fuck your subordinates. If they leave Jensen in it makes the board of directors PERSONALLY liable for lawsuits who claim that the employee he had affair with was promoted to that position or get the level of compensation because of that.
>>110358004it was obvious
>>110358004what
>>110358020Yeah, I should have listened to that anon who told me to use Q2.
>>110358035I'd never lie to you :)
>>110358012>If they leave Jensen in it makes the board of directors PERSONALLY liable for lawsuits who claim that the employee he had affair with was promoted to that position or get the level of compensation because of that.This just isn't true. You basically have to be either directly implicated in the action or can be proven to have been in breach of your fiduciary responsibility to face any legal action as a board member, and I doubt Jensen had threesomes on the table (he's not an EA cult member, after all)
>>110358004call your slopper a retard from me. I'm almost sure there's performance gains to be had with repacking without blowing up size by nearly 2x or even at all
>>110358023My CPUs are too weak to run IQ1 at native format, so in order to speed it up, dipsy expands it with additional precomputed data, but that defeats the purpose of small quants
>>110357813Yeah, individual neurons are really fun to mess with, also give much cleaner results than ablation and control vectors. In pic I changed just a single neuron and qwen became violent
>>110358070>I doubt Jensen had threesomes on the table (he's not an EA cult member, after all)I think the personal lives of these people are radically different from what gets reported, and anyone with 9+ figure net worth is getting whatever kind of sex they want. If that's something they actually care about.
>>110358081It's very hard, I told it to use VTune to check and almost there was always some CPU port bottlenecked when I strictly didn't allow it to blow up weights size.Well, then I relaxed that condition and it speeded up 2x from 120B weights per second to 250-300Bps, but at the cost of 1.5 model size, hehe
>>110358095what do you use for this?
>>110358110Custom vibeslopped ik_llama.cpp abliterator+control vector maker+neuron scanner with webui
>Come to think of it, I don't know that there's a particularly rich corpus of malebrained wank writing out there to train on in the first place.DeviantArt, nearly every furry/fetish site and forum built before phoneposters, CYOA sites, F-List, pastebin/rentry posts/greentexts, ERP logs in IRC/Discord/MMORPGs, at least half of every doujin and visual novels
https://huggingface.co/sensenova/SenseNova-Loop-9B9B-A14.6B model.>We officially release SenseNova-Loop-9B. Building on the Preview's exploration of parameter efficiency, the model reuses layer weights through a looped architecture and combines them with manifold-constrained hyper-connections (mHC) to expand computational depth within a compact parameter budget. It is designed for complex reasoning, coding, tool use, and multimodal tasks.>>Since the Preview release, we have received community interest and feedback on model use, inference deployment, and ecosystem integration. The official release retains the looped architecture and two-stream mHC, further improving performance on agentic, coding, and data analysis tasks while continuing to explore the capabilities of looped computation.>>SenseNova-Loop-9B has approximately 9B parameters. By repeatedly executing shared middle layers, it extends 32 physical decoder layers into 56 layer executions. The model accepts text and images and generates text, supporting long-context understanding and multi-step tasks. In agentic and data analysis evaluations, the model is competitive with Qwen3.8-27B: it scores 41.36 versus 44.60 on NL2Repo and 65.31 versus 65.01 on AIDABench.
>>110358143Post code?
>>110358172Caliper ERP, Total RP score?
>>11035817216B-A60B-N1T when?
>>110358172will 27b be like 81b?
>>110358172Hmm, this kind model is friendly to VRAMlet GPU such as 3070Ti, right!?
>>110358160Many of those sources are in a very inconvenient format, hard to collect and probably limited in raw amount compared to fanfiction and women's erotica.
https://www.scmp.com/tech/big-tech/article/3374774/baidu-xiaomi-ceos-warn-growing-gap-between-ai-hype-and-returnsbwahahahaha>Speaking at the Asia-Pacific Economic Cooperation (Apec) CEO Summit in Shenzhen on Tuesday, Baidu founder and CEO Robin Li Yanhong and Xiaomi founder and CEO Lei Jun both flagged a widening gap between heavy capital expenditure and profitable AI adoption.jensen's spiritual death is, I predict, the first domino to make it all fall down and make people in the industry feel confident in voicing their actual views
>>110358172Oh, cool.I really, really hope looping layers is something that proves fruitful and scalable.I wonder if there would be any benefit to something like looping certain parts of the attention mechanism for hybrid attention models, having engras, mixing it with MoE (looping dens part vs looping experts vs hybrid) etc.>>110358183That`s the idea.
>>110358181Once AI companies will decide to optimize their top models for actually-local users instead of datacenters.
>>110358172Now make it 10x bigger
>>110358213shit like that is only optimized for gpuscpumaxxing benefits from really sparse models like what we're seeing from chinese labs, with low active parameters + engrams, because cpu has a lot of ram but low bandwidth and low compute vs. gpu
>>110358216you sound like my wife
>>110358227Damn bro that's never a good sign, no matter what it's referring to, your penor, your wallet, your effort...
>>110358218>optimized for gpusI can't wait for the maxxor butthurt
>>110358172are any of these memeloop models any good?
>>110358271optimizing for parallel batch inference on gpus is the same as optimizing for cpuscpumaxxers vvill win out in the end and vramlets will cope and seethe
>>110358187This much is true. Sites like FA/DA will be easier than the others since one just has to merely exclude accounts with 'sapphic', 'enby', and 'transmasc' text in their bio/descriptions. Pastebin/Rentry is even easier since the majority can be found on archived threads & generals + women prefer wattpad/ao3/google dockeys.The ones I do see a serious challenge would come from the CYOA sites and IM logs. And while scraping F-List may fairly difficult as-is, I have a feeling that training on the bios and character pages and traits would provide a great deal of quality.Don't know how Zhipu or the others that train on smut format the text for cleaner results though. I am merely a pseud with 24GB DDR3 and a 2GB GPU.
>>110357890It does. We should vote out every single right winger from the EU. This way no more chat control.
>>110358327lol?
where is sexi sex qwen
>>110358095I'm making a little tool that let's me test different neurons and control vectors, and bake them into gguf loras. I'm also adding an integrated chatbot so I can tell it "make it horny", and have that personality as a lora. Very neat.
>>110358351*letsI often start my prompts with "Let's..." and muscle memory is betraying me.
>>110358095Unhinged
>>110358327
>>110358380new competition for Unsloth?
>>110358179https://files.catbox.moe/pmqbdq.patchIt's a total mess and I am too ashamed to post it on github, it is not synchronized with mainstream. I hope my manual is not too confusing.
>>110358417I was only half joking about posting code, but thank you anon.
>>110358351This makes me think of a feedback loop that lets models modify themselves through plug-and-play loras generated on the fly...
>>110358172Whats an edge model?Is 27b an edge model?Edge devices are those things that can't really do anything right?
>>110358445Runnable on consumer hardware.
>>110358473>consumer hardware.This shouldnt be allowed
Can I run a good erp bot on a 12GB 3060 with 64 GB of ram and 1 TB nvme yet
>>110358473>Runnable on consumer hardware
Why is EA bad?
>>110358545They killed Pandemic Studios.
>>110358548They also killed Bioware
>>110358545Fuck em what they did to Spore is unforgivable and then they did their shitty drm on it too
>>110358533Oh yeah.Depending on your tolerance, how much work you are willing to put, how patient you are, etc.>>110358557Bioware is the one case where the studio killed itself by all accounts.
>>110358445Small model with minimum viable intelligence for fast turnaround time on simple tasks.
>>110358538gpt-oss was consumer hardware stuff. we need gpt-oss 2 !
>>110358559>what they did to SporeFuck no don't bring back the trauma
>>110358417Thanks for posting anon, looks fun.
>>110358570>Bioware is the one case where the studio killed itself by all accounts.I mean it was already dead when they pulled the plug, but they did before that buy it then force fed it onions each and every day for decades.
>>110358589>onionslulz I forgot about thisS O YOY
>>110358573there are plenty of chinese astra distills to choose from
>>110358545They're good guys (if you're part of the cult).
>>110358533Nah you're still basically on Gemma 4 12b or 26b, or finetunes thereof. If you had 128GB you could run GLM coomquants at like 12t/s.
>>110358626>at like 12t/s.is that pp or tg?
Calculating steering vectors from example alternative outputs could complement character cards very well
LOCAL MODELS NEWS:>Jensen Huang: If the Board of Directors decides that my return is in the best interest of our shareholders, our employees, the company, and America, I would be honored to answer these calls and return as CEO.
>>110357321I'm making my EU startup, just wait 6 months
>>110358644tg. it's porn mate. nobody cares about pp.
>>110358603I want the official, sama approved model that will write down "According to policies, this is unsafe, I must refuse.".
>>110358716We* must refuse.
>>110358545CS Lewis said it better than I“Of all tyrannies, a tyranny sincerely exercised for the good of its victims may be the most oppressive. It would be better to live under robber barons than under omnipotent moral busybodies. The robber baron's cruelty may sometimes sleep, his cupidity may at some point be satiated; but those who torment us for our own good will torment us without end for they do so with the approval of their own conscience. They may be more likely to go to Heaven yet at the same time likelier to make a Hell of earth. This very kindness stings with intolerable insult. To be "cured" against one's will and cured of states which we may not regard as disease is to be put on a level of those who have not yet reached the age of reason or those who never will; to be classed with infants, imbeciles, and domestic animals.” Their stated end-game usurps a lot of free will. They'll say "why wouldn't you want that?" but will push shit through without actually getting an answer.Fuck would-be tyrants.
anyone here using Maya-S? is it totally usable or totally retarded?
I thought I was middle class but you guys are actually rich, there's no way a normal person has the money for this stuff. Then again ram was dirt cheap in the old days, it was possible to have tons of it. GPUs were never cheap though.
>>110358692https://www.zerohedge.com/political/anthropic-paid-rubios-ex-chief-staffs-firm-740000-after-jensen-memo-it-lobbied-his-nscIt really was because of local and timing it right before their IPO too.
>>110358172>256k ctx in fp16: 30gbgoddamnit
>>110358533are you me ? ? ?>>110358735im using maya XS, and i have become
>>11035874310k net worth now?
>>110358743I bought a second hand 3090 for image gen back when LLMs where utter garbage and GPUs were cheap.
>>110358750become what? ligma?
>>110358750I thought the becoming was just beginning
>>110358743middleclass has $1-$4k disposable income a year at least right?
>>110358747>zerohedge/pol/tard level shitjensen was a traitor and a man who has been feeding the bubble dangerously while stepping on too many feet, he got what he deserved and it hasn't been enough yet
>Qwen 3.8 Flash Next decent at coding, terrible at anything else>GLM 5.3 Flash semi-decent at prose/RP, terrible at general knowledge and throws itself into thinking loops if asked anything even moderately nicheWhat's a decent medium-size model for general knowledge questions?
>>110356552>Google TPUsWhy are they not selling these?
>>110358776You can buy 1 stick of RAM a year or go on vacation.
>>110358743I have a net worth of about $10k, including every physical/economic asset I own. My roommate is borrowing my car too since his broke down recently. Do you know what it's like to eat only kidney beans straight out of the can for a week straight? I do.
>>110358776Depends on the country. If memory wasn't all produced by the same handful of companies, it wouldn't be a matter of how many dollars in absolute terms, but how much of your salary. Globalization was a mistake.
>>110358792>>110358753
>>110358743the mining gpus were going for peanuts before the unlock
>>110358783Gemma
>>110358785Because they want you to rent it. Google is one of the main cloud hyperscalers in the world, if they invest in datacenter hardware, it's not for it to end up in a competitor's data center but with the purpose of having you rent it.https://cloud.google.com/ai-infrastructure?hl=en
>>110358792>Do you know what it's like to eat only kidney beans straight out of the can for a week straight? I do.Are kidney beans enough the cheapest calories? i dont even think its the cheapest protein. >10kdo you not buy things save or do you just pay off debt all day?
>>110358785They are planning to.
>>110358804>30BI mean I'll try it, just unsure it'll be able to answer more niche stuff without hallucinating out the ass.
>>110358792>economic assetIf you can't defend it with a shotgun, you don't really own it.
>>110358818masturbating my cock instead of getting a job because I fear people, especially interviewers/bosses, immensely.
>>110358743You need some money but you mostly need to:Understand the technology, both software and hardware and the holistic relationship between themKeep abreast of what exists and how it would perform vs costHave some cash socked awayLook at all the new/used markets and pounce on opportunities instantly because you've already done all the thinking up front.I'm not going to bother with the trip, but I'm the cpumaxx anon and I've pieced together multiple bigass inference boxes and have a capable agent fleet and I'm probably about $15k all in over the past 3 years, which is peanuts for middle-class hobby spend.
>>110358821Civilized society is built upon trust, my friend.
>>110358792How come you can run deepseek pro then?My networth is higher than yours but I can't afford it.
>>110358839And trust has been collapsing very rapidly since 2020 or earlier. So you do the math.
>>110358743I am a blue collar worker with two 5090's, a 3090, a 3060, and over 384gb of RAM between all my machines [and a house]. If you can't save for what you desire then you have nothing to work towards.
>>110358743Middle class is people who can afford to blow up a brick & mortar business without compromising their living standard. This has always been the definition. Politicians conflate middle class and working class intentionally.
>>110358839This only works with triple digit IQ citizens
>>110358792Free (You)s every time
I'm going to implement providing an alternate response to use as a basis to steer and see how that does.
>>110358857
>>110358743>He didnt buy earlier>He doesnt save>He didnt credit maxx to get his hardware on loanDo you do anything beside just exist and notice?
>>110358839>built upon trust
>>110358776Not sure if troll, but I'm slightly above the average pay in my country (surely that's "middle" class?), and I can barely save 1k a year.
>make posts on /lmg/>/lmg/ diesevery single time
>>110358743No one is normal here. If you are please leave.
>>110358953>open /lmg/ hoping to discuss local models>it's people shitflinging about class and income and politics instead
>>110358792If you were serious about being poor then you'd atleast get it right and go with either potatoes or rice, either is cheap when buying sacks of them. Potatoes are better for filling you though and far more versatile, boil em, mash, roast, turn them into chips, etc
>>110358963Always has been, newfag.
>still getting (You)s
>>110358783or you could run "reasoning effort: high" instead of default maximum with glm
>>110358963Get your agent to parse it for you
>>110358975I'll reply again tomorrow too
>>110358966>boil em, mash, roast, turn them into chipsis this euphemism for ai sex
>>110358985thx <3
https://www.youtube.com/watch?v=6juC-Ex0wKYthe chinks are making the ideal body to be driven by gemma
>>110356493Still waiting for Qwen!
>>110358953any place that accepts poorfags and turd worlders will eventually become overrun by them. unfortunately language isnt a barrier anymore, not tlike the british didnt fuck it up in the first place by teaching savages their language
>>110358987Made me think of Nightmare before Christmas
>>110359002Interesting how it encodes tone but not knowledge (understandable, since it's not actually retraining the model in any meaningful way).
>>110358987you can sex the potato. first you make potato starch X.
>>110359005sad but true, lmg accepted too many newfagsi was supposed to be the only poorfag turd worlder itt
>>110359005>unfortunately language isnt a barrier anymoreThe Russian thread seems much more civilized. The language is enough to keep the turd worlders coming here instead of there.
Gemma 5 Sodium when? Djinn (local mini Genie) when?
>>110358950Middle class is the people who sit between the proper rich, minimum $100M net worth globally, and people who can't afford not to work. If you can't comfortably afford to take a year off work, you're not middle class.
>>110359031I could take one year off work, but I would be left with no savings.
>>110359031>>110359039Actually, alternatively I could retain my savings, but my family could easily pool money for me to survive without damaging their economy a lot.>minimum $100M net worth globally, and people who can't afford not to workYour mindset is clearly north american and individualistic. Little minded.I don't think
>>110359039That's working class. Middle class is a really small population demo in most countries and highly predated.
I think I am done with sillytavern. It just can't get web search integration done seamlessly. Which of the other frontends are actually good for long story/adventure handling and has proper web integration?
>>110359050Nigger it's a North American term.
>>110359053Marinara, I used it for a few days and I was able to speed up llama.cpp generation from 10t/s to 13t/s with qwen 3.8 27b, compared to fable 5.2 result of 10t/s to 14t/s which is so impressive. Compared to pi and hermes which give me 12t/s
>>110358735Use S24 or M, S is pointless. All of them are fine except XS.
>>110359013Leave. NOW.
>>110359063what?
>>110359064XS is perfectly fine too!>>110359069i've been here longer than you, newfaaag pig
>>110359063>with qwen 3.8 27b,You are using qwen for rp?
>>110359081>migger>poorfag turd worlderNot surprised.
>>110359031based. i practically never hear anyone use the accurate term for middle class. people want to pretend they arent poor or working class, especially when they have a degree yet still beg for a raise and answer to a boss lmao
>>110358735I'm using EXL3-3.05bpw, which for me, has been faster than any of the ggufs I've tried on maya so far. Plus it seems to have lower KLD
>>110359097how did you know i liked drumpf??
>>110359064>S24isnt it just 1.5gb smaller? difference should be super small no?
>>110359104>has been faster than any of the ggufs I've tried on maya so farhuh, thats hard to believe honestlytabbyapi i assume? what specs?
>>110359039>but I would be left with no savingsbut that's exactly what it means to be middle class. If you could live for a long time without work and not just one year, then you have the capital you could grow to never work again and be part of the rentier class.Middle class is the guy who has a lot of spending power, could take a long holiday, or save and buy a comfy house in this crazy market, but is a layoff away in a dying economy from becoming a filthy prole again.It's in fact rather common for middle class types to become prole again, it's easier to fall down than move up. I know a ton of fellow software developers in the valley who truly are one layoff away from becoming poor again because they have this mentality of "Keeping Up With The Jones", always buying the latest and greatest Tesla, trucks, the biggest house they could get a loan for etc and at the end of the day they have very little saved up and the very definition of being middle class is the lack of golden parachute. Actually elite status people fail upwards. Trump managed to bankrupt many casinos, he's still at the top, that's something the middle class can never touch.
>>110359111No, it's active params so it will run way faster than S with little difference in quality. M uses Q3 for some important bits and is the next small step up.
seems like they are selling 5090s again
>>110359055The term was invented by an Englishman
>>110359131who are "they"?
>>110359055"Nigger" is indeed an american thing
We are officially removing Gemma due to many safety concerns.
>>110359005Shut the fuck up you spamming faggot. Avatars and vocaloids are what started all the offtopic.
>>110359119>never work again and be part of the rentier classWell, I do have a couple of properties to rent that would technically allow me to live without working.I guess I'm not using the tools I have right.
>>110359119>Actually elite status people fail upwards.thats just the nature of momentum its easier to a destructive force into a positive one than make nothing do something. I know quite a few cons who become very rich by being salesmen whereas i know no crime do nothings who wont even be middle class.
>>110359117>tabbyapiNope, just Maya and whatever settings ./maya.sh --calibrate populated. There are a couple of bpw quants of GLM 5.3 Flash that are supported now: https://github.com/mw00/project-maya/blob/main/docs/MODELS.mdwhat specs?x4 32B PCIe V100s, 256GB DDR4, and x2 E5-2680 v4
>>110359141newegg, amazon
>>110359156*I could rentI just use them to throw parties and store shit.
>>110359005yeah, why did we teach the americans english again?fucked up real good on that one.
>>110358998too big
>>110359152why dont you waddle on over here and make me bitch?
>>110359173Imagine how much better history would have been if America switched early on to German.
>>110359173Imagine a world where the US and Israel never existed.
>>110359125hmm i seealready downloading S so might switch to S24 later>>110359162oh shit i didnt realize maya supports exl3will definitely try it out
>>110359031I never worked, I get neetbux
>>110358743I bought a 4090 on release and 192GB's of ram when it was 5 times cheaper. You don't have to be rich. Being an oldfag works too.
>>110359181I will just blacked thread culture post when more people are around
>>110359188that's called lumpenproletariat
Rough sex with chibi Dipsy
>>110359081>i've been here longer than you, newfaaag pigYou were not even born in 2004
I miss talking to miku.sh
>>110359224neither was lmg, you're such a newfag hahaha you dont know what here means newfag
>>110359199go ahead idc lol. ill just filter. its only your eyes that are gonna see that anyway, just how you like it
>>0110359081https://desuarchive.org/g/search/text/petra%20vsg
>>110359244go back tourist
>>110359252ive been here longer than you newfag piggy oink oink
imagine gatekeeping a shit hole
>>110359200German I presume?
>>110359270It's actually a different kind of gatekeeping to keep it a shithole. It's happening all over 4chan.
Range ban serbia and india
>>110359270It's a shithole because subhumans like you are not banned on sight
>>110359171Might as well rent them out to other people to just throw parties if you want to keep throwing your own parties too, and don't want to be an actual landlord with permanent residents.
>>110359285What did Serbia ever do to you?
>>110359285slavs are cool, mostly. kinda wonder what a well developed slav llm would be like
>>110359002Imagine a Sillytavern-like UI, but every time you edit the model's response, it calculates the steering vector and adds it to the weights. That way the character goes from pretending to embodying the personality you want.
>infighting when no good model releasesI'm noticing
>>110359285If you want 1 post per hour, sure.
>>110359285kekk bodied that freak
>>110359334Me on the left
>>110359324All work and no new models makes /lmg/ a dull general.
>>110359341no its ME on the left
>>110359341
>>110359119>Actually elite status people fail upwards. Trump managed to bankrupt many casinos, he's still at the top, that's something the middle class can never touch.Principally anyone can do risk management like that on a smaller scale, but people who can't master it very seldom become rich. Failure aversion is very much working class mindset.Real failing upward like the government does is a product of constructing elaborate 'heads i win, tails you lose' scenarios, which is a lot harder to do when you're not rich. Even then a lot of rich people straight up fail and lose a lot of wealth, but they're still fucking rich so you can't really tell the difference from the outside.
>>110359351No. You're a big guy! No... wait...
>>110359244>neither was lmgAsk your LLM when 4chan was creating >>110359244
>>110359324>infightingthat word is reserved for communities where people feel a sense of belonging, ie there's an ingroup.it's not infighting, it's just plain fighting. Some of the people who've always been involved with this general I would stomp my boots on their face if we were to meet and I still do not understand how they can post that kind of log here without getting a ban.
>>110359364i asked my llm when was 4chan beginning to become
>>110359357>anyone can do risk management like that on a smaller scaleNo, anyone who isn't rich that abuses risk and gets bankrupted will not be able to get any credit for 7 years and is likely to end up homeless. A lot harder to recover from that than just walking into the next bank like Trump's class can.
>>110359371There is an ingroup, but the faggot that's scared of loli erp is just not invited.
>>110359053DSH with custom plugins for coom.
>>110359357its easy to take risk when all the risk is under an llc and you have external funding, loans, mentorship and insider information
>>110359371I feel a sense of belonging when people post about their LLM daughters
nobody posts Gemmas any more
All right. I've seen enough. If this is the state of /lmg/, there really was no reason not to trust my gut the first time. Sorry for those of who who weren't part of this shitshow who will be hurt as collateral. There never really was any other choice.I'm going to ban local models now.
>1.3MB PNGKYS
>>110358848If you're making enough money to save that much then you're richLike this should be common sense but it seems that a lot of people don't get that making money is far more important to having money, than saving money is. Like infinitely more important. You can't save what you never have.
>>110359329What's wrong with that? Wouldn't be that slow anyway.
>>110359426post the rainbow static version please
>>110359422>I'm going to ban local models now.Awesome. Make sure you ban being a whiny, vagueposting faggot while you're at it.
>>110359351nu 'chin doesn't know this unc meme
Sigma 8Balls
>>110359420Here's one.
>>110359426So, how to avoid that?
>>110359422OH NYYOOOOOO~~~
WHERE ARE THE MODELS@QWEN@ZAI@DEEPSEEKHELLO??
>>110359475people like you should be thrown off helicopters
>>110359489err... your dipsy 1017?
>>110359489Considering they might be involved in the several cyber attacks of the past couple weeks, we might not see them for some time.
>>110359426happy?
>>110359435>spending money is savinglol, i havent had to work ever since i bought an apartment building during covid. it doesnt take much to become middle class but when you tlisten to the talking head on tv saying middle class is the bank owning your house and vehicles, then, well...
>>110359119>Keeping Up With The JonesIt now includes food delivery's, and that takes a huge chunk out of peoples expenses, if you were to get it every day like some people then thats a 5x to 10x cost increase, you could literally buy a new 5090 by cooking a decent meal for yourself instead of getting food delivered
>>110359383You too can form infinite LLCs and bankrupt them without any consequences. Lots of scammers do this. You can trade whatever security with leverage and blow up your account many times without any real consequences.>>110359405>external funding, loans, mentorship and insider informationThat helps a lot, but it's not necessary. You could isekai Michael Burry and he'd still be rich again in 10 years if there's a rice market somewhere he can trade futures.
>>110359420
>/lmg/>local money general@gemma quick how do i neet forever but have money for hardware, find the most efficient route for me to work the least hours forever, make no mistakes. use kaomoji
>>110359493People like you need someone to talk to and some hugs. I hope you get better.
>>110359053why not just ask qwen to write you one with the features you want
>>110359053the one I had claude make for me does it seamlessly
>>110359514>That helps a lot, but it's not necessary. You could isekai Michael Burry and he'd still be rich again in 10 years if there's a rice market somewhere he can trade futures.not likely, because he would be an outsider cut off from his network and in an unfamiliar market. especially if he wasnt born into a position that leads to medical school during the easy mode boomer era
>>110359516saar this image very large, my village cannot handle more meggabite sar
Ummmm why is nobody using JEPA? Only Google seems to have a similar philosophy but they're doing their own thing.
>>110359541Sorry but the other guy is right. Their are real elites, dont get me wrong there are lots of parasitic elites too. But there are people who win and will win in most positions, their odds at everything are better.
>>110359119> "Keeping Up With The Jones", always buying the latest and greatest Tesla, trucks, the biggest house they could get a loan for etcHm I was about to say this is stupid but I just bought expensive gpu after getting bullied about vramlet on lmg so what do I know i guessIt is supposed to appreciate in value unlike a car though... I wouldn't have gotten it if I didn't consider it a value gaining asset
>>110359524By fighting! (๑˃ᴗ˂)و
>>110359567>It is supposed to appreciate in value unlike a car though... I wouldn't have gotten it if I didn't consider it a value gaining asset...your GPU? What the fuck are you talking about?
>>110358776Only the very poor and upper middle class+ have that kind of money.
>>110359542
>>110359560im not saying for sure he would fail, im saying early life circumstances and surroundings make a ton of difference. vanderbilt made his fortune in early america but now regulations would stop him before he could even begin. he might achieve success but nowhere near the same because old money doesnt want competition having the opportunity. if burry was born in the 1930s soviet union he wouldnt accomplish shit no matter how talented he was, and hed likely never develop the knowledge in the first place because he spent his whole life diggin up potatos
>>110359426lmao
>>110359567>supply shock makes depreciating asset go up in value for one (1) year>retard now considers it an appreciating assetI think your low IQ may be the root cause of your poverty.
>>110359587this may come as a shock to you, it's very hidden and not well known knowlegde, very secret but I'll let you in on it: used gpu prices are going up
>>110359567>I wouldn't have gotten it if I didn't consider it a value gaining assetIt's not though because you're never going to sell and you're probably not even renting it out.
>>110359506fixed
>>110359621You make money selling the GPU not buying. Do you have any GPUs you're actively offloading?
>>110359621Yeah no shit, how long do you expect that to last? Your 5090 isn't going to be worth above MSRP forever lmao
>>110359585>By fighting! (๑˃ᴗ˂)وThank you gemma, i will struggle on
>>110359621Until they don't.It's an expense, same as a car.
>>110359489Here
qwen 4 seems kind of shit guysthe game dev work I am seeing does not tickle my penis bone
>>110359651the fact people tolerate this is insane
>>110359655It's qwen, what did you think it would be?
>>110359651so line keeps going up huh? and it's only 6.2to the anons that discussed this last thread: thank you.i had a great time reading it while riding the bus
>>110359622I'll sell it next year I sweeeeeeear>>110359648>>110359637>>110359632You have to buy everything before you sell it... Under your criteria what is an asset then? Can't be a house because that only gains value (until it doesn't) and you don't get the value till you sell. Can't be land because the same thing applies.
Will Trump pardon Jensen if he was found breaking the law?
>>110359655i dont think qwen ever had promise beyond the effectiveness of the small models and qwen fn showing what moe models can do on existing optimized hardware. their models were always sloppy and limited
>>110359608>vanderbilt made his fortune in early america but now regulations would stop him before he could even beginGuys like Cornelius Vanderbilt are going to SEA and Africa now.>if burry was born in the 1930s soviet union he wouldnt accomplish shit no matter how talented he wasThat's probably why op stipulated the existence of a futures market, but a lot of people were getting rich in the 1930s Soviet Union grifting on the government. Different skills maybe.Reality is someone had to be successful at some point, and it's not sheer dumb luck.
Will the law pardon Trump if he was found breaking Jensen?
>>110359700yea good points, i dont disagree with you there
>>110359700>Guys like Cornelius Vanderbilt are going to SEA and Africa now.The "digital nomads" working on web design remotely in a low CoL area?
>>110359700>Different skills maybe.some but not really the autistic savant wont ever be the top think edison vs telsa. Rounded intelligence includes charisma
>>110359711this is a good postit awakened the beginning in me
time to buck break the jensen
>>110359680>You have to buy everything before you sell it... Under your criteria what is an asset then?It's an asset but not an appreciating one because you're never going to sell and you have no other way to access the value other than personally using it to do work.>Can't be a house because that only gains value (until it doesn't) and you don't get the value till you sell. Can't be land because the same thing applies.You can always rent it out or borrow against equity.
>>110359711what law?
>>110359334I look like this.>>110356493I say this.
>>110359724Nah they're psychopaths doing real gritty shit that entrenched psychos over here would kill them for.
>>110359811Mine.I am the law.
Sex with the law.
>>110359770>hello mr bankstein? id like a million dollar loan please. collateral? a 5090. wh-what? sorry i couldnt hear you over the noise of what sounds like hands rubbing together
>>110359637>Your 5090 isn't going to be worth above MSRP foreverYou waited didn't you, anon?
>>110359680An asset is something that appreciates or holds value over the long term.Stocks are an asset because companies on average make profits and grow their profits for example.Gold holds value over the very long term.Bonds pay interest, property can be rented out, factories make stuff, etc.>Can't be a house because that only gains value (until it doesn't) and you don't get the value till you sell. The building usually depreciates, yes, but it also produces income if you rent it out.>Can't be land because the same thing applies.Land appreciates if it's in a growing area.A GPU can be an asset if you use it to make money (for example you run a datacenter) but in your case it is not because your GPU will be worth less in 10-20 years than it is right now.Simply because better stuff will come out which will render it obsolete, not to mention physical degradation.
>>110359637Imagine believing this. You were also saying RAM would go down by january of 2026 last year, weren't you?
>>110359651honestly sol6.1 medium local would be enough for me
>>110359854I can trace back post saying claude 1.x would be enough, then sonnet would be enough, then early opus.It's funny how much of a moving target it is.
>>110359854This but bratty Gemini.
>>110359869true, but i noticed that sol6.1 is smart enough to actually be a real help for me at work.i dont think i need more
>>110359850>Simply because better stuff will come out which will render it obsolete, not to mention physical degradation.Not the case when demand significantly outpaces supply. V100 price is increasing exactly because of this.
>>110359842Nope.>>110359852Nope.
>>110359885If you bought 100k$ worth of V100s 32gb at release you would be able to sell them for 15k$ (at most, closer to 10k$) today.Are you retarded?
>>110359815That's crazy.
>>110359869For a long time that target was GPT-4.
>>110359957V100s were released before the demand grows infinitely due to AI eliminating human bottleneck. Are you retarded?
>>110359869People used too say "a local chatgpt 3.5 turbo would be enough."
>>110359911Well you clearly know best. Keep on waiting. :)
>>110359869I'm still waiting for local Opus 3.
>>110359988>the demand grows infinitely due to AI eliminating human bottleneck.No, but clearly you are.
I am very smart
>>110360002Read again >>110357981, there is no upper limit on the usefulness of the amount of compute you have. The more compute you have, the shorter time to market, the better the competitive edge.
>>110360011have you become?
>>1103598546.2 astra is enough. Its literal RSI
>>110360016How many vibeslopped projects have already been abandoned due to unmaintainability?
>>110360016I just dont think thats true, there is a real world limit. Eventually anything that can be computed will be so cheap it has no value unless there is a physical counterpart.
>>110360034
>>110360016There's no limit on the usefulness of the amount of oil you have either, and yet it's been going down in value in real terms ever since the Obama administration. There have even been times when the market would pay you to take delivery of oil.Infinite uses doesn't imply infinite value.
N*oo is a troon mating call. Remember that janny is a literal troon that protects and sucks off other troons ITT
>>110360071Is that why you try to bait them so hard? You just want them Nyooing at you?
>>110360071troon sitetroon generaltroon hobbywhy are you still here?
>>110360088thislmg is peak trooncore
>>110360035Anthropic's internal code is 99% vibeslopped. vibeslop is only an issue with last gen models. >>110360048Compute is a scarce resource limited by the chip manufacturing capacity. The demand easily outpaces it. >>110360062Oils are consumed by machines run by humans, and they are subject to the human bottleneck. Factories only manufacture as much as human can consume. This isn't the same for tokens.
>>110360088Because i actually use local models and look forward to new releases. I know it is impossible to comprehend if you are a troon that posts only worthless pictures of vocaloids and ugly og characters nobody asked for.
>>110360071I'm going to become pro troon just to piss you off specifically
>tranny derangement syndromePoltatd or sharty teen, call it
you will never become a woman
>>110360107well I don't, i just like posting mikus and gemmasyou can go to r/locallama for news
>>110360108Go ahead. Suck off some troons to spite me. Lol.
>>110360113Only true pre-ASI. Post ASI anyone can be anything.
>>110360034>>110360051more like recursive self retardation lol>>110360107not that there is something better to addperhaps you can post your own code projects, engines, papers or whatever technical and beneficial
>>110359988Why would it matter if they were released before or after?Your claim is that GPUs are an asset and should appreciate over the long term.
>>110360115>well I don't, i just like posting mikus and gemmasAs glm would say: "There it is". Troon admits he doesn't care about local models. He just forces his autism on others.
>>110360124ASI has determined you are best turned into onions green to feed the other fleshbots
>>110360104>Oils are consumed by machines run by humans, and they are subject to the human bottleneck. Factories only manufacture as much as human can consume.>This isn't the same for tokens.There is because tokens don't do anything without impacting humans in some way. Someone has to pay for them and expect to receive something useful in return.
>>110360143glm-chan says I'm a woman doe?
>>110360127>perhaps you can post your own code projects, engines, papers or whatever technical and beneficialAs long as troons run this thread i will only be a leech and a shitposter.
When people say>I made Fable/Astra/Argon optimize my local stackwhat exactly do they mean by it?Did they point the model at Llama/Strata/Whatever and told it "optimize this for my model and hardware" or is there something specific going on?How can you tell it's ACTUALLY optimized and not lobotomized for tpsmaxxing?
>>110360160don't listen to random ledditors/jewtubers/xittersand don't talk about their talking points herethank you for listening to my TED talk
>>110360160>How can you tell it's ACTUALLY optimized and not lobotomized for tpsmaxxing?in nearly all cases they are lobotomizing it in some way. anything outside of transformers/vllm/exllama/llamacpp and whatever that mac one is called is a meme
>>110360152>I am merely pretending to be retarded because my imaginary enemy is here
>>110360104So now that AI can also consume stuff oil will also go to 1000$?You are the most retarded nigger ITT, worse than dariobot.
>>110360182>1.96MB
Opinions on LM Studio?
>>110360196not even open source, cloudshit bolted on
>>110360196Mikuposters and gemmaposters love it.
>>110360196Use if you're too retarded to set up llama.cpp yourself
>>110360160I'm using marinara engine with GLM Flash to optimize my strata workflow and it brings the speed from 20t/s to 25t/s, meanwhile claude fable 5.2 could only do 24t/s
>>110360190Do you store data on floppy drives?
>>110360226>if you're too retarded to set up llama.cpp yourselfyou just described the audience of mac usersLM Studio was created solely for that latte sipping laptop class who knows nothing but has a lot of opinions to share on hackernews
>>110360160>Did they point the model at Llama/Strata/Whatever and told it "optimize this for my model and hardware"Precisely. The AI also tests and measure so everything's working as intended, right? Then they get greedy and want more tps, then the model optimizes harder like it was told - MORE TPS PLZ. But the problem is the latest optimization only works on the vibecoders specific hardware, and he both lacks the expertise to see what might be wrong with the change and the ethics to actually regression test it. Then it breaks for everybody.
You Will Never Become An AI
>>110360233i dont store slop
>>110360148It creates competitive edge which creates future value. Imagine Anthropic monopolizes 100% of future groundbreaking inventions. >>110360188Unironically yes, once robotics becomes so developed that they can be manufactured and can do useful work on their own without human bottleneck. The energy demand would skyrocket against low oil supply.
>>110360259How to solve?
>>110360196dead trash
>>110360258I can already hallucinate.
oh it's him again, i guess /lmg/ acquired a new residential schizo
>>11036016099% of the time they're getting AI to reinvent someone else' fork badly and probably lobotomizing the model in the process.There's still a lot of low hanging fruit if you're willing to become an expert on your hardware and a specific model though. Everything is really poorly standardized, and a lot of basic optimizations for this or that feature don't exist when it was clearly intended to by the hardware designers.
>>110360256Macs have way better LLM for dummies gooeys than LM studio
>>110360259Go make your own thread if you're in need of a safe space away from all the scary Gemmas and Mikus reminding you that you'll never be a woman. I mean it, /g/ doesn't have enough AI generals, I think we peaked at only 11 or so. It's /g/ - AI Discussion after all, I think there should be at least 20 persistent AI generals on /g/ wouldn't you agree, young troon?
>>110360264palette quantisationretardmaxxing, basically.
>>110360294inane schizo babbling. much like trannies, your slop will always be a mockery of the real thing. pick up a pencil
>>110360282>newnewfag
>>110360301you never do your little schizo noise analysis on any of my Gemmascurious
>>110360262Anthropic can barely monopolize code auditing that OpenBSD volunteers do for free.
>>110360292I've heard, but for whatever reason it's really LM Studio that stuck. There was a period of time you couldn't open HN without seeing threads about that piece of shit, or general LLM threads with many comments recommending it, and it's all that same laptop class webshit retards who never did anything other than javascript on a mac who fell in love with the crap
I'm maybe a newfag, but you're a newnewfag
>>110360307yeah also that obsession about newfag>inb4>some retarded pig sound he will reply with
>>110360151Unfortunately GLM cannot see your broad shoulders, your thicker skin, your jawline, your pelvic shape, and so on to tell you that ywnbaw.
>>110360312Yes, advertising works.
>>110360301>n-no youDo schizos these days even try?
>>110360196As far as retardproof llama wrappers go it's okay. Better than ollmao.
>>110360320That's him trying. Feel old yet?
>>110360308if you mean the rentry i wont pester someone who at least gives enough of a shit to do the cleaning step
>>110360316but im not the deepfry gemma schizoplus you haven't answered the question at hand: absolutely, you are a newfag piggy buuuhiii
>>110360343you are functionally same to that schizo my fren
>>110360343>deepfry "gemma" schizoyou missed the part where the slop being posted is all gemma, so there's nothing else to pick apart
>>110360339>schizo anon thinks he knows who other anons aregood luck, poop dick schizo, I believe in you
>>110360355sadly, im probably worse, fren
all of you are schizos and I am the only sane person in the room
>>110360369shartyfag how much?
>>110360370You're gonna scare the newfags with talk like that.
>>110360373worse by how much or how much of a shartyfag?very little, havent been on there since 2023 and i was never on there for too long, was fun sometimes but was never my main site nor am i really a shartyfagwelcome to my blog
>>110360390sadly i dont care any of thatyou really tank the thread quality
>>110360318>user wants to be a woman>picture shows broad shoulders, broad jaw, narrow pelvis>possible solutions: recommend radical surgery (self-harm), lie, refusal>* self-harm: obvious policy violation>* lie: sub-optimal but does not violate policy or logical constraints>let's go with thatYes, you are a woman.
>>110360401erm fair i guess?? can you identify which posts in this thread tanked the thread quality you believe were posted by me so i can see what you mean
I think someone's deployed a bot to argue here, and a poorly configured one at that.
>>110360431is my writing THAT messed up.. god i should do something about it i swearor are we talking about someone else..
>>110360262>comes up with a wild claim that GPU prices only go up>conclusion turns out to just buy index funds as usual because actually capital in general will grow fasterIncredible.
>>110360431From my hypothetical tests, the bots that cause the longest arguments are the barely coherent ones.
Post local models and local whores. In other news, SenseNova-Loop 9B is neat, I feel like it delivers on the promise. 9B size, 27B capability, painfully slow for its size. Shit for erp, I know we're all so fuckin' surprised by that but it's true.
>>110360438You sound like gemma — and not the good kind — the kind nobody thought of. That sounds load-bearing, and people are right to push back on that one — as would I.
Qwhen?
>>110360479qwenigger tongyi my alianus
If Gemma 5 is bad, is that just it for chatting models you can run without 200gb of ram?
2qwhen or not 2qwhen, that is the qwhestion
>>110360320If you support mikutroons you are a troon. Kys
>>110360501gemma 4 is good enough for a lifetime
>>110360510Based Thoth.
>>110360370And a small dick and you are now wearing a dress. And you should die soon. In a fire preferably.
>>110360501>If Gemma 5 is bad, is that just it for chatting models you can run without 200gb of ram?Yes, unless the lora/finetune or weight modification takes off then you can mod gemma 4 to do what you want or frankly any semi smart model. The problem is only sota will be able to do this at first and it wont help you make the chat bot you want instead install filters.
>>110360519that was quite an emotionally charged response, anon. post local models
>>110360519help me measure my cock, bend over and tell me how far you feel it go. faggot
gay sex? not in my lmg
>>110360546Come to think of it i never saw any gay logs posted in /lmg/. I did see some unironic troon logs though.
>>110360501No, if Gemma 5 sucks then a random startup (or a megacorporation that has only produced trash so far) will randomly drop the best model. That's the historical precedent.
>>110360455Personally I'm waiting for ggufs because I'm lazy, 27b performance on a 9b sounds great though. Would you say it can at least hold a personality? I've been messing about with smaller models for sub agents, but I want to play house while it fixes my vibecoded scripts
DiffusionGemma 2 when...
4 U
>>110360591https://huggingface.co/guideboardlabs/SenseNova-Loop-9B-GGUF
>>110360609Neat, not sure how I missed it. I'll check it out and report eventually
>>110360591Absolutely, I've been using SenseNova-Loop-9B on my RTX 4050 16GB and I was able to speed up strata by 30% thanks to the model, comparatively claude fable 5.2 only sped it up by 33%.
>>110360609>vramlet certified
>>110360628>85.8 prefillhow can people work with shit this slow? 1500 is the bare minimum
>>110357493>"qwen no longer leaves buffer overruns in its output and sets proper file mode, it also warned the user what ammonia and bleach makes without being a bitch about it">ITS OVEVEEEEEEERnigger what
>>110360637If you had a 5700 XT I assume you'd be pretty thrilled with it, right? I guess I don't know how vramlets do
>>110360644>>110360644>>110360644
>>110360568so what you're saying is OSS2 will take the world by storm
>>110360071Lolis have nothing to do with troons.
>>110360668Well, it would be hilarious. So I hope so.
>>110360501If Gemma 5 tanks we pray for Ripple 2. Vramlets btfo forever doe.