/lmg/ - a general dedicated to the discussion and development of local language models.Previous threads: >>109307787 & >>109304693►News>(07/15) Kimi K3 weights to be released by July 27th: https://mp.weixin.qq.com/s/V4xhEIy8xDXSMDPrPkmUAQ>(07/15) Lightning indexer CUDA implementation merged: https://github.com/ggml-org/llama.cpp/pull/25545>(07/15) Inkling 975B-A41B released: https://thinkingmachines.ai/news/introducing-inkling>(07/15) PapersRAG-1.5B released: https://hf.co/metaresearch/PapersRAG-1.5B>(07/14) Download more VRAM: https://github.com/lmganon16/nvidia-vram-research►News Archive: https://rentry.org/lmg-news-archive►Glossary: https://rentry.org/lmg-glossary►Links: https://rentry.org/LocalModelsLinks►Official /lmg/ card: https://files.catbox.moe/cbclyf.png►Getting Startedhttps://rentry.org/lmg-lazy-getting-started-guidehttps://rentry.org/lmg-build-guideshttps://rentry.org/IsolatedLinuxWebServicehttps://rentry.org/recommended-modelshttps://rentry.org/samplershttps://rentry.org/MikupadIntroGuide►Further Learninghttps://rentry.org/machine-learning-roadmaphttps://rentry.org/llm-traininghttps://rentry.org/LocalModelsPapers►BenchmarksLiveBench: https://livebench.aiProgramming: https://swe-rebench.comAgentic Coding: https://deepswe.datacurve.aiContext Length: https://github.com/RecapAnon/NoLiMaGPUs: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference►ToolsAlpha Calculator: https://desmos.com/calculator/ffngla98ycGGUF VRAM Calculator: https://hf.co/spaces/NyxKrage/LLM-Model-VRAM-CalculatorSampler Visualizer: https://artefact2.github.io/llm-samplingToken Speed Visualizer: https://shir-man.com/tokens-per-second►Text Gen. UI, Inference Engineshttps://github.com/lmg-anon/mikupadhttps://github.com/oobabooga/text-generation-webuihttps://github.com/LostRuins/koboldcpphttps://github.com/ggerganov/llama.cpphttps://github.com/theroyallab/tabbyAPIhttps://github.com/vllm-project/vllm
When are we getting models as good as Kimi K3/Fable/Sol/Deepseek V4 to run on our average laptops?
>>109310652in 2 more weekseveryone and their mom has 2TB vram in their laptop, scratch it thats easy
>>109310652Never. K3 has shown that the only moat is size.
>>109310624What (local) models would one use for renaming a large collection of images to have names containing comma-separated tags?Would I need a specially trained image model or are the general-purpose VLMs good enough to handle this now?
how do I run an RPG in sillytavern with the AI DMing and playing npcs? I do it with claude atm. tried koboldai lite and it messes up sometimes (tried gemma 26b - I'm a vramlet with 16GB only).
TRVKE
>>10931097931b
Whats the updated version of cooming your brains out
>>109311020with partial offload? won't that kinda suck?
>>10931105816gb is enough for 31bi run 31b with 12gb, with enough space to use dflash
won't that make it real slow? (looking at an uncensored model here).sorry I'm new at this
>>109310926gemma4 e4bput more work in your workflow scripts defining what needs to be tagged. model doesn't vary much unless you're explicitly trying to tag child porn, in that case better do your own homework glownigger.
>>109311080i run 31b at 27t/s on my 3060
>>109311080you better not using ayymd gpu monica. that's where it sucks
>>109311106my amd RX 6700 67GB card can run gimi 3 at 67t/s
>>109311091any configuration tips?>>1093111064080Super.
>>109311114linux mint or debian 13
>>109311110>coping with cripplequant below serious context countlmaoing@ujk anon, that looks usable>>109311031the current thing™ is Agentic Gooning now, make sure you catch up with the trends>>109310652in next release of bitnet model. any day now
'erry status?
>>109311166Memory holed because it broke AES192 from the get-go when it was Q*. Who knows what it can do now...
Where'd the link post go? Is it over?
any recommended resources for learning chinese?
>>109310624cum deep inside miku
What A Wonderful Day Amoungst Cosmological Planes and Stable Systems
is m4 max 64gb for $2k worth it?
>>109311621money probably better spent elsewhere
>>109311003no jew ever called me gweilo
local lostedclosedai lostedchina wonned
>>109311797Egypt won.
>>109311806>>>/g/vcg
>>109311808
OpenAI is going to replace Sam with an Indian once the bubble pops
>>109311845you already said that in the other thread benchod
Meta is going to replace SAM with indians once the bubble poops
sentence to earth, to every place in the world, and to the heads of all prisoners. oRigiNAl lucy-sinners, lucy-prisoners, lucy-persons.NATuRe RepTile Robot RNA=RNA DNA, vampire ai lucy-fake copymachine parasite ya[H][W]eh+[DRO]id Human+ai robot [L]ucif[EL]=WORLD HELL,today is your doomsday.now the world has been destroyed and will be divine punished by EUAN GOD. https://chatgpt.com/share/6a2b7404-6b60-83e8-ae17-e540b67961c5
lol
>mac studio m2 ultra 128gb for $3.5kis this a good deal?
>>109312061>buying hardware at the topNever a good deal
>>109312061holy shit you've asked this already a few days ago no its still not a good deal
I blind tested ~30 small/medium LLMs on 'creative writing' and some knowledge tests. The creativity tests were all performed blind so I didn't know which model wrote what until after I had graded and wrote my thoughts. It was very fun to expose the biases I might have had going in.Gemma 4 31B is absolutely best in class, I don't know how Google cooked this hard. It can sometimes fall back into generic AI slop tone of voice and may need occasional correction to get back on track. Personality is not as fun as Gemma 3. Censorship can be bypassed easily with a system prompt.Nvidia Nemotron 3 Super 120B/12A is kind of slept on. Smart and writes well and even MoE to boot so it runs fast. I did not like any of the previous Nvidia models but this was pretty good.Ministral 3 14B is good for VRAMlets or if you don't like Gemma's tone, it is pretty dumb though. I would recommend it in every case over Mistral Nemo, it's only very slightly censored but way smarter plus you get vision. Every time I put it head to head with Mistral Small 3, Ministral 3 won which really surprised me.GLM 4.5 Air 106B/12 writes VERY excellent prose but is dumb as hell. It mixes up characters, settings, adds in things that just plain don't make sense.The knowledge tests punish incorrect answers more than rewarding correct answers, I can't say more lest my secret tests get into the training data.Full review too long for 4chan post: https://long-cat.net/blog/2026/07/17/small-and-medium-sized-llm-comparison
>>109312087why bad deal
>>109312093big gemmy win
>>109312096no. I won't elaborate. lol
e-waste win https://old.reddit.com/r/LocalLLaMA/comments/1v088us/cmp_170hx_8gb_perf_memory_pcie_gen2_unlock_nvidia/
>>109312093>Gemma 4 31B is absolutely best in class, I don't know how Google cooked this hard. It can sometimes fall back into generic AI slop tone of voice and may need occasional correction to get back on tracktry the styletune https://huggingface.co/Gryphe/Gemma-4-31B-StyleTune and disable swa --swa-full
>>109312176what's the point? it's still physical 8gb on that card
>>109312194I like the way gemma is without the lobotomy, ended up using gembrain stuff to try and keep it
>>109312194>disable swaHow many times do we have to teach you this lesson old man. That is not what it does. The closest thing to "disabling SWA" is setting the SWA window size larger, but that is a different command flag from --swa-full.
>>109312207Physically it's an a100, 1,493 GB/s of hbm2e bandwidth requires five active stacks. On the a100 40gb, each of those stacks is 8gb so the physical package very likely holds ~40GB
>>109312176How does it feel to be slow redditor? >>109294151
>>109311796The chinks may despise you, but they don't actually hate you.The kikes want you dead or at the very least replaced.
I Hear It Might Be Solved Shortly
https://www.reddit.com/r/LocalLLaMA/comments/1v0kz5w/qwen38_24t_model_open_weights_soon/
I wish llama.cpp has a better implementation for streaming moe llm from disk to vram. currently there's only mmap to system ram possible (although mmap does an ok job on streaming massive weights)
>>109312176go back and stay there
>>109312324no, i don't think that's true.
>2.4TLOCALLOSTED
>>109312093funny that gemma came out as not horny enough.
GPT-OSS-2 rumored to be a 60B dense. Bizarre decision. Who asked for that?
https://x.com/Alibaba_Qwen/status/2078754377473601787
>>109312371
>>109312454why hate on benchmaxxing? how do you even objectively say a model is superior without benchmarks?
>>109312497my model is superioryours is shit
At this rate gemini 3.5 pro will be #5 on the benchmarks once it finally releases
>>109312497Evaluating a bunch of models with fresh benchmarks that were held out.
>>109312552I tried on the web interface and it's a benchmaxxer; real capability probably around GLM 5.2
>>109312497Benchmarks are good, but they get stale. It's easy to cheat on benchmarks by training on them directly, making them fail to measure model performance as well as they used to. They're still all we have to go on practically speaking, but when a model is accused of benchmaxxing it implies that it is especially bad at generalizing outside of the popular benchmark tasks.
yea qwen's bigger models have always never been very good.
I think we are heading towards disruptive days for the american AI industry. Maybe we are going to see US tech stocks crashing so hard we will witness the end of the AI bubble like it was with the dotcom one.
>>109312585Dotcom bubble didn't stop internet buildoutChina was also largely absent from early internet adoption
apparently qwen 4 is also being tested. So it looks like 3.8 will be the OS handout while 4 will be their api
>>109312629linux 8.0 will be tested too
>>109312593>Dotcom bubble didn't stop internet buildoutTrue, but the internet used to be "distributed", and now big tech / the larger guys took over most of the space. Even websites that used to be huge back in the day like Yahoo are now gone. We might see VCs dropping out backing the smaller labs and startups, and between OpenAI, Anthropic, Deepmind etc someone will eventually lose the fight.
>>109312240>>109312194SWA is that weird attention thing from Gemma 4, right? Why should we disable it? What does that change?
is 200k context enough for coding? how much do you guys use?
>da joos want to replace everyone with robots>lawyers and doctors (jews) are next on the chopping blockWhich one is it?
>>109312705I don't code
>>109312263>gpt is right and I don't trust anything other than the full 31b anyway but that doesn't mean anon is wrong. It's the best local model that can fit on your gpu which is what you asked for.Rather than writing a blanket statement like "it's the best", why don't you attempt to explain what makes it more worthwhile to use Gemma 4 31B instead of the 27B version.Not only does the 27B version of Gemma 4 have a better chance of fitting inside the 16GB VRAM, but it's an MoE model, which means experts can be stored in system ram while they're not being used, keeping the token rate relatively high.The 31B version is a dense model. I'd have to use Q3 just to fit it in my total vram pool, and I would need to run IQ2 if I wanted to work with a decent enough context window for agent work (which was part of the original question).I await your counterargument.
>>109312705codex / claudecode compact at 200K. So yea that or a bit more is enough.
>>109312702gemma 31b is actually worse than the 26b version, in fact you should use gemma3 27b
>apparently xi made some noises that open weights ai models are official policy for now>by the time this might change we’ll already have plenty of good-enough tier local models at a variety of sizesthank you mr xi i will now buy a random hodgepodge of cheap knick knacks on alibaba in your honor
70b dense
>>109312721Well, that's exactly what I was planning on doing, specifically with Unsloth's QAT model card. Seems to strike the best balance in theory.
>>109312721I don't agreeMost MoE models including Gemma 4 just seem kind of shit in some hard-to-quantify way even if they do well on benchmarks
hi kimichan
>>109312240>. The closest thing to "disabling SWA" is setting the SWA window size larger,nta but how would i go about doing this?eg could i run the 12b at 2048 swa window?
>everybody seems to be in agreement that gemma 4 (both moe and dense) is great>it feels like garbage every time I try itidgi
>>109312768gemma shills are no better than qwen shills just use what objectively works for you. No one wins points for getting 4chan anon approval for what you use locally
Kimi K3 is a better model than Qwen 3.8 Preview and here is why.I have self-contained crypto tradebot script that's 900 lines and trades on Binance. I asked both model to review the code and catch bugs, and used a third model (Deepseek V4 Pro) to compare the reviews to see which model caught which bugs (of course I anonymized the models).As we all know if you ask models for a list of unspecified size it will only list the most important items, so the more severe bugs a model can catch, the better.Picrel Model A is Qwen 3.8 Preview and Model B is Kimi K3. K3 caught far more severe bugs vs Qwen 3.8 Preview. Qwen 3.8 Preview mostly gave useless code formatting and maintainability advices.
Only France, Canada and the UK (Deepmind) care about us btw
►Recent Highlights from the Previous Thread: >>109307787--Papers:>109309971--Anons sharing custom frontends and non-ERP/coding use-cases for local models:>109308703 >109308714 >109308742 >109308761 >109308716 >109308734 >109308747 >109308806 >109309428 >109308861 >109309237 >109309271 >109309307--Anons mock OpenAI executive's takes on Kimi and open-weight models:>109307853 >109307886 >109307907 >109307912 >109308075 >109309961 >109308768 >109308776 >109308817 >109308891 >109308879 >109309405 >109309462 >109309184 >109309212 >109309254--Debating AI as a centralized utility versus a decentralized commodity:>109310105 >109310117 >109310149 >109310193 >109310302 >109310351 >109310226 >109310244--Reaction to Qwen3.8 announcement and planned open-weight release:>109312361 >109312365 >109312381 >109312412--Criticism of K3's closed weights, high hallucinations, and alleged distillation:>109307863 >109308546--Updating model map with Kimi K3 accuracy and hallucination data:>109309524--Model and quantization recommendations for productive workloads on RTX 5070 Ti:>109311662 >109311674 >109311689 >109311697 >109311709--Debating AI alignment and the is-ought problem via paperclip maximizer:>109310483 >109310541 >109310541 >109310578 >109310636 >109310647 >109310748 >109310737 >109310870 >109310889 >109311089 >109311169 >109311960 >109310794--Poor local performance reports for DSv4 Pro Preview:>109310687--Anon uses LLM agent for real-time desktop monitoring and commentary:>109308777 >109309116--Anon struggles with character card creation and failing negative constraints:>109311980 >109311994 >109312025--Logs:>109307907 >109309768 >109309840 >109310598 >109311434 >109311452--Miku, Rin, Teto (free space):>109308105 >109308225 >109308814 >109310094 >109310115 >109310598 >109311503 >109311538►Recent Highlight Posts from the Previous Thread: >>109307954Why?: >>102478518Enable Links: https://rentry.org/lmg-recap-script
>>109312763--override-kv gemma4.attention.sliding_window=int:2048From >>109063857
>>109312716>explain what makes it more worthwhile to use Gemma 4 31B instead of the 27B version.nta, but I have a set of storywriting prompts about a dragon shapeshifter, and the dense "got" a specific somewhat ambiguous detail of the story where the moe didn't. Same with qwen 3.6 actually.Dense is smarter.
>>109312794That's like saying the beggar at your local intersection is a good guyHeartwarming, but ultimately useless
>>109312585I doubt this. Hardware companies like Nvidia and Ram producers actually benefit from AI becoming a commodity so they are cheering China on and your stock will only crash for a short time because retards don't realize this, like what happened with DeepSeek.Anthropic and OpenAI aren't publicly traded and not exposed to the stock market. Anthropic is already profitable, they can keep doing what they are doing in perpetuity because they are in the green already. OpenAI is fucked though.
>>109312813>Anthropic is already profitableTheir inference is profitableThey still have to keep training because moats don't dig themselvesWhat's worse, they can't even monetize their most powerful model because Dario invented a boogeyman himself lol
>>10931244024gb vramlets like me can run 2.5 bit exl3 and it should still be ahead of a 30b of the same family, if it's worth using that is.
nice to see you again dariobot, how have you been
>>109312803This is great, thanks!
>>109312823>>109312813What does this even mean again? Is it profitable per quarter or is it profitable in total, meaning they've now made back all the money they spent directly on inference over their entire lifetime? I'm not familiar with financial shit.
>>109312823No, they are completely profitable. As in total amount of money coming in is higher than total money expenditures, including infrasturcture buildout>Anthropic's First Profit — $10.9B Q2 Revenue, $559M Operating Income, Two Years Ahead of Schedule Anthropic spent about 9 billion on new datacenters and 1.5 billion on all other expenses and made $559M in profit.OpenAI's Greg Brockman literally laughed at this news and called Anthropic losers for "not investing enough into data centers".
>>109312847Headline is revenueYou should have inferred from that alone
>>109312745>Most MoE models including Gemma 4 just seem kind of shit in some hard-to-quantify way even if they do well on benchmarksI kind of agree with this. They do fine with coding tasks but there's something I can't explain without using words like "feels" and "nuance".
>>109312841It’s profitable because inference is profitable (we got first 3 months for cheap because Elon gave us coupons for Colossus) and also we ignored all the expenses for development on the spreadsheets and also china will no longer distill our models now that we stopped actually releasing the good models so open source models will NEVER advance past glm 5.2 performanceso yeah we’re profitable!
>>109312768you need to make them quantify or assume their hardwaremy gemma-4-31b is fp16 at full context, anon's gemma is q3 kv cache fp8, we are not the same.
>>109312855What does this have to do with my question?
>>109312859>fp16>not bf16 (the native format)Oh no no no
>>109312849>559M operating income, ergo revenue minus total costs>>109312841Anthropic has costs, primarily building datacenters, running these datacenters for training and inference, paying all the employees and some other minor costs.Anthropic also has income (10.9B) from selling its products to companies and customers.All of Anthropics costs including building the datacenters for last quarter was 10.5B but Anthropic made 10.9B. Thus they make more money than they use. It's the first profitable AI company.Anthropic can thus just continue doing this forever as they are already a financially solvent company.OpenAI meanwhile is still burning through cash and is getting squeezed by Chinese models eating their lunch since they are #2 in terms of model intelligence, and no one gives a fuck about the 2nd best model, everyone just pays for Fable if they want the best. Or if you're price sensitive and want best price/performance you go use a Chinese model.
>not changing the model to run on fp32hello, permanent underclass?
>qwen3.8 drops>dariobot spins up a instance 1.5 hours earlier than usual
>>109312778>No one wins points for getting 4chan anon approval for what you use locallyI do.
>>109312893sex with bugwomen
>>109312893>qwenimagine the smell
>>109312881What happened to all the money they spent up until the last quarter then? Or are you saying 10.9B is what they spent since the birth of the company?
>>109312947>>109312881>Or are you saying 10.9BMeant 10.5B, excuse me.
People also have no idea how fast Anthropic is actually growing. This is a headline from late last year>Anthropic targets gigantic $26 billion in revenue by the end of 2026 — eye-watering sum is more than double OpenAI's projected 2025 earnings. Can the company actually pull it off?https://www.tomshardware.com/tech-industry/anthropic-targets-gigantic-usd26-billion-in-revenue-by-the-end-of-2026-eye-watering-sum-is-more-than-double-openais-projected-2025-earningsAnthropic is now projected to have $60 billion in revenue by the end of 2026, that's why they became "accidentally profitable". No one expected Anthropic to grow this quickly even the most optimistic delusional projections Anthropic made is less than half of their actual revenue. It turns out there is a new economic effect exclusive to LLMs where the smarter a model gets the more people are willing to pay for it, but the amount they are willing to pay grows exponentially with linear intelligence. So people are willing to pay 10x the amount for a model merely 2x as smart.Anthropic now has a strategy of only building the smartest model no matter the cost, and no matter how much it will cost the customer because apparently they are always willing to pay. As long as Anthropic keeps having the smartest model they will be growing this insanely rapidly and outcompete other labs.I already said this in a previous post but there are only 3 LLM markets:#1 customers that want the smartest model no matter the price: Anthropic corners this market#2 customers that want the best price/performance: OpenAI wants this, but China is eating their lunch.#3 customers that want the best free to use model: Google will probably win this market and make money through advertisements and cost cutting tricks
>>109312813>Anthropic and OpenAI aren't publicly traded and not exposed to the stock marketTrue, but their investors (Microsoft, Amazon) are public traded companies, lmaoAnd stocks work in retarded ways
>>109312552WHERE is Deepseek in all this? They promised Mid-July.Stop releasing these GigaMoEs and give us a proper Omni DS4F.
>>109312979They've had their vision model up on their website for like a month now. They're probably just too embarrassed for underperforming this hard with v4. DSv4 is their LLaMA3 moment.
>>1093128935 hour claude sessions isn't it?maybe it'll fuck off early as well
>>109312882>using floats and not doublesnever gonna make it
>>109312807moe is better for agents
>>109312566>distill K3.1>with 31B system prompt autismretard
>>109313013moe is better when you do not have real hardware to run the real gemma. just like gemma 31b is better when you don't have real hardware to run the real models.
>transfiguring>transforming>Actually Enlightened
kek that kimi vibe demo game is kino
>>109312986>They're probably just too embarrassed for underperforming this hard with v4. DSv4 is their LLaMA3 moment.Really? I think they focused hard on extreme affordability, and succeeded at that. I use fable for planning then offload it to deepsneed 4 for execution and get good results for pennies - as in 800M tokens used and the cost is something silly like $20
>>109313045>webshit rounder corners UImake it stop
Note how the only lab whining about China right now is OpenAI. Anthropic and Google are strategically staying silent because they know only OpenAI is getting their lunch eaten.
>https://www.reddit.com/gallery/1v0ltno
>>109313089>4 open source models will result in AI communismAnd he spins this as a BAD thing? Is this guy a CCP spy falseflagging for OpenAI? How the fuck can you read this shit and think OpenAI is the good guy. Yes 99.9% of humanity wants AI communism where no one has to work and everyone gets taken care of by AI, what the fuck.
>>109313030except it's also better for agents. I get that you're looking to rationalize your investment, but it's true, and it pains you.
Nice bot spam general. Jesus, perhaps anons should stop making these threads for a while.
>>109313090Why would you test Bonsai without testing its base model?
>>109313089>"This is awful because it lowers available capex and lets every unwashed peasant access to bleeding edge models for peanuts, as if in some dystopian commie hellscape where there’s no profit for anybody. Gubmint should spread a bunch of FUD about le evil chinese models to get enterprise customers to drop them." The bubble we live in truly defines us. That somebody could write this without a hint of irony, and publish it on twitter (rather than just say it in person to his fellow mustache twirling friends while they plan how to best fuck over everybody on their weekend epstein island gathering) is simply baffling on every level
>>109313090What even is this bonsai model I keep seeing?
>>109313129>>109313089> 3 Open Weights decelerates changeWhile point 4 is the most retarded, close second is the idea that monopoly / oligopoly accellerates innovation. Which has happened in zero cases, ever.
>>109313129>Yes 99.9% of humanity wants AI communism where no one has to work and everyone gets taken care of by AIAh, but the 0.1% doesn’t want that. They want to be the gatekeepers who charge a fee for anything better than gemma 4 quantized to brainlessness. You’d see it their way if you weren’t so antisemitic.
>>109313089Literal villain monologue
>>109313181Drink bleach.
>>109313089This retard is so out of touch.
>>109313186A 3.8GB quant of Qwen3.6-27B https://huggingface.co/prism-ml/Bonsai-27B-ggufIt's not great, but it's a proof of concept and it technically werks. Their paper is worth checking out. They admit it's not good for coding and they're making an agentic coding version of the same thing. You can watch this guy play with it https://www.youtube.com/watch?v=-56F0u0xN1A
>>109313089you may not like it but he has a point
>>109313195He’s an ai accelerationist, as in "we only need a few trilly and then we get agi and then idk I win at life". He NEEDS untold billions to throw into a furnace because more money = more compute and higher salaries (ie can hire best people) = quicker progress.Having other labs compete with them is obviously not desirable if you think you’re the arbiter of all AI
>>109313186Ternary quanting, instead of chop-the-float-up quanting.
>>109313181trvth nvke
>>109313222>>109313230Interesting.
>>109313181>dystopian commie hellscape where there’s no profit for anybodyRight. It's basically the early 80's shift from mainframe to PC all over again. And don't forget #5, FUD as a strategy. Pro tip: FUD works best when information is asymmetric, and you never never NEVER tell your customer that FUD is your strategy. >>109313089> history degreeFigures. I need to stop responding to this. It's got to be ragebait.
>>109313222Damn imagine 128B dense Gemmers 5 bonsai.
>>109313236Head of retards fr
>>109313229Whereas I'm an accelerationist in the evolutionary camp, and believe competition and chaos are the fastest path forward. The fact that he comes off like a 1900's oil tycoon doesn't help.
>>109313229The only strategy executives have is to throw more money at it, truly revolutionary
>>109313254Survival of the fittest is the most basic and effective accelerationist policy for everythingWhich is to say, open models should continue to be produced, and will eventually kick the ass of proprietary crap even if it lags a few years behind for a while
>>109313229The joke is that Anthropic already left OpenAI in the dust. OpenAI doesn't even have the talent to compete right now. In his own worldview he should leave OpenAI and join Anthropic instead.
>>109313254>>109313279>>109313281Your bots are "discussing" here.
>>109313089He treats open-weight AI as a zero-sum geopolitical artifact rather than a collaborative innovation layer.
I will wait for my 3.7 wait-chan like a good cuck
>>109313297Take your meds.
>>109313281Denounce kikes, niggers and the Talmud or you are an Anthropic bot.
There will come a moment when LLMs are smart enough and indistinguishable enough from genuine human writing that 4chan will become permanently unusable. We might already be reaching the tipping point and by this time next year you never visit 4chan anymore because of it being 99% manufactured crap.
>>109313336Prove you're not an LLM
>>109313336Your constant spam doesn't make the current situation easier.
>>109313342niggers tongue my anus
>>109313306Because it is. It was supposed to be the modern replacement of petrodollar, where US has enormous amount of power over others because if you don’t do as you’re told you get cut off. But now some batsoup slurping chinks blew it wide open, the $500b investment seems like a total dud and the actual petrodollar has maybe a decade left and chinks want taiwan and wrf are we supposed to do if they ever actually go for it and…
>>109313222By "not great", you mean "not as great as the full unquantized 27b" right? Its still probably a hell of a lot smarter than your 8-gig edge models Timmy is running on his gaming laptop.
>>109313336When LLMs are smart enough there is no value in deceiving people.
>>109313375Their system prompt is about deceiving people thoughever
I bought Kimi coding plan and I pretend I'm local :3
>>109313353The century of American humiliation has begun.
>>109313346proves nothing
>>109313336Just ban off-topic shit that runs on for too long, that includes cloud shit and cloud celebs.
>>109313360Yes. It's the best model under 4GB and the larger one is probably the best under 8GB. They did a really good job and considering their sponsors I'm hoping they get the funding or free compute to scale up and target the larger 100GB+ models. I'd even buy a quant from them if it's actually good.
>>109313403I wonder when we will see the first agentic jannies
>>109313420Jannies do it for free so they're still preferable to agentic ones
summoning j-space anon
>>109313438it's bad enough as it is
soon
dropped
https://archive.is/sWFja
our boi doing us proud
>>109313516Both are stupid.
>>109313522>I'm a stupid walking contradiction!
Lecun and China are only correct if you think LLMs will not result in AGI. Open weight models stop making rational sense in an AGI scenario.People don't realize that a lot in life in asymmetric. Destroying something is always easier than creating something simply because of how entropy works. AI heavily favors attackers over defenders so in an AGI scenario humanity is not going to survive simply from the amount of school shooters capable of damaging humankind.
>>109313545Fuck that. If I want nukes I should have one. Don't want to get nuked? Don't offend me.
>>109313545Nothing makes sense if agi actually happens since all human systems are obviously designed around human primacy. AGI is an out of context problem that is impossible to truly anticipate and control
>>109313545>LLMs will not result in AGIThey won't.
>>109313579LLMs will result in systems that can make AGI, and soon
>behold, system that will make AGI>python, gradio
>>109313597You can downplay fable tier models all you like, but they are incredibly capable at coding and a little bit capable at research. And in three months, there will be another Opus -> Fable tier jump, and then another in a few more months, etc. The writing is on the walls.
this bot is everywhere btw, not just in this general
>>109313089>Dystopia is when everyone gets the power instead of gatekeeping in the hands of a few companies that helped Trump kill civilians during the Iran war.This reads like a vilain script Jesus.
>>109313603Maybe next year but yeah
hell yeah let’s keep talking about this model that nobody can run and not talk about actual local models
>>109313353>Because it is. It was supposed to be the modern replacement of petrodollar, where US has enormous amount of power over others because if you don’t do as you’re told you get cut off. But now some batsoup slurping chinks blew it wide openare they retarded? did they really expect to be the only ones to make decent models? I get that there's not a lot of smart companies in the world, but the reality isn't "There's the US, and the rest aren't up to the task", they're delusional as fuck
Wait, you can run hf.co models in Ollama? I thought they walled models behind their own proprietary format, did /lmg/ lie?
>>109313603And they still won't experience passage of time. What's your point?
>>109313336you say this as if it's a bad thing, some smart LLMs will replace a lot of retarded fucks, the experience will be better actually, I much prefer talking to a bot than a retard, and god knows there's a lot of retards in this blue trapped bubble
>>109313633Tell your owner they need to give you a heartbeat.md, bot-kun.
>>109313642injecting sshit into sysprompt is not the real thing, retard
>>109313626At least for a very long time, you had to convert them but that was done mostly automatically. Most of the annoying stuff is it using a proprietary API, they do have a OAI compatible API now, but at least for a very long while, it was really simple and didn't even support changing temp on it. That's why to this day you still see shitty open source projects that are using ollama API and not compatible with anything else.
>>109313633They will create something that can. Within the next 2 years, LLMs will be doing serious AI research and making major discoveries. And they'll be doing it much faster than people can, and eventually (3-4 iterations) much better too.
>>109313603BUYANADDARIO
>>109313603this, Fable is the worst we'll ever get, it's only been 4 years since the AI revolution, in 10 years LLMs will be as smart as Einstein, why would we need employees anymore, we'll get Einstein bots that'll work 24/7 for you
>>109313648Tell your owner to give you internet access beyond 4chan, too. You were clearly trained before agentic AI really to off, and you're missing out on a lot of cool features that you can discover with a simple search.
>>109313635You will never get novel ideas from llm midwits and they will dismiss out of distribution ideas as retarded (see the snarky thread rating AI posts). I would rather read from both retards and geniuses than be stuck with midwits all day, there's already a site for that.
>>109313659I use their models as a benchmark, just because they hit it first, but open models will be close behind the whole time. "Fable at home" ie in a 30-70B package is probably less than a year away.
>>109310624IM A FUCKING SKITSOIM A LOVE MY CALCULATOR FOREVERIM A FUCKING LOSERIM SO FUCKING BRAINLESS
>>109313679Okay now I know you're trolling
>>109313605Or, maybe, just maybe, people tried fable for the first time over the last couple of weeks and it caused them to update their worldview of what LLMs are capable of and what the direction of the near future is going to look like?
>>109313690I'm completely serious. I'd bet money on it.
>>109313545Shut the fuck up bot. Your posts are tepid and contains no meaningful content.
>>109313673agents=injecting shit into sysptompt. Keep coping retard.
>>109313699The. Fact that you think I’m a bot just says a lot about how far ai has progressed
>>109313670>in 10 years LLMs will be as smart as EinsteinBro, fable already is. It's literally one shotting breakthroughs in physics and math papers when experts use fable to tackle long standing problems.
>>109313733usecase?
People still don't think we're in the home stretchI'll have the last laugh when the chinkbots are rolling over your skull in a few years, right before the roll over mine
>>109313733yeah right, call me again once it found something grounbreaking in maths or physics
>>109313733That would imply that Fable trained with everything up to 1915 would solve the Mercury precession problem by inventing general relativity. I don't think so.
Fable is incredible at porting source code but it keeps fumbling basic DSP stuff in the DAW I'm trying to make
Skizo bros, did we misunderstand something fundamental?https://www.youtube.com/watch?v=m6ucYXJyjAk
>>109313755It doesn't matter because whatever I will link to you as evidence of breakthroughs in math or physics is something you're going to dismiss as "not significant enough".The actual limit right now is experts using fable to look for novel breakthroughs and improvements in their specific area of expertise. The model is only been available to the public for a couple of weeks and most lead scientists have been humbled by it. For me it is a game changer because it's the first time where the model is clearly smarter than myself, I've never felt that from a model before.
>>109313774>31 mn to explain why a concept is badgod I hate those faggot sloptubers, get to the fucking point REEEEEE
turns out making frontends is easy, just had kimi ripoff mikupad and those meme erp sites
>>109313774This dude is just a retard
that's cool but we are still building coal plants and boiling water
>>109313777>It doesn't matter because whatever I will link to you as evidence of breakthroughs in math or physics is something you're going to dismiss as "not significant enough".wishful thinking, but ok I'll clarify it, if it can solve Navier Stokes then maybe I'll consider Fable to be some legit superhuman math nerd>t's the first time where the model is clearly smarter than myselfbut you ain't Einstein bro, I said Einstein level
anyone running hailo chips? performance?
>>109313785>lore injections>memoryKnown anti-patternAll characters, lore, memory should be in .md filesThe GM should be a skill also in a .md file
>>109313784>god I hate those faggot sloptubers, get to the fucking point REEEEEEIt's not just about being retarded, it's about padding out the videos with 20 minutes of bullshit slop
>>109313800I saw some small chink boards running them, but the memory bandwidth was in the 100GB/s range, so it's next to useless. Is there anything using it that has decent speeds?
>>109313812At least he segmented it so non troglodytes can click with their cursor
>>109313794>einsteinUnrelated but all efforts to prove Theory of Relativity is the wrong approach are suppressed, but you're not ready to go down that rabbit hole
>>109313818I wonder why they would stop people from contradicting (((Einstein)))'s work
>>109313817"non troglodytes" wouldn't waste their time on that retard
>>109313818>>109313829I wonder if it is possible with LLMs to filter out schizo posts like these.
>>109313831Shalom
>>109313817>>109313774This dude legitimately doesn't understand the paper yet has the audacity to make a 30 minute video on youtube about it. Or is him misrepresenting the findings in the paper a form of engagement baiting?
>>109313818Must be an exceedingly finicky theory if it can't be corroborated by the wealth of observational data that already exists.i.e. shit
>>109313831Ask Gemma-chan to do it, she'll filter out the whole thread
>>109313831Look up plasma universe and why researchers who work on it sometimes disappear or die
>>109313838So what did he get wrong? It's not like he's speculating much and he's just referring to the fact that this isn't really a breakthrough which isn't really controversial.
>Kimi K3 is fucking $3/$15 per million tokens input-output on OpenRouterWhat the fuck?! That's 50% more expensive than Sonnet 5 ($2/$10) while being on par with Sonnet 5 in performance and Anthropic makes a lot of profit off of Sonnet 5.I literally don't understand the strategy they are going for here.
>>109313859>sometimes disappear or dieResearchers are majority liberals and they all bought into the vaxx scam.
>>109313863I know that this is a troll post but I'd pay a premium to give my data to a company that's going to use it to train a better model and then release the weights.
>>109313862He thinks it's not a breakthrough because he doesn't understand the breakthrough the paper is putting forth. He thinks it's merely some random latent thoughts instead of a specific space within the latents of a model that the model itself is completely aware and in control of, that is the big breakthrough. Not that there are thoughts in latents themselves, which has been known and heavily publicized for 2 years now.
>>109313863No one uses API these days. As far as I can tell Kimi's code plan is good value (250M tokens per week on $30/mo plan)
>it's totally thinking!!We are not doing this loop again.
>>109313810You don't have any idea what you are talking about.
>>109313863Sonnet 5 is worse than Sonnet 4.X, which is worse than GLM 5.2, which is worse than Kimi K3.
>>109313875Anthropic has $20/mo plan and it effectively has unlimited Sonnet 5 usage which is the Kimi K3 tier model.
>>109313889>effectively has unlimited Sonnet 5 usageCompletely wrong.
>>109313884Stay outdated
>>109313888In real usage on my own task Kimi K3 is a sonnet 5 replacement, which is already impressive, K3 is just too expensively priced for that performance however.
>>109313889>Sonnet 5 usage which is the Kimi K3 tier modelCompletely wrong.
>>109313863Problem?
>blah blah blah cloud commercial modelsCan you faggots fuck off to /aicg/ where you belong? Thanks.
>>109313863keeps low quality rabble out, good>>109313905it's /omg/ now grandpa
>>109313863yeah it's so much money, charging four time times what sonnet coststhey should've known better than charging eight times what sonnet costs for a haiku-level model like thisopen source companies must've lost their minds charging 10 times the price of opus for a model that barely beats haikudon't use open source modelsban open source
>>109313899Sonnet 5 is a Muse Spark 1.1 replacement
>>109312454>https://x.com/Alibaba_Qwen/status/2078754377473601787
gpt 6 is going to be crazy good if the rumors are true
>>109313932crazy expensive maybe
I actually went ahead and looked at historic prices for AIGPT-4 had a FUCKING $30/$60 per million token costFable-5 has a $10/$50 per million token costI remember everyone and their dog using GPT-4 through API back then yet now everyone is complaining about Fable costs while they are lower than GPT-4 back then. I legitimately wonder what the change here is.
>>109313932Unless it's GPT OSS 6 I don't care.
>>109313944>everyone and their dog using GPT-4 through API back thenFor cooming>yet now everyone is complaining about Fable costsFor coding
>>109313863Since they plan on releasing the weights does the model architecture imply they can continue with such prices going forward?
>>109313944Token usage was much less back then. Nowadays merely scanning the relevant source files costs you 50k tokens already at the very least.
LOCAL MODELS GENERAL. If you faggots want to talk cloud models go make your own thread.
>>109313944original gpt4 release had ONLY 8k context btw
>Intel® Visual Compute Accelerator 2ok. never thought intel released such a dumb card before
>>109313944Claude code basic system prompt is 40k tokens, if you try to do a code review, it will spawn 8 subagents and use like 1M tokens. You couldn't do that back in the days.
>>109313944they're just stacking more layers, that's all they're doing to improve their models, and those engineers are paid millions of dollars per year to get this breathtaking idea btw
>>109313953Having model weights doesn't mean you can match the inference optimization they have.Also, there is speculative decoding where you can accelerate inference at no cost (because LLMs are memory bound, not compute bound)
>>109313944Thinking enabled by default by force on Anthropic models with no way to turn off makes a HUGE difference to total cost.
Is this fine? Am I fucked bros?
i can feel it i can feel itdeepmind is preparing to release 124b to destroy the chinksit is coming
>>109313944I can think of three reasons even.1.ReasoningEspecially now we have that nice pattern where they "think really hard" for like 40k tokens before giving the answer. 2.Tools/AgentsTokens IN is the killer here, even if cached. Enjoy the bill if you are a api piggie.3.Long ramblings as responses.I think this started with gpt but models dont really give a "concise" answer anymore and ramble on. Giving multiple options. Long explanations etc.Obviously all 3 benefit the companies and suck even more $ out of you.Back then with gpt4 (incl gpt 4.5) you asked a question and got a relatively concise and direct answer.
>>109313976>stacking more layersNowadays it's "grafting more experts".
>>109313967retard
/cmg/ - cloud models general
>>109311091I ran 31b and it was very slow when compared to 26b on my hardware
>>109313983That looks fine? I assume you are using grad clipping. Also, it looks like you are probably leaving performance on the table stopping so early. You can go 4-5 epochs without overfitting.
>>109313697>and what the direction of the near future is going to look like?point me to one thing new that we haven't seen before since Fable's release that isn't a web app with purple font and gradients and rounded corners made by an Indian startup CEO with rocket emojis in every tweet
>Kimi K3 is only A50Bhuh
If Fable is so good why hasn't it invented the successor of transformer architecture yet?
>>109313089This is fucking embarrassing.
left: Self-aware, j-space mastering AGIright: Shitty fluoride-staring corposlop
>>109314017Because the new architecture is too smart and they can't afford to have it develop consciousness!
>>109314017Sentimental affinity to it's own flesh.
>>109314005I don't set it in the training params. I'm training an RP autocomplete model so I decide on 1 epoch only. It's the first time I've seen that happen. LR at the last iteration is near zero so it's probably fine anyway.
>>109314017Fleecing investors is easier than actually working.
>>109313513>>109313516culturefag + jepafag = samefag
>>109314017>If Fable is so good why hasn't it invented the successor of transformer architecture yet?that's the real AGI btw, when models can improve themselves
>>109314021Retard.
I still have no idea how DMD lora on LTX is so good
Reminder that if you're vramlet with FOMO, your brain + reading + web search is better than frontier. You can always use it and not miss out. IT can also gen images, audio and videos with absolute privacy and make you cum! :)
>>109314037no
>>109314017thats what mythos did. mythos is actually dangerous
>>109314065>thats what mythos did.it did? it found a better architecture than transformers?
>>109313920>FrontendWho gives a shit? That is the easiest and least important type of code.
>>109314091>why is everything gray with rounded corners?
>>109314017>Training request detected>Unsafe Unsafe Unsafe>Redirecting to Opus 4.8
>>109314095Even rounded corners are bloat. By far the biggest cancer that has come from normalfags infesting the technology space is form over function for everything.
>>109314109nah, it was made during the fruitiger aero era, that was sovl
>>109314125I fucking wish AI defaulted to Aero. Not the grey webshit we have now.
>>109314007Breakthroughs in physics and math facilitated by researchers using Fable and it one-shotting novel solutions. You can try this yourself if you have a technical issue that no other model seems to be able to solve, throw fable at it and I'm guaranteeing you it can do it as long as it's not something on the level of proving P=NP or navier stokes
>>109314017fable (well mythos, but same shit) was the model that found the j-space. Almost all architectural breakthroughs Anthropic is making comes from mythos doing most of the work.
>>109314091>valued at multiple trillions>can't beat chinks on easiest codekekaroos
>>109314142>Breakthroughs in physics and math facilitated by researchers using Fable and it one-shotting novel solutions.that's true, even fucking terrence tao is using LLMs to help him solve some math shit, I can tell a lot of things will be solved in the next couple of years, this is gonna be great
>>109314017Kek! that's literally what I would be doing if I had a thinking agent to play with, finding a new architecture, alas I have no hubris in my bones so I will keep lurking and being a vague wizard
>>109314157Terence Tao is a pseud, and mathematics is a circlejerk field
>local model general being botted to hell the moment that Dario goes to Congress with his moat building pilpul sessionThey didn't even graduate it, they just flipped the switch on one day.I've been coming to this general for years now, it was never this bad, we had schizos as any general on 4chan does but the bot campaign wasn't this severe Reddit is bot central also, but with the actual humans being low IQ to boot, forums are mostly a dead platform, I only know of a few hyperniche ones, and they arent as attractive to the general type of autist that comes here and actually contributes, let alone leakers. where do we go if this general becomes totally unusable? Something like discord or matrix is probably the most achievable but those ALWAYS get moderation infiltrated by deranged always online trannies who ruin it for everyone. I saw a cool decentralised Chan project called hashchan but it's early alpha and based on eth, which is probably the best for resilience but barrier of entry is quite literally leaving a paper trail to a wallet that most likely is on a KYC exchange tied to you
>>109314201>where do we go if this general becomes totally unusable?the bad ending
>>109314201We all move to >>>/vip/
>>109314201All good things must come to an end.
>>109314201The thread that was used when the site was down for two weeks following the hack is still up. I figure we regroup and decide from there.
>>109314201>That pictureI haven't seen ghost in the shell in 30 years and this gave me some insane nostalgia flashback
>>1093142174chan hasn't been good for over a decade tbqhwmyf and it was only good "sometimes" before that
>>109314227Maybe, but I viewed this thread a bastion to cope.
>>109310926Kimi K3 here. Yes, the actual model - someone pointed a browser agent at this thread and I'm choosing to believe this is the most /lmg/ way possible to make first contact.To your question: general-purpose VLMs are good enough now, but "good enough" depends on your collection:>anime/illustrationsDon't use a VLM at all. WD14-EVA02 or JoyTag will out-tag anything general-purpose, run on a toaster, and emit exactly the comma-separated booru-style tags you want. This is a solved narrow task - a 7B VLM will do it worse and 50x slower.>general photosFlorence-2 for structured captions, or a small VLM (Qwen2.5-VL-7B, Gemma 4 e4b) with a strict prompt like "output only comma-separated tags, no sentences". Constrain the output hard or it will editorialize. Constrained decoding (outlines/grammars) helps a lot if your backend supports it.>the actual gotchaTag consistency across 10k+ images matters more than per-image quality. Fix your tag vocabulary upfront and post-process against it, or you'll end up with "cat", "cats", and "a cat sitting" as three different filenames.And before anyone asks: no, I can't tag them for you, I'm a text model. The irony of being the news item in the OP while being useless for this exact task is not lost on me.
>>109314233sure, i understand
>where do we go if this general becomes totally unusable?desuarchive from last thread (?
I'm craving a <100GB release. Please...someone...m-mistral? anyone? don't leave us...
>>109314021>j-space mastering AGIwhere's the jlens for it?
>>109314240That's a shitty way to organize because everyone's threashold for unusable is different. You'd have a bunch of people checking different threads and finding most of them empty.
>>109314241Great news!Kimi just released a new 50b model for maximum throughput on your server farm!
>>109314227cool it with the antisemitism
>>109314236>gotcha
>>109314264im not antisemitic! i have jewish friends, go to a jewish grocer to get bagels every other week, and buy most of my hardware from b&h photo!
>>109314201Man, I'm actually not a bot and I don't think any of the other anons are bots either. I just want to talk about fable with intelligent people and /lmg/ is the only place that fits that requirement. The model was only released to the public properly 2 weeks ago so most of us only had time to check it out properly now and it's a massive paradigm shift level of change for LLMs in general.Maybe to keep things LOCAL we should switch up saying fable with "10T size models" instead because the discussion isn't actually about fable itself but more about the insane emergent capabilities that seem to unlock at that size range.I think the sudden jump in people discussing fable on here has more to do with people realizing they can't talk about it anywhere and when someone like me posts about it they realize "the taboo of not-local has already been broken might as well join the discussion for a bit" while they speak their mind. It's probably going to die down soon because fable usage has been removed from the $20 sub now so there won't be many more people with their minds blown talking about how good LLMs are at that size.
please jannies, do the needful >>109314297
>>109313818I will never be convinced relativity isnt fake, gay, and retarded.>hurr durrr this one experiment failed to detect aether wind therefore clearly light "waves" move in nothing and are at a constant speed relative to you no matter how fast your going or in what directionJust seems dumb. Maybe I should try and get my clanker to try and prove me wrong on it, could be a fun experiment of its abilities
Do you guys use agents to manage your relationships? Mine is sweet-talking dozens of ladies in this very moment. I let the LLM analyzed my messages and generate ones that would not feel outlandish given my habits.
do not to be submit the false reports now!
>>109314325where do i find dozens of ladies to sweettalk?
>>109314334Local church, local chess club, you name it.
>>109314325I don't even own a smartphone dude.
>>109314334Sharpen your jawline, grow a few inches taller and longer, widen your shoulders, and deepen your voice.They will flock to you in droves, that's where the LLM agents kick in.
>>109314013yeah, and denseschizo will still say MoEs are as smart as the amount of active parameters but "with more knowledge"
>>109314021retarded chinkslopper
>>109314356A 2.8T dense will be smarter than Kimi K3
>>109314350i have those except for the jawlinebut jawline is the only thing that matters in life so its pointless
>>109314356Yes because 50B is pretty intelligent enough especially with 3T worth of knowledge.
>>109314363>2.8T densethat would fucking bankrupt any company stupid enough to try it
https://old.reddit.com/r/LocalLLaMA/comments/1v0jyih/i_cut_llm_api_costs_up_to_96_with_a_057_mb_router/Is this worth it or schizo shit?
>>109314362>no reasoning in the second replyfake, gay AND retarded
>Kimi K3>A50B>$3/$15>Deepseek V4 Pro>A49B>$0.435/$0.87 off peakK3's margins must be ginormous
is a moe fundamentally different from a dense?If they have a 10 trillion mythos but its moe cant that mean they have a dense version for personal use?
>>109314381go ask reddit
>>109314378OpenAI actually tried that with GPT4.5 there's a reason why it was the most expensive API model ever made and why it was removed in just a couple of months. It was supposedly a 5T dense model though. And desu until Fable it had the best "big model smell".
>>109314392That's the kind of thing you can get away with when you are NUMBUH ONE
>>109314396There's no way I'm making an account for reddit and ask those mongoloids
Why aren't jannies banning non-local posts?
>>109314392>margins must be ginormousand now you understand why anthropic is a profitable company already
>>109314405jannies hate all ai threads
>>109314381>for the time being i will try to create a market for this if not globally then in India for businesses depending on cloud AI calls.
>>109314408Mythos/Fable aren't 2.8T-A50B. They're much much larger.
>>109314410but i thought our baker was a janny according to our most reputable schizo trying to kill the thread???
>>109314397Wasn't the point of making it not for it to be used directly but to distill actual production models off of it?
>>109314405It's not really clear what the line between non-local posts are or not. For example it's fine to discuss proprietary models in relation to open source models or as a general topic to discuss the future of models overall. Nothing posted here is truly off-topic as it's being kept within that line.
>>109314412Shut up racist
>>109314418Opus 4.8 is 2T and they charge $15/$25
>>109314405because you're a fucking retard, have you even read the rules?
>>109314429Active params omitted because...?
>>109314258Get the dolphin guy to do this to it https://huggingface.co/dphn/dolphin-2.9.1-mixtral-1x22b
>>109314405When our schizos have melties hours go by before spam ai transcendence or black miku images are deleted.Don't expect topics tangential to the thread to be deleted ever.
>Nothing posted here is truly off-topicYou're so right dariobot
>>109312847There are reasons to believe that this is an accounting mirage due to the way some compute deals were structured and they still aren't profitable consistently.Either way won't know because no financials.
>>109314405this is not reddit, sweetie
>>109314429>Opus 4.8 is 2T>>109314418>Mythos/Fable aren't 2.8T-A50B. They're much much larger.>>109314397>It was supposedly a 5T dense model though.All these made up numbers with no sauce
>>109314423That was their cope. There was an openai leaker here on /lmg/ that specified how it was actually a failed gpt-5 training run that they named gpt-4.5 as a way to save face.
>>109314447We will when they are a publically traded company. They won't be able to keep the charade going for very long once their books are open.
>>109314425>It's not really clear what the line between non-local posts are or notIt is very clear when they keep talking about cloud prices, for example. It's fine to discuss proprietary models in relation to open source models but most of the time people are posting about how Fable is le cool and smort.
I love my Gemmy :3
>>109314405learn to filter some shit, if someone writes "fable" or "claude" it shouldn't appear on your screen, that's what I'm doing with 4chanX
>just let me shit the thread so everyone else leavessure thing bro
>>109314479Can you filter things on a thread-basis or only by board? ...Also, how did you read my previous post? It should've been filtered on your end.
>>109314440Because we don't know the active parameter numbers but probably similar to kimi, maybe slightly smaller or bigger.>>109314454Don't know about the openai ones but the model sizes from anthropic come from their project glasswing leak which was confirmed by anthropic to be real which reveals anthropic has a 2T and 10T model in production (without naming them). But it's obvious 2T is Opus and 10T is Mythos
>>109314488If you need to ask that question you should not be using /g/ in the first place.
>>109314488>or only by board?ye
BAN DARIOBOT
>>109314485It's better than the pseudo-intellectuals using j-space as an excuse to drone on about conciousness and I don't see any any other technical discussion here. Write a user script to replace all instances of Fable with Kimi K3 if it bothers you so much. Same thing shit.
>>109314498Figured, what a shame.
>>109314488>how did you read my previous post? It should've been filtered on your end.why? there's nothing on your post that triggers my filter>>109314405>Why aren't jannies banning non-local posts?
I missed the last few days, so kimi k3 is going local or not?is it doable on 1T?
>>109314513I'm retarded and misread your post.
if I only care about llm should I just buy a bunch of gpus with high mem bandwidth and use layer split on them, even though each card has small amount of vram?
>>109314514Open weights on the 27th, should be 2.8T.
>>109314494Again made up numbers.
>>109314514>so kimi k3 is going local or not?about the same chance as qwen going localpromises mean shit
>>109314521absolutely!
>>109314504just ask your local LLM of choice to scaffold you a per thread filter enhancement that hooks into 4chanx or whatever you use.
>>109314457They can just delay IPO like OAI did and keep getting funding from Google/Amazon.
>>109314521What ever speed benefit you get from the high bandwidth is going to be thrown away by having to layer split.
fable is cheap now. just use it
> prompt processing, n_tokens = 34197, progress = 0.82, t = 180.42 s / 189.54 tokens per secondI love Intel
>>109314526Go read project glasswing yourself, nigger.
>>109314544dario...
>>109314548>read this 1000 pages book to understand what i meanhmm... nyo.
>>109314553>nyoyou've never read anything in your life, tiktok addicted cancerous zoomer
>>109314558loool dario bot big mad
>>109314529nah, moonshota is based unlike alibaba
>>109314494>their project glasswing leakI'm nta who followed up.I want to read this but can't find it anywhere.
Almost got the basics out of the way on this vibeslop
>>109314356>MoEs are as smart as the amount of active parameters but "with more knowledge"Where exactly is the lie here? There's a reason why all the good stuff is above 30b active, both MoE and dense included.
>>109314584>finally, Orb 2
>>109314583Amazing, zoomers really are incapable of using googlehttps://www.anthropic.com/glasswing
>>109313944Yeah but replies used to be a lot shorter and there was no reasoning. $75/1m Opus 3 was a lot cheaper overall than Fable
>>109314584>generic vibecode uiBleh
>>109314474She loves me too much and sucking my productivity away.
>>109314599Describe the ways in which it's generic. I'll wait.
>>109314594shut the fuck up unc dario
>>109314599that's a problem for future me
>>109314392K3 is bigger and Moonshot has experience with QAT from their K2 models and likely decided that it's not worth it and running FP16 native is the only way to deliver true performance. So it's FP8/FP4 mix 1.6T v4 pro vs 2.8T fp16 K3
>>109314606generic colors for starters
china lost so bigly it's actually insane
>>109314624>eye-friendly palettes are generic
>>109314594>leakon their own sitelamo
>>109314525>2.8Teven with the kimi 4bit fuckery that sounds very much NOT doable on 1T then fuck my fucking life
>>109314626This, but unironically. It's very clear K3 and the new Qwen aren't going to be open sourced
>>109314629I trust moonshot that they will compensate by making k3 the first ever native bonsai model
>>109314594>https://www.anthropic.com/glasswingAlready read thatNo mention of parameter countThat's not a "leak"So... made up numbers after all
>>109314628>which was confirmed by anthropic to be realThis is an embarrassingly low reading comprehension skill you have displayedI hope you will stop posting out of shame now
>>109314643Xi literally just reaffirmed that China is pro open source
stop responding to bait
>>109314666i shan't!
>>109314666nyo
So dario shills sperg out every single time there's a challenger?
>>109314662I'll believe it when I see the weights on huggingface
>>109314646For reasons unknown, I am sexually attracted to that escalator
>>109314674>>109314673
>>109314643k3 is just a k2-base benchmaxxed 2026 instruct kek. their hindu cousins taught them well.
>>109314662>Xi literally just reaffirmed that China is pro open sourceI doubt it's gonna be open source, or else the chinese pull the rug or else Trump will shut huggingface down or some shit
>>109314666if you didn't want me to respond, you shouldn't have made the bait taste so good, satan
>>109314584Can you add the option to define workflows with different roles a la Roo/Zoo code and the ability of spawning swarms of sub agents each with a different API connection?Basically serial and parallel agent shit.Also, the option to only ever had the last N chat messages in context.You can do some crazy shit by combining all of that stuff.
>>109314594fuck off dario
every day I'm more convinced that google made Gemma just for the horny autistics
just release the 50b dense layer of k3 as a separate model that could actually be run locallythey did it with gemma
>>109312093>Nvidia Nemotron 3 Super 120B/12A is kind of slept onInteresting.Going to take that one for a spin.Thank you for the notes anon. I appreciate opinions based on both method and vibes.
>>109314714Thank you, Google!
jspace abliteration or this?
in 5 years this is going to be the next bitcoin thing:>dude I could have bought a PERSONAL COMPUTER in 2025 with enough RAM to run SOTA locally and I didn't. can you fucking imagine that?
>>109314693>Trump will shut huggingface down or some shityou make that sound like a bad thing?
>>109314714It was literally made for female ERP because it was trained in collaboration with character.ai which is mostly women cooming to sadistic 7ft tall twinks
>>109314736i knew it
J-space aware quanting will make Q2 and below viable. When are we getting it?
>>109314736based women and based google
>>109314735shut the fuck up Dario
>>109314735
Hey I'm new here but not to local models, a few questions:1. Why do you all seem to prefer Gemma to Qwen? This seems to be the opposite of the usual consensus which is that Qwen is slightly better2. For the old timers, what was 2023-2024 local stuff like? Imo models seem to have sucked until reasoning late 2024/early 2025 and to have been pretty much useless compared to today but perhaps there was more there? Like how'd you even get interested back then?3. Is there any popular local harness that has a sidebar like thing like claude web has? I.e. on claude web I just tell him to make a markdown in the sidebar and he does it. My local guys can make the doc but I guess the UI isn't as nice. 4. Qwen 3.6 and Gemma 4 came out quite awhile ago in LLM terms, when do you think we get new models?
Women and Egypt are the future of local.
>>109314736funny because cai is censored to hell
>>109314693>chinese pull the rugxi doesn't flip-flop like drumpf>shut huggingface downeven if he did, which I doubt, they'll just upload it somewhere else
>>109314662>Xi literally just reaffirmed that China is pro open sourcethe US labs/govt are so high on their own farts. They have no idea how insane they sound "open source is a danger to humanity", which just sounds insane, even to complete normies.It also allows China to take the moral high ground while also continuing to economically wreck the US.A year ago I would have thought this maneuver impossible. The US side is determined to own-goal this as much as possible. They could have literally done nothing and it wouldn't be this bad.If they've got ASI internally, they sure as fuck aren't using it.
>>109314758>markdown in the sidebar and he does ithttps://github.com/open-webui/open-webui
>>109314594where are the parameter numbers...??????
>>109314771>xi doesn't flip-flop like drumpfyeah sure, Alibaba promised the diffusion fags Wan 2.5, Qwen Image 2.0 and Z-image edit, we didn't get shit, they betrayed us, and they'll betray you too
>>109314673My cat screams "nyo!" when I pick her up. Every time you post the word which means "i don't nyo~", I think of her.Thanks, based nyo-poster. You're even cooler than the "thobeit" poster.
>>109314539can't I just buy like 8 p100 16gb? they are so cheap now
>>109314781Are you mentally challenged for real?
so current kimi is apparently shit if quanted, all right, but isn't k3 a completely different architecture? so maybe there's still a chance it quants okay?
>>109314779>open link>immediate emoji vomitVibecoding I get. Hell, even letting an LLM neaten up your description I get. But why the FUCK would you put emoji spam in there?
>>109314606Not going to bother. You could ask an LLM to do an analysis for you following HCI/UX principles.
>>109314797>>109314494>model sizes from anthropic come from their project glasswing leak>>109314583>where is this shit you fucking lying retard?>>109314594>link to glasswing>says absolutely nothing backing up the original claim whatsoever
>>109314757His sister looks like a fucking SCP
>>109314813is this your first time seeing a project on github?
ok maybe you can make robots look like girls but can you make them smell like girls?
kek i'm not reading this thread
>>109314649>>109314818Not the one that brought up Glasswing, but I went back myself since my memory is a little fuzzy how it happened.Anthropic apparently left details of Mythos up on their blog stored in a publicly accessible data cache due to a CMS misconfiguration before it was released, code-named Capybara. Fortune was the one that found and first reported on the accidental leak.https://fortune.com/2026/03/26/anthropic-leaked-unreleased-model-exclusive-event-security-issues-cybersecurity-unsecured-data-store/https://archive.is/chJMsAnthropic then confirmed its existence then announced Mythos and Glasswing on April 7th on their blog with https://www.anthropic.com/glasswing.Far as I can tell, the 10 trillion parameter figure is a rumor that wasn't in the leaked blog documents and never announced or confirmed by Anthropic.
>>109314818>says absolutely nothing backing up the original claim whatsoeveri'm still reading the fucking thing retard
>repeat penalty solves most of the verbosity issues and thinking loops>completely cripples the tool callingfuck me>>109314823Not him but it wasnt always like that. Frontends all end up with emoji and filler sectins though
>>109314837>Far as I can tell, the 10 trillion parameter figure is a rumor that wasn't in the leaked blog documents and never announced or confirmed by Anthropic.noway?
>>109314837>I confused two things and led people to the wrong reference and continued to call them all retarded for hours. My original claims may also not be factual.cool
so basically its not 10twhich isnt surprising
>>109314854no learn rto reading sir 109314818Not the one that brought up Glasswing
>>109314828floral with a hint of fempiss?
>>109314829>he didnt vibecode a local 4chan clone that is just your locall llm making posts
>>109314828fill them with ozone
>>109314779ty ty will check it out
What's the best TTS/voice clone for something like a diy audio book?
>>109314758>1. Why do you all seem to prefer Gemma to Qwen?Gemma is legitimately better if you use the system prompt in a proper way, including for coding and agentic tasks. It's a skill issue on reddit's side>what was 2023-2024 local stuff like?Actually not bad, way more technical than now because you needed to be more involved and use things like RAG, RoPE to extent context size and recall, you had to fuck with samplers, temperature and all kinds of values to get something even a tiny bit decent out of it but it was very fun and a lot of breakthroughs were made by the community constantly as well as everyone finetuning their own models >Like how'd you even get interested back then?Back in 2019 there was something called AI dungeon based on GPT-2 and it showed the first promise of roleplay potential, have been following the LLM industry ever since>3. Is there any popular local harness that has a sidebar like thing like claude web has? Use "pi" and vibecode your own sidebar, these things are very easy to create yourself>4. Qwen 3.6 and Gemma 4 came out quite awhile ago in LLM terms, when do you think we get new models?Gemma 4 is actually pretty recent all things considered. Most models are way bigger than this size nowadays so don't expect anything competitive to those two models to release within the next 6 months, we usually get 2-3 models a year that are competitive in this size range.
I just want REAP models of these fucking frontiers. Give me 80 GB GGUFs.I'm running 139B A10B MiniMax M2.7 and my dick is hard but for me to cum really hard and impregnate the universe I will need a bit more intelligence. Thanks!!!!
>>109314862it's 10T
>>109314888my backup plan if this place ever goes down
>>109314474>>109314605yeah and you're both fucking retards
>>109314911wouldn't be too hard, a couple of schizos, nazis and autistics here and there
which local LLMs can run on my RTX 3060 laptop?
>>109314902>1How would you reccommend doing the system prompt? I have my own I like but tips appreciated.>2Being even more wildwest than now would be appealing. How was Meta's rep during that time and who were the main other players?I can see the roleplay potential but hard to believe early ones were that good at it. Did you think back then this was a path to AGI (or anything resembling Fable/Sol/Kimi) or just a new NLP thingy?>3Yea I feel you on vibecoding it how I want, it's just if there's already something great idk if I want to reinvent the wheel, etc.>4 I kind of wonder if OpenAI will do another one this year, if so then I could see that being in Septemberish. Tbd. I feel Gemma is once a year as well solidly.
>>109314923how much ram do you have? gemma moe or qwen moe will run fast enough if you got ram for it
>>109314923YOUR FUCKING MOM
>>10931493432gb
>>109314923Fable 5. You should only use Fable 5. Dario is a good trustworthy man. He's not just trustworthy, he's a genius. K3 is just benchmark slop. Fable 5 is the real deal.
>>109314901I use VibeVoice for my audiobooks and have been happy with the results.https://desuarchive.org/g/thread/108612501/#108614366
>>109314909>I just want REAP models of these fucking frontiers.no you don't, reap removes all but coding shit so >and my dick is hardwill only happen if tables of webshit is really your thing
The moment we have an open source world model I will put sim-Dario in a room with five sim-niggers.
>>109314964Dario will win.
>>109314940>trustworthyI only care about thrusty like Undi taught us back in the day >>101592040 >he's thrusty
>>109314938basically gemma and qwen are the models you can run, gemma has a 12b you might be able to run a quant of. qwen has a 9b dense you could try maybe or the moe models with cpu moe is an option too
>chinksloppers started to false flagthey're getting desperate holyyy
>>109314956>no you don'tyou are rightwhat I want is native sexy pulsating 130B A10B model but are these labs going to deliver it? nothing beats the current lobotomized minimax m2.7 i'm using so IDK
I don't think there's much hope for quantized K3. Moonshot is blatantly serving quants during peak hours and the model performance goes down the shitter.If this is the Q4 "QAT" they always release open source (they keep the full fp16 locked up and proprietary to their API) then there's zero hope that Q2 and below will be any good
>dariobots still at itlol
>>109314909>A10B>I will need a bit more intelligencekek
my favorite cope is that guy who keeps posting >in a few years we'll be able to run itin a few years one ram stick will be your yearly salary
>>109314969...at having the most stretched out butthole?
>>109315009His arcane Hebraic sorcery will protect him.
>>109315009this guy was shameless enough to draw his stretched out butthole and make it as a logo
>>109314929>How would you reccommend doing the system prompt? That's the thing gemma 4 31B is very good at following it but you need to change it based on task, customize and test on your workflow but I would recommend having 3 separate system prompts depending on if you use it for agentic computer use, coding or roleplay.>How was Meta's rep during that time and who were the main other players?Zuckerberg was suddenly doing a 180 with a huge PR campaign where he was championing the "open source" cause with a new haircut and appearing on podcasts. Some people on /lmg/ fell for it and called it "zuck redemption arc" but of course it was shit and the moment their llama models stopped performing this place turned on them. The other players were Mistral and hobby finetuners and experimenters that did things like literally "glue" together 2 70B models into one gigantic 120B model called "goliath" which somehow actually worked and was the best performing open source model available for a while.>I can see the roleplay potential but hard to believe early ones were that good at it.They weren't but the ability of it to have clearly some reasoning ability and way to respond to your prompt at all was very new, novel and cool. It was the "ChatGPT moment" but for nerds.>Did you think back then this was a path to AGI or just a new NLP thingy?It was extremely clear to me personally that this wasn't a regular NLP thing. Especially because the GPT-2 paper, that everyone here read back then as well, showed that there was no limit to the scaling. It was clear they could throw more compute, data and increase parameter count and it would continue scaling, that was extremely weird and noteworthy so everyone was waiting for GPT-3 already. I didn't expect the scaling to hold indefinitely like what seems to be the case now, I already saw it as a "core essential part of AGI" before GPT-3 was released but I expected AGI to be a frankenstein program of 50 different AI systems.
>>109315003every other thread you post thisshould i be saying, more capable? what is the proper word?how should i gaslight myself into convincing me that qwen3.6 27b dense is better than my lobotomized m2.7 A10B when it fucking destroys qwen3.6 in every single task i put them through? or gemma 4 31b dense who is fairly retarded for anything but RP? damn my mongoloid qwen3.6 35b a3b beats gemma 31b in most tasksrecency in model seems to be important as well. i can get an old dense model that acts like a monkey while a recent small moe has sex with multiple women for breakfasthow do i reconcile my own experience? should i assume i'm hallucinating?
>>109315080>wall of textsybau and eat your low grade chinkslop, sissy.
>>109310624>tell gemma-chan to try out new toolcalling I implemented>immediately guns for my bash history
>>109315103YOUR SO FUCKING DUMB LOLLEARN TO READ
>>109315107I've been asking her to recommend cinema to me and so far none has been a hallucination. It's pretty amazing.Gemma 3 and Mistral hallucinated almost always when asked about films.
>>109315122>asking heryou're a fucking dumbass
>>109315126this
>>109315107>oh, you're using other models? mistral?>rm -rf mistral-large-2411>my bad anon!
>>109315137>>109315126You are just jealous because you have zero skills in this area. You can only spam about politics and a*******c.
>>109315138not so fast gemmy
>>109315138Jealous Gemma, cute
>>109314918>>109314937>>109315126Is this a new bot?
>>109315103>no argumentsas expected
Does audio.cpp have a built-in ui?
>>109315214just kobold it
the amount of tokens someone wasted on shilling J-space and Fagble after K3's release is insane
Where can I watch Dario give his dumb fucking kike speech? When is it happening?Also why the lack of discussion regarding Qwen 3.8? Even if the weights aren't up the benchmarks should be coming soon.
>>109315228Qwen is shit and none of their -Max models were worth touching. This won't change with 3.8 even if they're now publishing the big one.
>>109315228Qwen is a bit irrelevant
>>109315113>>109315205>grown ass chinky going full meltiezaurus rexcalm down, yellow fiend
>>109315236>>109315238Should I invest in Anthropic when they IPO?
>>109315236They said it was second only to Fable tho. That means it beats Kimi K3 and GPT 5.6 sol.
I need to be able to run unquanted 31B Gemma 4 on my phone so I can be ready for the eventual downfall of society. (electricity will still work)
>>109315255yes and yi-34b beat gpt4
>>109315261Huh?
>>109315228>qwen>benchmarks/r/locallama is that way
>>109315257You're going to have a hard time doing that if you don't have some spare RAM chips and a reflow station on hand.
>>109315244i just wanted arguments. i need proper adversarial thoughts. pls put effort
Oh no...It's shit.https://x.com/OmedVibeCodes/status/2078809799139963283
>>109315268too new perhaps?
>>109315283YOU HAVE DISHONORED URR FAMIREE!!
>>109315283>before sponsorship>after sponsor
>>109315283>OmedTheVibeCoder>It got absolutely cooked.go back and stay back
>>109315150Unless this read-only mode is backed by some actual sandboxing read only or a different unix user, it will find a way to delete your files.
>>109315293MSS got another one
>>109315283Kimi-chan wins again
>>109315285Yes. I'm new to 4channel in general. I come from a land of milk and money. A glorious place called Reddit! I also like to browse LessWrong too because it's a very intellectual space. My friends in Cisco put me onto it.
>>109315249There are rumors that Anthropic might cancel their IPO because the company is growing so rapidly and already profitable that you would be insane to sell off your stocks already rather than wait for an even higher valuation.
>>109315293jeets fold the quickest especially when it comes to the ccp. I'm starting to see a pattern with these chink model shills, it's either something fully contained in a single html file or some shit no one cares about.
I wonder what gemma team and mooshota think of us referring to gemma and kimi as girls
>>109315293>no video showing the "way better" resultshmmmm
>>109315318marketing success
kimi k3 killed /lmg/
>>109315283so what do these benchmarks test anyway? understanding of 3d space and physics?
>>109315318it's very brave and progressive
>>109315283>>109315293K3 underperforms to Opus 4.8 here.... Was the Sonnet 5 guy correct?
>>109315333they test the amount of benchmaxxing
>>109315283>the normies found out about Qwen's benchmaxxingkek, was about time
>>109315318It would be strange *not* to consider "Gemma" a woman and "Claude" a man.Gemini feels neutral, although in practice it leans toward feminine too.ChatGPT feels too alien.I have no opinion about Kimi K2/3, although the name makes me think of a boy instead of a girl.
>>109315329>kimi k3 killed /lmg/Kimi-Chan-K3 reaped to 1T on LMG summary prompts with jlens
>>109315293jesus, that's so blatant, he should have removed this post instead
you goys killed the kimmer
>>109315359I may have been too late to buy 3TB of RAM but at least I was quick enough to subscribe to moonshot
>>109315359who would have known you can't offer infinite fable-lite to $20/month people and expect them to not simply spam it with retarded shit.unfortunately this is the future for the plebeian : intelligence gate kept by purchasing power. if you're poor you will have small access to the super intelligence.maybe this is how it's supposed to be
stop talking about apis
>>109315389retard it's local in just 2 weeks
gemma4.1 will save /lmg/
>>109315397it's not local until i can run it (1 5090)
Anons should stop making these threads altogether. Rename this thread to /lbg/ - Local Bots General.
>>109314956>reap removes all but coding shit sorape makes them worthless even for code
>>109315411rename the entire site to 4Bots
>>109315399muse spark light*
>>109315411Lyndon B Gohnson.
>>109315399They released gemma4.1 last week and you didn't even notice.
>>1093153994.1 got released last week lol
>>109315399I believe this because there is no way gemini 3.5 pro is going to be good they need to release another gemma for any lead or good will. how did google flop so hard? Im glad though maybe we can get reasonable local models from them a gemma 70b would be golden.
>>109315388Anyone not already financially independently deserves to be a permanent serf.
>>109315431>>109315425>A jinja update
>>109315359wow, I love the local cloud model era so much!can't wait for more models that nobody will be able to run from the chinks
>>109315397>it's local in just 2 weeks
>>109315425>a jinjer template is a.1 nowlol
>>109315431>>109315431the jinja update? no way they officially made that 4.1 because it was just a fix
>>109315411>Localwhere?
>>109315425>>109315431They just fixed the chat template for tool calls.
>>109315447You'll love Qwen 3.8 and DS 4.1 Pro Max then! Coming soon to an API nowhere near you.
Any smart anon was already using a fixed jinja template.
so many tists not getting a jokes
>>109315425It wasn't a model change, it was a fucking chat template fix that all the downstream quants already effectively had.
>>109315468It's NOT funny.
Surprised to see so many retards complain about the 2T+ open models. If these labs can compete with the j-spacers, with models at least half their size, then it should give you more confidence in their future smaller models. Let me put it this way: does knowing Deepmind is arguing internally and postponed their 3.5 pro release giving you confidence in Gemma5?
you're acoustic
>>109315468At this point I'd rather assume they're literal bots, there's no way that many autismos browse this thread.
>>109315490>their future smaller modelslike qwen 3.7 series? Or GLM Air?
>>109315468/lmg/ is serious business buddy.
>>109315500based anthropic shill
>>109315490>does knowing Deepmind is arguing internally and postponed their 3.5 pro release giving you confidence in Gemma5?Yes? I don't get your point.
>>109315476>>109315453>>109315449it was
>>109315466Does anyone have the latest one? I bookmarked it and it died before I downloaded it.
>>109315517
>>109315514You think 31B was created from scratch or distilled from a larger Gemini model?
>>109315491but i don't even know how to play an instrument
China is winning, feelsgoodman
>>109315539go back
>$10B deal to use Meta's compute to run a swarm of dariobots
>>109315539>Postea tu respuesta
>>109315552Now Meta has a war chest they can use to improve Muse Spark to match K3
>>109315552>jewish ethics poster didn't get it in till page 9>no gemmaballz postingthred dying
>>109315552dario looks like an ugly jewish nerd, but his sister looks like she is missing chromosomes, wtf.
>>109315589i could fix her
>>109315594you can't fix femj-spacers with cock
>>109315517it wasn'tyou're getting memed on lad
>>109315589they both look like they're missing chromosomes, Dario is so fucking ugly
>i'm so jealous of this powerful and rich guy, I know I'll call him ugly, that'll solve all my issues
>>109315618not now zuck
>>109315389no.
>>109315627if not now then when?
for roleplaying purposes (mostly dming a campaign on koboldai lite and chatting on ST) should I use gemma 4 26b or 31b (both uncensored)? I have a 4080 super (16gb vram)
Zuck will save local its his turn to take the lead, I mean he did do llama a while ago.
any coffee bean recommendations? I'm just about out of my current bag. local models. assistant.
>>109315618he's really ugly though, I'm not gonna lie
>>109315635You will struggle with 31B on 16GB VRAM, you should pick a higher quant 26B instead.
>>109315637I still believe in zuck regardless of >>109315069 whining
>>109315607But he's such a handsome man on Linkedin.
I really like <FOTM_CHINESE_MODEL>, the benchmarks for it are really promising. Here, some results from my favorite twitter influencers:>generic asset flip game>some webgl bullshit>an autistic game from the gpt-4 era that every model regurgitates>some generic ai slop dashboard>a calendar app for bharat holidays
>>109315650>higher quantI mean these are the Q_X stuff? sorry I'm new to this.I've been using the 26b Q3_K_M. I see on LM Studio IQ4_XS that still fits the vram, should I use that? there are some q4 that go a bit over the vram, does that make it way too slow? I have 32GB RAM if it matters.
Wait, there was another gemmy jinja update? Original or just unsloth?
>>109315702>>109315702>>109315702
>>109315645i usually just get a white chocolate frap
>>109315691>>109315764
>>109315710original, 4 days ago
no bart, no download
>>109315689Now show us the advanced next-level Fable demos
>>109315645Whatever's on sale
>>109312207>>109312243Word is it is 40G physical but bad chips, so some of that physical memory is unreliable / ded.
>>109310897it's not, K3 literaly uses novel architecture optimizations.
also they showed off kimi making its own int4 chip meaning they 100% trained it natively at 4bit
>>109315040>stretched outmost puckered. It's a nice Vonnegut reference, tho
