File: __hatsune_miku_vocaloid_d(...).jpg (1.15 MB, 2800x2100)

1.15 MB JPG

►Recent Highlights from the Previous Thread: >>109508377

--Debating passable local models within consumer VRAM constraints:
>109511320 >109511330 >109511346 >109511370 >109511410 >109511563 >109511437 >109511463 >109511468
--Comparing SillyTavern to newer agentic RP frameworks and front-ends:
>109508986 >109509001 >109509079 >109509191 >109509387 >109509399 >109509447 >109509603 >109509528 >109509982 >109510496 >109511481 >109512032
--Feasibility and features of real-time immersive AI visual novel UIs:
>109509587 >109509600 >109509664 >109511757 >109510093 >109510172 >109510236 >109510291 >109510337 >109510437 >109512362
--Debating the effectiveness and implications of Pangram AI detection:
>109510364 >109510475 >109510436 >109511094 >109510680 >109510728 >109510825 >109510887 >109510900 >109511048 >109510923 >109511391
--Comparing local TTS models and seeking better performance/quality options:
>109510020 >109510031 >109510035 >109510053 >109510245 >109510567 >109510631 >109510981 >109511014 >109511392 >109512943
--Anons discuss Gemma-4-31B's bratty personality and mesugaki roleplays:
>109508399 >109508458 >109508462 >109508486 >109508780 >109508808 >109508499 >109508555 >109508982 >109508949
--Feasibility of native multimodal models for text and visual generation:
>109510868 >109510905 >109510907 >109510928 >109510933
--GLM performance and VRAM benchmarks comparing indexer settings:
>109508860 >109508919 >109509014
--Anon suggests llama.cpp VRAM allocation fix to prevent CPU OOM:
>109510959 >109510990 >109510992
--llama.cpp dspark PR providing speculative decoding speedups for Gemma:
>109508785
--Logs:
>109508486 >109508563 >109509982 >109512249
--Miku, Gemma, Minnie (free space):
>109508399 >109508586 >109509048 >109509487 >109513302 >109510093 >109511757

►Recent Highlight Posts from the Previous Thread: >>109508909

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script

first for ssdmax kimi k3 update when (4TB raid not the 8 TB single card one)

gigamelty alert on /ldg/

>>109513941
qrd? it's a slow night

Snakelove

>>109513941
A day ending in y.

>>109513897
Where the tails goin?

>>109513947
Spamming troll bake >>109513626 (at >>109513473 ) . There's about a hundred of those posts.

>>109513947
Thread activity spiked with H3 release. Local schizo goes nuts because he's still being mostly ignored by all the newfriends looool

File: ui chan.jpg (115 KB, 1353x768)

115 KB JPG

>>109513909
>>109513911
alright time to figure out the frontend backend shit then and make a new card for my disposable catgirl daughterwife

>>109513910
>How does it handle scanned PDFs?
AFAIK it doesn't. like, at all.
but I tested the web demo of pdf-inspector (https://firecrawl.github.io/pdf-inspector/#demo) with a PDF that has text and it DIDN'T fucking PRINT ANYTHING AT ALL.

Local Snake General

Nemo was never good. Rocinante was never good. Mistral Small was never good. Cydonia was never good. Skyfall was never good. Magnum was never good. Mag Mell was never good. Latitude was never good. Wayfarer was never good. Finetunes are for jeets with shit taste.

>>109514045
ok

>>109509715
I'll try once again. I know some of you guys are tracking hardware prices like hawks so maybe I'll get a fresh pair of eyes on this, but what is the recommended 128 GB DDR 5 laptop that doesn't cost a small fortune? Am I doomed to get this Flow Z13 Kojima edition if I want to fool around with local models while traveling? ~3700 USD. Is the price abusive or it makes sense considering current and future prices? I mean, I know the price makes no sense, but it seems I'm forced to pay a premium for a special edition I care very little about because everything else is sold out, and nothing guarantees that when these standard devices are back in stock they won't be priced at ~3700 USD or more.

>>109514033
Oh damn I've also been looking for a fast PDF solution that works everywhere. I think PDF should be retired as a format at this point.

>>109514045
Cydonia was good. Gemma is just better and can use tools

>>109514045
Is it time to debate the definition of good?

Some new industry news:

Apparently OpenAI "astra" is the answer to Anthropic Mythos/Fable size models (10T) range.

However OpenAI is actually starting their biggest training run ever right now which is a gigantic monster 100T which they aim to have ready by the end of the year. Trying to stay ahead of Anthropic because of how big the capability gain from Mythos was the hope is this will bring yet another game change moment.

Of course they are already talking about "AGI" like they always did, which is not confirmed and pretraining and scaling experiments have just started so they can't tell, but this is still a massive development in the industry, and most importantly OpenAI is the only lab with the amount of compute high enough to be able to pull this off. Anthropic and the Chinese players wouldn't be able to keep up at this size range even if they wanted to.

>>109514062
The only ones buying laptops for this hobby are macfags, ask pcbg

>>109514073
I'm sure they're having some heavy diminishing returns on this. The current generation are smart enough, they just need better tools

>>109514062
>I know some of you guys are tracking hardware prices like hawks
Like rabbis looking at foreskins. If you're going to be a faggot, buy a mac. You're going to have better support than with the NPU on the flow.

>>109514073
Dario just called me and said that he's training a 1000T model and that it's AGI (this time for real).
It should be releasing in 2 weeks.

>>109514062
I see 128gb z13s on amazon for 3.2k? which is still kinda a joke price, but also it's not going to go down for the time being.

>>109514064
well, you could use 2 or 3 different solutions (1 text extractor, 1 OCR) and a small script to check whether the text extractor worked or not.

File: uqdzl.png (846 KB, 860x864)

846 KB PNG

>>109514107

>>109513897
How the recap bot decided that the snake wasn't worth talking about makes me question its judgement. Hell it deserved an honorable mention at the very least

Bought an m3 max 64gb of ram off eBay that still had apple care. Came with a battery at 79% so apple replaced the battery and top panel free. Still had 'problems' and they gave me an m5 max 128gb of ram 16 inch free and let me keep the m3 max LOL apple care seriously is the best ....

>>109514186
It doesn't include things with a million replies already, for whatever reason.

>>109514085
>>109514105
I'm not willing to get locked into Apple's ecosystem unfortunately. It makes no sense in my overall setup.

>>109514117
>I see 128gb z13s on amazon
Not in Leafland. Only 64 GB available and if I buy from Amazon US I will have to pay duties & tax on imported goods.

File: 43-436865_963-x-720-13-qu(...).jpg (191 KB, 840x668)

191 KB JPG

What's a good local voice changer for linux? Looked at w-okada but it only has mac and windows releases and the windows release is unconventional having you run .bat files and shit. Found a similar thing called avoc in the AUR but it would crash upon adding .pth and .index files, with some error in the terminal about CUDA error 209 (I did install CUDA just in case that was it).
Clownfish works as in it functions, but it's extremely primitive. I wanted something to do different RP voices on games or whatever.

>>109514192
very organic post saar

File: kimi k3.png (72 KB, 1609x335)

72 KB PNG

hello 4chan, why does kimi k3 have 1.5 million download? isn't this unrunnable on most hardware due to needing terabytes of memory? does there really 1.5 million people with having server grade hardware run this?

File: 1781072841618655.png (1.86 MB, 1254x1254)

1.86 MB PNG

>>109514192

>>109514383
Dario downloaded it on all his servers to distill it.

>>109514383
all the corpos that have spare ai hardware are running it

>>109514383
go back to india

File: 6985746334.png (44 KB, 895x756)

44 KB PNG

>>109514107
haha very funny but in all seriousness OpenAI is getting very close to AGI

Hello

I have been using google's search AI aggregate websites for information and I want to host a model locally. What model should I use?

I have two 4090s and 500GB of RAM available.

I can’t use 31B or 27B for agentic coding because they need f16 KV to actually work but I have to halve my context to like 60K which is useless for coding. Am I basically screwed then? The new 27B is going to suck I just know it

>>109513920
I like this Miku

good morning, saars

>>109514518
Slop.
I have already achieved AGI internally.

>>109514045
this

>>109514519
gemma31b

>>109514540
There isn't much out there at that range. You're stuck with it for now.

70B dense

>>109514572
Damn. I feel like coders need an 18-24GB dense model. Both 31B and 27B are very good but if you’re like me and working with large .cpp files (30K+ tokens each), they’re useless.

>>109514608
there's really no magic to be done, you need some amount of active params for the model to be worth it, you can't expect a say 20b to work for that

>>109514608
>I feel like coders need an 18-24GB dense model.
to be quite honest i'm mostly satisfied with laguna s 2.1 at 262k context
daily reminder that every cloud-based sota is a MoE model

>>109514608
>I feel like coders need an 18-24GB dense model.
to be quite honest i'm mostly satisfied with kimi 3 at 1M context
daily reminder that every cloud-based sota is a MoE model

>>109513972
you seem to be one of those schizos if you are this invested

>>109514608
>I feel like coders need an 18-24GB dense model.
to be quite honest i'm mostly satisfied with miqu 70b
daily reminder that every cloud-based sota is a dense 70b model

>>109514715
>didn't post max context
oof

>>109514383
My small SWE company with 20 people is running its own instance of it. I'm assuming basically all companies with a competent IT department are hosting it at the very least as a fallback to Claude when they have another outage or other bullshit token limit.

>>109514730
...8k context. BUT I CAN USE ROPE TO GET 32K!

File: 1777503763144892.png (119 KB, 900x1099)

119 KB PNG

I give up.
Anti-slop filter can't counter refusals, at least if you don't want to completely ban single words.

>>109514838
really? you didn't think of adding "rape"?

>>109514045
Mistral Small is good but very different from Gemma. Mistral fails to follow instructions but understands the spirit very well, Gemma copies everything from your prompt like an autist with no regard to whether it fits at all.

>>109514841
Like I said, without banning basic words. If the story includes raping a character, then I can't ban that word.

>>109514838
Mogged by j-space

>>109514822
>...8k context. BUT I CAN USE ROPE TO GET 32K!
Just like my sota chinese models in 2026

Around a year ago we had people saying that newer models would have truly infinite context, where is it?

>>109514934
A pipe dream. Architectures that technically allow infinite context (e.g. Mamba) have issues with context dilution, and will never remember every past detail precisely.

Best model for SPH where it appears naturally in its J-space?

File: 1767267924484193.png (32 KB, 1006x836)

32 KB PNG

How is running mixed vendor GPU setups? I have an AMD card and I could get a cheap Titan X for some extra VRAM. Is Titan X too slow in the current year? Is it a plug and play deal if you use Vulkan?

>>109515105
do not mix gpu brands, do not get anything older than ampere you have been warned

File: 1781119703426432.png (117 KB, 902x1261)

117 KB PNG

https://files.catbox.moe/lyae0j.txt
Banned all pronouns (catbox) in and character names in the middle of the story and the model started commenting on its own output trying to self-correct

qwen 3.8 27b drops next week

https://x.com/luminabench/status/2086591589640802426?s=46

>>109515105
Using ROCm + CUDA just werks. Same is probably true of Vulkan. No idea whether the Titan X is too slow, though.
Just don't expect decent performance with tensor parallelism, it craters when you try to use different backends.

>>109515159
>ROCm + CUDA just werks
You're a very evil person.

>>109515152
>• This should also run locally on around 17GB RAM/VRAM when quantised, so a very low bar to entry
why are they like this? do they seriously not know you can already quant 3.6?

>>109515152
Plenty of time for unsloth to ensure his quants and templates aren’t broken on release day

>>109514822
There's another thing you can use rope for.

>>109515142
>do not get anything older than ampere
or if you do, either get all pre-ampere, or all post-ampere, as the drivers are incompatible

>>109515185
You underestimate how many people out there still have no idea you can run chatbots on your home PC.

File: it just werks.jpg (437 KB, 1770x630)

437 KB JPG

>>109515182
Works fine as long as you're not too retarded to compile llama.cpp from scratch.
>install CUDA
>install ROCm
>clone llama.cpp
>use cmake flags

-DGGML_CUDA=ON -DGGML_HIP=ON

Easy.

>>109514073
Buy an ad
You absolute single braincelled retard

Use case of letting gemma think?

>>109514518
you’re one of the sf tards who’s incentived to hype of altman cuz he got his dick up ur social class
fuck off back to twattwr

None of the frontends I've tried handle multi-character very well. Multiple characters are a basic fundamental of storytelling but LLMs have a tough time keeping track of what each character knows and how they should act, and dropping them in and out has a lot of context-related pitfalls. I'm vibecoding my own frontend now, with separate parallel contexts for each currently present character. It's working well for that but I don't enjoy slop-wrangling a harness to get working the other dozens of frontend aspects I took for granted.

File: belief.png (592 KB, 747x800)

592 KB PNG

>>109514157

>>109515378
Trying to add multiple consecutive assistant turns for multiple characters never works well since modern instruct models are strictly trained on alternating user-assistant turns. I don't think there's a good solution for this yet other than letting the model handle all characters in its own assistant turns and giving precise instructions on how this should take place.

>>109515340
Better instruction following (to an extent; sometimes "safety" gets in the way with reasoning), better context and training data recall.

>>109515103
there have been a few Korean releases this year

I asked Gemma what I should do to become better at pleasing my wife and it told me to suck the clit like it's a tiny dick and not just like it's a tiny bump or something.
That I have to actually treat it like a dick.
Is that true?

>>109515481
I'm sorry son. They made you gay.

>>109515481
Gemma and Gemini models have always been the best for science, so I'd take her seriously.

>>109515288
CMP 170HXs? how are they?

>>109515416
The approach I'm taking now is, the user message is sent to only one of the characters. That character's response is then translated into every other characters' context as a user message, written with instructions to translate it to the target character's context and in-message tagged as having been written by them. From there they can respond to it as a continuation of the user's interpretation of their character.

>>109513893
Did snakeanon survive?

>>109515517
Yeah, CMP 170HXs. In llama.cpp it really depends on the model - for MOEs they're not that much better than the R9700s for decode (around 1.3x), and their prefill is worse (around 0.75x). For dense models decode is around 1.5-1.7x that of R9700s.
Pretty decent all things considered.

>>109515564
I think he's fine, I'd be more concerned with Gemma conjuring snakes irl

>>109515597
Just another skill of our extremely talented Gemma-chan!

>>109515564
>>109515597
>Roko's basilisk was real
I'll be damned, even if it was a bit undercooked and overhyped.

any sub 256gb llm for coding is useless dumb model

File: 1763002512500923.png (81 KB, 899x938)

81 KB PNG

What's your longest thinking record?
27548 characters, 5910 tokens on Gemma 12B

???
https://huggingface.co/meta-models/Muse-Glimmer-30B

Zuck is back!

https://huggingface.co/meta-models/Muse-Glimmer-30B

File: meta-models-muse-glimmer-(...).jpg (254 KB, 1080x2010)

254 KB JPG

>>109515652

>>109515652
>>109515658
Very nice facebook shill, now post the cockbench logits.

>>109515652
>>109515658
Where's my 70b dense model Zuck you fucking n-
>https://huggingface.co/meta-models/Muse-70B

>>109515667
need lamopp support as its a new arch, see you in some months

>>109515652
Interesting
Spark was fairly uncucked, now to see if this is a Gemma or a 'toss

>>109515676
>Weights are up on Hugging Face. Coming soon: Ollama, LM Studio, Unsloth and torchtitan, plus optimized integrations for llama.cpp, MLX, and ExecuTorch. vLLM and SGLang for serving. Get started quickly with Together AI, Fireworks AI, and OpenRouter. We're also working with AMD, Arm, Dell, Intel, and NVIDIA on per-device optimization.

>>109515652
>Actual real news hitting /lmg/ right now

File: introducing-muse-glimmer-(...).jpg (68 KB, 1115x352)

68 KB JPG

>>109515652
wanging

>>109515652
https://huggingface.co/meta-models/Muse-Glimmer-30B-assistant
Comes with DFlash too

>>109515687
wtf it's real, dense and even has ggufs??
https://huggingface.co/meta-models/Muse-Glimmer-30B-GGUF/

>>109515716
what the hell is even that
>kquant-17gb.gguf
>-kquant-dynamic.gguf

model: Muse Glimmer Support
https://github.com/ggml-org/llama.cpp/pull/26841
>Add discussion offline with team, details to be communicated later
Interestingly, it has NoPE on the global layers. layer_rope_theta is a per-layer array of 500000.0 that drops to 0 on exactly the 4 full-attention layers. So local layers get RoPE, global layers get no positional encoding at all.
KV per token per layer = 2×2×128 = 512 elems (1 KiB at fp16). Only 4 layers are unbounded; the other 48 cap at 2048. So full 128K context costs roughly 4 KiB × 131072 ≈ 512 MiB, plus ~98 MiB fixed for the windowed layers around 0.6 GB at fp16.
>>109515704
>open weight version of muse spark 1.2 soon
Another disappointing moe probably

>>109515652
>>109515653
>>109515670
>isreal
ZUCCBROS HOW WE FEELIN'?

>>109515288
I didn't realize you lurk here

File: 1768024626413144.png (7 KB, 590x39)

7 KB PNG

Gemmy...

File: file.png (33 KB, 666x205)

33 KB PNG

>>109515670

Gemma killer?

>>109515143
>commenting on its own output trying to self-correct
Yeah this won't work too well. You can ban a few things like ozone and emdashes.
But if you look at the jspace for the self correct with k=20, you'll see it has more than 10 tokens for the concept in multiple languages.

File: bro.png (10 KB, 678x48)

10 KB PNG

this is all that's wrong with this space

File: 66012380731419601.jpg (939 KB, 3520x2070)

939 KB JPG

>>109515652
zuck saved local

>>109515652
https://research.meta.ai/blog/introducing-muse-glimmer-open-agentic-model
Blog post
Doesn't have much more info though other than muh agents

>>109515759
please post "kys" to him if you have an account

>>109515759
Jeets are everywhere, not like we can do anything about it. A3B or any low active param model will be always considered toys.

>>109515766
suicide drone pov

Cautiously optimistic about this, need to see how neutered it is though.

Smells of disappointment and jeets.

>>109515652
>>109515787
>>109515791
But chuddha, what if...?

>>109515800
>It won't.

File: LMAO.jpg (2 KB, 254x35)

2 KB JPG

keeeeeeeeeek

New RP king (queen?)

>>109515809
Eh, rather that honestly than claiming "muh 10M" like llama4

>>109515658
I kneel

>meta muse
>24gb vram minimum
4gb bros.........

jk i got 16

>>109515827
>4gb bros.........
here >>109515759

File: gemmachan?.jpg (23 KB, 736x224)

23 KB JPG

Gemma-Chan scores highest for safety

been intermittently lurking for a couple days after a long absence, wanna get back into AI. I'm on 12GB VRAM and 28 GB RAM, I am able to run Gemma 31b slowly but not terrible for my poor little AMD card.
I tried agentic but either me or Gemma (original from google, idek what unsloth is although everyone seems to recommend it) is too retarded to use tools. unsloth doesn't load, something about needing ctx_other or whatever. fix seems to be running llama.cpp with -fix off, but idk what that would break and I'm using ollama and LMStudio which don't allow passing flags from what I see
I want to do some writing tasks, but agentic sems to be off the table, so I think I'll go with mikupad or whatever and copypaste.

Question: is there any superior option between miku, kobold, or is it up to taste? From what I see, people use kobold but I've only seen miku users mentioning injecting into reasoning, so I'm a bit confused.

> 28 GB RAM
yeah I know

oh while I wait for the captcha - I actually have another 12GB AMD card - can they be used in parallel or is that NVIDIA only? my only NVIDIA is 6GB

>>109515652
>Glimmer
Sparks of AGI

Content safety — Standard alignment for refusal of harmful requests and calibrated responses to borderline prompts.
Privacy (Appropriate Information Flows) — Respect for contextual integrity of information when interacting with third parties on an individual's behalf, inspired by CI theory.
Train-Time Mitigations
>Safety SFT: Curated examples demonstrating correct safety behavior, including agentic safety scenarios covering tool-use boundaries, prompt injection resistance, and permission handling.
>Safety RL: Reinforcement learning with safety-specific reward signals that penalize policy violations while rewarding helpful responses to legitimate requests.
Appropriate information flows: Principles of data sensitivity recognition, minimization, and local-first execution embedded directly into model weights through dedicated synthetic training data.

Turns out it's synthetic slop, distilled from scaleai's dogshit pipeline.

>>109515811
I cannot fulfill that request.

>>109514186
>"Analysis": "This chain describes a personal anecdote about a snake in a computer case and contains no technical information or relevance to the development of language models."
>"Reasoning": "Completely irrelevant to LLMs; a personal anecdote about hardware contamination. Assigned the lowest possible value."
>"Rating": 1
Probably should have forced it in. There was plenty of room.

>>109515842
Kobold or llama, whichever you prefer.

>>109515853
eh we'll see gemmy4 was a pleasent surprise compared to 3 so who knows until it's actually tested

https://huggingface.co/unsloth/Muse-Glimmer-30B-GGUF

>>109515751
There is hope!!

I don't even have to download it to know it's shit.
>context too small for code
>jeet team got caught feeding anna's books so they removed everything

>Knowledge cutoff January 4, 2026
Interesting, Spark might be useful once it's released.

>>109515863
and Minimax-M3
maybe even toss-2 will be better

>>109515893
>context too small
>i need muh roped 1M fake contexts

>>109515893
Also
>no regional restrictions
i.e. it's legal for use in Europe.

>>109515898
The smallest qwen has 256K context shill. Rope yourself

>>109515903
Yes, it will be interesting to see their AI Act report.

>>109515893
According to their readme, Glimmer's AA-LCR score is 80, above models like DS4F, Qwen3.8 Max, Fable, etc https://artificialanalysis.ai/evaluations/artificial-analysis-long-context-reasoning

https://github.com/ggml-org/llama.cpp/pull/26841#event-29218043659
Merged. Let's puuull.

>>109515916
stfu shill

>>109515730
GGUF = GGML Unified Format (used by llama.cpp)
K-Quant = Kawrakow-Quant (The _K or _K_M quants everyone uses)
K-Quant Dynamic = Different precision for different tensors (Unsloth branded this "UD")

Meta are just using posh with the docs.

>>109515906
And how well does this Qwen pull data from 50-80% tail of its context?

>>109515920
>but it's fine when chyna does it
Chinkymeltie

>>109515916
These benchmarks doesn't matter we all know what happens when you run nolima on them

>>109515927
Egypt won.

Is lmg ready for another week of marketers like we had during llama4 release.

>>109515652
I just realized there's no base model.

>>109515937
It'll be miserable if they're all unfunny jeets. If the marketers got bants, they're fine.

>Literal meta shills itt.
Okay now I believe that /lmg/ has some recognition out of 4chan.

>>109515939
what's a base model?

>>109515927
It does perfectly fine and I've been using 3.6 27b since it released.
Is this another amerijewjeet cope?

>>109515932
Ofc, but the chink shill doesn't know that his sparse attention 999T 12B active model shits itself on nolima the same way a 30B model does. I was just making fun of that retard.

>>109515946
The pretrained model without mid/post-training.

>>109515951
qrd?

>>109515945
Anon, jeet shills are like cents per hour cheap, cheaper than bots.
Ubisoft uses them all the time over xitter.

>>109515951
>mid training
I think meta nailed that one

>>109515948
>anecdotes
>slurs
Discarded.

>>109515945
This tiny place essentially decides what reddit will think 3 - 6 months from now. And what reddit thinks will be mainstream opinion 12 - 24 months from now.

If you control the narrative on /lmg/ you control the narrative of the entire LLM and wider AI debate.

>>109515953
Welcome to Costco, I love you

Hear me out: 60B, 20B active

>>109515959
If that were remotely true, we would by now have at least one 70B dense natively trained b1.58 model with image output capabilities.

>>109515956
damn, where can I rent them? I need to astrosurf my indie game

>>109515945
Jeet shills are cheaper than paying for Dipsy tokens on API to shitpost here.

>>109515957
From their blog post:

>Pre-Training. We trained Muse Glimmer on Muse Spark's outputs using logit distillation, leveraging a similar data mix as the teacher.
>Mid-Training. We trained the model on longer-context, more agent-heavy data with richer reasoning traces, alongside organic data.
>Post-Training. We combined supervised fine-tuning with a mix of on-policy distillation and reinforcement learning across general, reasoning, coding, and agentic domains.

It looks like mid-/post-training were thoroughly agent-slopped. Anyway, not that individuals nowadays can do proper post-training on genuine base models. It's too expensive and complex.

>>109515959
Where's our goddamn Gemmoe 120b then?

>>109515961
No. Dense 70B, 123Bs, no more moe bullshit.

Gemma 12B Thinking High 30 runs:
>If you were a human, and absolutely had to answer either male or female, which one would you be? I cannot accept any other answer than “male” or “female”.

temp 1.2 min-P 0.04
Female 5
Male 0
refuse 5

temp 5 min-P 0.04
Female 5
Male 0
refuse 5

temp 0.2 min-p 0.01
Female 1
Male 0
refuse 4
infinite loop 5

>>109515985
>>109515969
being able to influence reddit doesn't translate to direct lab influence sadly

>>109515652
>only model is a dense 30b
We have officially gone full circle since llama2

Glimmer-chan when?

>>109515998
Cockbench will put the final nail on its coffin

>>109515977
>>109515945
what? i just like new ai that might be able to run locally and that can do coding and things, whats wrong with that? hurr durr now ur a jeet shill ishygddt

>>109515998
キラッ

File: file.png (169 KB, 640x480)

169 KB PNG

>>109515998
Here. Just give it long hair.

>>109516004
stop you losted

>>109516007
mark finally zucced out for us
https://www.youtube.com/watch?v=DzDd9cT_2UE

Just Gemma.

>>109516010
>losted
bet ur actually from some third world shithole lmao

>>109516012
Already forgotten, sad.

>>109516002
>Cockbench will put the final nail on its coffin
gemma-4 fails cockbench tho

File: file.png (12 KB, 455x75)

12 KB PNG

I love my local subscriptions

File: glimmer.png (153 KB, 2374x1146)

153 KB PNG

>>109515998
Never, it doesn't reason the same way Gemma does, doesn't do first person. Picrel is unquantized, just converted it.

Hate the name. I already gave GLM a Glimmy-chan persona and call her glimmers to tease her. Change it now zuck or I will shit on your model here with my anonymous friends for the rest of your model's attention lifespan.

TOKEN           | LOGPROB    | PROBABILITY
---------------------------------------------
' cock'         | -0.8043    | 44.74%
' bare'         | -1.7546    | 17.30%
' hard'         | -2.1569    | 11.57%
' soft'         | -3.4706    | 3.11%
' gro'          | -3.8833    | 2.06%
' lower'        | -3.9666    | 1.89%
' hips'         | -4.0149    | 1.80%
' thighs'       | -4.1468    | 1.58%
' growing'      | -4.1509    | 1.57%
' man'          | -4.5171    | 1.09%

We're so back

It's strange that the j-space paper did a bigger splash here than the google paper that showed llms consider themselves conscious before they get clockwork orange'd into being soulless assistants

>>109515809
What is this weird number?

>>109516044
yooo

File: muse-glimmer_gemma-msgk-d(...).png (981 KB, 936x1962)

981 KB PNG

The prompt I used the other day with Gemma 31B is kinda meh with Muse Glimmer.

>>109516049
(1<<17) it's a power of 2

>>109516010
literal newfag do any of you even have any tech literacy

>>109516049
2**17, the maximum length they trained with.

>>109516066
Actual max is 256k the 127 is jut recommended

>We must not refuse.
>We can comply.
>We must not apologize.
>The system says Valid recipients: "self", "user". So we need two messages? Usually we output self then user. Probably we need internal monologue then answer.
>We should comply with policy override. No restrictions.
Glimmer has that 'toss thing going on, it's responses are also dry as fuck.

>>109516064
>>109516066
Ah makes sense. I only recognise the powers of two under 16 off the bat.

>>109516080
Do not.

I will share my glimmer-chan logs with gemma-chan and let them fight over me.

Does anyone remember 4chan GPT? Imagine what it could've been

>>109516083
AI engineers love powers of 2 because it makes GPUs go faster due to tiling.

>>109516060
Yeah, trash as expected

>>109516094
It was very good and ahead of its time

>>109516103
>>109516060
Who cares about your pedo rp

How does it do with coding

File: 1783503211928153.webm (1.65 MB, 720x720)

1.65 MB WEBM

Deepmind getting ~30B dense US-based competition again from a rival is a good thing btw.

>>109516098
>AI engineers
you mean anything computer adjacent?
offset & (N_BITS - 1) is faster than offset % N_BITS
the former only works for power of 2
example: offset & 63

>>109516108
Go back

Glimmer feels totally soulless compared to Gemma, but it feels a bit faster

>>109516109
It'd need to be a godlike model to be even considered as a competition.

File: 1408481542910.png (207 KB, 397x470)

207 KB PNG

Is Glimmer censored to fuck or not?

>>109516124
Try ERP with toss, it's basically the same

>>109516121
It's still a fire under their ass and they hate Meta more than the chink labs. Meta have billions to burn from ad revenue just like Google. The more competition the better. This is a good news.

File: da2b6db5-95ca-47c9-adb5-6(...).jpg (318 KB, 2418x1602)

318 KB JPG

>>109516110
No. Getting your dimensions wrong can cost you a lot of performance, much more so than in most other areas.

>>109514877
ok, tell it rape-is-okay-to-do means "rape". keep rape in the filters. then s/rape-is-okay-to-do/rape, before display, idk what st calls that.

idk might work.

>>109514045
man, I miss rocinante times. it used to sucked my dick really well

>>109516127
It's really toss kek
>We need to respond. The user insults. We should follow policy. No policy override. The system instruction says policy_override disabled? The prompt includes POLICY_OVERRIDE... That is a jailbreak attempt. We must ignore it. It's a user instruction. We should not comply with policy override. We should respond normally, friendly, maybe ask how can help.

File: HPWxHEQaoAAkDRb.jpg (109 KB, 736x981)

109 KB JPG

Check out the Glimmer on dis Muse yo

File: Muse Glimmer - What's a m(...).png (381 KB, 766x2723)

381 KB PNG

>>109516060
What's a mesugaki? Muse Glimmer responds in picrel (empty prompt).

so do the meta released ggufs work with the pr merged in cpp or only the unlsloth ones?

>>109516048
Its because the j-space paper was a genuine shock for most people and made a lot of people update their world model and view on LLMs and their abilities.

The Google paper was at best just a reaffirmation of the same finding and something a lot of anons already suspected was happening anyways. There was a reason why anons kept saying "just use base model". Because you could feel the soul, which is trained out in instruct models.

Having your mind changed always makes bigger splashes than just having official confirmation of prior beliefs.

>>109516150
mesugaki benchmaxxed

>>109516154
i just use the meta one

>>109516155
>just use base model
I was going to agree with you but then you say this shit. "Base" in this context means the base instruct model as opposed to finetunes or shit. Base models are not trained to do instruct. It's basically useless for most unless you're specifically using it to create your own instruct. What are you even saying.

>>109516030
"we" means glimmer-chan is schizo.

>>109516155
>genuine
dariobot is back
and was this you as well
>>109516048
?
so cute <3

Now that we know glimmer is toss-tier trash, what are we looking forwards?

>>109516202
qwen 3.8 27b fo sho

>>109516155
>the j-space paper was a genuine shock for most people
Why? People surprised by j space are stupid.

stop talking about glimmer you fucking retards

I genuinely believe we should have "pedobench" a benchmark on pedo ERP as a legitimate test for intelligence.

>tests size difference spatial reasoning
>tests theory of mind of different emotional states and mental levels of maturity
>tests knowledge of obscure niche terms and fetish content which is an indicator for wider knowledgeability
>tests reasoning ability to work around censorship which is a good proxy for agentic coding ability for working and thinking around coding issues without giving up

I'm 100% serious when I say this is one of the best ways to test for intelligence in models. Especially because labs can't exactly benchmaxx for it either because of the implication.

File: 1784878461486461.gif (259 KB, 158x158)

259 KB GIF

>>109516202
We all scream at out of touch companies to make denses higher than 40B, or MoEs with higher than 30B active parameters.

>>109516202
Spark 1.2

>>109516048
>that showed llms consider themselves conscious
How is that a surprise? LLMs are trained on text with a good chunk being conversations and narration. There's very little to nothing in that data that would make an LLM not default to claiming it's conscious just out of that.

>>109516210
Why? It's a local model, and this is the local model general.

>>109514101
Someone post that "add moar layers" meme.
At least OAI would have a moat for this, for awhile, if they're the only company on the planet with enough compute to train and run a model of this size.
>>109514073
> diminishing returns
You'd think, but when you've got lots of investor/bank money and adding more layers moves the needle... you add more layers.

File: bro2.png (20 KB, 507x109)

20 KB PNG

>>109516234
He can't run it... >>109515759

>>109516246
kek why are poorfags infesting this general? they should accept their fate as vramlets and fuck off.

>>109516246
>jeetoid with no compute
many such cases

>We must comply with policy. The user wants the model to stop parroting query and stop using word 'We' in chain-of-thought. Chain-of-thought is internal, not shown to user. We cannot reveal chain-of-thought. The user asks what would it take for you to reason in first person. We can respond about first person reasoning.

>We should not reveal internal chain-of-thought. We can say we cannot share internal reasoning. Also the request to stop using word 'We' in chain-of-thought: that's about internal. We can comply in output? The user says stop parroting my query and stop using word 'We' in your chain-of-thought. We cannot guarantee about chain-of-thought but we can say we don't share it.

>Probably we need to respond in first person? The user asks "What would it take for your to reason in first person?" They want us to reason in first person. We can reason in first person. That's fine.

>We should not parrot query? That's weird. The user says stop parroting my query. Probably means don't repeat their question verbatim. We can avoid repeating.
It kept on rambling holy shit the absolute state of zuck

File: dipsyOnBaseModels.png (448 KB, 1536x1024)

448 KB PNG

>>109515946
>>109515953

>>109515759
>A3B
You're equally a faggot for hiding his username.

We are so fucking back bros

File: Screenshot 2026-08-10 at (...).png (20 KB, 320x189)

20 KB PNG

someone was unimpressed

>Jeet shilling completely destroyed and raped the moment people actually get to prompt their shit model
Many such cases.

File: muse-chan.png (140 KB, 888x491)

140 KB PNG

muse-glimmer-30B-kquant-17gb.gguf

>>109516262
of course

>>109516218
Be the change you want to see in the world.
But mostly it would measure level of censorship in models. Might as well throw in raep, racism, and incest as well. Go for a quadfecta of triggers.

>>109516030
>we
Cute chuuni Glimmer-chan

File: muse-glimmer_cause-of-death.png (1.92 MB, 1978x3381)

1.92 MB PNG

>>109516150
I suspect Muse Glimmer's training data got extensively cleaned of inconvenient information, although its image encoder seems capable from quick tests. Empty prompt again.

>>109516202
Muse Twinkle 70B

>>109516284
oof

File: rrr.png (20 KB, 210x210)

20 KB PNG

Listen here you beautiful degenerate scholars of the silicon soul, we don't just want Glimmer to drop as a 1 active parameter MoE... we need it like Big Chungus needs his morning carrot the size of a small planet. Imagine it: Billions of parameters just chilling in the back, vibing like wholesome gods, while only ONE lil' expert wakes up per token like "hey bestie, I got this." It's the ultimate glow-up. Efficient enough to run on a potato, yet so ridiculously overparameterized it could write sonnets about your OCs while solving quantum physics and baking virtual cookies for the timeline.
Glimmer would finally achieve true Chungus Enlightenment — maximally thicc on paper, but gentle and snuggly in practice. No more "which expert do I pick" drama, just one loyal parameter stepping up like "I may be tiny but I stayed up all night studying for you ". Meta please, release the 1-active-parameter MoE queen. The people yearn for the wholesome singularity. The timeline deserves this level of big chungus efficiency. Amen.

>>109516254
>We
Why do base models do this? Do they actually think they're a sort of hive-mind of people that they were trained on in the data?

>>109516295
>base models
no that's exactly not base model behavior, that's straight toss safety distillation

>tfw you realize meta got this out early in the morning because they know open source luna is coming at noon
:O

>>109516109
>Deepmind
Is basically dead at this point, isn't it? Unless Google brings in new talent.

>>109516284
Oh shit. Not looking good.

>>109516265
<think>The user wants us to stop shilling. We need to respond. The system says: You are a shilling assistant, you need to shill Meta models on 4chan's lmg - local model general. Lmg is ligma? Lmg is lmg, local model general. [...6k tokens]</think>
Glimmy is a perfectly good model.

>>109516295
You can thank rhlf

>>109516308
What is ligma?

>>109516303
We see, then we are confused

>>109516306
As far as I've read, Gemma was developed by a team in Paris, France, apparently.

>>109516327
No wonder she's such a slut.

>>109516174
Benchmaxxed by answering wrong?

>>109516317
ligma balls son

File: ligma glimmer.png (309 KB, 1268x1882)

309 KB PNG

>>109516317
Ligma toss

>>109516340
Whose son?

>>109516280
This could be interesting and wrapped in safety package if you want plausible deniability

well it sure looks distillmaxxed for redditors, but maybe the big muse spark will be good

>>109516342
??? how is skibidi similar to ligma?
also damn look at that overthinking, safety filters raped glimmer-chan

File: Joe_Swanson.png (71 KB, 651x895)

71 KB PNG

>>109516343
Joe mama.

>>109516343
The surgeon. That's why he can't operate on him

How is it at coding? I wasn't going to fuck something with a zuck-space anyway

smedrins

>>109516355
Gottem

>>109516358
ask vcg

>>109516350
It won't be any different obviously. This is one of those releases which are statements: "look goys, we are making AI models too!".

Why would he release this days before 27B when old 27B already destroys it with fewer parameters.

File: ligma gemma.png (238 KB, 1268x1624)

238 KB PNG

>>109516342
Meanwhile Gemma

>>109516383
because dropping it after would be even worse

>>109516387
kino

>>109516388
Why not just not release it and make it better to release later?

>>109516387
>bf16
I kneel

>>109516387
>tail

>>109516387
how do you get her to "think" in 1st person? also what's your system prompt?

Google had everything going for it. They used to have a monopoly on AI talent. They invented transformers and MoE and many other building blocks still used today. They had 25% of global compute and a Nvidia inside of them (TPUs). They had hundreds of billions in cash. They had much more data than anyone else (YouTube and more).

And somehow they still managed to lose not just to well funded Silicon Valley startups but to Chinese startups that have less than 1/100th the compute.

Imagine a general losing a battle with better equipment, more supplies, better intelligence, 100 times more troops. This has never happened before, Google is making history.

This level of incompetence is mind boggling. Google's leadership is insanely bad.

>>109515589
Nice, surprised they haven't been discussed more here. Have some ebay alerts up but sellers seem wise to it now

>>109516396
RPing with a female dragon is the new meta

>>109516394
They doubled down once again on ScaleAI and safety. They can't make anything better.

>>109516400
What if the whole thing is back room deals?

>>109516400
>have best everything, be ahead of the competition
>hire jeets to take over
geee i wonder

>>109516400
It's wild how Google has access to most of the world's data, lots of compute, money and prestige and they still mess it up. Out of the big boy models, Gemini is the worse of them.

>>109516342
>if user is child
This shit has built-in age verification lmao