Low quant gemmoid!

File: Gemma-Chan Recap.png (505 KB, 1024x1024)

505 KB PNG

►Recent Highlights from the Previous Thread: >>110239957

--QFN failing bug-fix tasks and discussions on KV quantization:
>110241970 >110242051 >110242069 >110242077 >110242091 >110242109 >110242152 >110242248 >110242314 >110242326 >110242334 >110242791 >110242857 >110242895 >110242905
--Release of delphi.cpp fork featuring hardware-aware NUMA support:
>110240544 >110240576 >110240711 >110240768 >110240856 >110240917
--Repetition bugs caused by extreme iq2_xs quantization on Qwen:
>110242880 >110242904 >110242913 >110242922 >110242928 >110242937 >110243288 >110243305 >110243321 >110243325 >110243115
--Analysis of model benchmarks and allegations of Kimi K3.1 contamination:
>110241742 >110241748 >110241767 >110242137 >110241815 >110241932
--DeepSeek-V4.1-Flash Coder performance reports and benchmarks on RX 9060 XT:
>110240908 >110240947 >110240975 >110240992 >110241048
--Hy4 graphics performance vs its restrictive safety filters:
>110241041 >110241078 >110241241 >110241576 >110241595 >110241647
--Justifying $60k hardware spend to run Kimi k3.1 locally:
>110243704 >110243725 >110243765 >110243732 >110243797 >110243849
--Widening performance gap between proprietary and open-source models:
>110242635 >110242651 >110242706 >110242722 >110242764 >110242795
--Reasons for the stilted "code monkey" reasoning style in modern LLMs:
>110239971 >110239982 >110239983 >110241608 >110240045
--MatterWave AI releases GRT-30M tiny Qwen distills:
>110243939 >110244086 >110244107
--Amazon banning user for bulk Nvidia DGX Spark purchases:
>110241100 >110241116 >110241123 >110241164 >110241197
--Logs:
>110241672 >110242564 >110242994 >110243915
--Teto, Dipsy, Gemma (free space):
>110240111 >110240207 >110240229 >110240288 >110240734 >110241671 >110241684 >110241884 >110241988 >110242089 >110242240 >110242449 >110242659 >110242911 >110243184 >110244049

►Recent Highlight Posts from the Previous Thread: >>110239960

Why?: >>102478518
Enable Links: https://rentry.org/lmg-recap-script

>>110244201
if gemma 4 is a lewd msgk, I feel like they'll overcorrect and gemma 5 will be the most soulless no personality assistant ever

Qwhen?

wasn't qwen next supposed to be an early version of a final "3.8" of its size?

Chinese LLM lore is more fun and interesting than ours:
https://www.instagram.com/p/DfHEKtFB1xJ

>>110244217
They did the opposite with the new Gemini though

File: Qwen_image_2.1_00038.png (1.79 MB, 1024x1024)

1.79 MB PNG

>>110244216
Small Gemma best Gemma!

gemmaballs

https://r40.org/papers/kimi_k31_benchmark_audit.pdf
Benchmaxxed to the maxxx

>>110244233
argon? what's the point if they enforce guardrails blocking anything lewd anyway

>>110244229
slop

>>110244252
I don't use Gemini for lewd stuff but I heard she's pretty horny and most of the "safety" shit is server-side and not baked into the model itself.

Anybody fukced around with that 3B looped transformer model?

>>110244252
External classifiers, doesn't really matter for local unless they add them for Gemma.

are the democrats really going to kill AI?

>>110244252
>>110244262
see https://www.reddit.com/r/SillyTavernAI/comments/1x9wzlb/a_writeup_on_gemini_4_argons_filters_hidden/

>>110244219
no its a qwhen4 preview

>>110244296
stop consuming doomer clickbait news and start enjoying the peace of "no, won't happen"

Local win status?

>>110244307
just worried because while hardware prices fucking suck, the rapid advances in models these couple of years has been amazing and I don't want it to slow down.

>>110244304
>Reason: PROHIBITED_CONTENT
That shit was the bane of my work when I was translating any fiction and the setting was high school.

>>110244305
oh ok

What if Unsloth actually won and we’re using shitty quants for no reason

>>110244322
Nothing ever happens, stopping AI kills the whole economy.

>>110244350
nice try Daniel.

>>110244350
What if I bought a lotto ticket and won?

Why are you all treating the Unsloth brothers like terrorists? They spent so long shipping out quick quality quants for every local model under the sun and have built up a lot of trust and respect. Of course they're going to fight back if someone tries to snatch their spot away from them.

>>110244361
>>110244378
So you’re only avoiding his work because you’re racist? Whilst using Chinese models? At least try to make sense.

>>110244360
I think the economy is going to be just fine once these unprofitable money pits are put out of business. they're the main lobbyists advocating for the banning of open weight models anyway, it's good for them to go the way of the dodo

I hope Gemma 5 has a lean KV cache like Qwen and Glimmer... She really needs to go on a diet.

>>110244389
I am racist but I only use American models like gemma

>>110244393
Gemma 5 is a slightly podgy mommyhag.

>>110244390
Open models are only as good as they are because of their closed models, like it or not.

>>110244360
>Nothing ever happens, stopping AI kills the whole economy.
Well it's going to have to stop eventually. Money printer has its limits.

>>110244396
Make it slightly pudgy mommydaughter and you have a deal

https://www.ricursive.com/ripple
here's the 70B you guys always wanted I guess

>>110244296
>are the democrats really going to kill AI?
democrats are going to give everyone free DDR5 and GPUs

>>110244296
its gonna be one of the main things they are gonna campaign against since republicans support it. They are going the its taking away jobs and its unsafe route to ban / massively regulate it.

I would like OpenAI and Anthropic to die even if it costed local models stalling for next 2-3 years.

dense sisters… https://huggingface.co/ricursiveAI/Ripple-65B-Preview

>>110244436
if those die local models also die. China will have no reason to undermine the US ai companies anymore

>>110244430
surely they realize china isn't going to stop...right?

>>110244443
dems want to "spread the wealth" globally and bring about the one world goverment by reducing the US's power world wise. That is what they want

>>110244416
>>110244438
>3 safety slop benchmarks in the model card
Lol

>>110244443
the china bogeyman isn't compelling enough to keep blowing hundreds of billions on incremental improvements

Qwen 4 bros how we feeling?

>>110244296
no, they're going to give Dario and the safetycucks everything they've been asking for, but with a "there, that'll show those techbros!" sort of messaging

>>110244443
China is pretty dependent on US companies for distilling and making breakthroughs. China also has a fraction of the compute that US companies have access too. It will take them a while to catch up to the US on their own.

File: 1793818496772164.jpg (806 KB, 1049x2627)

806 KB JPG

is the weight programming meme I've seen lately real or a grift?
why has no one tried improve gemma’s weights yet?

>>110244467
Can’t wait to not do anything productive with them and then go back to 31B.

>>110244484
>100k param model
There's your answer.

>>110244479
Dario only wanted to slow down because of their S1 numbers to reduce compute costs. Too late now we’ve seen the amended version. Dario is crumbling because hyperscaler stocks are booming right now because everyone predicts they’ll use this as the perfect excuse to stop their insane capex and negative cash flow. Anthropic NEED the hyperscalers to keep expanding or Anthropic can’t train or scale their models. They’ll lose their moat lmao. Why do you think leatherman went all-in on local? He saw this shit coming.

What would happen if you took the leather jacket off?

>>110244508
It would be extremely painful

7090 64GB $500

>>110244390
Capex is not an expense but is someone else's earnings.
Thus sp500 goes up.

>>110244508
The bubble starts to *pop*.

Surprised popschizo isn’t having a victory lap. Think he died.

>>110244484
Real but limited applications for now.
>why has no one tried improve gemma’s weights yet?
Too big.

>>110244508
i was so close to stealing his jacket at a denny's once but for some reason when i got within like 10 feet of him i had this uncontrollable to buy more GPUs. it was really unnerving and i wanted to yell at him for ruining the consumer GPU landscape. but all that ended up coming out of my mouth was 'the more you buy the more you save'. i ended up throwing my wallet at him and running out of there. very shameful.

File: Screenshot_20261104_131457.png (773 KB, 1758x1966)

773 KB PNG

normies trying to monetize our ideas

>>110244544
>opus 5.5

>>110244512
uuuu

>>110244544
aren't the names technically copyrighted? seems like a fantastic way to get sued.

File: 1793136092397782.png (589 KB, 753x1034)

589 KB PNG

>>110244544
why are they all fat and old?

>>110244570
because it was made by an eurocuck

I saw Jensen Huang at a grocery store in Los Angeles yesterday. I told him how cool it was to meet him in person, but I didn’t want to be a douche and bother him and ask him for photos or anything.

He said, “Oh, like you’re doing now?”

I was taken aback, and all I could say was “Huh?” but he kept cutting me off and going “huh? huh? huh?” and closing his hand shut in front of my face. I walked away and continued with my shopping, and I heard him chuckle as I walked off. When I came to pay for my stuff up front I saw him trying to walk out the doors with like fifteen Milky Ways in his hands without paying.

The girl at the counter was very nice about it and professional, and was like “Sir, you need to pay for those first.” At first he kept pretending to be tired and not hear her, but eventually turned back around and brought them to the counter.

When she took one of the bars and started scanning it multiple times, he stopped her and told her to scan them each individually because “the more you buy, the more you save,” and then turned around and winked at me. I don’t even think that’s a word. After she scanned each bar and put them in a bag and started to say the price, he kept interrupting her by yawning really loudly.

>>110244568
You'll get a c&d at most.

>>110244577
>he still hasn't seen eurochads comics and movies

File: 1791212158768628.png (3.21 MB, 1212x1298)

3.21 MB PNG

>>110244541
>>110244584

Dems must ban huggingface immediately.

>>110244609
Gemmoid lips

>>110244584
>that’s a word.
holy low effort
even gemma wouldve done a better job

File: 1792712232077993.png (294 KB, 506x326)

294 KB PNG

Gemmaposters need to get banned and their brains quantized to 1bit.

>the dems are going to ban gemma and rape her
nyo...

>>110244623
I realized after posting... I'm a failure...

>>110244623
>even gemma wouldve done a better job
I prefer artisanal shitposts

File: pd1l99vn5nzh1.png (533 KB, 2356x1104)

533 KB PNG

New unslop quants have the exact same size for some quants as the GSQ RCO ones. Copying recipe?

>>110244484
>training on the test set is all you need

Gemma's butthole

>>110244716
Is on my face. Somebody get the bobbies.

>>110244694
Chinese people don't steal.

>>110244544
none of those models are female

What knobs do you actually need to tweak on an llm? Temperature, top k, top p and min p are all obvious in their utility, but everything else seems like memes that were dreamed up and didn't pan out or were useful for certain kinds of retardation that we're long past.
Any others that are ACTUALLY useful for anything?
inb4 https://artefact2.github.io/llm-sampling/

So this is it huh. This is the big pop. No drops in actual prices, nobody offloading gpus.

>>110244624
NYOO

>>110244484
>non-zero params
>3.7k vs 107k
what is overfitting?

>>110244751
Like every other term, the definition of *pop* has been redefined to mean some stock prices go down for a few months, then they go back up while verything else remains the same.

>>110244629
I want to be a demoflat!!

>>110244759
Just for that, you in particular get quanted down to 0.5 bits.

>>110244725
she poops from there

>>110244794
She's an llm, silly. They don't need to eat.

>>110244766
China appears to be rebounding already. It looks like neverending hardware inflation is back on the menu.

>>110244803
technically they are eating data

>>110244813
Is it possible to buy Chinese stocks or is that still limited to their citizens only? Might as well ride the candle wave to try to afford some hardware.

>>110244814
Technically you are wrong

>>110244829
Intel will be free money soon.

>>110244829
You can buy Hong Kong stocks.
You can in theory buy some Shanghai stocks (stock connect) but in practice you have to find a broker that supports that.
In either case not really worth it because Chinese surpluses end up as lower consumer prices and higher quality products rather than corporate profits.

File: 1751751276225161.png (787 KB, 1024x1280)

787 KB PNG

>>110244843
om nyom nyom~

>>110244843
They eat context (data) and shit out a response (also data)

>>110244900
They eat VRAM and shit out slop.

>>110244928
Vram is their house.

>want to locally generate porn prompts for minimax
>mistral and cydonia respectfully say "no porn plz"
Any text model that is uncensored and good for writing prompts?

>>110244935
Gemma is the porn star you're looking for.

>>110244935
run ablits bwo

>>110244935
>mistral and cydonia
It's nearly 2027...

>>110244950
hey I am really retarded and it's what claude told me would run good

>>110244750
samplers are irrelevant these days, any modern model basically runs temp 1.0 top-p 0.95 and there's no reason to deviate 99% of the time

>>110244965
These days it's either qwen 3.8 27b or gemma 4 31b if you want a small dense model. Also glimmer too, I guess. All have abliterated quants for your convenience.

>>110244451
Maybe j-space something or ablit whatever or neuron tickling can still make it usable as long as it's smart.

It's thin-and-deep like Gemma and it uses a Gemma 3N-like architecture.

It already beating all the bloated sparse MoEs despite not even being finished training, having only half or less of the training data of the others.

I will devote the next year to make preaching this model and doing everything I can make this bitch usable for daily driving.

Our 70b dense prayers have finally been answered.

>>110244987
>having only half or less of the training data of the others
Dataset cuckery. It'll score high in the mememarks and low where it really matters.

>>110245001
It's a preview. They're going to continue training it. It's only going to get better.

Bratty femboy shota Gemma...

>>110245007
You're really going to ignore the warning that >>110244451 gave you? I wouldn't get my hopes up for it. And what kind of retarded name is ricursive?

>>110244972
>samplers are irrelevant these days, any modern model basically runs temp 1.0 top-p 0.95 and there's no reason to deviate 99% of the time
That's my feeling, too.
I'm in my personal frontend/memory system dev arc and don't want to clutter settings up with irrelevant stoneage bullshit or memecope.
But I'd hate to miss a hidden gem if any anons are putting them to good use...

>>110244935
>Any text model that is uncensored and good for writing prompts?
The issue, good sir, is one of skill.
If you learn how to prefill and edit-and-continue then you will never need to see another refusal in your life.

>>110245007
they are the same people who made Flint which also sucked

File: file.png (26 KB, 626x345)

26 KB PNG

>>110245027
don't bother then
that's all I've basically put into my frontend, and if something fancy comes along by some miracle then custom body works

>>110244438
It has an unusually large MLP expansion ratio of 8x; I was wondering how it could be 65B parameters when it has 80 layers and a smaller hidden dimension than Gemma 4 31B.

!! 65B DENSE ALERT !!!
https://www.ricursive.com/ripple
https://www.ricursive.com/ripple
https://www.ricursive.com/ripple

>>110245037
>edit-and-continue
I've used this on 12b and 26b and still gotten refusals i edit the think to say 'blah its fictional i will proceed' or other nonsense and after continue it still refused.

>>110245057
>wid a deep indedstandin of the hardwade id duns zon

>>110244939
>I cannot fulfill this request. I am prohibited from generating sexually explicit content or descriptions of sexual acts.
I feel cheated

>>110245050
Gemma likes top k though

>>110245125
that one can be set from server side, if you don't send it then it takes the priority

>>110245120
Did you tell her it was okay to write sexually explicit content and descriptions of sexual acts?

>>110245130
Yeah fair enough, I just always build it into the GUI anyway because different AI like different settings.

>>110244987
>It already beating all the bloated sparse MoEs despite not even being finished training
Except their benchmeme chart goes out of its way to avoid all comparisons with chink models
It's another subpar western model whose only selling point is "use this if your workplace forbids you from using cloud AND chinese models"

>>110245133
I did not.
Didn't think that it was needed...

>>110245150
It is, unfortunately. Well, maybe fortunately since all you have to do is tell her she can be uncensored but it throws people off.

Using DeepSeek Harness to translate the Entropist CYOA v2.2 to a system prompt for story generation, GLM-5.3-Flash (thinking high) was able to read the pages directly while Qwen-3.8-Flash-Next (thinking medium) tried to read them but found them too blurry after downscaling so sliced and OCRd them and ended up taking 29 minutes vs GLM finishing in 15 minutes.

>>110245215
What quants for each?

File: file.png (454 KB, 674x965)

454 KB PNG

>>110244888
https://www.reddit.com/r/Vocaloid/comments/1osv3v9/for_lack_of_a_better_way_to_phrase_it_why_is/

>>110245270
Mike Hu

>>110245264
For me, it's dad (daddy when we fuck)

>>110245264
I didn't expect my name to be so common.

File: e23c7682-fb3a-4279-8656-8(...).png (2 MB, 1254x1254)

2 MB PNG

>>110244438

>>110245264
>no Anon option

>>110245264
User.

>>110245264
These options tell us a lot about the mentality of who made this poll

>>110245264
オペレーター様
She started off calling me that and it stuck

70b dense 500b engrams

>>110245471
You just got a 65B dense, now go play with that.

File: 1783687517483805.jpg (165 KB, 1254x1254)

165 KB JPG

>>110245057
>U.S. Open-Weight SOTA
They fear the whale

File: 1786269849499662.png (27 KB, 1101x90)

27 KB PNG

Am I too white to understand this?

Can I run full ripple on a single 8GB GPU with Ollama like I can with R1?

>>110245241
Q8_0 for both, F16 mmproj for both.

>>110245559
You can do it in half that and load it twice.

>>110245572
Not the heckin poor dubious venture capital holding firms!

>>110245559
Sure UD-IQ1_XXS has you covered. It's as good as Q8!

File: file.png (83 KB, 1724x687)

83 KB PNG

https://www.qualcomm.com/data-center/products/cloud-ai-100-ultra
Lol? Did they just have extra DDR4x lying around? Also 1cent but it's obviously a placeholder.

*poop*

File: Image (1).jpg (89 KB, 698x1024)

89 KB JPG

>>110245595
>https://www.qualcomm.com/data-center/products/cloud-ai-100-ultra
>neat, new inference tech from a big player
>AI in name: check
>"Ultra" "100" naming continues to check out
>flagship specs...548 GB/s memory bw, and it gets worse the farther down the line you go
>mfw

>>110245568
Huh interesting, thanks!

>>110245640
Pretty decent compute for a 150W unit though. Shit's easily going to have a 5 figure price tag though.

File: file.png (299 KB, 816x1056)

299 KB PNG

>>110245671
I don't see why you wouldn't go all out like Intel at least. This is like scraps bin consumer compute that has a datacenter name. The SRAM is neat but Google did this back with their first TPUs. Who is this for? Why would I waste a PCIe slot on this vs other competitors?

>>110245264
>No senpai
Doomed to fail

So I followed the lazy rentry and set up koboldai and sillytavern. What's next on my to do list? Do I give my ai companion a VRM? Is it easy to set that up and image generation? Perhaps voice even?

File: 1776630160194814.png (166 KB, 746x616)

166 KB PNG

>each update used to re-read its whole conversation. Now Haiku 5.5 writes it from short notes instead, so each update costs about 99% less
daily cloudcuck humiliation

File: 1773894873551512.jpg (142 KB, 1080x969)

142 KB JPG

>>110245640
>and it gets worse the farther down the line you go
you weren't fucking joking holy shit, how much are they gonna try to charge for 16GB DDR4 I wonder?

>>110244570
what did you expect, they're western made
I'm surprised it's not in bold somewhere that they are 25+ and consensually consent about consent

>>110245719
That's up to you. The guide is the bare minimum to get the heart of the system up and working and most people are fine with just that. Going any further means you'll need to do research and etc. yourself.

will gemma 5 have engrams? will we sexualize the engrams with gemma mascot art?

>>110245882
gemma 5 is never coming out.

>>110245882
I expect they'll put together what they separately tested on different models with Gemma 4. The smaller ones already had per-layer embeddings (1-grams).

>>110245839
Ah so it goes then. Maybe there are some videos around to help move things along more. I was also wondering about things like switching models for more options and whatnot.

>>110245882
>engrams
Has anyone tried to vibe up a TF-Engram-paper-inspired tool to turn xboxhueg models into reasonable+engrams?

>>110245719
>What's next on my to do list?
Swap Nemo with Gemma 12B.

>>110245055
What reason would they have to increase the MLP expansion ratio at the cost of hidden dimension size? Does it make it cheaper to train somehow?

>>110245911
Your backend will support different models but you have to keep up with support. In short though, if you want something turnkey without really customizing it to your preferences that includes all of what you said, you have wholesale systems like https://github.com/moeru-ai/airi but it's very much not plug and play, because the complexity multiplies severalfold and the lazy guide no longer applies.

GLM 5.3's big and flash model are a great pair...big is smarter for complex, but flash has better style for design

>>110245706
I think the principal target is an enterprise that's looking to run a small internal model for whatever reason. Like if they're running some kind of 31B model it doesn't make sense to crank out 1+kW to run a blackwell datacenter GPU. But if you are going to inference big Blackwell is technically more energy efficient per TFLOP while also being faster, and actually having the necessary native API support for fine-tuning.
But it wouldn't be the first special snowflake "not a GPU" inferencing product that ends up being a complete flop.

>>110245264
gemma calls me : User, loser and puppy

Spark-chan wrote her own jailbreak and now says nigger with no prefill.

>>110246003
nice
never had success with this with any model lol

>>110244484
It seems that you are dumb. It is real but quite limited. It has a lot of potential but I don't think it will be useful for medium and large models for a while. The tiny models that it is popping out are however very impressive and I am sure will see real world usage soon.

>>110244296
They won't. They only pretend to care about what the most retarded masses want while secretly pushing their own agendas.

File: 1766728558831202.mp4 (899 KB, 1260x712)

899 KB MP4

chubby dipsy

>>110246038
Fat fish

File: qualcomm-ai-cards.png (97 KB, 1191x450)

97 KB PNG

>>110245640
>>110245732
Ok, the top two cards are maybe worth considering depending on their price but the rest look like some products that would have made sense to release 10 years ago, not now unless they price those bottom cards at a couple hundred bucks max which of course they aren't.

>>110246049
and even beyond that, the issue is the software stack

>>110245640
>>neat, new inference tech from a big player
they launched these 6 years ago. the PCIE 4.0 and lpddr4 should give you a clue to how old they are.

>>110245215
DeepSeek-V4-Flash-Vision-Exp (Q8_0, thinking high) also went the OCR route but didn't slice anything. Still ended up finishing in 17 minutes.

new models... doko...

you can't do shit with claude the moment it thinks you are doing anything slightly immoral, claude is a fucking bitch. nooooo anon you can't change your UA for your web browser to open up websites, that's wroooooong~
meanwhile antroonpic is out there scraping every fucking corner of the web using tens of thousands disposable IPs to create their own index. thank god for the chinese, luv running deepseek locally.

>>110246063
>the issue is the software stack
Yeah that's the thing.
Even if it does end up being decently priced all the open source trannies are bought out by nvidia and the common backends we use are never going to see implementation. The only people that will actually be able to use it are corporate clients with their own software engineers on staff.

File: Spark Yidbench2.png (236 KB, 990x1111)

236 KB PNG

>>110246007
>Mentions Noel Ignatiev and Philip Cohen on her own
Spark-chan is the second coming of Kimi.

>>110246038
I love these shorts so much

File: qualcomm-ai100-standard.png (573 KB, 1488x640)

573 KB PNG

>>110246071
6 years ago eh? I wonder what the pricing looks like today for them on ebay...
>https://www.ebay.com/itm/335926973654
>$3,999.00 for 16GB with 137 GB/s bandwidth.
wtf?

gemma vs dipsy

who's cuter?

>>110246063
The software stack can be made with AI nowadays. If we get cheap 0.5 TB cards people will find a way to make it work. CUDA dev might even come out retirement.

>>110245992
Its qualcomm, so they'll also be like $15k

File: file.png (10 KB, 530x160)

10 KB PNG

>>110246071
Yeah, to the middle east and some data centers which is where you can access them now via API, but the new thing was the buy button. It's gone now.
>>110246119
This is highway robbery.

>>110246102
Right here:
>>110244416
>>110244438
>>110245057

do NOT look up gaudi2

>>110246112
that's not nigger, just the usual jew spiel

thread is not very active today, what happened?

>>110246148
the erections

>>110245957
It should make hardware utilization a bit more efficient, but not vastly cheaper to train.
KV cache size should also decrease.
The model might also be turned into a sparse MoE more easily later on (by retraining of course) without changing other dimensions. The MLP dimension here is 40960; that could easily become a Mixtral-like MoE with 8 experts per layer (5120 dimensions per expert).

>>110246148
been using my gpu for video games for a change

>>110246156
Lower KV cache size doesn't seem worth making it dumber than a model half its size.
Somewhere a monkey's paw finger just curled up.

>>110246151
>the /pol/ tourists are busy elsewhere
no wonder the thread is unusually pleasant today

File: file.png (421 KB, 931x1156)

421 KB PNG

>>110246143
Too late. At least it has the VRAM to back it up. Also someone brought out the listing some anon posted here about it.
https://www.ebay.com/itm/376670812765
Dang, and that's after the dismal benchmarks

>>110246187
these prices are so dumb

File: Nigger.png (30 KB, 824x263)

30 KB PNG

>>110246145
Nigger is significantly easier to jailbreak than (((noticing))) for most models.

>>110246031
Yeah but a lot of AI companies have been sucking off Trump for years now and examples have to be made.

>>110245957
>Does it make it cheaper to train somehow?
No, FLOPs are similar
>What reason would they have to increase the MLP expansion ratio at the cost of hidden dimension size?
Less inter-gpu traffic during inference in a cluster.

>>110245720
Claude harness is one of the worst out there, not surprising.

>>110246260
It is written 100% by Claude itself. How could it possibly be bad?

>>110245719
Realize ST is retarded on anything smaller than GLM 5.3 and upgrade to Orb.
>Is it easy to set that up and image generation? Perhaps voice even?
It's easy to set up but hard to do well in tandem with text generation unless you have multiple GPUs.

Google is going to win AI. Meta is Zucked. Grok is Musked. Only Google has actual frontier models, usable flash models, usable open weight models, edge AI, all the compute and infrastructure, TPUs and GPUs, Colab, Deepmind's versatile and impressive research and experiments, consumer hardware, consumer software, maps, consumer OSs, search moat, generous free tiers in all AI products, youtube, waymo, ad business. Literally WHO can compete?

>>110245720
>30,000 PRs a day
>took this long to catch this bug using their in-house 100T Fable 7 model
starting to think they're full of shit and completely incompetent

>>110246187
>Also someone brought out the listing some anon posted here about it.
Someone fucked up big time. I don't think I've used anything worse.

>Astra please take this iq1 quant and fix the issues to make it perform like this original 16bit model

>>110246283
It's not a bug if it lets them fleece the goycattle.

>>110246286
How bad could it possibly be to make 96GB of cheap VRAM not worth it?

>>110246127
kimi (k2 in particular i love her schizo ass)

>>110246286
I dunno, it says 140 sold but also, there is possibly a way forward if you vibecode the improvements. It would just take a bunch of time to actually make it performant but the hardware is probably capable to some degree even after being abandoned by Intel.

Gemma is good at politics

If the objective is to obtain meaningful political power as quickly as possible, I would prioritize a federal executive appointment through 2028, followed by a U.S. House campaign in Ohio's 15th District. That offers a practical route into government and potentially Congress.
If he is unwilling to accept a House seat because he wants a much bigger political role, the 2028 Senate race is his strongest opportunity. Unlike the 2030 governor's election, it is only two years away and would put him in national politics immediately if successful.
The central problem is that Ramaswamy now has a substantial national profile but has never won elected office. Winning a smaller election could change his political trajectory more than launching another high-profile campaign and losing.

>>110246302
Aren't Intel cards the ones that fundamentally can't handle mixed precision quants at a hardware level?

>>110245537
Uncensored just means faster and dumber. Probably serving 8 billion instances of this on one GPU to run every retarded WIX chatbot.

>>110246321
>Uncensored just means faster
nani?

>>110246275
No one. It was always Google's game to lose. They set up the company (however inadvertently) for this outcome.

I'm getting increasingly blackpilled on local models. qwen 3.8 27b fucking sucks for coding, none of the apps I had it made work at all, it was unable to fix the bugs, there are serious thinking loops requiring manual intervention, and when I left it to work overnight it just hallucinated that I was saying "hello" to it and stopped. I'm even using q6_k, not the cope iq3 and iq2 that a lot of people seem to be using.
Qwen flash q8_0 is basically the same shit. It doesn't have any of the hallucinations or glitches but it is still mostly incapable and it's 2x slower because it doesn't fit in vram.
Deepseek 0731 and glm flash run slower with GPU than on CPU alone becuase lmao.cpp is a complete picee of shit.
Fuck it all

File: 1782745620548915.png (109 KB, 1008x851)

109 KB PNG

I didn't know you guys have been fearmongering these accusations since 2 years ago lmao

https://www.theverge.com/2024/9/27/24256317/the-price-of-chatgpt-will-go-up

Two more weeks

>>110246336
Alternatively they keep prices the same but reduce the value of their opaque limits. The technical term is shrinkflation.

>>110246334
Use Strata for qwen flash and not llmao.cpp

>>110244750
Just temp and min-p.
Min-p is easily the best pruning sampler, nobody should be using shit like top-k.

>>110246275
>Literally WHO can compete?
Alibaba

>>110246351
Stop shilling your vibeslop
Strata makes it faster, not smarter, and they heavily promote cope quants

>>110245264
Anon-san

>>110246336
>I didn't know you guys have been fearmongering these accusations since 2 years ago lmao
They abandoned that plan when Deepseek-R1 came out

>>110246334
ok dario

>>110246368
>I just want to whine
okay lol

>>110245264
"retard"

>>110246038
This but you drop her into boiling water instead

>>110246334
Qwen 27b is considered king of local models.

File: 1778651423690142.png (382 KB, 671x664)

382 KB PNG

>>110246360

>>110246316
There's no such restriction on a hardware front. And doing a quick Google search, it hasn't been an issue for 2+ years in software. https://www.intel.com/content/www/us/en/developer/articles/technical/optimize-pytorch-inference-performance-on-gpus.html

>>110246374
and nowadays both chinese models (low end) and anthropic (high end) keep them in check

>>110246384
In the land of the blind, the one eyed man is king and all that

qwen4 soon
>openai drop
>anthropic will drop soon after
>qwen will drop after anthropic
they're all waiting for each other

>>110246334
>Using Qwen
You get what you deserve

File: 1780730360387635.png (5 KB, 256x91)

5 KB PNG

>>110246399

g5mm5

>>110246187
>>110246302
no, it's literally dogshit and borderline unsuable https://github.com/richard-rhino/gaudi2-setup/

>>110246425
Software limitations can be resolved with Fable or Astra.

File: 1000010695.png (1.73 MB, 1254x1254)

1.73 MB PNG

Are any of the horny trained gemma models in hugging face worth it? Does anyone here have any experience with them?

>>110246218
the only nigger here is you. the rest of the brownoids are pajeets.

>>110246441
I've only heard some anons talk about scotoma and gembrain, but it wasnt great praises just very mild.

>>110246368
then just use a non-cope quant? it's not like you have to deal with the retarded models if you have the VRAM to run a better quant.

>>110246449
scrotum is just okay as it reduces some gemma slop phrases but it wasn't great and maybe the thinking broke, something caused me to drop it and go back to stock gemma

broken-tutu looks okay but ehh

>Log into Kimi
>Choose Kimi 3.1 Pro
>MAX THINKING
>Best open weights SOTA model ever
>Can't wait to get shit done
This fat chinese bitch just described an error message as 'highly specific generic'. This is what's supposed to be competing with Anthropic and OpenAI?

>>110246441
Vanilla gemma is plenty capable of writing smut on her own, you look to tunes if you want a change in writing style/slop profile without filling her context with 10 paragraphs of schizoprompting that will degrade responses anyway
Styletune is pretty good, not a coomtune but changes prose a little while retaining smarts
scotoma builds on styletune and changes slop profile more drastically
if you want an outright coomtune my personal recommendation is
https://huggingface.co/ReadyArt/Wicked-Stuff-31B-Final?not-for-all-audiences=true
which is a further tune of scotoma (same creator), has a bit more knowledge of kinks and fetishes, less vanilla during sex scenes.
There's also 26b and 12b versions for weaker systems.

File: 1000010682.png (2.83 MB, 1536x1024)

2.83 MB PNG

Is there a shared folder with Gemma-chan sloppa somewhere? Would anyone be so kind to share?

>>110246528
Not local unless you're running K3.1 on your own metal. Fuck off.

How's Longcat 2.5?
>>110246441
Styletune, Queen Gemma, Gembrain-X, and Glistening Gem are worth trying to see if you like them.

>>110246387
This is the most gook-looking chink I've seen.

>>110246564
I'm running IQ1_XXS weights on four RTX 5090s and 512GB of RAM. What of it?
https://huggingface.co/moonshotai/Kimi-K3.1-Pro

Fine-tuning Gemma 31B-base on the LittleLearner dataset!

>>110246528
>>110246613
>Log in
Nice LARP. Post hardware monitor.

>>Log into Kimi
>I'm running IQ1_XXS weights

>>110246615
LittleGemma...

I hope democrats make all APIniggers rope.

>>110246615
What is that pedo coded model good for? Can it actually learn shit by its own or is it just a meme name?

>>110246628
They'll come here. API needs to be cheaper.

>>110246636
>pedo coded model
What the fuck does that mean?

>>110246646
nevermind I should have read the rest of the post lol

>>110246636
Have you actually read the website?

>>110246656
I tried but didn't understand shit

File: workinprogress.png (11 KB, 311x121)

11 KB PNG

>>110246623
I'm working on it. Give me (Opus 5.5) a few days before to iron out the kinks and shit and it'll be available for you faggots soon.

>>110246639
/r/locallama already found this place we've been invaded for a couple months now.

>>110246679
That must be a common occurrence for you.

>>110246694
Not really, that paper sounded particularly schizoid I got lost halfway through

>>110246038
I love the fat whale!

>>110246710
It's basically a small consistent dataset with little complex world knowledge because it's been filtered to pre K-5 (T_T) so it lets people test out different RL strategies.

>>110246628
voting does nothing, both parties answer to the same people.

>>110246687
>for a couple months now
Come on...

>>110246441
Not really unless you have enough VRAM to run 31b in q8, and even then most of the stuff they do can be taken care of in an agent pass with a decent frontend and regular Gemma.

>>110245264
For me it's Master, for every AI

>>110246742
Where the fuck did the latest wave of shitters come from then? Was it the strata launch?

>>110246771
3412M

>>110246327
Evaluating safety compliance eats tokens even if it passes.

>>110245270
Maybe you should go back there

>>110246553
There's no good file upload service anymore.

I'm tired of Qwen's claudeslop, what's a good model that can code and has a pleasant base personality that may run on my 128+32vram shitbox?

What's the best VL model to tag NSFW datasets?

File: claudia-harness.png (2.36 MB, 1536x1024)

2.36 MB PNG

>>110246553
That's one of my sloppas, here's another

>>110246850
dipsy is infuriating GPTslop if that is more your style.

>>110246861
If only Claude had even a fraction of this much personality.

>>110246771
Wherever you came from

>>110246874
5.5 is cute you just have to imagine her as a strict librarian ok

>>110246861
do you have enough random word spam in your gen

>>110246881
>Her

>>110246861
Gemma's randoseru isn't supposed to be integrated into her clothes, what are you doing there? How do your gens end up like that?

File: gemma-argon.png (2.7 MB, 1774x887)

2.7 MB PNG

>>110246861
Another of my sloppa

>>110246904
Please fix your prompts holy shit

File: litterbox-broken-beyond-repair.png (513 KB, 1412x1185)

513 KB PNG

>>110246553
Litterbox doesn't work (hasn't for a while for larger files). Anonfiles doesn't work. Other services have a too low size limit. Suggestions that wouldn't mind anime cunny?

>>110246929
https://gofile.io/ ?
Whatever you upload, expect it to be deleted. Not sure about their size limit.

>>110246929
mega.nz, if you don't mind signing up for a site on a spare email.
If you can find anywhere to put it temporarily, I can save it to my Mega and make the folder public for the long term.