[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: 1783287585050.png (327 KB, 633x758)
327 KB PNG
>tfw fell for 2x32GB DDR5-8000 RAM meme
>>
wrong pic ig
>>
>>109250005
>8000hz
how stable is it on a scale of 1 to 10?
>>
>tfw fell for the 4x128gb ram meme
>>
>>109250005
How so you can sell half of it to more then you paid money back?
>>
>>109250005
6000Mhz is all you need
>>
>>109250005
>tfw fell for the 4GB RAM meme
>>
File: iChads.jpg (225 KB, 1846x648)
225 KB JPG
>>109250005
>he fell for the 512Gb of ram meme...
>>
>>109251751
must be pretty good for llm inference.
>>
>>109251754
Nta, it isn't. Low ram bandwidth
>>
>>109251760
Not sure if just wrong or droidjeet. Macs are great at it because the memory is fast. Let me know when you can run Deepseek 3.2 8bit at 17 t/s (that's two of those clustered together with RDMA because that model is 768GB in size)
>>
>>109251751
shiieeeetttt this makes my macbook pro m4 pro with 24GB RAM look like an infant.
must feel good, no?
>>
File: 1772527635668438.png (304 KB, 852x614)
304 KB PNG
>>109251792
It's pretty sweet. EXO is still a little buggy so I'm using it for much atm, but I plan to build some stuff out to make it much more useful in an agent sense. Also that model is overkill, I just loaded it for fun.

Curious when Apple will drop the IChadUltraM4 chips
>>
>>109251760
isn't it like 800GB/s ?
that'd be plenty for a moe.
>>
File: 14690.png (753 KB, 1330x1020)
753 KB PNG
>>109251754
Nah, Mac inference speed is kinda shit, it just let's you run fuck off huge models(which are even slower). Would be kinda shit for models over 32b just due to speed. Maybe a 70b. 200b wpuld crawl.



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.