[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


The price of a single 5090 32gb where I live is the same as an m4 max with 64gb of unified memory, and the latter is complete system, at this point if I want to get serious about local models I just don't see the point in going the classic cuda alternative. Anyone here have any experience in how is it to run AI on apple silicon?
>>
File: 1780388449280354.jpg (133 KB, 1500x1000)
133 KB JPG
>>109083167
>soldered ssd
>serious hardware
Yeah at this point picrel is a fitting equivalent with better bang for the buck.
>>
>>109083223
Ok nigger build me an AI system for ~$5000 (europe) with 64gb of vram if you're so smart
>>
>>109083242
64gb is not enough
>>
>>109083242
Here my nigger : NVIDIA Tesla A16
>>
>>109083167
Yeah, my old M1 64GB Macbook seriously outperforms my recent work PC (Ryzen 9 7900X / 64GB RAM / 4070 Ti SUPER) for local LLMs - running default qwen 3.6 through Ollama and it works surprisingly fast.
And there's plenty of optimization to be done - for example I've yet to try the MLX version of models which are supposedly even better for macs.
>>
>>109083167
>MacBook
Yes.
>AI
No.
>>
File: 1769318545404448.png (1.43 MB, 2224x2300)
1.43 MB PNG
macs have:
>soldered SSD/RAM/WLAN
doesnt exist on 99% of PCs
>when pajeetOS runs out of RAM it swapfile rapes the SSD to death within 3 years
doesnt exist on 99% of PCs
>when the SSD dies it bricks your entire currybook because the EFI is stored on the soldered SSD to save $0.05 on a dedicated chip
doesnt exist on 99% of PCs
>components serial numbered and tied to the motherboard to prevent repair and replacement (including battery)
doesnt exist on 99% of PCs
>riveted keyboard that requires total destruction of the chassis to replace
doesnt exist on 99% of PCs
>flexgate cables that are so brittle they crack from opening your screen past 90 degrees more than 2 dozen times
doesnt exist on 99% of PCs
>screens so fucking shit they have over 90ms response times (essentially 10Hz)
doesnt exist on 99% of PCs
>screen made from pajeet trash glass that cracks from temperature change in seasons or tape over the iBotnet webcam
doesnt exist on 99% of PCs
>so fire and explosion prone the FAA have banned them from all flights
doesnt exist on 99% of PCs
>uses phone CPU that's so shit it gets destroyed by decade old i3s from 2017 and can only "compete" by cheating at benchmarks in extreme edge cases with hardware accelerators
doesnt exist on 99% of PCs
>curryniggers at apploo get so full of sniffing their own currynigger silicon shit they ship currybooks with no fans and they run so hot they melt the keyboard keys
doesnt exist on 99% of PCs

>keyboards with 63.5% failure rate
unheard of on PCs, and yet you curryniggers defend it with "jus werx fer me!"
just because you're in the 36.5% survivor group doesn't make your currynigger trash any good
this list goes on forever
there's no PC laptop as total fucking currynigger shit as crapple's streetshitter books
they are the biggest heaps of steaming currynigger shit in the history of computing second only to curryPhones
>>
>>109083167
My one day a week job sent me a new MacBook M5 Pro. I'm thinking about trying local models with ollama or llama.cpp + crush for my agent.
>>
>>109083333
>4.2k CAD
Not bad desu
What parts should I pair with it?
>>109083355
seriously? shit... I refuse to use macos though. I have to use it at work and I prefer Ubuntu
>>
>>109083167
>Macbook for AI
No. Either slow or will overheat.
>>109085224
>My one day a week job sent me a new MacBook M5 Pro
Sure bruh
>>
>>109083223
>muh soldered ssd
this board is so fucking retarded and autistic



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.