The price of a single 5090 32gb where I live is the same as an m4 max with 64gb of unified memory, and the latter is complete system, at this point if I want to get serious about local models I just don't see the point in going the classic cuda alternative. Anyone here have any experience in how is it to run AI on apple silicon?
>>109083167>soldered ssd>serious hardwareYeah at this point picrel is a fitting equivalent with better bang for the buck.
>>109083223Ok nigger build me an AI system for ~$5000 (europe) with 64gb of vram if you're so smart
>>10908324264gb is not enough
>>109083242Here my nigger : NVIDIA Tesla A16
>>109083167Yeah, my old M1 64GB Macbook seriously outperforms my recent work PC (Ryzen 9 7900X / 64GB RAM / 4070 Ti SUPER) for local LLMs - running default qwen 3.6 through Ollama and it works surprisingly fast. And there's plenty of optimization to be done - for example I've yet to try the MLX version of models which are supposedly even better for macs.
>>109083167>MacBookYes.>AINo.
macs have:>soldered SSD/RAM/WLANdoesnt exist on 99% of PCs>when pajeetOS runs out of RAM it swapfile rapes the SSD to death within 3 yearsdoesnt exist on 99% of PCs>when the SSD dies it bricks your entire currybook because the EFI is stored on the soldered SSD to save $0.05 on a dedicated chipdoesnt exist on 99% of PCs>components serial numbered and tied to the motherboard to prevent repair and replacement (including battery)doesnt exist on 99% of PCs>riveted keyboard that requires total destruction of the chassis to replacedoesnt exist on 99% of PCs>flexgate cables that are so brittle they crack from opening your screen past 90 degrees more than 2 dozen timesdoesnt exist on 99% of PCs>screens so fucking shit they have over 90ms response times (essentially 10Hz)doesnt exist on 99% of PCs>screen made from pajeet trash glass that cracks from temperature change in seasons or tape over the iBotnet webcamdoesnt exist on 99% of PCs>so fire and explosion prone the FAA have banned them from all flightsdoesnt exist on 99% of PCs>uses phone CPU that's so shit it gets destroyed by decade old i3s from 2017 and can only "compete" by cheating at benchmarks in extreme edge cases with hardware acceleratorsdoesnt exist on 99% of PCs>curryniggers at apploo get so full of sniffing their own currynigger silicon shit they ship currybooks with no fans and they run so hot they melt the keyboard keysdoesnt exist on 99% of PCs>keyboards with 63.5% failure rateunheard of on PCs, and yet you curryniggers defend it with "jus werx fer me!"just because you're in the 36.5% survivor group doesn't make your currynigger trash any goodthis list goes on foreverthere's no PC laptop as total fucking currynigger shit as crapple's streetshitter booksthey are the biggest heaps of steaming currynigger shit in the history of computing second only to curryPhones
>>109083167My one day a week job sent me a new MacBook M5 Pro. I'm thinking about trying local models with ollama or llama.cpp + crush for my agent.
>>109083333>4.2k CADNot bad desuWhat parts should I pair with it?>>109083355seriously? shit... I refuse to use macos though. I have to use it at work and I prefer Ubuntu
>>109083167>Macbook for AINo. Either slow or will overheat.>>109085224>My one day a week job sent me a new MacBook M5 ProSure bruh
>>109083223>muh soldered ssdthis board is so fucking retarded and autistic