Do people really actually legitimately use the base mac mini (16GB) to run local models?
You can run Qwen3.6-35B-A3B on it but I think most of the hype around le Openclaw was people actually buying these so that the agent wouldn't blow their own daily driver OS the fuck out
>>108729406>actually buying these so that the agent wouldn't blow their own daily driver OS the fuck outIs it even worth doing that?
>>108729436I hear they’re backordered to hell because world+dog is doing just thatbut I wouldn’t run OpenClaw, and if I did, I wouldn’t run it on my real machine
>>108729397Nobody uses them for local models, people use them as a hub for openclaw because it lets you send sms n shit (unlike winblows and loonix)
>>108729406For sandbox. Not OS.
>>108729515So this is for iPhone users?
>>108729532Are android phones not capable of sending text messages and making phone calls?
>>108729544Yeah, but when you mention wangblows and linux can't do that I assume you're talking about apple messagesActually I have no idea what this means
>>108729554Ah fair enough I misunderstood. Yeah iphone is needed if you want full phone connectivity. But macs are great for a variety if reasons: they’re small, silent, use fuck all energy (matters if you run it all day), have built in integration with a lot of services and protocols like home automation etc. Most of it can work on a winblows or linux computer but it’d be a huge ballache you’re better off spending a few greenbacks and skip all the nonsense.
>>108729397I am guessing they use these shits because they want to send imessages and other Apple crap from their openclaw agent, right? Otherwise the would just use a VM. x86 Appleshit in a VM is still a thing, right??
>>108729940>x86 Appleshit in a VM is still a thing, right??I mean even hackintosh still sort of works, thing is macOS "That ho" is the final x86 version.
>>108729397What do you people fucking use local models for? Why do you need to buy up the entire supply of Mac minis and Mac Studios to run local models? What the fuck do you do all day?
>>108730346Look man I'm as bewildered as you. I've been looking a bit into these AI agents and I have no fucking idea what people even do with them that they spend some dollarydoos on hardware specifically for that purpose.I have to think that they earn a lot -that way-. I bet some of them make enough that a mac studio with 256GB of RAM is like a small investment
>>108730376It kind of seems like it's kind of similar to the 3d printing craze a while back in terms of what individuals are doing. Everyone wants the cool new tool but doesn't really know what to do with it, so they spend a bunch of money to create worthless trash. Just when 3d printing people would pump out stupid plastic garbage instead of stupid digital garbage, and its much easier to see stupid plastic garbage.
>>108729436Idiots seem to think so. I think that's dumb as fuck. I'd rather buy a cheap gaming PC from Walmart for the same money, but the fuck do I know? I'm not drinking the ARM kool aid and getting on the low power bandwagon. I'll deal with my electric bill being an extra $2 every month to use a machine I can repair and upgrade myself.
>>108729436I set up open claw on an ancient Dell laptop for the exact reason of keeping it away from any other operating system I care about. You can nuke it entire machine and I’m out with nothing. Why you would spend a bunch of money on a Mac mini do the same thing I have no idea. I’m currently working on setting up open claw on android TV box, lol.
>>108729406>You can run Qwen3.6-35B-A3B on itLiterally how with usable context size
>>108730741the m4 minis are being purchased by idiots who don't know better and can afford it. they're probably following some youtube video.
>>108729397yes, for maybe 3 times, got bored then sell it off
>>108731008True. I run openclaw just fine on a Dell I bought from ebay for $40 that has an old i7 and 8GB ram.
>>108731044To add to that, I use a free Google API key to call Gemma 4 31B and never run into any rate limit issues. I spend $0 on OpenClaw, and lots of people apparently spend thousands on it, it's hilarious.
>>108731056I'm still just playing around and I can't imagine actually paying for tokens at current prices. localllm is best. qwen 3.6 is better than gemma4
>>108731056>To add to that, I use a free Google API key to call Gemma 4 31BHow frequently does the usage reset? I run that model locally but it's a little too slow on my machine, so I'd much rather burn their money instead.
>>108731704There's no limit it seems, just can't hit it really fast in one minute.
>>108729397I just want a mini pc with thunderbolt 5 and upgradeable ram/ssd desu
Retards ran image boards off mac minis
>>108730346>>108730376Greg Kroah-Hartman (2nd only to linus himself) uses local models powered by a framework desktop an at AI-assisted bug-finding tool. Since April 7, close to two dozen patches have been merged into the mainline Linux kernel using the aforementioned tool.
>>108731044Yep. Unless youre running .ocal inference there's no reason to run anything more advanced than an ewaste tier machine.
>>108731044>>108734822So wait, if the mini is shit for LLMs so people use openclaw, but openclaw doesn't require a good machine anyways, what's the point?Is it le efficiency meme? is it that complicated to find a low TDP machine? too bulky?
>>108736041memory bandwidth
>>108736041> low TDPYou could run openclaw on a raspberry pi. I'll let you go look up current prices on those POS and see why I no longer recommend that. Even the chinese knockoffs like orange pi have gotten expensive (for what they are) and for hobby stuff I've been avoiding them. Shit like Openclaw deserves to run on the crummiest computer you can lay hands on given the completely insane new hardware market costs rn. Honestly I think it's just herd behavior and the apple stuff looks cool and looks appropriate. There is nothing cool about posting your ewaste machine on LinkedIn for your professional network, larping about how with it and efficient you are.
>>108732938comfy setup
>>108729397Of course not.How would that even work? It's completely underpowered.Don't believe the retarded crap some shitty Apple shill spams.
>>108736385lol I have that exact same keyboard I think. I thought it was Dell but flipped it over, and it's some generic Chinese thing. I've never seen Dell (or Verison) version of that screen, just the cheap chinese knockoffs.
>>108732938>Since April 7, close to two dozen patches have been merged into the mainline Linux kernel using the aforementioned tool.Bullshit.If you ask an AI: "here is the code, tell me if you find bugs", why would you only do that selectively at only two dozen patches? Why not on all of them? You just ask it for its opinion after all.Your wording also suggests that "this tool" merged it, which it didn't.Google runs a free tool to AI check linux patches as well.
>>108736385That's a 5000 dollarino machine with 128 GB of LPDDR5x. That is useful for running local models, a fucking mac mini is not.We are talking about two completely different worlds here.
>luddites seething about people spending couch change on a mini pc for fun/g/ - technologyi spent $4k on a hog hunting rifle last year
>>108732938This is false because I decided it is
>>108736601lol my cheap af Rem 783 30-06 kills hogs just fine and was under 400.
>>108736709And you can also sleep in the backseat of your $3k car instead of a proper houseway to miss the point
>>108730969he's lying