[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: m4 mac mini.jpg (442 KB, 2400x1600)
442 KB JPG
Do people really actually legitimately use the base mac mini (16GB) to run local models?
>>
You can run Qwen3.6-35B-A3B on it but I think most of the hype around le Openclaw was people actually buying these so that the agent wouldn't blow their own daily driver OS the fuck out
>>
>>108729406
>actually buying these so that the agent wouldn't blow their own daily driver OS the fuck out
Is it even worth doing that?
>>
>>108729436
I hear they’re backordered to hell because world+dog is doing just that
but I wouldn’t run OpenClaw, and if I did, I wouldn’t run it on my real machine
>>
>>108729397
Nobody uses them for local models, people use them as a hub for openclaw because it lets you send sms n shit (unlike winblows and loonix)
>>
>>108729406
For sandbox. Not OS.
>>
>>108729515
So this is for iPhone users?
>>
>>108729532
Are android phones not capable of sending text messages and making phone calls?
>>
>>108729544
Yeah, but when you mention wangblows and linux can't do that I assume you're talking about apple messages
Actually I have no idea what this means
>>
>>108729554
Ah fair enough I misunderstood. Yeah iphone is needed if you want full phone connectivity. But macs are great for a variety if reasons: they’re small, silent, use fuck all energy (matters if you run it all day), have built in integration with a lot of services and protocols like home automation etc. Most of it can work on a winblows or linux computer but it’d be a huge ballache you’re better off spending a few greenbacks and skip all the nonsense.
>>
>>108729397
I am guessing they use these shits because they want to send imessages and other Apple crap from their openclaw agent, right? Otherwise the would just use a VM.
x86 Appleshit in a VM is still a thing, right??
>>
>>108729940
>x86 Appleshit in a VM is still a thing, right??
I mean even hackintosh still sort of works, thing is macOS "That ho" is the final x86 version.
>>
>>108729397
What do you people fucking use local models for? Why do you need to buy up the entire supply of Mac minis and Mac Studios to run local models? What the fuck do you do all day?
>>
>>108730346
Look man I'm as bewildered as you. I've been looking a bit into these AI agents and I have no fucking idea what people even do with them that they spend some dollarydoos on hardware specifically for that purpose.
I have to think that they earn a lot -that way-. I bet some of them make enough that a mac studio with 256GB of RAM is like a small investment
>>
>>108730376
It kind of seems like it's kind of similar to the 3d printing craze a while back in terms of what individuals are doing. Everyone wants the cool new tool but doesn't really know what to do with it, so they spend a bunch of money to create worthless trash.

Just when 3d printing people would pump out stupid plastic garbage instead of stupid digital garbage, and its much easier to see stupid plastic garbage.
>>
>>108729436
Idiots seem to think so. I think that's dumb as fuck. I'd rather buy a cheap gaming PC from Walmart for the same money, but the fuck do I know? I'm not drinking the ARM kool aid and getting on the low power bandwagon. I'll deal with my electric bill being an extra $2 every month to use a machine I can repair and upgrade myself.
>>
>>108729436
I set up open claw on an ancient Dell laptop for the exact reason of keeping it away from any other operating system I care about. You can nuke it entire machine and I’m out with nothing. Why you would spend a bunch of money on a Mac mini do the same thing I have no idea. I’m currently working on setting up open claw on android TV box, lol.
>>
>>108729406
>You can run Qwen3.6-35B-A3B on it
Literally how with usable context size
>>
>>108730741
the m4 minis are being purchased by idiots who don't know better and can afford it. they're probably following some youtube video.
>>
>>108729397
yes, for maybe 3 times, got bored then sell it off
>>
>>108731008
True. I run openclaw just fine on a Dell I bought from ebay for $40 that has an old i7 and 8GB ram.
>>
>>108731044
To add to that, I use a free Google API key to call Gemma 4 31B and never run into any rate limit issues. I spend $0 on OpenClaw, and lots of people apparently spend thousands on it, it's hilarious.
>>
File: 1753449159585606.png (79 KB, 1724x938)
79 KB PNG
>>108731056
I'm still just playing around and I can't imagine actually paying for tokens at current prices. localllm is best. qwen 3.6 is better than gemma4
>>
>>108731056
>To add to that, I use a free Google API key to call Gemma 4 31B
How frequently does the usage reset? I run that model locally but it's a little too slow on my machine, so I'd much rather burn their money instead.
>>
>>108731704
There's no limit it seems, just can't hit it really fast in one minute.
>>
>>108729397
I just want a mini pc with thunderbolt 5 and upgradeable ram/ssd desu
>>
Retards ran image boards off mac minis
>>
>>108730346
>>108730376

Greg Kroah-Hartman (2nd only to linus himself) uses local models powered by a framework desktop an at AI-assisted bug-finding tool. Since April 7, close to two dozen patches have been merged into the mainline Linux kernel using the aforementioned tool.
>>
>>108731044
Yep. Unless youre running .ocal inference there's no reason to run anything more advanced than an ewaste tier machine.
>>
>>108731044
>>108734822
So wait, if the mini is shit for LLMs so people use openclaw, but openclaw doesn't require a good machine anyways, what's the point?
Is it le efficiency meme? is it that complicated to find a low TDP machine? too bulky?
>>
>>108736041
memory bandwidth
>>
>>108736041
> low TDP
You could run openclaw on a raspberry pi.
I'll let you go look up current prices on those POS and see why I no longer recommend that. Even the chinese knockoffs like orange pi have gotten expensive (for what they are) and for hobby stuff I've been avoiding them.
Shit like Openclaw deserves to run on the crummiest computer you can lay hands on given the completely insane new hardware market costs rn.
Honestly I think it's just herd behavior and the apple stuff looks cool and looks appropriate. There is nothing cool about posting your ewaste machine on LinkedIn for your professional network, larping about how with it and efficient you are.
>>
File: file.png (863 KB, 970x546)
863 KB PNG
>>108732938
comfy setup
>>
>>108729397
Of course not.
How would that even work? It's completely underpowered.
Don't believe the retarded crap some shitty Apple shill spams.
>>
>>108736385
lol I have that exact same keyboard I think. I thought it was Dell but flipped it over, and it's some generic Chinese thing.
I've never seen Dell (or Verison) version of that screen, just the cheap chinese knockoffs.
>>
>>108732938
>Since April 7, close to two dozen patches have been merged into the mainline Linux kernel using the aforementioned tool.
Bullshit.
If you ask an AI: "here is the code, tell me if you find bugs", why would you only do that selectively at only two dozen patches? Why not on all of them? You just ask it for its opinion after all.
Your wording also suggests that "this tool" merged it, which it didn't.
Google runs a free tool to AI check linux patches as well.
>>
>>108736385
That's a 5000 dollarino machine with 128 GB of LPDDR5x. That is useful for running local models, a fucking mac mini is not.
We are talking about two completely different worlds here.
>>
>luddites seething about people spending couch change on a mini pc for fun
/g/ - technology
i spent $4k on a hog hunting rifle last year
>>
>>108732938
This is false because I decided it is
>>
>>108736601
lol my cheap af Rem 783 30-06 kills hogs just fine and was under 400.
>>
>>108736709
And you can also sleep in the backseat of your $3k car instead of a proper house
way to miss the point
>>
>>108730969
he's lying



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.