[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: 1761037121339877.jpg (237 KB, 1600x2048)
237 KB
237 KB JPG
How do I run local AI models if I can't buy RAM?
>>
>>108185441
you don't
>>
good post
>>
The same pathetic no-initiative slob mentality that made you an unsuccessful virgin loser is now squeezing you out of the only hobby/"life" you have ever known lmao.
>>
>>108185441
How do I eat ice cream on the sun?
>>
You had multiple chances for around 2 years now, if you didn't get you piece now, welp.
>>
>>108185441
You pay the datacenters to rent gpu time and own nothing.
Until the bubble pops that is.
>>
>>108186432
very carefully
>>
>>108185441
that's the point
>>
>>108185441
Why do you think they're buying up all the RAM supply?
>>
File: 1635943572848.jpg (42 KB, 765x637)
42 KB
42 KB JPG
>>108185441
>he didn't boughted 128 GiB of RAM when it was dirt cheapo
>>
>>108185441
get a job so you can buy ram
>>
>>108186432
I prefer to eat ice cream on Earth
>>
>>108185441
You don't. Get a new hobby.
Personally I like to pretend it's 1995 and Windows 95 just came out. I read period-appropriate books and articles, with 86box emulating a Pentium 90mhz.
Poorfags gotta poorfag.
>>
File: 1767106690333321.jpg (184 KB, 960x720)
184 KB
184 KB JPG
>>108185441
you can buy some tesla v100's from ebay. you can find both the 16gb and the 32gb for sale and the Chinese also make the smx2 to pcie adapters you will need.
If you go the 32gb route you can get the adapter, gpu, and heatsink + fan for like $700, much cheaper for the 16gb but really for the price/performance its a bargain at both levels.

What, are you telling me you don't trust dataceenter e-wate + custom adapters + custom heatsink and fan? You need to relax and live a little. Transforming e-waste into a usable computer is fun
>>
>>108188497
absolutely terribad speed for the money
>>
>>108185441
You run them on your GPU instead of on the RAM. You do have a GPU don't you Anon?

>>108186955
For once in my goddamn miserable loser virgin life I actually did one thing right and bought 128 GiB of RAM at 315 EUR back in fall of 2025. That same RAM is now over 1200 EUR on Amazon.
>>
>>108188586
it is plenty considering a rtx 5090 will run you $3600+ new
for fractions you are getting a usable experience
>but it is not generating faster than i can read
deal with it or miracle up a few thousand dollars
>>
>>108188497
>the Chinese also make the smx2 to pcie adapters you will need.
How to start a house fire: the post.
>>
>>108188684
$700 is/was in the range of a 5070Ti, this frankenstein'd card is slower than a GTX 1070 though
>>
>>108188730
but it has more vram! in the few things that support such an old arch (for now) anyway
>>
>>108185441
sayuringo eroi!!!!
>>
>>108188764
Oh I'll give her ressun alright
>>
>lust provoking image
>time wasting question
>>
>>108186955
>128 GiB
Wrong unit, RAM is sold in GB
>>
>>108185441
this is when you nvmemaxx and alllocate 200GB of swap space to inference a 128-MoE model at 29s/tok



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.