[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology

Name
Options
Comment
Verification
4chan Pass users can bypass this verification. [Learn More] [Login]
File
  • Please read the Rules and FAQ before posting.
  • You may highlight syntax and preserve whitespace by using [code] tags.

08/21/20New boards added: /vrpg/, /vmg/, /vst/ and /vm/
05/04/17New trial board added: /bant/ - International/Random
10/04/16New board for 4chan Pass users: /vip/ - Very Important Posts
[Hide] [Show All]


[Advertise on 4chan]


Best value gpu right here.
>>
>>109741953
>3090 having 50% more vram for the same price
oh no no no no
>>
>>109741953
Probably 9070xt
>>
>>109741968
>getting a slower and hotter gpu because muh vram
please don't tell me you actually do this
>>
>>109741992
>slower
the only reason to get a better gpu is for local ai, surely you're not playing modern goyslop games, right?
so having 50% more vram and thus loading more of the model into the gpu is gonna make it much faster, and the 3090 already has slightly faster memory bandwidth.
>>
>>109741992
the connector on the 5070ti gets way hotter
>>
>>109742003
>ai
>local ai
mother of all memes
>>
>>109742040
yes little goy, i actually do coding work with local ai and dont use my gpu to listen to UE5 leftshit black woman cinematic lectures.
>>
>>109741953
That would be the 9070 XT. The 5070ti is expensive and you won't need the proprietary features.
>>
>>109742048
You can do AI with the 9070XT. It's not an excuse anymore. AMD fixed their shit very quickly somehow.
>>
>>109742067
lol. lmao even. search the archives of lmg/ldg for AMD and see how good it is.
>>
>>109742067
AMD got supported a lot better for ai workloads, but even if and when it gets better it will not get on par with nvidia simply because now everyone that does ai does it on nvidia and so new developments happen there first..
Don't get me wrong: I want nothing more than buying a gpu with more vram for less dollars..
>>
>>109742086
That's cool but if you can't deal with a bit of problems you shouldn't be doing AI in the first place.

>>109742075
Works for engineers.
>>
>>109742075
i use a 7900XTX; pytorch is the backing for 95% of local inference stuff and they got properly sorted for AMD backends. glm 5.3 flash can set up anything using pytorch like comfyui or forge for your specific GPU and ROCm version if you're too dum to into venv
>>
3090 sisters we're losing
not like this...
>>
>>109741953
buy an ad
>>
>>109741953
Just buy a fucking RTX 5080 and stop fucking around. RTX 5090 was extremely expensive last time I checked.
>>
>>109742067
>16gb vram vs 24gb 3090
>640gb/s vs 940gb/s 3090 memory bandwidth
>>
>>109742125
Some 5080s were pretty "cheap" recently, I got a nice PNY one on sale for roughly Founders MSRP, cheaper than 5070Tis...
>>
>>109742097
What are your Qwen 3.8 27b numbers amdchad?
>>
you need a blackwell 6000
>>
>>109742003
>Local AI
The 24gb vs 16gb will go a longer way desu
>>
File: images (2).jpg (9 KB, 259x194)
9 KB JPG
>>109741953
>Best value gpu right here.
ftfy
>>
>>109742173
3.7 tokens/sec. AMD won.
>>
>>109742173
24GB isn't really enough for qwen 27b in the first place, you should really sub to opencode go or openai plus or pro. my local GPU work is blender rendering and training smol neural networks w/ pytorch



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.