[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology

Name
Options
Comment
Verification
4chan Pass users can bypass this verification. [Learn More] [Login]
File
  • Please read the Rules and FAQ before posting.
  • You may highlight syntax and preserve whitespace by using [code] tags.

08/21/20New boards added: /vrpg/, /vmg/, /vst/ and /vm/
05/04/17New trial board added: /bant/ - International/Random
10/04/16New board for 4chan Pass users: /vip/ - Very Important Posts
[Hide] [Show All]


[Advertise on 4chan]


File: 1750436862521055.png (204 KB, 614x615)
204 KB PNG
So It seems AMD will sell gpus with flashed LLM as ROM.

https://www.servethehome.com/amd-to-acquire-taalas-for-model-specific-ai-inference-chips/
>>
>>109638536
Use case for hardware that gets obsolete after 2 months?
>>
File: 1601322880054.jpg (18 KB, 344x342)
18 KB JPG
>>109638598
It will cost 100 usd to replace the chip, rather than 5k per nvidicuck shit.
>>
>>109638610
It will likely cost more than you make in an entire decade. They're going to be low volume runs, and likely each system will have to be rack-scale to support models big enough to be useful.
>>
File: 1695762628624265.jpg (25 KB, 988x558)
25 KB JPG
>>109638690
>Making a LLM into a physical chip requires more tech than building a 5090 RTX
ok
>>
>>109638610
The best this shit can run right now is llama 3.1 8B. If this ever goes somewhere and you seriously believe AMD won't milk it to kingdom come you need to be put down and your surviving family members forcibly sterilized to prevent any further mishaps.
>>
File: 1703107821055012.png (458 KB, 659x642)
458 KB PNG
>>109638737
>It can't improve chud
It only need to load DeepSeek 4 and I'll buy it.
>>
>>109638750
Nigger if this improves there are ZERO reasons not to price it 0.01$ beneath whatever HXXX generation Nvidia offers by that point assuming either company will still be relevant by that point.



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.