/g/ - Why can't a SDD or HDD be used as a RAM alternativ - Technology

Anonymous

07/06/26(Mon)09:52:44 No.109212322

File: 1681831722897491.jpg (86 KB, 680x649)

Anonymous 07/06/26(Mon)09:52:44 No.109212322 Archived

Why can't a SDD or HDD be used as a RAM alternative for LLM and AI models?

Anonymous
07/06/26(Mon)09:53:23 No.109212329

Anonymous 07/06/26(Mon)09:53:23 No.109212329

it can, its just way way slower

Anonymous
07/06/26(Mon)09:54:20 No.109212337

Anonymous 07/06/26(Mon)09:54:20 No.109212337

File: 1756831295936937.png (626 KB, 640x784)

>>109212322
ARIGATO SAMURAI-SAN

Anonymous
07/06/26(Mon)09:54:45 No.109212339

Anonymous 07/06/26(Mon)09:54:45 No.109212339

>>109212322
You discovered swap.

Anonymous
07/06/26(Mon)10:03:53 No.109212390

Anonymous 07/06/26(Mon)10:03:53 No.109212390

>>109212329
well this was a fun thread

Anonymous
07/06/26(Mon)10:05:39 No.109212397

Anonymous 07/06/26(Mon)10:05:39 No.109212397

>>109212322
average /g/ poster

Anonymous
07/06/26(Mon)10:08:48 No.109212414

Anonymous 07/06/26(Mon)10:08:48 No.109212414

>>109212322
[spoiler]They're buying all those up too.[/spoiler]

Anonymous
07/06/26(Mon)11:15:04 No.109212787

Anonymous 07/06/26(Mon)11:15:04 No.109212787

>>109212322
Why can't you just Google this instead of ahitting up the board

Anonymous
07/06/26(Mon)11:51:07 No.109213049

Anonymous 07/06/26(Mon)11:51:07 No.109213049

>>109212322
It could, but only if it's really fast. Intel optane is actually fast enough to do some llm stuff.

Anonymous
07/06/26(Mon)11:51:28 No.109213053

Anonymous 07/06/26(Mon)11:51:28 No.109213053

maybe pc3200 is six times faster than sata ssd

Anonymous
07/06/26(Mon)12:03:05 No.109213140

Anonymous 07/06/26(Mon)12:03:05 No.109213140

SSDs and HDDs are best reserved for XXLLMs.
Forget about LLMs. XXLLMs streamed from disk is where it's at.