Why can't a SDD or HDD be used as a RAM alternative for LLM and AI models?
it can, its just way way slower
>>109212322ARIGATO SAMURAI-SAN
>>109212322You discovered swap.
>>109212329well this was a fun thread
>>109212322average /g/ poster
>>109212322[spoiler]They're buying all those up too.[/spoiler]
>>109212322Why can't you just Google this instead of ahitting up the board
>>109212322It could, but only if it's really fast. Intel optane is actually fast enough to do some llm stuff.
maybe pc3200 is six times faster than sata ssd
SSDs and HDDs are best reserved for XXLLMs.Forget about LLMs. XXLLMs streamed from disk is where it's at.
