Plugging SSD into GPU to give it more VRAMwhy can't I do this? why haven't they made a gpu that can do this? I don't care that the ssd is slower, it's still flash memory. it's still really fast.
>>108739249ssds inclusing nvmes are an order of magnitude slower than regular ram
>>108739256yeah but if the whole point is to store immense amounts of data in a memory so the gpu can access it extremely fast it should still be plenty fast when plugged directly into the gpu vs motherboard > operating system
>>108739249because you dont own radeon pro
>>108739249It's extremely slow. Some NVMe SSD can do like a few GB/s and even that only in purely sequential workloads. On the GPU side a 4090 is over 1 TB/s, a 5090 is like 1.8 TB/s. SSDs aren't even anywhere close, a drop in the ocean even in terms of bandwidth, let alone latency.SSDs are just gigaslow in comparison, no real point.
>>108739272ask your AIB guy to make you a card with DIMM slots
>>108739249You don't really understand how much slower it is and how much more latency it has.
>>108739249what a disgusting creature it should be put down; oh and pic is gross too
>>108739249you can. offload part of the model to system memory and set up however much swap you want. your concerns about this going through the operating system are unwarranted because the bottleneck will be the speed of the ssd itself.
>>108739272>it should still be plenty fastHow the fuck would you know? show us your calculations, we'll wait
>>108739249You don't even have to plug it in, because your computer can already do this with GTT and swap
>>108739753well my ssd runs pretty fast in my computer and the ssd is plugged into the motherboardso itwould run pretty fast on the gpu too
