>$CURRENT_DATE>I am forgottenname a biggest nothing burger for current year2 months in and still no non buggy piece of shit implementation aside from internal google datacentersmemory stock and ram prices has completely rebounded and more
turbo quant sounds like something you call a sped in high school
>>108798066>australian guy describing a terrific woman
>>108798052it just wasnt the win we wanted it to be. it only lowers context memory usage, the entire model still needs to fit inside memory.
>>108798120just being able to fit full context within the very last gbs, without all the massive compromises involved would have been a huge win
>>108798052well, the real issue is that in real world testing turboquant falls below performance of the existing kv quant techniques. it was a complete nothingburger.