I genuinely believe big ai corpos made deals behind the scenes to keep the models as bloated as physically possible. There is no reason for model weights to be in the hundreds of gb. It has been PROVEN and DEMONSTRATED that you can fit 27b models in 6.8gb size (not just model weight but everything included to run it) with ternary architecture while maintaining near 90% of the performance. There is not GOD DAMN REASON to use floating point bullshit anymore to shit up free space. If the big corpos just made everything as efficient as that then every schmuck willing to spend 1k on a graphics card with 24 gb vram could run a 100b model all on their own and there wouldn't be a dime of revenue, let alone profit, for the greedy corpos.
