how do I make offline AI?how much memory is required?what model to download from hugginface?(I am already running locally an old chat AI but its no programmer)
DON'T use SIThat shit will rot your brain
>>110295393are local models SI
>>110295393I'm pretty anti-AI but I would use it for code review on my personal projects. It would not be allowed to touch the code, only point out mistakes and make suggestions. I would not trust anything it says. Basically I'd treat it like a very junior dev who might make a valid point once in a blue moon.
>>110295371Local AI models suck for programming. Don't bother.
ask ai
>>110295559AI hands typed this post.
>>110295371AI puts more errors in my code than not.>if you tell me what you're using this for I can generate a more precise rendition>spend 30 minutes going back and forth, explaining what I want>would take me only 10 minutes to write it myself
>>110295371well you could spend $30k on your own personal datacenter, or you could spend $5 on a programming manual
>>110295371>how much memory is required?96GB of video RAM is considered the starting point. if thats too hot for you than get out of the kitchen
>>110295371just use claude what you want requires tens of thousands of dollars in hardware