[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
▼ Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: images (1).jpg (25 KB, 608x504)
25 KB JPG
how do I make offline AI?

how much memory is required?

what model to download from hugginface?

(I am already running locally an old chat AI but its no programmer)
>>
DON'T use SI

That shit will rot your brain
>>
>>110295393
are local models SI
>>
>>110295393
I'm pretty anti-AI but I would use it for code review on my personal projects. It would not be allowed to touch the code, only point out mistakes and make suggestions. I would not trust anything it says. Basically I'd treat it like a very junior dev who might make a valid point once in a blue moon.
>>
>>110295371
Local AI models suck for programming. Don't bother.
>>
ask ai
>>
>>110295559
AI hands typed this post.
>>
>>110295371
AI puts more errors in my code than not.

>if you tell me what you're using this for I can generate a more precise rendition
>spend 30 minutes going back and forth, explaining what I want
>would take me only 10 minutes to write it myself
>>
>>110295371
well you could spend $30k on your own personal datacenter, or you could spend $5 on a programming manual
>>
>>110295371
>how much memory is required?
96GB of video RAM is considered the starting point. if thats too hot for you than get out of the kitchen
>>
>>110295371
just use claude
what you want requires tens of thousands of dollars in hardware



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.