[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / r / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
Settings Mobile Home
/g/ - Technology


Thread archived.
You cannot reply anymore.


[Advertise on 4chan]


File: ai-vision.jpg (215 KB, 989x828)
215 KB
215 KB JPG
do you have executable AI:s?

I do have an llama.exe, it doesnt need an internet.
You put it into Windows 10 which has never been and never will be, connected to internet.

And then you run AI stuff with it.

AI must be sent a text prompt before it does anything.

I was wondering if there are a lot more of models like this. I just dont feel like connecting to internet.
>>
>>108189886
ollama if you want just api
lmstudio if you want usable client and also option for API as well

then download the model from the internet, and run them offline
>>
This is how every local model works
>>
File: ollama.jpg (105 KB, 863x636)
105 KB
105 KB JPG
>>108190062
>>108189893
how do I download a model into it ??

I downloaded ollama setup like this:

>using windows XP SP3, Pentium 2, 1024MB RAM, Supermium Browser from 2026

The windows 10 computer is physcally incapable of accessing internet. But it has better hardware for AI.
>>
>>108190105
Go here https://ollama.com/
look for the model name and variant you want, it will tell you what to provide to
ollama pull
like if you see `ollama run qwen3.5:cloud` do `ollama pull qwen3.5:cloud`.
>>
>>108190105
What does that give you? 1 token per minute?
>>
>>108190141
no idea until I get to try it
>>
>>108189886
Download koboldcpp
Go to huggingface
Download Mistral Nemo GGUF. Get the one that's smaller than your VRAM - 1gb or so.
I'm running llama.cpp with Qwen Next and Qwen Coder Next for some stuff.
Yes, including cooming. It's pretty fun.
Am yet to fuck around with image models though.



[Advertise on 4chan]

Delete Post: [File Only] Style:
[Disable Mobile View / Use Desktop Site]

[Enable Mobile View / Use Mobile Site]

All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.