File: intel.jpg (259 KB, 2500x1313)

259 KB JPG

anyone host their own AI stack and actually use it and not fall back on big corp AI? talking about dedicated AI server box and not just your gaming desktop.

what's your hardware setup? what do you use it for?

Meganoob here
I host a bunch of webapps from my PC to a website hosted on cloudflare

I've set it up on the CF Console so that it doesn't allow anyone in save for my Google account. I've tried other accounts and saw it was blocking it.
Still, idk if that's enough safety to keep baddies out. I don't want to get pwned.

Mailserver without relay with 3rd party provider? I want to build one with vps just doing the port forward and TLS terminate at my local server, but most vps block port 25, and risk of IP got blacklists

>>110098158
you're 100% going to be auto blocked by all major mailservers for spam

>>110097219
yes I do.
I use it for troubleshooting and settiing stuff up. that's about it. making agentic is pointless, imho

>>110098309
Nah, requesting to open the port 25 doesn't help? I was planning to run an instance on hetzner because I heard that their port 25 might not get blocked by other mailservers.
Seem to go with relay. Thank you

>>110099043
are you fucking dumb
piss off back to your ai porn slop

>>110099043
FYI, this guy is an anti AI schizo who is spamming our thread in the hopes someone will take down /ldg/. He is not one of us. Please ignore him.

>>110099180
He did it to the phone thread as well

>>110097219
Yes, although this isn't really the thread for it.

>what's your hardware setup?
Sparks (from before they doubled in price) and Hermes on the server I already have. Sparks are really nice if you care about idle wattage. They're fast enough for personal use and the scalability is a nice feature.

>what do you use it for?
Just Hermes, which covers everything I need right now. I've used it to finish so many backlogged personal projects, like organizing and deduping my ROM collection, or building a homelab monitor with Uptime Kuma and ntfy. Pretty much all learning and hobby, not work (although I've used a lot of what I've learned at work already). Its worth the cost for the privacy and ownership.

>>110097171
I'm wanting to share some self hosted stuff with family members that aren't going to be able to set up wireguard on their own and I don't really want to give them unrestricted access to my network. I looked into pangolin to reverse proxy them because people keep saying how good it is online but nearly every guide says you need to run it on a vps or the big scary boogeyman is going to gape my asshole and that if you're running it locally you're doing it wrong.

Is there a better solution? Should I just use a regular reverse proxy?

>>110097171
do you guys keep online backups? which service do you use?

>>110097219
No. I just use my Mac.

>>110100516
I use Backblaze personal backup.

>>110100516
no im not gay

>>110099263
>Yes, although this isn't really the thread for it.
Hosting your own AI is a service just like running your own plex or file server. Just because it's a meme right now doesn't mean it doesn't involve some homelab skills to make it secure and optimized

>>110100516
>intentionally giving away your data
miss me with that. i have a backup nas at my dad's house. i set him up so he has his own dataset for his stuff and also pihole (for his network).

>>110099439
really the only risk for self hosting is getting ddos'd if you understand how to set up a firewall, have everything behind a password and keep everything updated. also keep your internet facing servers on their own vlan. a vps just gives you an extra layer of protection, it's not needed. you can still get pwned if your vps gets pwned

>>110097219
I've posted about it before but I run two Ubuntu VM's and an Opnsense VM on my Proxmox host. One for Ollama, which has a 5090 passed through running qwen 3.8 27b and the other behind the Opnsense firewall running a Hermes agent.

I haven't really found a life changing use for it yet though, mostly just use it for a chatbot for troubleshooting log files and light internet research.

>>110099439
In your shoes, if you're not comfortable with reverse proxying, I'd get them to download Tailscale, login with their email, invite them to your tailnet, and then set up a whitelist so that group:familymembers can only access serverip:8096 or whatever.

>>110103263
>Just because it's a meme right now
That's not it, it's because there's already a dedicated thread for local AI setups >>>/g/lmg

>>110103544
>>CROSS TOPIC POSTS ARE STRICTLY NOT ALLOWED!BANNED!

ok you reddit-ass mod
fuck off

File: IMG_6648.jpg (164 KB, 626x640)

164 KB JPG

I don’t understand the point of proxmox or why it’s pushed so heavily by youtubers when there’s kubernetes/docker

File: Pan.jpg (225 KB, 1000x821)

225 KB JPG

>>110104016
Different use case, Proxmox can replace VMware now that Broadcom killed it.

>>110104016
proxmox is a hypervisor for running multiple OS's. you cant do that with kubernetes/docker.

>>110100516
It would be too expensive. I have like 300tb of data. having that stored encrypted in a cloud would be a nightmare

>>110104016
You can run containers directly on Proxmox as well as VMs

>>110104362
>>110104268
I don’t really see the point of running multiple OSs inside VMs when I’m probably just going to put linux on all of them.
Do you guys have it booting windows to your monitor and then have something like TrueNAS in a separate VM on the same machine?
I could see the point of something like linux / windows / xpenology off the same machine instead of getting multiple machines.
Are any of you guys using proxmox? If so, why / what kind of setup?

>>110104362
>>110105193
how much of that is boomer php apps to run all over the file system and was coupled with everything?
I literally don't need more than docker, though I don't port forward because I don't trust docker's security.

>>110105500
boomer php apps should be able to be docker-ized tho, so even that doesn’t seem like an excuse imo
although perhaps I’m clueless as to just how fucking crazy those php apps could get

File: Screenshot.png (146 KB, 760x776)

146 KB PNG

Check your plex servers anons

>>110106806
apparently a fix was already added 2 months ago, so it's not a problem as long as plex is up to date

>>110106806
Lmao at plexoits

>>110106806
ffs
I literally just installed plex for the first time yesterday on my synology that I just bought off ebay

File: hello.png (85 KB, 1962x542)

85 KB PNG

>3 minutes for this
I am gonna have to restart my 20 shekel subscription

>>110107962
Qwen is great at overthinking.

can i use an early macbook air 2014 for anything decent or don't bother?

>>110108554
pretty sure those don’t have apple silicon chips, so to my understanding, you’re just getting an intel chip with however much RAM like all the other laptops from that era

File: 1775919567294495.png (13 KB, 610x156)

13 KB PNG

it's over...

Is there any simple way besides wireguard/openvpn to be able to access your home lan when away while keeping your services completely walled off from public internet access to prevent attacks and spam? I currently use tailscale and it works well but it's very slow, even between devices on my home network things like data transfers are many times slower than with tailscale off, and when out and about trying to stream even just a 10-15 mbps video via jellyfin results in a ton of stuttering from slow buffering despite having gigabit symmetrical fiber at home, usually no less than 50-100mbps on my mobile network, and the devices having a direct connection (no relaying).

>>110097219
I went from a 5090 to a pro 6000 and then bought a second one. The bigger the model, the more capable it is and I've seen that first-hand. Still dog shit compared to cloud models, but they can still do some nice general work like web search, installation, file management, light troubleshooting, log summary etc.

>>110108554
you should learn to flip your shit and swap it for whatever you need. like i got a bunch of ram recently from a local guy because his gpu died and i had a 1060 around i didnt need, and literally his ad was the first thing i seen when logging into facebook market after two years.

File: 1792396395111.jpg (186 KB, 903x730)

186 KB JPG

Buying RAM in 2026 be like

File: umineko;natsuhi;reaction image.jpg (29 KB, 516x455)

29 KB JPG

>lay out cat6 cables
>punch down cat6 keystones
>tester shows all 8 wires as connected
>occasionally device on one side negociates to 1G, while the other negociates to 100M, preventing all communication
what the hell is this.
I've checked different cables and devices, the same problem still occurs, setting manual to 1G doesn't help either, as it can't always link to that speed, something must be wrong with keystones then? I tried repunching them on both sides, didn't help.
This is my first time doing this, but I suspect the chink punch down tool and keystones.
I've already had a similar problem with chink RJ45 crimping tool not making a good crimp, bought Knipex one and never had this problem again.
I'll probably buy a genuine Knipex punch down tool and some good brand-name keystones, you can't trust chinks with anything.

File: hmm.jpg (71 KB, 1200x700)

71 KB JPG

>>110109934
>tester shows all 8 wires
what kind of tester

File: tester.jpg (557 KB, 1600x1600)

557 KB JPG

>>110109944
a chink one like this, so it's probably lying to me as well

>>110108416
it got stuck in a loop once
>>110107962
it's not terrible anymore, the webui had retarded settings on by default that rape your cache. Also tuning it a bit now I get 27t/s. The 40k context windows is shit though. But it's cool, I can now do devious stuff on my own computer

>>110111550
>>110109014
hello AI frens can you guys recommend me a android client\app for local LAN Ollama models?

I'm THIS close to dropping like $2700 on ram
Thought I got a decent deal at $7/GB but it turned out to be a scam. Cheapest genuine place I found was $11/GB

>>110108931
>tailscale
you made an account to use it?

>>110108931
No.

I upgraded to openwrt 25 today
(I was on 18)

>>110109133
i don't use facebook that's for normie freaks

Elfs are gay
Anime and traps are gay
Jews did 911 and rape kids
Your tranny porn nas is not a server

File: patchpanel.png (1.33 MB, 1210x681)

1.33 MB PNG

>>110109934
>Punchdowns
Hearty kek
Pic related makes so much more sense and is simpler.
Especially if you have to move a line

>>110111782
>$2700 on ram
What would that ram let you do that you can't do now?
Running MoE LLMs? Would it run fast enough fo you to use?

File: 71DJbyI8LCL.jpg (216 KB, 2560x2560)

216 KB JPG

I want to setup a networking box in my house like pic related. If I just want to do some cable runs to some outlets to connect up some machines and some access points, what networking equipment do I need? I know I need my modem and a PoE switch of some kind. Should I get a managed or unmanaged switch? I keep reading things about gateways, do I need to worry about those? I don't really want to get fleeced and buy shit I don't need.

>>110112916
>what equipment i need?
- cable
- patch panel
- labels on your sockets
- managed network switch (for vlans)
with at least 2.5Gbps or 5Gbps
and with poe+ or poe++ (if security cameras or wifi access points)

>>110113036
>Labels on your sockets
I bet you label your breaker box too, cuck

>>110097219
i'd probably want to spin up the models in cloud first and see how they compare to the big cloud models.
I stuffed an old 2070 in my home server and span up ollama/openwebui and the 8b models are mad dumb.
27b models can fit on a lot of consumer hardware but not sure how capable it'd be.

>>110113097
I bet you haven't vacuumed your house in years.

>cuck
That's my name, don't wear it out.

>>110113127
>27b models
>how capable
Coding, apparently.

>>110111681
i dunno i just used open webui on browser for testing

>>110111911
Yes
>>110112067
Damn

File: Screenshot_20261019-17433(...).png (1.22 MB, 1080x792)

1.22 MB PNG

For the last five years I have lived in the bush very far away from the road and had a docsis internet connection with signal issues because the run to my house is too long for docsis so Rogers says it never should have been installed in the first place .
This causes a few problems like packet blackouts that last 1-4 seconds and make online games , voip and video calls impossible .
Complete loss of connection that can last 3-48 hours and happen at least 3 times a year.
Worst of all retard fob rogers third party contractors loitering on my property like its a club house while fixing nothing .

This should all end now though .
I've moved the modem outside so I can connect it directly to the cable coming out of the ground . This eliminates 30-40 ft of coax cable run along and inside my house but also it removes an amplifier Rogers had installed when they first tried to fix the issue .

Nothing but steady pings now and can finally play CS after half a decade of shit connection

>>110115113
Reminds me of when I lived in Alaska, the house I rented didn't have internet but the landlord's shop about 30 ft away did. I called the cable company (gci, the single most greedy asshole isp in the country and it's not even close, spectrum and time warner and the rest have nothing on them) seeing about getting them to extend the line but they wanted me to cover the FULL cost of connecting, laying and burying the extension which was several thousand dollars just for the privilege of paying them like $200 a month for 50mbps and 500gb data. I told them to go suck every dick they could find and once they ran out of dicks to start over from the beginning. I instead made a deal with the landlord to bump up his plan to the best they had which was like 200 mbps and 1tb data and we would split it 50/50, and I had him string an ethernet cable across the roofs for my router. Worked great for the two years I lived there, but god I wish starlink was a thing back then so I didn't have to give those jews any money, even indirectly.

comfy thread

>>110097219
I use distributed inference via ROCm/RoCEv2 with llama.cpp. I have 2 computers with some old connectx4 wired together (don't worry they have 40mm fans on them). Turn out this shit works just fine on gen 4 AMD cards, so my 7800xt and 7900xtx act like one great big vram pool. and because the interface is 25G, it's fast enough to let me run shit like Qwen or Gemma dense at 30-50t/s, and nearly 100 with MoE models.

>>110097171
>imagine sliding in your extra length rack rails in there

>>110115446
I almost did the same thing since my uncle owns a house in a subdivision that borders my property and his house is only like 100m away.
I was gonna cut down a bunch of trees to get line of sight and do point to point WiFi bridge but my uncle is a direct Rogers costumer instead of using a reseller so he has to use a rogers the awful modem/router/WiFi combo with NAT and I just couldn't give up my bridge mode modem for hosting stuff at home

>>110113036
Thanks. Any recommendations for the switch and access points? Am I opening myself up to threats if I buy a TP link switch and APs and they decide to stop updating them?

>>110115096
>Yes
faggot

>>110115113
I have the same shitty modem. My internet stops working randomly every ~2 months and I have to power cycle it

what did you change with your setup, exactly? I can't tell from your post

>>110116193
Instead of having an amplifier boost the docsis signal where the cable comes up at my house then having it run along my house and into my server room I brought my modem outside so it doesn't need a noisey amplifier or extra cable run to lose signal .
then I have a cat 6a cable that powers and connects the modem to my server inside the house .

I did this to fix a poor signal issue that would stop my internet completely regardless of reboots so it probably won't fix your issue.

>>110116257
Okay, thank you for spelling that out. I appreciate it. And yes, you're right. That will not fix my issue because my modem is two meters away from the internet box.

>>110116170
:(

>>110116752
I don't want you taken advantage of. Don't sign up for encryption services. That's faggotry

>>110108931
For web stuff, you can have a reverse proxy that enforces SSO. It is "open to the public", but it's an explicit security boundary and a single attack surface to cover, so very comparable to a VPN from a conceptual security standpoint.

>>110115113
you got PoE there?

>>110118380
Ya keeps it cleaner with just one cable running into the house

>>110116051
Just don't expose management interfaces to the internet in the first place. As for APs, just use the latest WPA (3 or whatever it is) and the APs should remain secure until the protocol itself gets declared as insecure. Your network access will be as secure as your password. There's other methods that are inherently more secure, but that's an autistic rabbithole in itself.

>>110115113
I hope that's not some shitty Chinese PoE splitter.

File: Screenshot_20261020-10550(...).png (486 KB, 1080x1294)

486 KB PNG

>>110120661
Of course it is

Like a lot of poe junk on Amazon I think its actually a passive poe device and its compliance claims are lies.
It also didnt want to make a data link with cat 5e so I had to break out my hoarded expensive AF cat 6a so I didn't end up making any actually savings over a proper splitter .

That all said it I can get full gigabit download from it and its been reliable.

>>110120777
I have two of those currently awaiting to be taken to an e-waste recycler. I had one powering up a Rasberry Pi, the other one was for my Hue hub. Both times the devices just started failing mysteriously, dropped off the network, and the Raspberry Pi was making a massive whining sound. Thankfully there doesn't seem to have been any serious damage done to the devices. They lasted maybe for 18 months.

>>110120810
Have you had luck with anything else ?
All I can find on Amazon is rebrands of the same piece like I'm on Ali express

>>110120870
No, I haven't tried others yet. But the next time I'm buying a splitter, I'm definitely going for a brand name. TP-Link, Mikrotik, Ubiquiti, whatever. Never trusting no-name chink splitters for anything again.

>>110120777
>cat 6a
>full gigabit
You do know you don't need to go above 5e for that, right?

>>110120914
I bought 100 ft of cheap ass cat 5e just for this project but while it would light up as a good gigabit connection on the switch lights it would not actually get a data link and my modem could never talk to my router.
I tried cat 6a and it worked great so I think this cheap ass splitter struggles with unshielded cable like 5e over long runs because its out of spec.

>>110121047
Then the issue is that your "cheap ass cat 5e" and/or "cheap ass splitter" are potentially out of spec. Cat5e should in theory be able to do GbE with PoE at 100ft.

>>110121365
Its obviously the splitter since cat 5e spec is so low that it wouldnt make sense to lie about it

>>110121630
>Its obviously the splitter
Yet changing the cable is what fixed the issue...
>cat 5e spec is so low that it wouldnt make sense to lie about it
You mean to say that it's impossible to save money by producing non-compliant "Cat5e" cable versus a compliant one?
The thing that doesn't make sense to me, is the eagerness with which some people jump to conclusions like that.

>>110121719
Sorry but a shitty poe splitter not being able to cope with the smallest amount interference from an unshielded cable is a perfectly acceptable explanation for me .
Case closed moving on

>>110108931
you're doing something very wrong if tailscale is noticeably slower for lan clients. ask gpt to fix it.

>>110121845
I can think of several other "perfectly acceptable explanations" off the top of my head. Neither your theories nor mine mean shit until tested and proven. If you're gonna have the attitude of "swap shit out, it works, moving on" that's fine, but don't act like you "just know" what's going on.

>>110122007
>several
Name 2

>>110122315
PoE itself could have been causing the interference and the "Cat5e" couldn't handle it.
Or the cable was too fucked to do the signal even without PoE.
Both of these could easily be tested, hardly any need to keep guessing.

File: net_SatNOGS2.jpg (282 KB, 1521x906)

282 KB JPG

>friend buys a bunch of pi's
>suggest using raspberry pi imager, more user friendly for his skill level
>keeps telling me doesnt work
>try it myself
>it's completely broken and enshittified, i had to go back to 1.9.x to the last usable version

File: shot-2026-10-20_12-18-47.jpg (114 KB, 855x662)

114 KB JPG

>>110120810
I use like 10 of them for years, powering Odroids, rPis and Beaggles.
One failed after about 4 years of service. It's okay when price was about 7€.
I'd like to find an industrial grade CEM certified one for SDR.

got a domain and put a reverse proxy for my apps. Even though these were all LAN only it makes a big vibe difference

File: Screenshot 2026-10-20 170840.png (146 KB, 550x583)

146 KB PNG

whoever recommended me this thingy, thanks. It was very easy to set up even for a retard like me I got 2 8tb HDDs in there.

>>110124252
you got mfa and sso and bbw? you used cloudflare?

>>110124269
It's a DAS?

>>110124307
>mfa and sso and bbw
I googled idk, i need context. I wireguard into my home LAN, always on for phone and laptop
>>110124307
>you used cloudflare
yeah, caddy does the challenge thing

>>110124624
>>you used cloudflare
>yeah
well no, I thing you meant tunnels things. No I register with cloudflare cause they sign certificate with the api key, and I kinda liked using it vs the other domain platform I used. And all their PR work bought me

>>110124552
It's a NAS

File: optiplex_micro.jpg (40 KB, 1024x511)

40 KB JPG

where do you find a job-lot of lease-back USFF desktops?
like a pallet worth?

hp elite mini
dell optiplex micro
lenovo thinkcenter/station tiny

where can enterprise-grade lease-backs be found? asking for a friend.

>inb4 eBay
>inb4 marketplace
>inb4 social media