Password manager editionprevious: >>107493906READ THE (temp)WIKI! & help by contributing:https://igwiki.lyci.de/wiki/Home_server/hsg/ is about learning and expanding your horizons. Know all about NAS? Learn virtualization. Spun up some VMs? Learn about networking by standing up a OPNsense/PFsense box and configuring some VLANs. There's always more to learn and chances to grow. Think you’re god-tier already? Setup OpenStack and report back.>What software should I run?Install Gentoo. Or whatever flavor of *nix is best for the job or most comfy for you. Jellyfin/Emby/Plex to replace Netflix, Nextcloud to replace Googlel, Ampache/Navidrome to replace Spotify, the list goes on. Look at the awesome self-hosted list and ask.>Why should I have a home server?De-botnet your life. Learn something new. Serving applications to yourself, your family, and your frens feels good. Put your tech skills to good use for yourself and those close to you. Store their data with proper availability redundancy and backups and serve it back to them with a /comfy/ easy to use interface.>Links & resourcesCool stuff to host: https://github.com/awesome-selfhosted/awesome-selfhostedhttps://reddit.com/r/datahoarderhttps://www.reddit.com/r/homelab/wiki/indexhttps://wiki.debian.org/FreedomBox/FeaturesARM-based SBCs: https://docs.google.com/spreadsheets/d/1PGaVu0sPBEy5GgLM8N-CvHB2FESdlfBOdQKqLziJLhQLow-power x86 systems: https://docs.google.com/spreadsheets/d/1LHvT2fRp7I6Hf18LcSzsNnjp10VI-odvwZpQZKv_NCISFF cases https://docs.google.com/spreadsheets/d/1AddRvGWJ_f4B6UC7_IftDiVudVc8CJ8sxLUqlxVsCz4/Cheap disks: https://shucks.top/ https://diskprices.com/PCIE info: https://files.catbox.moe/id6o0n.pdf>i226-V NICs are bad for servers>For more SATA ports, use PCIe SAS HBAs in IT modeWiFi fixing: pastebin.com/raw/vXJ2PZxnCockpit is nice for remote administrationRemember:RAID protects you from DOWNTIMEBACKUPS protect you from DATA LOSS
I'm overhauling my network soon. I'm still on the fence between /24 and /16 for my subnets. Currently thinking /24 since I don't need the space a /16 offers on any of my networks. I do however like how it's easier to read at a glance 10.10 or 10.11 instead 10.10.10 or 10.10.11. I only have nine networks that I plan on setting up at this point.
>>107556806/16 is the way10.subnet.type.nodealso, 10.1 is a pretty neat shorthand for 10.0.0.1
So I've discovered you can give raw disks to ZFS without creating partitions, by running zpool create on an intermediary loopback device instead. Only thing it didn't do, was set whole_disk to 1, not sure how much it matters, but there must be some workaround for that as well.Is it really as bad an idea to use disks in this way as the internet is making it out to be? Not having something that doesn't strictly need to be there, is quite pleasing to my autism.
nice rack
post you're ECC
>>107556806>seriously thinking about using /16 instead of /24 for single subnets>gets challenged by a third octetSounds like the networking equivalent of you average USoid that can't move without a segway
>>107557906ouch, goddamnlmao
>>107557752I am ECC
>>107558088then post
>>107557752>post you're ECCMines a handgun, which is irrelevant to this board
>>107557752but moving to a minisforum ms-a2 with 128gb no ecc in a few days
>>107557752>This is now $1000 in ram
>>107558596I bought those 4 for $275 total august of 2024. Now they're $230 a piece.
>>107553019 >how do I have my cake and eat it with the worst mini PC line (HP)The Tiny/Mini/Micro PCs are overall trash for airflow inherently with HP being perhaps the worst. Your idea to heatsink to the 2.5" caddy is interesting, but I suspect it would get thermal soaked quite quickly without airflow anyway. Matching pad thickness to the caddy height would be also be hard and risky. >M.2 heatsink?You can't use NVMe heatsinks because there isn't enough clearance between the drive and the motherboard, let alone above to the caddy. My suggestion would be this - unless you want to brave making a custom heatsink+mount and getting the Z axis perfect for mounting pressure, I would be looking into buying this https://www.aliexpress.com/item/1005009890263603.html and somehow unfolding the fins into something like picrel. Then design a 3D printed chassis lid to mount a 140mm fan to blow over the whole board like this https://cults3d.com/en/3d-model/gadget/m720q-gehaeuse-mod-luefter. >I don't have a 3D printer JLC3DP>how do I connect the fan?The fan pin out is exactly the same as a standard PWM fan, just make sure you have the wiring order matched. You'll need a 4 pin JST SH1.0mm connector which you can then wire directly into a fan or to a standard 4 pin female connector. Wiring as seen here - https://g3r4686.wixsite.com/multimodsg3r/post/prodesk-elitedesk-cooling-problem-mod-solutionOther options >90W model chassis lidIt's perforated and you'd just blow a fan through it, though they're stupidly priced and it would probably cost more for worse performance than the above idea ironically. >small inline fan good luck fitting it anywhere and you'd have to piggy back off a power point somewhere on the board still>skipping all the DIYYou could just connect the fan via an external controller and simply design the chassis lid, but it may overspin the stock fan and you wouldn't drop CPU temps because the heatsink would be vertically blocked still.
How much storage do you guys have? I only really need a file server, not transcoding or anything fancy so I've been using a 4TB drive plugged into a Pi as a NAS but I'm up to 3/4TB filled and I'm thinking maybe I should get an 8TB just in case I need it now SSD's are about to get FUCKED
>>107556806>I'm still on the fence between /24 and /16 for my subnets.Well that's easy. How much broadcast spam do you want?
>>107558998We use ZFS around here. So we fill up a drive only halfway and add a second drive for redundancy. So 25% usable space, and that's not counting backup(s).
>>10755899891TiB.
>>107558998110 terror bytes. Think I might be getting more for Christmas.
I can remember having 1TB on an external HDD and my university friend telling me I'd entered "the terror zone" of data hoarding.
>>107556713Wish my gf had those...
I want to transfer large data (~6 TB) from old home server to the new one, but I don't want to want traffic to go through the rest of the network and eat up bandwidth.How can I transfer the data with rsync using direct ethernet connection?
>>107560404it will only go through "the rest of the network" if there's another device relying on the same ethernet link. otherwise, the limit will be however much the switch is capable of handling at a time, which is usually somewhere between all links in full duplex at full speed and half of them. in other words, you should be fine.
>>107558596nice
>>107560484No it won't be fine.Since it will slow down, and I'm already doing other network heavy stuff.
>>107560638Then try and describe your setup at least. How many links and switches there are in between the two servers? Is it just server -> switch -> server?
>>107560687>Is it just server -> switch -> server?Yeah, and that switch (1GbpE) has all of my devices (DVR+cam,NAS, Media storage NAS, Jellyfin server to 4 client at minimum, 1-2 game streaming)Surprisingly 1GbpE is enough, network traffic spike between 600 Mbps to 800 Mbps, but when I started the transfer from old server to new over the switch you can tell what happen, the bandwidth got saturated and the transfer speed was something like 20-30 MB/sec.And it's not other hardware bottleneck, since the data is stored on SSD and both of the NIC are GbpE.So I'm assuming the network is being saturated.And that's way I want to do direct server -> server data transfer.
>>107560846Run an iperf3 test between the two servers for a few minutes. If it slows down then it's a network congestion issue and you'll need either a separate switch or a direct cable to your server. If it doesn't slow down then the issue is elsewhere.
>find cool looking project>clone it>install>works>check out the instructions for adding custom models>it's incoherent bullshit spread across 50 lines that can be boiled down to read these source files and figure it out fuckoAt this point I'm in favour of just outlawing open source projects without proper documentation. I don't give a shit how people cope if you can't be bothered to write down a fucking example config and expect people to read your incoherent spaghetti code you and your family need to be shipped off to an extermination camp ASAP.
>>107560920And to add to this all I'm trying to do is uncomment one of the additional models that are already (theoretically) included in the config anyways its just that the provided config doesn't fucking work and neither do the instructions to add custom models. Oh and of course even when you put the log level to debug it's just 309749283749827398472938742793 billion trillion database connections no one has ever gave a shit about in the history of the universe but not one word about what is wrong with the config.
Can someone explain what's with this sexy woman in the OP? I see her all the time in your threads
>>107560913I did.And it slowed down a lot.On hindsight upgrading the server without the infrastructure was a bad idea, but the truth to be told I think the cables are Cat5e anyway.So my only option is direction connection.>separate switchHow would this help without a router?
>>107560993>And it slowed down a lot.Then you've found your problem.>the cables are Cat5e anywayCat5e is fine for gigabit, even 2.5GbE at short distances. Unless your setup has some kind of single link as a bottleneck, the cables is not the issue.>separate switch>How would this help without a router?My impression was you're doing a local network transfer, or am I wrong?
>>107558998Based, is that a 3.5"?
>>107560993If all your shit is connected to one switch and you think the switch itself is the bottleneck, then get a new switch, unplug both servers from old switch, plug them both into the new switch, then get another cable from the new switch to the old one.
>>107561056>My impression was you're doing a local network transfer, or am I wrong?yeah, I mean a switch doesn't provide DHCP server?>>107561416This is for later, now I need to migrate to new server.I know we are on the spectrum but can someone help with the main request? >>107560404>How can I transfer the data with rsync using direct ethernet connection?
>>107561672>manages servers>doesn't know how to set-up a network without DHCPnigga just set one of the NICs on each server (your servers do have multiple NICs, right?) to the same-but-different-from-DHCP network and connect the NICs with an ethernet cable
>>107560968you have been visited by office mommy of milky titties protector of homeserversgood luck low latency and everlasting hard drives will come to you only if you reply with>thank you office mommy
>>107561672>yeah, I mean a switch doesn't provide DHCP server?If the issue is caused by the fabric of your current switch being oversaturated, then you want to split some of the load onto a different switch and connect the two switches together. That way your server to server links can have an entire switch to itself, while still connecting to the DHCP server via the additional link to the old switch, literally no additional configuration is required.>This is for later, now I need to migrate to new server.I'm trying to figure out what's feasible in your situation. You can connect your two servers with a single cable and assign each of them a static IP and transfer stuff that way - if you have a cable long enough and if you don't mind both the servers being completely inaccessible to the rest of the network. Otherwise you get a switch, plug both of the servers into it, and plug the two switches together - like I've been trying to tell you.
>>107561792>everyone here is sysadmin>>107561911>if you have a cable long enough and if you don't mind both the servers being completely inaccessible to the rest of the networkThanks man, both of these servers are sitting next to each other so yeah, and I don't mind being unable to access it.I guess I can connect to one with Wifi for SSH and such.> static IPNo other way? I don't want to do things that will persist after reboot. ipv6 or ipv4
>>107561672>I mean a switch doesn't provide DHCP server?If your switch can't do DHCP it's no wonder it has a stroke when it has to handle a bit of traffic...>>107561947>No other way? So you want a snowflake solution but you don't want to configure anything at all?
>>107561947Aside from physically attaching the hard drives and doing a local transfer, there's not much else that's more straightforward than giving each server a static IP address then connecting them both together. As soon as you're done you should be able to clear the static IP entries, reconnect to your old switch and they should be back on the DHCP addresses......unless you want to create static ARP entries for your DHCP addresses on each of your server, but I feel like that's an unnecessarily complicated can of worms for this purpose.
>>107562022>If your switch can't do DHCP it's no wonder it has a stroke when it has to handle a bit of traffic...The presence or the lack of Layer 3 functionality on a switch says nothing about its total switching bandwidth.
>>107562049Yeah, you're right.I've set up static IP using ipv4.ipv6 didn't work as it should with local link>>107562022If you're so rich send yours over.
>>107560404>How can I transfer the data with rsync using direct ethernet connection?--bwlimit=RATE limit socket I/O bandwidth
--bwlimit=RATE limit socket I/O bandwidth
>>107556713Ok so I got an hp elite desk g4 800.Put Debian on it, loaded it with 2 nvme, 2hdd, 1 m.2 ssd, 64gb of ecrc ram. I have docker containers running various services, pihole blocking all of Reddit on all my devices. Tailscale. Now what? What do I do. Should I block 4chan and 9gag now? I never been so productive.
>>107562279do that as well
>>107562279get two more and make a cluster
>>107562279What's the point of blocking shit for yourself?Don't you have any impulse control?
>>107560404are we talking local to local?just drive an ethernet through small router
>>107562438ego depletion (aka aus den augen aus dem sin)
>>107562446I don't have one.
>>107562476which german child molester from the 1800s said this
>>107562291Will likely do that when I get home>>107562307What do I get out of a cluster? I was looking into it with those elitedesk mini pcs>>107562438To stop myself from rage browsing. To stop doom scrolling when I search for a problem and some Reddit thread comes up and next thing I know an hour elapsed as I was reading other threads an the stupid liberal tranny commenters
>>107562279>Now what? What do I doForgejo is a good service to have
>>107560404Connect the servers togetherAssign static IPs in the same subnetTransfer via rsyncdead fucking simple
>>107556713I look like this
Ignorant anon new to home server and NAS stuffI recall reading about a RAID setup or RAID alternative that requires all the drives in the array to be the exact same size: Not that say 3 12tb and one 1 14tb drives will make an array as of it were 4 12tb's, but that it won't work periodIs that how ZFS works? Or does ZFS do fine with drives of different sizes?
>>107562911Excellent suggestion. Thank you my good sir
>>107556713who dat? can find the picture on a random forum posted in late 2022. so it might not be AI.looks distinctively british.
>>107564439you can do different sizes with zfs. that would be a shitty implementation of raid if you couldn't use different disks, probably some old legacy hardware raid controller.
>>107564439zfs will treat everything as the lowest size of drive.
>wasted another 3 hours over the same exact issue I had a month ago>was too stupid to document how I fixed it>had to retrace all my steps and googling again>finally figured it outFUCK. DOCUMENT EVERYTHING YOU DO.
what ever happened to ZFS on root for Ubuntu?
>>107564439ZFS can do pools with different sized drives but each vdev should have the same size.3x12tb and 1x14tb would be the same as 4x12tb because you can only build one vdev with that. But if you had 2 more 14tb drives you could build one vdev out of 3x12tb and another vdev out of 3x14tb without losing any space.
>>107557906It makes no difference between a /16 and a /24 for a local network. It's more of a convenience thing. If you were not preaching form the peak of Mt.Stupid you'd already know this.
>>107559187You'd only get broadcast spam if you actually had enough hosts for a /16. If you only have enough for a /24 and run those same hosts on a /16, you'll see the same amount of broadcasts.
>>107564551>Excellent suggestion. Thank you my good sirnp. if you want to get into weird levels of managing things i got another suggestion: hashicorp vaultmaybe thats too weird or not useful for you, so consider this: a deploy script that creates a docker container with kubernetes clusters for every service you use and it can be run on any linux environment; brand new installation. Start with catering towards your current OS and fine-tune from therePro tip: manage backups>inb4 whyso if something fails on a hardware level you can instantly have it restored
>>107564636i just look into my old gemini chats. that is much better then documenting anything.
>>107565055i'm still too much of a boomer to rely on ai chat bots to solve problems.
>>107565103i am just lazy and google search is ass.
anyone here hosting headscale? is there a docker image for the derper that deals with the certificates?i have it running behind caddy but i'd like a setup that updates automatically
>>107564675AnyRaid is coming.
>>107556995Don't use /dev/sdc, all sorts of fun problems if you rearrange a disk and suddenly the raid is fucked
got a QSFP28 cable but the EEPROM seems screwed up and so it does not work with my Mellanox NICs, or at least the NICs can't detect the proper supported speeds. anyone here reprogram them before?
