What's On My Home Server? Storage, OS, Media, Provisioning, Automation
- What applications do I run on my home server?
- What OS am I using?
- How do I automate deploying and provisioning?
- How do I secure my services from unauthorized access?
...and many other questions, answered in this video 😊
Links:
My Ansible Playbook: github.com/notthebee/infra
My Ubuntu Autoinstall Role: github.com/notthebee/ansible-...
"Ansible for Devops" by Jeff Geerling: www.ansiblefordevops.com/
"Ansible 101" Series by Jeff Geerling: • Ansible 101 - Episode ...
Awesome Selfhosted Github: github.com/awesome-selfhosted...
Follow me:
Twitter / notthebeeee
GitHub github.com/notthebee
Twitch twitch.com/notthebeee
Support the channel:
Patreon / wolfgangschannel
PayPal (one time donation) www.paypal.com/donate/?hosted...
Music:
Jalowo - Luminism (ft. Yonderling)
Hale - Moment
Tru Genesis - Burned
King Pong - Game Recognize
Videos are edited with Davinci Resolve Studio. I use Affinity Photo for thumbnails and Ableton Live for audio editing.
Video gear:
Camera geni.us/K8OOyKV (Amazon)
Main lens geni.us/jnnElY4 (Amazon)
Microphone geni.us/tgiSqL (Amazon)
Key light geni.us/Gi1zE2 (Amazon)
Softbox geni.us/F86pM (Amazon)
Secondary light geni.us/aciv (Amazon)
Other stuff that I use:
Monitor geni.us/KUzcmcP (Amazon)
Monitor arm geni.us/5RXu (Amazon)
Laptop stand geni.us/X5vx9Af (Amazon)
Keyboard www.amazon.de/HHKB-PD-KB401W-...
Mouse geni.us/KB7h (Amazon)
Audio interface geni.us/sdhWsC (Amazon)
As an Amazon Associate, I earn from qualifying purchases
Timestamps:
00:00 Intro
00:29 The dashboard and media applications
02:21 Nextcloud
03:20 PhotoPrism
04:15 Bitwarden/Vaultwarden
05:30 System applications
06:35 PiKVM
07:48 PiHole & Unbound
09:07 Home Automation
11:36 Other stuff
12:15 The OS
13:05 Storage and filesystems
14:38 Security
16:57 Dynamic DNS
17:59 Provisioning and deploying
19:09 IaC (Infrastracture as Code)
20:00 Why not just use shell scripts?
22:14 Ansible playbook walkthrough
23:50 Yeeting my bootdrive and reinstalling from scratch
25:48 Thoughts and considerations
26:38 Special thanks and outro
Links in order of appearance: Homer github.com/bastienwirtz/homer My custom CSS for Homer github.com/notthebee/infra/blob/ca87f0daf211919ff19ce678523f48f2a6d25ed7/roles/homer/files/custom.css Nord colors for Homer pastebin.com/AH9NWmSL Jellyfin github.com/linuxserver/docker-jellyfin arch-delugevpn github.com/binhex/arch-delugevpn Radarr hub.docker.com/r/linuxserver/radarr Sonarr hub.docker.com/r/linuxserver/sonarr OpenBooks github.com/evan-buss/openbooks Nextcloud hub.docker.com/_/nextcloud PhotoPrism hub.docker.com/r/photoprism/photoprism Vaultwarden github.com/dani-garcia/vaultwarden UniFi Controller hub.docker.com/r/linuxserver/unifi-controller Jackett hub.docker.com/r/linuxserver/jackett PiKVM github.com/pikvm/pikvm PiHole + Unbound github.com/chriscrowe/docker-pihole-unbound Deconz github.com/deconz-community/deconz-docker Home Assistant hub.docker.com/r/linuxserver/homeassistant
Do you maybe have a link for the nextcloud image? Looks damn nice!
@Mrbarb Sure thing i.imgur.com/4Pp7dRg.jpg
Pin this comment !
Great work! Is ansible needed if most of you stuff is in dockers anyway? Should this not make you environments be hw independent already as long those are backed up or in some version control? Also does anyone know if ansibel can be used on a running system, like detecting current config for later deployment?
Hi great video and v similar apps/setup to mine. I've just installed the homer portal and downloaded your custom css file. As this is configured via yaml, please could you tell me where the css file needs to be saved and if it needs to be linked in the config yaml? Thanks
You have so much legally obtained content. You're an example to the community.
💀
DEFINITELY do a Step by Step. I'm just getting into server stuff and would love to learn from you mate.
totaly agree
@@juliantorres957 I think you can follow the ansible portion and spin up a clone of his setup. I believe. I am new as well lol
juniper certs have topics on certs
Step by step would be really useful!
Each and every time you used the phrase, "...you already know..." I actually hadn't a clue. I too am eager to build my home server as my IoT is getting out of hand.
Thanks for making this! I'm making a home server for my family to use for plex and a google drive alternative. Your vids are in-depth yet digestible and you know how to edit so what you're looking at is clean and interesting. Thanks for all that you do
I've been debating learning Ansible for a while. Recently got my DCV-VCP 2021 and I kinda of want to learn Ansible + Vagrant to see what all cool stuff can be done. Your playbook is a goal, from zero config to fully functional in one playbook. Very nice.
I love how much information is in this video without over doing it on any one topic. Tips, why you chose it, how you use it, and clear explanation of what it does and it’s application. Definitely saving this video to refer back to. Thank you!
Never thought that IaC would be brought to this channel, and I'm all for the detailed Ansible guide. Merry Christmas to you and everyone watching.
I am planning to set up my home server on an old laptop and it's been weeks of searching and reading through random articles, forums, yt videos etc to create a list of links for reference but when I stumbled on your video I was mindblown by how well made this was. Watched it fully in one go because of how useful it is and packed with so much usable info. From infra to services to security to deplyment to networking, just absolutely insane. Thank you so much for this.
And the ansible playbook service was a really useful cherry on top to anyone who doesn't want to dip their hands in infinitely complicated minor tweaks that takes months to set up successfully!
The video was packed full of great things. I can hardly wait for more videos, especially HomeAssistant, you bring things across in such a calm and structured way, it's fun to watch the videos.
The amount of work put in this video and in the setup itself flies through the roof. I got really inspired to lift up my tiny Raspberry pi server to something much greater!
I just want to let my FBI agent know that I am legally watching this video from my legally purchased device that is connected to a legally purchased network connection that only transmits legal things.
The amount of useful information in this video is just insane. Thank you SO much and please make more videos like this!!!
Thank you so much for this great content!! That must have been a GREAT deal of work, and we, the community, really apreciate it! Hope I can contribute as much as you guys do someday! Anyways, merry xmas and a great new year y'all!
Let’s gooo
Super long video but… Super packed with info! Bizarrely I know all the Ansible automation stuff you covered later but really want to deep dive into almost everything you covered earlier. Great video 👍 really enjoyed it 👍
I’ve watched this video several times since it was uploaded, most times only getting about half way until I had to tap out from confusion. Not your fault, I just didn’t have the prerequisite knowledge before diving in. It’s been over a year since this video was uploaded, and I have finally gotten to the end. I just wanted to share this small achievement of mine, and also commend you: it takes balls to demo an ansible playbook on a production machine with all your data on it. Fair play, and great video.
Densely packed. Elegant. And immediately practical. Thanks! Not sure I can pull off a whole ansiblized server configuration, but now I’ll look at it carefully.
As someone just starting to learn about self hosting, I think this video is packed with great tips. Thanks for taking the time to explain your setup!
This is an incredible video. Very well done. Way beyond my capacity but great to see what can be done!
Nice video, the IaC part was an unexpected goody. Working as a DevOps engineer I can highly recommend learning this. I even have a playbook to setup my laptop with all the config, software and tools I prefer. Might be a good start for everyone who doesn't have a home server.
Do you have any recommended sources to learn it?
@@maciejrolecki55 check out this playlist: kzhead.info/channel/PL2_OBreMn7FqZkvMYt6ATmgC0KAGGJNAN.html
@@Doninhas thank you very much, will check it out
Thanks for making this video, this was super helpful! I was able to fork and run your playbook after some trial and error, using it as a jumping off point for a similar setup, adding things I want to host from repos like docker-selfhosted-apps. Having the setup defined with IaC makes me a lot more willing to spend some time and do it properly instead of hacking together something and having to redo/forget parts later.
Thanks for showing so many self hosted alternatives. This video is gold. Great job!!!
I'd love to see a deep dive into your IaC setup. I've been planning to remake my Home Assistant supervisor plugin-based server into a proper easily reconstructible setup with something like Docker Compose or NixOS, and your Ansible demonstration has blown me away! This video alone has also been incredibly inspiring. Thank you!
+1
Would also love to see a deep dive. Looking at getting my home server setup with ansible.
+1
Yeah I think I would look to do it with guix :)
I would imagine it to be much more maintainable if done with a tool like guix that can probably do most of the setup by itself from a couple scheme files, and brings easy rollbacks and upgrades, etc. but it’s probably not optimized for the use case yet and lacks packages/services.
I just found this and I want to give it 10.000 thumbs up. Especially the parts about using a Reverse Proxy for your webservices, proxying connections via Cloudflare, Authelia and reinstalling your Linux system because after a while they feel "dirty" were so good!
I'm so happy you released this video, what a beautiful Christmas present ! 👀 I want to redo my NAS that I installed with OpenMediaVault and your first part NAS Video tempted me with the PiKVM and Homer dashboard ! I'd like to see the deep dive and step by step walkhtrough of your Ansible configuration, it looks impressive and would help me so much ! Thank you ! ☺️
lot of valuable info here, just got my own 42U Server Rack setup and there are some services you listed that I'm absolutely going to look into more, great video man!
it's not a long video if the content is super interesting and conveyed in a very accessible, user friendly manner. great work as always!
Interesting to see your server running on 6100. Mine runs on 4570T, I have few of the programs like yourself, however I run emby instead of jellyfin. And instead of pihole, I have OpenWRT running on my router and I block DNS ads on there. I am always happy to see things like these :)
I'm an SRE and thankful you're out here providing all of this great institutional knowledge for those who wanna get into this this stuff.
So much work went into this. Absolutely crazy. Great vid
Hey mate, would love to see a video about debloating Windows 11. To everyone watching Merry Christmas and a happy new year.
Afaik Chris Titus already has some videos about that.
@@WolfgangsChannel doing that with Ansible would be fun XD Maybe run OOShutUp10 first and then those PowerShell scripts :D Both can easily run unattended!
@@WolfgangsChannel Chris Titus also said that Linux is an operating system, so we're taking his word with a grain of salt these days.
@@dial2616 Yeah I don't know why creators are so afraid of covering a topic after someone else has already done it. Usually the first video on a topic is lacking certain tips or other info
@@davisssamuel same spyware, different label
Hey Wolfgang, nice to see your home setup! Question: what brand of smart thermostate are you using?
Danfoss Ally
Wow! Very impressive Wolfgang. I would love to see a step by step walk-through & deep dive video for your IaaC setup.
That piKVM setup looks really slick, definitely going to set that up in my homelab! I'm tired of lugging out the spare monitor when I need it. Great video!
Been waiting for this! Thanks.
Okay, wow. That was a lot of stuff I'm certainly going to slowly chew on over the next months lol. Sadly I can't really reproduce everything because I don't even have a dedicated server or any RPis, but this is right up my alley. Viele danke for the amazing presentation! One question though, is this approach (mostly Ansible and hosting Docker conts on Linux) feasible with a desktop machine as server, especially without using tons of storage devices?
Thank you! Ansible can definitely be used to set up a desktop machine. Haven't tried that myself (maybe an idea for a video?) but I don't see why it wouldn't work.
@@WolfgangsChannel Some guys use ansible to setup MacBooks in mass, it's really amazing. Fully development ready machine in 15 minutes, from 0.
Yeah using it for desktops works great as well! If you use Windows then you can install packages with chocolatey, which is such an improvement... Also windows Updates are a breeze! For work I had to create a Window Update Playbook and tried it on a fresh 2012R2 with no Updates and surprisingly it worked great. I almost thought that it stopped at some point, but no it just needed to install a lot of updates... When I had to cancel it, it was at Update 110 XD
There is a video which can be used for inspiration. kzhead.info/sun/ZLqhgLqtbHeBaKc/bejne.html
@@WolfgangsChannel Thanks for the great video. Just a smal question, how can you use homer with local dns on the pi-hole? For example my homer portainer port is 1.1.1.1 , example 192.168.1.200:1111 how can i add a local dns on the pihole dns? As i see you dont use any port and you can direclty access to the homer dashboard.
Watching this video alone I learned the basics & nuts n bolts of cloud computing!!! Thank you very much!
Herzlichen Glückwunsch zu den tollen Videos und zum Channel. Deine Videos finde ich richtig gut, ruhig, sachlich, informativ.
Interesting. Although, the big problem is when you set something for the first time: you often don't know exactly what the right commands are, you have to experiment a bit, test stuff out etc. And with some things, setting them up is such a long and tedious process, that you have no incentive to start doing it all over again. Take for example hosting your own mail server. That takes ages to properly set it up and have it support all the scenarios. By the time you are done, you won't be wanting to do it all over again, and rather resort to patching what you have and keeping it running. Doing things right takes a whole lot of time on top of a whole lot more time for the initial setup and figuring things out.
Ansible
btw for keepass you can sync the kbdx file using syncthing between mobile and laptop/computers. it gets updated everytime you make an entry or an edit on any device. works for me up until now. give it a try maybe. edit: sucha lovely video! happy holidays!
No Synching on iOS, unfortunately
This is amazing content man. Just found your channel. Keep up the great work!
After watching this I might just end up getting a Synology. I have Home Assistant and other various servers running. I don't know if I have time for another one but I'm very impressed with what you have accomplished. Very nice.
For new homelab builders as option consider proxmox as base system instead of ubuntu server for learning purposes also.
"I use proxmox btw"
wow! that was a wealth of knowledge. I wish I had my home server setup like yours. I would love to see a video for a linux newbie setting up a system like yours.
You’re an OG. So much to learn from you. I am finishing my cs degree and took a networking course and got interested in home setup/networking/ etc and find your videos to be really cool and informative.
I’m always learning a lot of new stuff when watching your videos. Keep it up!
If you want to add more drives into ZFS pool, you'd need to create new vdev and add vdev to pool. And disks in vdev can be replaced with larger disks one by one.
I discover your channel watching this video and wow so much content. A lot to get excited about how I can upgrade my Homelab. Thanks for sharing !
Would definitely like to see a step by step. Amazing informative video as always!
Need to put SSL from Let’s Encrypt now! You are inspiring me to install Home Assistant instead of Apple Home.
You can also use Home Assistant with Apple HomeKit! 🙂 I run a HomeKit bridge to be able to use Siri commands with my Zigbee devices.
great video. I will definitely use some of these applications. Since you mention "very legally obtained" movies and software a lot, could you make a video on that topic? All for educational purposes of course
KZhead already removed my video on how to download KZhead videos and gave me a TOS strike, so I won’t risk it
@@WolfgangsChannel too bad. Thanks for the reply anyways, I really appreciate it. :)
Looking forward to that deep dive video! Great job!
Oh hey! Thanks for the video, the home servers are always interesting, hopefully I’ll adapt some of you ideas
ZFS is not as limiting as you make it out to be. The only RAID solutions that I know requires the same size drives to be used are hardware RAID systems. As of OpenZFS 2.1, you now can add additional drives to RAID vdevs after they are created. You can add nVME drives for Caching and they are handled automatically by ZFS itself, no scripts required. I personally like the fact that everything is checksummed with ZFS, so things bit rot can be avoided, something that ext4 does not do or protect from. ZFS is much more flexible than than you realise.
ZFS is a nightmare
@@adiledemiri7372 How is that?
OpenZFS cannot add any drives to vdevs yet, even in the 2.2.0 ... and it will be a long way to go. Plus caching (L2ARC) requires a LARGE amount of RAM available (1:5 to 1:10 as RAM:NVME ratio!), and this should be ECC. So extremely expensive. Plus ZFS performance degrades when the pool is >50% full. Not a workable idea at all if you don't have a lot of money to support all this.
Hey Wolfgang, why are you using XFS instead of Ext4 of Btrsf ? Are there any advantages?
There's so much info in this video I love it thank you Wolfgang!
Wow. What a gem of a channel. I honestly feel lucky to have found it
One thing that's missing and also hard to set up properly is off-site backup.
You better update your unifi controller, as that version is very much affected by log4j, also the issue with that it constantly wants to adopt is most probably that it sets the wrong set-inform url on the AP when setting it up. if you have the controller as a docker container it might have given the internal ip instead of the host ip, this can be set in the controller to specified ip, setting is called "Host for Inform" and will most probably solve that issue between restarts
Thanks for the info!
Welcome back, Wolfgang! Missed you on the youtube feed!
Thanks a lot. It can be seen here lots of curated work along the years in a 20 min video. Definitely going to take a look to the references you mention.
How do you use Local DNS to access docker containers with something like homer.box, since they share the same IP address but different port?
Reverse Proxy!
Have you figured out how to do it? I've been trying all day to set up a reserve proxy with Apache and/or nginx but it doesn't work.
@@Blitzritze let us know if you figure it out..
@@rpm10k. My next try I'll do it with Nginx Proxy Manager, since swag looked too complicated to me. I am completely new to the whole topic.
@@rpm10k. I think I figured it out, I have to rebuild my entire raspberrypi but then it should work. You have to run all "programs" in docker and in the same docker network and so you can say via swag or traefik that if a certain docker container is accessed with a certain domain it should be forwarded to the certain ip with port.
Do you self host your e-mail? I assume that if you do, you might be doing it on a VPS. Also you should consider hosting a tor node.
I don't - in my opinion it's more trouble than it's worth
Hosting email from residential address space gets you autoblacklisted just about anywhere - no amount of spamlist training can fix that. Then there's the problem of incoming spam. So I agree with Wolfgang it's more trouble than it's worth for sure.
Question: I host my email on a VPS, but I was thinking about setting up a second server at home, and pointing my email address DNS at both the VPS and the home server for some redundancy. Assuming this even makes sense (I'm a DNS noob), would that then just get me blacklisted whenever it sends from my home?
Making my first home server, and the MergerFS and SnapRAID advice is what I was just looking for! You just gained a sub!
This is a fantastic video. Thank you for sharing this with us. Question at 14:19 into the video you mentioned something about ways of getting around having persistent storage, which sounded pretty cool. Do you have a video that goes into detail about that? If not, would you be willing to do one. I'm very interested in seeing this done. Thank you again.
Step by step cache drive for mergerfs video please
4:14 *МАМА, Я В БЕРЛИНЕ* pepega
I love how excited you appear in your thumbnail. It exudes infectious enthusiasm.
Many of the software solutions I was looking for my own server, in one video. Vielen dank!
“Based on Rust” is a meme now. An irrelevant detail gets promoted like it’s some kind of feature.
Why?
Yeah, All the work Firefox, Google Chrome & Linux Kernel team is doing to rewrite their projects in Rust is a meme right?
@@4n0nmann5 they aren't rewriting anything. They're using it to write select components. In the kernel case, they're allowing some device drivers to be written in it for instance. Rust fanaticism is ridiculous. It's a cool language but anyone that's actually used it will tell you it's language ecosystem is still immature. People need to chill.
@@seabrookmx I agree. Rust is ok, but it’s not perfect and has its problems. Just like anything else it’s not a fix all. Rust fans are toxic.
@@WolfgangsChannel End users don’t really care about programming languages and they usually don’t have an effect on usability. Slapping the “based on Rust” label on it doesn’t make it magically good.
THANK YOU ! I was seeking for ideas with my own serv, definitely awesome content
This is amazing; it's basically exactly what I'm doing or want to do, plus a few new things I'll try out
Hey! Great vid. I would love to see a video about your macOS setup. Thanks for your time and all the stuff you make!
Love your video style and topics! We need a home automation video :)
This is such a wealth of info. Bookmarking the links for reference. Thanks a ton!
This video is exceptional in showing everything you can do... but pretty overwhelming for beginners.
Wonderfully informative! Thanks sir! Ill gladly take a video on your IaC etc.
Great video. I really love videos where people share lots of their fav open source tools around a topic. I wasn't aware of SWAG or DDClient both of them will be very useful to me :-) Been using Ansible for many years (7 maybe?) my fav provisioning tool. I love that it is push based and you can see the progress on multiple servers.
Been waiting for your vid on this, and was not disappointed!
the best part of this video is just all the other resources you posted for the rest of us to follow along a learn our way too, i had been so frustrated on bad query results when looking online, with things that just say "buy this crap of NAS and use the crap software it comes with it" nothing on the side of build it yourself, which is what i was actually looking for, thank you so much for this, i looked up on the whole smart home thing, and is a great rabbit hole to fall into, to know that you can even check energy consumption and stuff like that makes it actually really good
Wow this was an awesome video. I just randomly came across one of your videos through the KZhead algorithm and I’m hooked. Can’t wait to work on some of this stuff.
Still one of the best Tutorials/Showcases I've seen so far!
Incredible work, thank you for sharing! 💪
heavily detailed, and sure once again I'll come back and look at all these when I take my self-hosting journey ~
Really appreciate the callout to all the other contributors. Fantastic stuff
Love this channel and content thank you
It was pretty interesting! Thanks!
This is good stuff man!, Spread it by explaining step by step
Whow! That's super inspiring!! 🙏 Thanks a lot!!
This video is just everything anyone would ask for, thanks for the dedication.
just build a new pc and have been planning to convert my old PC into a HomeLab and as someone with no Server/Docker experience it's quite overwhelming at times. This video was super helpful for me though! explained everything well enough for even myself to understand. well i was a bit lost during the ansible section but i don't think i plan on using it to start with anyways. maybe when i'm more experienced.
This is great! Almost exactly what I want to do and in almost exactly the way I want to do it (Ansible included)! Thanks
would really love a tutorial/guide on setting up your version of home server with step by step using docker. i know it would be huge but could be a series.
How do you backup your Home Server? Expesially the vaultwarden should really carefully be backed up. Planning to get similar but getting messed up with the backups is my only consern, because that can always happen and better get ready for it before so I don't lose all my account credential and secure information. Best video in a year I have watched!!! 🥳😎
Great video! Got some inspiration. Personally I'm just running a pi4 with harddrives attached so it's not as complex but more energy efficient
the serious expression on your face while talking about legal hannah montana linux, is hilarious ! Thank you for providing great high quality content on your channel
So, looking at my current proxmox box with MineOS, microk8s and truenas vms, I think it's time to expand the storage and do a software improvements. Very nice video. I enjoyed it so much.
This is the first time I'm watching you and it's just, WOW!
Great video! I'm saving this to help me later. I had two questions. 1. On your main Ubuntu server, what hardware did you need to run all the apps/ containers? You have a Pi, NAS, and network devices, anything else? 2. Have you chosen no need for virtualisation, hosting the Ubuntu server on metal? Is that because any benifits VMs are covered with your Ansible solution, ie. rebuilding from saved state?
Always waiting for the next Wolfgang video. Why? Because I know that my Knowledge and tech life will really improve. Wolfgang, of course I want a walk-through and deep dive on you infrastructure code setup. Merry Christmas and a Happy New Year! / Frohe Weihnachten und ein gutes neues Jahr! / Счастливого Рождества и весёлого Нового года!
you are the man! I want to do this for a living and as a hobby its just so nice to see the help!