• notabot@piefed.socialEnglish
      0·
      9 days ago

      Have you tested your backups recently? Having them complete is one thing, having the data you need for recovery is another. Have you backed up your vm configurations and build scripts?

      Go test your latest backup!

        • notabot@piefed.socialEnglish
          0·
          9 days ago

          Ah, that frission of excitement when you come to restore! Will it work? Does it contain that very important file? Is it up to date? How much will future you hate past you if it isn’t there?

  • beegnyoshi@lemmy.zipEnglish
    0·
    10 days ago

    I haven’t messed with my raspberry pi in maybe a month… And I think one of my backups got corrupted because I receive an email saying that it failed along with tons of errors every night. Hmm, maybe I should get to that soon…

  • tal@lemmy.todayEnglish
    0·
    10 days ago

    All of your systems are set up, but are they capable of being redeployed using a configuration management software package? Ansible or something like that?

    Oh. They’re not. Well, that’s probably okay. I mean, you could probably go manually reproduce configurations, more or less.

          • tal@lemmy.todayEnglish
            0·
            9 days ago

            Sure. What that guy is using is actually not the most-interesting diagram style, IMHO, for automatic layout of network maps, if you want large-scale stuff, which is where the automatic layout gets more interesting. I have some scripts floating around somewhere that will generate very large network maps — run a bunch of traceroutes, geolocate IPs, dump the results into an sqlite database, and then generate an automatically laid-out Internet network map. I don’t want to go to the trouble of anonymizing the addresses and locations right now, but if you have a graphviz graph and want to try playing with it, I used:

            goes looking

            Ugh, it’s Python 2, a decade-and-a-half old, and never got ported to Python 3. Lemme gin up an example for the non-hierarchical graphviz stuff:

            graph.dot:

            graph foo {
    a--b
    a--d
    b--c
    d--e
    c--e
    e--f
    b--d
}

            Processed with:

            $ sfdp -Goverlap=prism -Gsep=+5 -Gesep=+4 -Gremincross -Gpack -Gsplines=true -Tpdf -o graph.pdf graph.dot

            Generates something like this:

            That’ll take a ton of graphviz edges and nicely lay them out while trying to avoid crossing edges and stuff, in a non-hierarchical map. Get more complicated maps that it can’t use direct lines on, it’ll use splines to curve lines around nodes. You can create massive network maps like this. Note that I was last looking at graphviz’s automated layout stuff about 15 years ago, so it’s possible that they have better layout algorithms now, but this can deal with enormous numbers of nodes and will do reasonable things with them.

            I just grabbed his example because it was the first graphviz network map example that came up on a Web search.

    • Sabata@ani.socialEnglish
      0·
      10 days ago

      If you know how your setup works, then that’s a great time for another project that breaks everything.

      • cenzorrll@piefed.caEnglish
        0·
        9 days ago

        Saturday morning: “Incus and podman seem interesting. I bet I could swap everything over while the family is out this afternoon”

        Sunday evening: “Dad, when will the lights work again?”

  • HugeNerd@lemmy.caEnglish
    0·
    9 days ago

    Yes that does seem to describe modern computing, indeed, consumer electronics in general.

    It’s no longer about solving actual problems, it IS the problem.

  • DownByLaw@sh.itjust.worksEnglish
    0·
    10 days ago

    Have you already tried implementing an identity provider like Authentik, so you can add OIDC and ldap for all your services, while you are the only one that’s using them? 🤔

    • Pumpkin Escobar@lemmy.worldEnglish
      0·
      10 days ago

      Behind a traefik reverse proxy with lets encrypt for ssl even though the services aren’t exposed to the internet?

      • diablomnky666@lemmy.wtfEnglish
        0·
        9 days ago

        To be fair a lot of apps don’t handle custom CAs like they should. Looking at you Home Assistant! 😠

      • suicidaleggroll@lemmy.worldEnglish
        0·
        9 days ago

        Who cares if it’s exposed to the internet?

        1. Encrypting your local traffic is still valuable to protect your systems from any bad actors on your local network (neighbor kid cracks your wifi password, some device on your network decides to start snooping on your local traffic, etc)

        2. Many services require HTTPS with a valid cert to function correctly, eg: Bitwarden. Having a real cert for a real domain is much simpler and easier to maintain than setting up your own CA

  • tal@lemmy.todayEnglish
    0·
    10 days ago

    You have remote power management set up for the systems in your homelab, right? A server set up that you can reach to power-cycle other servers, so that if they wedge in some unusable state and you can’t be physically there, you can still reboot them? A managed/smart PDU or something like that? Something like one of these guys?

    Oh. You don’t. Well, that’s probably okay. I mean, nothing will probably go wrong and render a device in need of being forcibly rebooted when you’re physically away from home.

    • FauxLiving@lemmy.worldEnglish
      0·
      10 days ago

      Oh. You don’t. Well, that’s probably okay. I mean, nothing will probably go wrong and render a device in need of being forcibly rebooted when you’re physically away from home.

      *furiously adds a new item to the TODO list*

      • TerHu@lemmy.dbzer0.comEnglish
        0·
        10 days ago

        if you can cycle your home assistant with the shelly plug whilst your home assistant is down, yes. from experience it’s really quite annoying to have a smart plug switch off HA…

        • lemming741@lemmy.worldEnglish
          0·
          10 days ago

          HA is on the same proxmox host as the router. So yeah I can end up locked out. Hasn’t happened yet tho! The relay is on my test machine, it’s always nvidia that crashes there.

          • Fmstrat@lemmy.worldEnglish
            0·
            9 days ago

            An 8 switch relay, old Pi, and 8 hardware store outlets can be had for not much more. I did that and let PiKVM control my outlets directly.

            This is the back of my 10" rack before it was cleaned up. Lots of custom work on this that I’ll be posting a page on my site about when complete.

            @tal@lemmy.today in case you are interested

    • tychosmoose@lemmy.worldEnglish
      0·
      10 days ago

      If you do have the smart PSU and power management server you probably also went down the rabbit hole of scripting the power cycling, right? Maybe made that server hardened against power loss disk corruption so it can be run until UPS battery exhaustion.

      What if there is a power outage and NUT shuts everything down? Would be nice to have everything brought back up in an orderly way when power returns. Without manual intervention. But keeping you informed via logging and push notifications.

    • Fmstrat@lemmy.worldEnglish
      0·
      9 days ago

      I built an 8 outlet version of those with relays and wall outlets for… a lot less.

    • cenzorrll@piefed.caEnglish
      0·
      9 days ago

      I’ve moved my homelab twice because it became stable, I really liked the services it was running, and I didn’t want to disturb the last lab**cough**prod server.

      My current homelab will be moar containers. I’m sure I’ll push it to prod instead of changing the IP address and swapping name tags this time.

  • tal@lemmy.todayEnglish
    0·
    10 days ago

    You have squid or some other forward http proxy set up to share a cache among all the devices on your network set up to access the Web, to minimize duplicate traffic?

    And you have a shared caching DNS server set up locally, something like BIND?

    Oh. You don’t. Well, that’s probably okay. I mean, it probably doesn’t matter that your devices are pulling duplicate copies of data down. Not everyone can have a network that minimizes latency and avoids inefficiency across devices.

    • InnerScientist@lemmy.worldEnglish
      0·
      10 days ago

      That won’t work in most cases, all https traffic isn’t cached unless you mitm https which is a bad idea and not worth it.

      Only cache updates those are worth it and most have a caching server option.