For two years my homelab lived on a shelf. A couple of tower boxes, a switch balanced on top, a small UPS, and a heroic quantity of cabling that I had stopped pretending I would ever tidy. It worked. It also looked like a crime scene, and every time I needed to reseat a drive I had to take three other things offline to get at it.
So in July I bought a 24U rack off a chap who was decommissioning an office. Forty quid and a van hire. I genuinely thought this would be the bit I regretted, the spending. It wasn't.
what actually got better
Cabling, mostly. Once everything is on rails at a fixed depth, cable management stops being aspirational and becomes the obvious thing to do, because the slack has nowhere to hide. I put in a cheap horizontal cable manager, a metre of Velcro, and suddenly I could trace any run by eye. Reseating that drive now takes thirty seconds and zero collateral downtime.
The other quiet win is that the rack imposes discipline. A shelf lets you say "I'll just pop this here for now". A rack makes you decide where something lives, with what power, and how it's cooled, before it goes in. That sounds like overhead. In practice it stopped me accreting junk.
what got worse
Three things, and they're all physics.
Heat. The garage is not climate controlled, and a closed-ish rack concentrates heat in a way a shelf in an airy room does not. I'm running it open-frame for now and I've already ordered a temperature sensor and a fan that I can switch on a threshold, because doing it by feel is not a plan.
Noise. 1U gear has 40mm fans that scream. I knew this intellectually. I did not know it in my spine until I powered on a second-hand switch whose fans apparently trained for a jet engine. It lives in the garage and not the house for exactly this reason, and even there I've swapped the worst offenders for Noctua replacements where the pinout allowed.
Power. A rack invites you to fill it, and filling it costs real money every month. I metered the whole thing for a week before I let myself buy anything else, and the number was a useful cold shower. The rule now is simple: nothing goes in unless it's replacing something that comes out, or it earns its watts.
would I do it again
Yes, without much hesitation. The honest summary is that a rack doesn't reduce the work of running a homelab, it relocates it. You trade the daily friction of bad cabling and awkward access for the upfront friction of heat, noise and power planning. For me that was a good trade, because the upfront stuff you solve once and the daily friction you pay forever.
If you're on the fence: the rack is the cheap part. Budget for the cooling and the quiet fans and a real PDU from the start, and you'll skip the two weekends I spent learning that the hard way.