I've got 16 3.5" hard drives whirring and chugging next to me. I do not miss the sounds. If I could afford the same setup with SSDs I'd do it in a heartbeat. The heat is another story.
I found it worthwhile to move my desktop to another room by using long, 50ft cables (DP1.4, USB 3.0, powered USB hubs). I also have a pikvm connected to Home Assistant so I can press the power and reset buttons using a ZigBee remote. The desktop lives in a Sliger 4U chassis in a rack with my NAS, networking gear, and a UPS.
My office room is now absent of both noise and heat generated by my desktop and it's so much nicer for it.