←back to thread

So you want to build your own data center

(blog.railway.com)
261 points dban | 6 comments | 17 Jan 25 20:41 UTC | HN request time: 1.444s | source | bottom
1. dban ◴[17 Jan 25 20:47 UTC] No.42743076[source]▶
This is our first post about building out data centers. If you have any questions, we're happy to answer them here :)
replies(2): >>42743553 #>>42744958 #
2. gschier ◴[17 Jan 25 21:38 UTC] No.42743553[source]▶
How do you deal with drive failures? How often does a Railway team member need to visit a DC? What's it like inside?
replies(1): >>42743681 #
3. justjake ◴[17 Jan 25 21:55 UTC] No.42743681[source]▶
Everything is dual redundancy. We run RAID so if a drive fails it's fine; alerting will page oncall which will trigger remote hands onsite, where we have spares for everything in each datacenter
replies(1): >>42743725 #
4. gschier ◴[17 Jan 25 22:00 UTC] No.42743725{3}[source]▶
How much additional overhead is there for managing the bare-metal vs cloud? Is it mostly fine after the big effort for initial setup?
replies(1): >>42743901 #
5. ca508 ◴[17 Jan 25 22:22 UTC] No.42743901{4}[source]▶
We built some internal tooling to help manage the hosts. Once a host is onboarded onto it, it's a few button clicks on an internal dashboard to provision a QEMU VM. We made a custom ansible inventory plugin so we can manage these VMs the same as we do machines on GCP.

The host runs a custom daemon that programs FRR (an OSS routing stack), so that it advertises addresses assigned to a VM to the rest of the cluster via BGP. So zero config of network switches, etc... required after initial setup.

We'll blog about this system at some point in the coming months.

6. coder543 ◴[18 Jan 25 01:29 UTC] No.42744958[source]▶
I thought it was an interesting post, so I tried to add Railway's blog to my RSS reader... but it didn't work. I tried searching the page source for RSS and also found nothing. Eventually, I noticed the RSS icon in the top right, but it's some kind of special button that I can't right click and copy the link from, and Safari prevents me from knowing what the URL is... so I had to open that from Firefox to find it.

Could be worth adding a <meta> tag to the <head> so that RSS readers can autodiscover the feed. A random link I found on Google: https://www.petefreitag.com/blog/rss-autodiscovery/