A post-mortem on the infrastructure we built, the challenge that ate our subnets, and everything we learned the hard way