Housing segregation leads to racially distinct social spaces, and not just when it comes to schools or offices.