Access to higher education has more to do with your zip code than your grades or goals.