Pareto Robustness for Fairness Beyond Demographics