Learning Helpful Inductive Biases from Self-Supervised Pretraining