Sparse Graphical Memory for Robust Planning