Flatness of the loss curve is conjectured to be connected to the generalization ability of machine learning models, in particular neural networks. Indeed, it has been empirically observed that flatness measures consistently correlate strongly with generalization. However, it is an open theoretical problem why and under which circumstances flatness is connected to generalization, in particular in light of reparameterizations that change certain flatness measures but leave generalization unchanged…