Brain Network Transformer
Dec 6, 2022
Speakers
About
Human brains are commonly modeled as networks of Regions of Interest (ROIs) and their connections for the understanding of brain functions and mental disorders. Recently, Transformer-based models have been studied over different types of data, including graphs, shown to bring performance gains widely. In this work, we study Transformer-based models for brain network analysis. Driven by the unique properties of data, we model brain networks as graphs with nodes of fixed size and order, which allows us to (1) use connection profiles as node features to provide natural and low-cost positional information and (2) learn pair-wise connection strengths among ROIs with efficient attention weights across individuals that are predictive towards downstream analysis tasks. Moreover, we propose an Orthonormal Clustering Readout operation based on self-supervised soft clustering and orthonormal projection. This design accounts for the underlying functional modules that determine similar behaviors among groups of ROIs, leading to distinguishable cluster-aware node embeddings and informative graph embeddings. Finally, we re-standardize the evaluation pipeline on the only one publicly available large-scale brain network dataset of ABIDE, to enable meaningful comparison of different models. Experiment results show clear improvements of our proposed Brain Network Transformer on both the public ABIDE and our restricted ABCD datasets. The implementation is available at https://anonymous.4open.science/r/BrainTransformer.Human brains are commonly modeled as networks of Regions of Interest (ROIs) and their connections for the understanding of brain functions and mental disorders. Recently, Transformer-based models have been studied over different types of data, including graphs, shown to bring performance gains widely. In this work, we study Transformer-based models for brain network analysis. Driven by the unique properties of data, we model brain networks as graphs with nodes of fixed size and order, which all…
Organizer
NeurIPS 2022
Account · 966 followers
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Unsupervised Learning of Group Invariant and Equivariant Representations
Watch later
Robin Winter, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Phase diagram of SGD in high-dimensional two-layer neural networks
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learning
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Explainable Reinforcement Learning via Model Transforms
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Proximal Learning With Opponent-Learning Awareness
Watch later
Stephen Zhao, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Direct Sampling for extreme weather generation
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%