Nov 28, 2022
Speaker · 0 followers
Speaker · 1 follower
We study model reusability evaluation (MRE) for source pre-trained models: evaluating their transfer learning performance to new target tasks. In special, we focus on the setting under which the target training datasets are small, making it difficult to produce reliable MRE scores using them. Under this situation, we propose synergistic learning for building the task-model metric, which can be realized by collecting a set of pre-trained models and asking a group of data providers to participate. We provide theoretical guarantees to show that the learned task-model metric distances can serve as trustworthy MRE scores, and propose synergistic learning algorithms and models for general learning tasks. Experiments show that the MRE models learned by synergistic learning can generate significantly more reliable MRE scores than existing approaches for small-data transfer learning.We study model reusability evaluation (MRE) for source pre-trained models: evaluating their transfer learning performance to new target tasks. In special, we focus on the setting under which the target training datasets are small, making it difficult to produce reliable MRE scores using them. Under this situation, we propose synergistic learning for building the task-model metric, which can be realized by collecting a set of pre-trained models and asking a group of data providers to participate.…
Account · 953 followers
Professional recording and live streaming, delivered globally.
Presentations on similar topic, category or speaker
Inwoo Hwang, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Zongkai Liu, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Jason Stock, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Qizhou Wang, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Viktor Bengs, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%