On the Relation between Quality-Diversity Evaluation and Distribution-Fitting Goal in Text Generation
Jul 12, 2020
Sprecher:innen
Jianing Li
Sprecher:in · 0 Follower:innen
Yanyan Lan
Sprecher:in · 0 Follower:innen
Jiafeng Guo
Sprecher:in · 0 Follower:innen
Xueqi Cheng
Sprecher:in · 0 Follower:innen
Über
The goal of text generation models is to fit the underlying real probability distribution of text. For performance evaluation, quality and diversity metrics are usually applied. However, it is still not clear to what extend can the quality-diversity evaluation reflect the distribution-fitting goal. In this paper, we try to reveal such relation in a theoretical approach. We prove that under certain conditions, a linear combination of quality and diversity constitutes a divergence metric between the generated distribution and the real distribution. We also show that the commonly used BLEU/Self-BLEU metric pair fails to match any divergence metric, thus propose CR/NRR as a substitute for quality/diversity metric pair.The goal of text generation models is to fit the underlying real probability distribution of text. For performance evaluation, quality and diversity metrics are usually applied. However, it is still not clear to what extend can the quality-diversity evaluation reflect the distribution-fitting goal. In this paper, we try to reveal such relation in a theoretical approach. We prove that under certain conditions, a linear combination of quality and diversity constitutes a divergence metric between t…
Kategorien
KI und Datenwissenschaft
Kategorie · 10,8k Präsentationen
Über ICML 2020
The International Conference on Machine Learning (ICML) is the premier gathering of professionals dedicated to the advancement of the branch of artificial intelligence known as machine learning. ICML is globally renowned for presenting and publishing cutting-edge research on all aspects of machine learning used in closely related areas like artificial intelligence, statistics and data science, as well as important application areas such as machine vision, computational biology, speech recognition, and robotics. ICML is one of the fastest growing artificial intelligence conferences in the world. Participants at ICML span a wide range of backgrounds, from academic and industrial researchers, to entrepreneurs and engineers, to graduate students and postdocs.
Gefällt euch das Format? Vertraut auf SlidesLive, um euer nächstes Event festzuhalten!
Professionelle Aufzeichnung und Livestreaming – weltweit.
Freigeben
Empfohlene Videos
Präsentationen, deren Thema, Kategorie oder Sprecher:in ähnlich sind
Energy-Based Models for Object-Oriented Learning
Später ansehen
Learning to Rank Learning Curves
Später ansehen
Inferring DQN structure for high-dimensional continuous control
Später ansehen
FetchSGD: Communication-Efficient Federated Learning with Sketching
Später ansehen
Optimal Sequential Maximization: One Interview is Enough!
Später ansehen
