One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval
Dec 6, 2021
Speakers
Akari Asai
Řečník · 0 sledujících
Jungo Kasai
Řečník · 0 sledujících
Hanna Hajishirzi
Řečník · 1 sledující
About
We present CORA, a Cross-lingual Open-Retrieval Answer Generation model that can answer questions across many languages even when language-specific annotated data or knowledge sources are unavailable. We introduce a new dense passage retrieval algorithm that is trained to retrieve documents across languages for a question.Combined with a multilingual autoregressive generation model, CORA answers directly in the target language without any external translation or in-language retrieval modules as used in prior work. To train CORA, we extend available annotated data using an iterative training approach that improves retrieval for languages with limited resources. Our results show that CORA substantially outperforms the previous state-of-the-art model on multilingual open question answering benchmarks across 26 languages, 9 of which are unseen during training. Our analyses show the significance of cross-lingual retrieval and generation in many languages, particularly under low-resource settings. We will publicly release our code and model.We present CORA, a Cross-lingual Open-Retrieval Answer Generation model that can answer questions across many languages even when language-specific annotated data or knowledge sources are unavailable. We introduce a new dense passage retrieval algorithm that is trained to retrieve documents across languages for a question.Combined with a multilingual autoregressive generation model, CORA answers directly in the target language without any external translation or in-language retrieval modules as…
Organizer
NeurIPS 2021
Účet · 1,9k sledujících
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Open Data Sharing and Indigenous Genomic Data Governance
Zhlédnout později
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
Prototypical Cross-Attention Networks for Multiple Object Tracking and Segmentation
Zhlédnout později
Lei Ke, …
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
Improved Regret Bounds for Tracking Experts with Memory
Zhlédnout později
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
A Novel Self-Distillation Architecture to Defeat Membership Inference Attacks
Zhlédnout později
Xinyu Tang, …
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
A Benchmark for Out-of-Distribution Detection in Deep Reinforcement Learning
Zhlédnout později
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
Towards Deeper Deep Reinforcement Learning
Zhlédnout později
Johan Bjorck, …
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %