Longformer for MS MARCO Document Re-ranking Task

September 20, 2020 · Entered Twilight · 🏛 Text Retrieval Conference

"Last commit was 5.0 years ago (≥5 year threshold)"

Evidence collected by the PWNC Scanner

Repo contents: .gitignore, README.md, data, src

Authors Ivan Sekulić, Amir Soleimani, Mohammad Aliannejadi, Fabio Crestani arXiv ID 2009.09392 Category cs.IR: Information Retrieval Citations 13 Venue Text Retrieval Conference Repository https://github.com/isekulic/longformer-marco ⭐ 20 Last Checked 1 month ago

Abstract

Two step document ranking, where the initial retrieval is done by a classical information retrieval method, followed by neural re-ranking model, is the new standard. The best performance is achieved by using transformer-based models as re-rankers, e.g., BERT. We employ Longformer, a BERT-like model for long documents, on the MS MARCO document re-ranking task. The complete code used for training the model can be found on: https://github.com/isekulic/longformer-marco