Dense Passage Retrieval (DPR)

Links

• Training

  • SBERT:

    • Doc: https://github.com/UKPLab/sentence-transformers/tree/master/examples/training/ms_marco

    • Impl: https://github.com/UKPLab/sentence-transformers/blob/master/examples/training/ms_marco/train_bi-encoder_mnrl.py

  • Beir

    • Doc: https://github.com/beir-cellar/beir/wiki/Examples-and-tutorials#beers-dense-retrieval-training

    • Impl: https://github.com/beir-cellar/beir/tree/main/examples/retrieval/training

  • Facebook-Research: https://github.com/facebookresearch/DPR

• Metrics

  • Doc: https://docs.haystack.deepset.ai/docs/evaluation#metrics-retrieval

  • Impl: https://github.com/beir-cellar/beir/blob/main/beir/retrieval/custom_metrics.py

• BM25

  • https://github.com/beir-cellar/beir/tree/main/beir/retrieval/search/lexical

• Videos

  • [Dense Retrieval - Knowledge Distillation (Sebastian Hofstätter)] (https://www.youtube.com/watch?v=EJ_7Gx6amt8)

  • [Crash Course IR - Evaluation] (https://www.youtube.com/watch?v=EiDltQZ713I)