Advanced Information Retrieval System: Theoretical and Experimental Perspective

Evaluating Traditional and Modern Information Retrieval Techniques

Author(s): Urmila Pilania*, Manoj Kumar* and Sanjay Singh *

Pp: 1-10 (10)

DOI: 10.2174/9798898813666126010003

* (Excluding Mailing and Handling)

Abstract

The vast data sources use Information Retrieval (IR) methods for accessing the required information. The classical methods of IR, like Boolean retrieval and vector space, are fundamental for search strategies. The integration of these techniques with artificial intelligence will improve the accuracy of information retrieval. The research work compares the working of both the classical and modern information retrieval techniques. The comparison provides the merits and demerits of both methods so that information retrieval can be made more intelligent. The classical methods include Boolean retrieval and Term Frequency - Inverse Document Frequency (TF-IDF), while the modern method is Bidirectional Encoder Representations from Transformers (BERT). The authors have used the MS MARCO dataset for training and testing purposes. The authors have calculated precision, recall, and F1 score to evaluate the research work. From the simulation of work, it has been noticed that modern information retrieval methods can reduce the computational cost and enhance the accuracy of retrieval.


Keywords: BERT, Information Retrieval (IR), Modern IR techniques, Traditional IR techniques.