Testing different Log Bases For Vector Model Weighting Technique

Kamel Assaf
7/12/2023
cs.IRcs.AI

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

Information retrieval systems retrieves relevant documents based on a query submitted by the user. The documents are initially indexed and the words in the documents are assigned weights using a weighting technique called TFIDF which is the product of Term Frequency (TF) and Inverse Document Frequency (IDF). TF represents the number of occurrences of a term in a document. IDF measures whether the term is common or rare across all documents. It is computed by dividing the total number of documents in the system by the number of documents containing the term and then computing the logarithm of the quotient. By default, we use base 10 to calculate the logarithm. In this paper, we are going to test this weighting technique by using a range of log bases from 0.1 to 100.0 to calculate the IDF. Testing different log bases for vector model weighting technique is to highlight the importance of understanding the performance of the system at different weighting values. We use the documents of MED, CRAN, NPL, LISA, and CISI test collections that scientists assembled explicitly for experiments in data information retrieval systems.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Exploring Information Retrieval Landscapes: An Investigation of a Novel Evaluation Techniques and Comparative Document Splitting Methods

80% match1 repo12024

A Comparative Study of Text Retrieval Models on DaReCzech

79% match2024

What Does MMLU Actually Measure? A Psychometric Audit of Difficulty Structure in Aggregate Benchmark Scores

77% match2026

Resources for Brewing BEIR: Reproducible Reference Models and an Official Leaderboard

77% match1 repo2.3k2023

Towards Explaining Query Expansion Performance in Information Retrieval

77% match2026

CHOP: Chunkwise Context-Preserving Framework for RAG on Multi Documents

77% match2026

Cite this paper

@article{assaf2023testing,
  title  = {Testing different Log Bases For Vector Model Weighting Technique},
  author = {Kamel Assaf},
  year   = {2023},
  eprint = {2307.06213},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2307.06213v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2307.06213.svg)](https://codeofpaper.com/paper/2307.06213)

Discussion