Exploring Prompt-Based Methods for Zero-Shot Hypernym Prediction with Large Language Models

Mikhail Tikhomirov, Natalia Loukachevitch
1/9/2024
cs.CLcs.AI

No confident code implementation found for this paper. 10 possible matches can be shown below.

Abstract

This article investigates a zero-shot approach to hypernymy prediction using large language models (LLMs). The study employs a method based on text probability calculation, applying it to various generated prompts. The experiments demonstrate a strong correlation between the effectiveness of language model prompts and classic patterns, indicating that preliminary prompt selection can be carried out using smaller models before moving to larger ones. We also explore prompts for predicting co-hyponyms and improving hypernymy predictions by augmenting prompts with additional information through automatically identified co-hyponyms. An iterative approach is developed for predicting higher-level concepts, which further improves the quality on the BLESS dataset (MAP = 0.8).

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 10 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{tikhomirov2024exploring,
  title  = {Exploring Prompt-Based Methods for Zero-Shot Hypernym Prediction with Large Language Models},
  author = {Mikhail Tikhomirov and Natalia Loukachevitch},
  year   = {2024},
  eprint = {2401.04515},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2401.04515v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2401.04515.svg)](https://codeofpaper.com/paper/2401.04515)

Discussion