Comparing Optimization Targets for Contrast-Consistent Search

Hugo Fry, Seamus Fallows, Ian Fan, Jamie Wright, Nandi Schoots
11/1/2023
cs.LGcs.CL

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

We investigate the optimization target of Contrast-Consistent Search (CCS), which aims to recover the internal representations of truth of a large language model. We present a new loss function that we call the Midpoint-Displacement (MD) loss function. We demonstrate that for a certain hyper-parameter value this MD loss function leads to a prober with very similar weights to CCS. We further show that this hyper-parameter is not optimal and that with a better hyper-parameter the MD loss function attains a higher test accuracy than CCS.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{fry2023comparing,
  title  = {Comparing Optimization Targets for Contrast-Consistent Search},
  author = {Hugo Fry and Seamus Fallows and Ian Fan and Jamie Wright and Nandi Schoots},
  year   = {2023},
  eprint = {2311.00488},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.00488v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.00488.svg)](https://codeofpaper.com/paper/2311.00488)

Discussion