FurChat: An Embodied Conversational Agent using LLMs, Combining Open and Closed-Domain Dialogue with Facial Expressions

Neeraj Cherakara, Finny Varghese, Sheena Shabana, Nivan Nelson, Abhiram Karukayil +7 more
8/29/2023
cs.CLcs.AIcs.HC

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

We demonstrate an embodied conversational agent that can function as a receptionist and generate a mixture of open and closed-domain dialogue along with facial expressions, by using a large language model (LLM) to develop an engaging conversation. We deployed the system onto a Furhat robot, which is highly expressive and capable of using both verbal and nonverbal cues during interaction. The system was designed specifically for the National Robotarium to interact with visitors through natural conversations, providing them with information about the facilities, research, news, upcoming events, etc. The system utilises the state-of-the-art GPT-3.5 model to generate such information along with domain-general conversations and facial expressions based on prompt engineering.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Dobby: A Conversational Service Robot Driven by GPT-4

89% match2023

GPT Models Meet Robotic Applications: Co-Speech Gesturing Chat System

88% match2 repos512023

Think Before You Speak: Cultivating Communication Skills of Large Language Models via Inner Monologue

85% match1 repo32023

I Was Blind but Now I See: Implementing Vision-Enabled Dialogue in Social Robots

84% match1 repo72023

DiagGPT: An LLM-based and Multi-agent Dialogue System with Automatic Topic Management for Flexible Task-Oriented Dialogue

84% match2023

AsyncMLD: Asynchronous Multi-LLM Framework for Dialogue Recommendation System

84% match2023

Cite this paper

@article{cherakara2023furchat,
  title  = {FurChat: An Embodied Conversational Agent using LLMs, Combining Open and Closed-Domain Dialogue with Facial Expressions},
  author = {Neeraj Cherakara and Finny Varghese and Sheena Shabana and Nivan Nelson and Abhiram Karukayil and Rohith Kulothungan and Mohammed Afil Farhan and Birthe Nesset and Meriam Moujahid and Tanvi Dinkar and Verena Rieser and Oliver Lemon},
  year   = {2023},
  eprint = {2308.15214},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2308.15214v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2308.15214.svg)](https://codeofpaper.com/paper/2308.15214)

Discussion