Towards End-User Development for IoT: A Case Study on Semantic Parsing of Cooking Recipes for Programming Kitchen Devices

Filippos Ventirozos, Sarah Clinch, Riza Batista-Navarro
9/25/2023
cs.CL

No confident code implementation found for this paper.

Abstract

Semantic parsing of user-generated instructional text, in the way of enabling end-users to program the Internet of Things (IoT), is an underexplored area. In this study, we provide a unique annotated corpus which aims to support the transformation of cooking recipe instructions to machine-understandable commands for IoT devices in the kitchen. Each of these commands is a tuple capturing the semantics of an instruction involving a kitchen device in terms of "What", "Where", "Why" and "How". Based on this corpus, we developed machine learning-based sequence labelling methods, namely conditional random fields (CRF) and a neural network model, in order to parse recipe instructions and extract our tuples of interest from them. Our results show that while it is feasible to train semantic parsers based on our annotations, most natural-language instructions are incomplete, and thus transforming them into formal meaning representation, is not straightforward.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

FIRE: Food Image to REcipe generation

78% match2 repos82023

From Language to Programs: Bridging Reinforcement Learning and Maximum Marginal Likelihood

78% match2017

Large Language Model Instruction Following: A Survey of Progresses and Challenges

78% match1 repo5122023

Scalable Learning of Latent Language Structure With Logical Offline Cycle Consistency

78% match2023

Coarse-to-Fine Decoding for Neural Semantic Parsing

77% match1 repo1682018

On Recipe Memorization and Creativity in Large Language Models: Is Your Model a Creative Cook, a Bad Cook, or Merely a Plagiator?

77% match2025

Cite this paper

@article{ventirozos2023towards,
  title  = {Towards End-User Development for IoT: A Case Study on Semantic Parsing of Cooking Recipes for Programming Kitchen Devices},
  author = {Filippos Ventirozos and Sarah Clinch and Riza Batista-Navarro},
  year   = {2023},
  eprint = {2309.14165},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2309.14165v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2309.14165.svg)](https://codeofpaper.com/paper/2309.14165)

Discussion