Differentiable Multi-Target Causal Bayesian Experimental Design

Yashas Annadani, Panagiotis Tigas, Desi R. Ivanova, Andrew Jesson, Yarin Gal +2 more
2/21/2023
cs.LGcs.AIstat.ME

No official code found. Best implementation: yannadani/DiffCBED (5 stars, MIT, last commit 2023-07-13).

Abstract

We introduce a gradient-based approach for the problem of Bayesian optimal experimental design to learn causal models in a batch setting -- a critical component for causal discovery from finite data where interventions can be costly or risky. Existing methods rely on greedy approximations to construct a batch of experiments while using black-box methods to optimize over a single target-state pair to intervene with. In this work, we completely dispose of the black-box optimization techniques and greedy heuristics and instead propose a conceptually simple end-to-end gradient-based optimization procedure to acquire a set of optimal intervention target-state pairs. Such a procedure enables parameterization of the design space to efficiently optimize over a batch of multi-target-state interventions, a setting which has hitherto not been explored due to its complexity. We demonstrate that our proposed method outperforms baselines and existing acquisition strategies in both single-target and multi-target settings across a number of synthetic datasets.

View on arXivView PDF

Code Implementations(1)

yannadani/DiffCBEDCommunity100%
MIT
53R, PythonMay 29, 20233 years agoMIT

Cite this paper

@article{annadani2023differentiable,
  title  = {Differentiable Multi-Target Causal Bayesian Experimental Design},
  author = {Yashas Annadani and Panagiotis Tigas and Desi R. Ivanova and Andrew Jesson and Yarin Gal and Adam Foster and Stefan Bauer},
  year   = {2023},
  eprint = {2302.10607},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2302.10607v2},
  journal = {ICML 2023 2023}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2302.10607.svg)](https://codeofpaper.com/paper/2302.10607)

Discussion