Applications of the Theory of Aggregated Markov Processes in Stochastic Learning Theory

Fangyuan Lin
11/1/2023
stat.MLcs.LGmath.PR

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

A stochastic process that arises by composing a function with a Markov process is called an aggregated Markov process (AMP). The purpose of composing a Markov process with a function can be a reduction of dimensions, e.g., a projection onto certain coordinates. The theory around AMP has been extensively studied e.g. by Dynkin, Cameron, Rogers and Pitman, and Kelly, all of whom provided sufficient conditions for an AMP to remain Markov. In another direction, Larget provided a canonical representation for AMP, which can be used to verify the equivalence of two AMPs. The purpose of this paper is to describe how the theory of AMP can be applied to stochastic learning theory as they learn a particular task.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Almost Sure Convergence Rates and Concentration of Stochastic Approximation and Reinforcement Learning with Markovian Noise

79% match2024

A Tutorial Introduction to Reinforcement Learning

79% match2023

The ODE Method for Stochastic Approximation and Reinforcement Learning with Markovian Noise

78% match2024

A Cantor-Kantorovich Metric Between Markov Decision Processes with Application to Transfer Learning

78% match2024

Deep Stochastic Processes via Functional Markov Transition Operators

77% match2023

Stochastic weight matrix dynamics during learning and Dyson Brownian motion

77% match2024

Cite this paper

@article{lin2023applications,
  title  = {Applications of the Theory of Aggregated Markov Processes in Stochastic Learning Theory},
  author = {Fangyuan Lin},
  year   = {2023},
  eprint = {2311.01476},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.01476v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.01476.svg)](https://codeofpaper.com/paper/2311.01476)

Discussion