TY - JOUR
T1 - Abductive learning of quantized stochastic processes with probabilistic finite automata
AU - Chattopadhyay, Ishanu
AU - Lipson, Hod
PY - 2013/2/13
Y1 - 2013/2/13
N2 - We present an unsupervised learning algorithm (GenESeSS) to infer the causal structure of quantized stochastic processes, defined as stochastic dynamical systems evolving over discrete time, and producing quantized observations. Assuming ergodicity and stationarity, GenESeSS infers probabilistic finite state automata models from a sufficiently long observed trace. Our approach is abductive; attempting to infer a simple hypothesis, consistent with observations and modelling framework that essentially fixes the hypothesis class. The probabilistic automata we infer have no initial and terminal states, have no structural restrictions and are shown to be probably approximately correct-learnable. Additionally, we establish rigorous performance guarantees and data requirements, and show that GenESeSS correctly infers long-range dependencies. Modelling and prediction examples on simulated and real data establish relevance to automated inference of causal stochastic structures underlying complex physical phenomena.
AB - We present an unsupervised learning algorithm (GenESeSS) to infer the causal structure of quantized stochastic processes, defined as stochastic dynamical systems evolving over discrete time, and producing quantized observations. Assuming ergodicity and stationarity, GenESeSS infers probabilistic finite state automata models from a sufficiently long observed trace. Our approach is abductive; attempting to infer a simple hypothesis, consistent with observations and modelling framework that essentially fixes the hypothesis class. The probabilistic automata we infer have no initial and terminal states, have no structural restrictions and are shown to be probably approximately correct-learnable. Additionally, we establish rigorous performance guarantees and data requirements, and show that GenESeSS correctly infers long-range dependencies. Modelling and prediction examples on simulated and real data establish relevance to automated inference of causal stochastic structures underlying complex physical phenomena.
KW - Machine learning
KW - Probabilistic finite automata
KW - Stochastic processes
KW - Symbolic dynamics
UR - http://www.scopus.com/inward/record.url?scp=84874131722&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84874131722&partnerID=8YFLogxK
U2 - 10.1098/rsta.2011.0543
DO - 10.1098/rsta.2011.0543
M3 - Article
C2 - 23277601
AN - SCOPUS:84874131722
SN - 1364-503X
VL - 371
JO - Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
JF - Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences
IS - 1984
M1 - 0543
ER -