Structures

This entity applies MarkovModel for fully observable models, using Markov Chain and Markov decision process. More about Markov Models.

Given N possibles states, this entity calculates predictions of the next states given a current state. It relies on calculations and operations between vector and matrix.