Markov process simulator
Markov process type:
Markov process
Markov reward process
Share: (click to copy)
Markov process property:
Stochastic matrix:
Add node +
Determinant: 0
-
-
0.5
0.5
0.5
0.5
Agent state:
Current state:
S0
S1
Agent speed:
Current timestep: 0
Current cumulated reward: 0
Start Agent
Clear
History:
S0
S1
0.5
0.5
0.5
0.5