Definitions of Markovian:

  • adjective:   relating to or generated by a Markov process