Our paper on the relationship between self-attention and markov models is available on arXiv!