news

Jul 9, 2024 New paper CAT on the power of Convolution-Augmented Transformer is out!
May 3, 2024 Two papers: Sparse-PGD and From Self-Attention to Markov Models are accepted to ICML 2024. See you at Vienna.
Apr 3, 2024 I will be joining UC Berkeley EECS as a first-year PhD student in the upcoming Fall. See you at Berkeley!
Jan 10, 2024 Our paper on the implicit bias of next-token prediction has been accepted to AISTATS 2024! It’s also available on arXiv.
Feb 22, 2023 Our paper on the relationship between self-attention and markov models is available on arXiv!