Our paper on the implicit bias of next-token prediction has been accepted to AISTATS 2024! It’s also available on arXiv.