Our paper on the power of hybrid architecture is accepted to AAAI 2025 as an oral presentation! You can find it at arXiv.