Yixiao HUANG

Kowloon, Hong Kong, China
yixiao.huang@my.cityu.edu.hk My first name can be pronounced as “e-/ɕjɑʊ/”:
I’m Yixiao HUANG (Chinese name: 黄一笑) and I’m a first-year PhD student at UC Berkeley EECS supervised by Prof. Somayeh Sojoudi. I’m interested in establishing the theoretical foundations for generative models to enhance their efficiency and reliability.
I received my Bachelor’s degree in Informaton Engineering in June, 2023 from Department of Electrical Engineering, City University of Hong Kong. I was fortunate to work with Prof. Rosa CHAN who patiently guided me to start my research adventure. I also had a great time at University of Michigan, working with Prof. Samet Oymak on the theoretical foundations of self-attention and hybrid models.
news
Dec 9, 2024 | Our paper on the power of hybrid architecture is accepted to AAAI 2025 as an oral presentation! You can find it at arXiv. |
---|---|
May 3, 2024 | Two papers: Sparse-PGD and From Self-Attention to Markov Models are accepted to ICML 2024. See you at Vienna. |
Apr 3, 2024 | I will be joining UC Berkeley EECS as a first-year PhD student in the upcoming Fall. See you at Berkeley! |
Jan 10, 2024 | Our paper on the implicit bias of next-token prediction has been accepted to AISTATS 2024! It’s also available on arXiv. |
selected publications
* indicates equal contribution- AAAI 2025On the Power of Convolution Augmented TransformerAAAI Conference on Artificial Intelligence (AAAI), 2025Oral Presentation
- ICML 2024From Self-Attention to Markov Models: Unveiling the Dynamics of Generative TransformersInternational Conference on Machine Learning (ICML), 2024
- ICML 2024Towards Efficient Training and Evaluation of Robust Models against ł_0 Bounded Adversarial PerturbationsInternational Conference on Machine Learning (ICML), 2024