Yixiao HUANG
Kowloon, Hong Kong, China
yixiao.huang@my.cityu.edu.hk My first name can be pronounced as “e-/ɕjɑʊ/”:
I’m Yixiao HUANG (Chinese name: 黄一笑). I received my Bachelor’s degree in Informaton Engineering in June, 2023 from Department of Electrical Engineering, City University of Hong Kong. I’m generally intersted in ML/DL Theory and non-convex optimization.
Currently I’m a research assistant at City University of Hong Kong supervised by Dr. Chen Liu where I’m investigating the reason behind the superior performance of adaptive methods (e.g., Adam) in language models. I was fortunate to work with Dr. Rosa CHAN who patiently guided me to start my research adventure. I also had a great time at University of Michigan, working with Dr. Samet Oymak on the theoretical foundations of self-attention.
news
| Jul 9, 2024 | New paper CAT on the power of Convolution-Augmented Transformer is out! |
|---|---|
| May 3, 2024 | Two papers: Sparse-PGD and From Self-Attention to Markov Models are accepted to ICML 2024. See you at Vienna. |
| Apr 3, 2024 | I will be joining UC Berkeley EECS as a first-year PhD student in the upcoming Fall. See you at Berkeley! |
| Jan 10, 2024 | Our paper on the implicit bias of next-token prediction has been accepted to AISTATS 2024! It’s also available on arXiv. |
selected publications
* indicates equal contribution- ICML 2024From Self-Attention to Markov Models: Unveiling the Dynamics of Generative TransformersInternational Conference on Machine Learning (ICML), 2024
- ICML 2024Towards Efficient Training and Evaluation of Robust Models against ł_0 Bounded Adversarial PerturbationsInternational Conference on Machine Learning (ICML), 2024