publications

publications are listed in reversed chronological order.

2025

  1. Preprint
    Generalization or Hallucination? Understanding Out-of-Context Reasoning in Transformers
    Yixiao Huang*, Hanlin Zhu*, Tianyu Guo*, Jiantao Jiao, Somayeh Sojoudi, and 3 more authors
    2025
    arXiv
  2. Preprint
    OVERT: A Benchmark for Over-Refusal Evaluation on Text-to-Image Models
    Ziheng Cheng*, Yixiao Huang*, Hui Xu, Somayeh Sojoudi, Xuandong Zhao, and 2 more authors
    2025
    arXiv
  3. Preprint
    Fast Adversarial Training against Sparse Attacks Requires Loss Smoothing
    Xuyang Zhong, Yixiao Huang, and Chen Liu
    2025
    arXiv
  4. AAAI 2025
    On the Power of Convolution Augmented Transformer
    Mingchen Li, Xuechen Zhang, Yixiao Huang, and Samet Oymak
    AAAI Conference on Artificial Intelligence (AAAI), 2025
    Oral Presentation
    arXiv

2024

  1. ICML 2024
    From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers
    M. Emrullah Ildiz, Yixiao Huang, Yingcong Li, Ankit Singh Rawat, and Samet Oymak
    International Conference on Machine Learning (ICML), 2024
    arXiv
  2. AISTATS 2024
    Mechanics of Next Token Prediction with Self-Attention
    Yingcong Li*, Yixiao Huang*, M. Emrullah Ildiz, Ankit Singh Rawat, and Samet Oymak
    International Conference on Artificial Intelligence and Statistics (AISTATS), 2024
    arXiv PDF
  3. ICML 2024
    Towards Efficient Training and Evaluation of Robust Models against ł_0 Bounded Adversarial Perturbations
    Xuyang Zhong, Yixiao Huang, and Chen Liu
    International Conference on Machine Learning (ICML), 2024
    arXiv

2022

  1. ICBINB@NeurIPS
    Dynamic Statistical Learning with Engineered Features Outperforms Deep Neural Networks for Smart Building Cooling Load Predictions
    Yiren Liu, S. Joe Qin, Xiangyu Zhao, Yixiao HUANG, Shenglong Yao, and 1 more author
    I Can’t Believe It’s Not Better Workshop: Understanding Deep Learning Through Empirical Falsification, 2022
    PDF
  2. BHI
    Stratification and Survival Prediction for Amyotrophic Lateral Sclerosis Patients
    Yixiao Huang, Xiaoli Wu, Rosa H. M. Chan, and Pooled Resource Open-Access ALS Clinical Trials Consortium
    2022 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), 2022
    PDF