avatar

Haiyan Zhao

Ph.D. Student
New Jersey Institute of Technology
hz54@njit.edu


About Me

I am a second-year graduate student at the Department of Computer Science, New Jersey Institue of Technology(NJIT). Currently, I am working closely with Prof. Mengnan Du on model interpretablity. My research interests lie in Explainable AI(XAI), with an emphasis on large language models(LLMs). Before that I obtained my master degree from Huazhong University of Science and Technology(HUST) and my bachelor degree from Wuhan University of Technology(WUT).

Research Interests

XAI, LLM Alignment

News

  • [06/2024] Talk @ IEEE ICHI: Explaining training samples and enhancing trustworthiness with LLM
  • [11/2023] Invited talk @ NJIT FinTech Seminar: Explainability on LLMs
  • [10/2023] Invited talk @ MLLM-AI: Explainability on LLMs
  • [10/2023] Invited talk @ UberAI: Explainability on LLMs

Publications

  1. arXiv
    Beyond Single Concept Vector: Modeling Concept Subspace in LLMs with Gaussian Distribution
    Haiyan Zhao, Heng Zhao, Bo Shen, Ali Payani, Fan Yang, Mengnan Du
    preprint
    PDF Project Page

  2. arXiv
    Exploring Multilingual Probing in Large Language Models: A Cross-Language Analysis
    Daoyang Li, Mingyu Jin, Qingcheng Zeng, Haiyan Zhao, Mengnan Du
    preprint
    PDF

  3. arXiv
    Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?
    Mingyu Jin, Qinkai Yu, Jingyuan Huang, Qingcheng Zeng, Zhenting Wang, Wenyue Hua, Haiyan Zhao, Kai Mei, Yanda Meng, Kaize Ding, Fan Yang, Mengnan Du, Yongfeng Zhang
    preprint
    PDF

  4. arXiv
    Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era
    Xuansheng Wu, Haiyan Zhao, Yaochen Zhu, Yucheng Shi, Fan Yang, Tianming Liu, Xiaoming Zhai, Wenlin Yao, Jundong Li, Mengnan Du, Ninghao Liu
    preprint
    PDF Code

  5. arXiv
    Towards Uncovering How Large Language Model Works: An Explainability Perspective
    Haiyan Zhao, Fan Yang, Bo Shen, Himabindu Lakkaraju, Mengnan Du
    preprint
    PDF

  6. COLING
    Mitigating Shortcuts in Language Models with Soft Label Encoding
    Zirui He, Huiqi Deng, Haiyan Zhao, Ninghao Liu, Mengnan Du
    Association for Computational Linguistics (COLING), 2024.
    PDF Code

  7. ACL
    The Impact of Reasoning Step Length on Large Language Models
    Mingyu Jin, Qinkai Yu, Dong Shu, Haiyan Zhao, Wenyue Hua, Yanda Meng, Yongfeng Zhang, Mengnan Du
    Association for Computational Linguistics (ACL Findings), 2024.
    PDF Code

  8. TIST
    Explainability for Large Language Models: A Survey
    Haiyan Zhao, Hanjie Chen, Fan Yang, Ninghao Liu, Huiqi Deng, Hengyi Cai, Shuaiqiang Wang, Dawei Yin, Mengnan Du
    ACM Transactions on Intelligent Systems and Technology (TIST), 2024.
    PDF Code

Teaching

Services


Powered by Jekyll and Minimal Light theme.