About me
I am actively seeking a Spring or Summer 2027 Research Internship!
Hello, I am a Computer Science PhD student at Johns Hopkins University Center for Language and Speech Processing (CLSP) working on Natural Language Processing, advised by Prof. Mark Dredze. Before joining JHU, I was a student at Yale University, where I first learned and researched NLP under the guidance of Prof. Arman Cohan. My research interests are natural language processing, and applied mathematics and statistics, especially in health, social, and business applications. I regard many practical problems as an optimization problem with partially observed data. How to make the most use of the limited data and how to maximize the quantified outcome through simple, elegant ideas and rigorous definitions are my primary focuses during research.
My current research interests include (take the medical domain for example):
Evaluation of Open-ended Machine-Generated Text: Past evaluations require human-written answers as a gold standard, and compare lexical or semantic similarities of machine-generated text with gold answers. How can we evaluate diverse LLM-generated text with no human annotations? My current work focuses on factuality, completeness, and safety evaluation of LLM answers to patient questions.
Utilization of Web and Knowledge: Web information is mixed with misinformation and factual information. How can we identify misinformation based on the goal of study and optimally utilize the filtered knowledge to reach our goal?
Evaluation of Agents and Understanding Model Behaviors
To scale up affordable and accessible healthcare services, I envision one day chatbots can act at a trained clinical expert level to understand, comfort, and guide patients to recover.
If you are a student looking for research opportunities in clinical/medical NLP, please fill out this form and email me with your research interest and NLP-related experience/Google Scholar. I usually mentor one student each academic year.
Publications
Heyuan Huang, Jirui Dai, Alexandra DeLucia, Sonal Joshi, Mahsa Yarmohammadi, Jie Gao, Bernal Jiménez Gutiérrez, Mark Dredze
🏆 Oral (Top 2%, Best Paper Finalist) at NeurIPS 2026 Generative AI for Health (GenAI4Health) / code
Heyuan Huang, Alexandra DeLucia, Vijay Murari Tiyyala, Mark Dredze
ACL 2026 / code
How to Interpret Agent Behavior
Jie Gao, Kaiser Sun, Jen-tse Huang, Katherine Van Koevering, Sijie Ji, Heyuan Huang, Weiyan Shi, Zhuoran Lu, Ziang Xiao, Daniel Khashabi, Mark Dredze
NeurIPS 2026 / code
Alexandra DeLucia, Heyuan Huang, Sonal Joshi, Mahsa Yarmohammadi, Ahmed Hassoon, Mark Dredze
MedExpert: An Expert-Annotated Dataset for Medical Chatbot Evaluation
Mahsa Yarmohammadi, Alexandra DeLucia, Lillian C Chen, Leslie Miller, Heyuan Huang, …, Mark Dredze
Machine Learning for Health 2025 / code
Lorenzo Jaime Yu Flores, Heyuan Huang, Kejian Shi, Sophie Chheang, and Arman Cohan
EMNLP 2023 / code
Service
Invited Conference Reviewer: WWW 2027, NeurIPS 2026, COLM 2026, ACL 2024
Program Committee/Area Chair: Computational Linguistics and Clinical Psychology (CLPsych) 2025, 2026, 2027; Interpreting Agent Behavior 2026; Pacific Symposium on Biocomputing (PSB) 2027
Teaching
Head Teaching Assistant in Computer Science 601.486/686 Artificial Intelligence System Design and Development, Johns Hopkins University, Aug/2025 - Dec/2025
Teaching Assistant in CPSC 477/577 Natural Language Processing, Yale University, Jan/2024 - May/2024
Beyond Research
I love taking photos for other people, whether we’re traveling or just going about an ordinary day. Finding the right frame is my small way of handing someone a moment they’ll want to hold on to.
My parents adopted a dog while I was in college. She is 8 years old now and shares a personality with my younger self… 🤨 (My parents adopted another dog when I moved abroad for a graduate degree. He has no similar personality with me.)
My favorite book is Les Misérables by Victor Hugo, and my favorite musicals are its musical adaptation and Maybe Happy Ending.