Pan He Pronunciation
Assistant Professor · Auburn University
Department of Computer Science and Software Engineering
Samuel Ginn College of Engineering
CV · Google Scholar · GitHub · LinkedIn
3101T Shelby Center
357–359 W Magnolia Ave
Auburn, AL 36832
+1 (334) 844-6389
About
I lead the Modern Artificial Intelligence and Learning Technologies Lab (MALT Lab) at Auburn University. My research spans machine learning, language and multimodal models, computer vision, and intelligent infrastructure. We develop methods and systems that learn from multimodal data, adapt to changing environments, and understand dynamic scenes. Explore our research.
I received my PhD in Computer and Information Science and Engineering from the University of Florida in 2023, advised by Sanjay Ranka and Anand Rangarajan, and my BE in Software Engineering from Sichuan University in 2015. Previously, I worked with Yu Qiao and Weilin Huang at the Shenzhen Institutes of Advanced Technology (SIAT), Chinese Academy of Sciences, and with Xiaoou Tang and Chen Change Loy at the Multimedia Laboratory (MMLab), The Chinese University of Hong Kong (CUHK).
Join our group. I welcome prospective PhD, master’s, and undergraduate researchers, including remote collaborators. Research opportunities and application details →
Latest News
- Congratulations to Darryl Jacob, who received a NeurIPS 2026 Financial Assistance Award.
- I am honored to serve as an Area Chair for ICML 2027
- I am honored to serve as an Area Chair ARR Rolling Review, October 2026 Cycle
- NSF Panelists for multiple programs
- Both our COPRA and TorchUMM have been accepted in (NeurIPS 2026)
- I am honored to serve as an Area Chair for ICLR 2027
- Our paper "OISD: On-Policy Internal Self-Distillation of Language Models“ has been accepted in the 2026 Findings of the Association for Computational Linguistics: (EMNLP 2026)
- Our NSF proposal has been awarded. We sincerely thank Dr. Chris Yang and the panel reviewers for their time, support, and thoughtful evaluation.
- I am honored to serve as an Area Chair for WACV 2027
- Our paper "OISD: On-Policy Internal Self-Distillation of Language Models“ is available at arXiv
- Our paper "COPRA: Conditional Parameter Adaptation with Reinforcement Learning for Video Anomaly Detection“ is available at ArXiv
- Our paper "HiWaveRec: Hierarchical Wavelet Decoupling Framework with Adaptive Gating for Sequential Recommendation“ has been accepted in the 2026 European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD)
- I am honored to be recognized as a Gold Reviewer for ICML 2026
- Our paper "Mitigating the Modality Gap in Vision–Language Models with Fractal Spectral Geometry" has been accepted in the 2026 International Conference on Machine Learning (ICML)
- Our paper "OracleTSC: Oracle-Informed Reward Hurdle and Uncertainty Regularization for Traffic Signal Control" has been accepted in Transactions on Machine Learning Research (TMLR)
- I am honored to serve as an Area Chair for the Position Paper Track at NeurIPS 2026. I look forward to contributing to the community.
- Congratulations to Xinyu for being selected as a CRA Department Support Invitee to participate in the 2026 CRA-WP Grad Cohort Workshop!
- Congratulations to Darryl for being selected as a CRA Scholarship Invitee to participate in the 2026 CRA-WP Grad Cohort Workshop!
- Invited to serve as Associate Editor in IEEE Transactions on Image Processing (TIP).
- I am honored to serve as an Area Chair for the 2026 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2026). I look forward to contributing to the computer vision community.
- We gratefully acknowledge the generous cloud credits provided by the Lambda Research Grant Program. Thank you to the Lambda team!
- I received the 2025 ORAU Ralph E. Powe Junior Faculty Enhancement Award from Oak Ridge Associated Universities. Thank you, ORAU and the lovely reviewers!
- We are organizing the workshop Foundational AI for Pervasive Computing (FairPC) at PAKDD. We warmly invite you to submit your work
- Congratulations to Owen Strength. He has been selected as an honorable mention for the 2024-2025 CRA Outstanding Undergraduate Researcher Award
- Our paper "VERA: Explainable Video Anomaly Detection via Verbalized Learning of Vision-Language Models" is available at Project
- Our paper "An Efficient Semi-Automated Scheme for Infrastructure LiDAR Annotation" has been accepted in T-ITS
- Our paper "BadFusion: 2D-Oriented Backdoor Attacks against 3D Object Detection" has been accepted in IJCAI
- Our paper "A Holistic Framework Towards Vision-based Traffic Signal Control with Microscopic Simulation" is publicly available arxiv
- Congratulations to Isaiah Gallardo for being selected as 2024 Wolotsz Graduate Student Fellow.
- Invited to serve as Associate Editor in IEEE Transactions on Neural Networks and Learning Systems (TNNLS).
- Congratulations to Isaiah Gallardo. His research proposal to the AAAI-24 Undergraduate Consortium has been accepted (with awarded travel funding)
- My PhD dissertation is publicly available dissertation
- Our paper "BadFusion: 2D-Oriented Backdoor Attacks against 3D Object Detection" has been accepted in Backdoors in Deep Learning @ NeurIPS 2023
- Our paper "Towards Improving the Generation Quality of Autoregressive Slot VAEs" has been accepted in Neural Computation
- Our paper "Learning Canonical Embeddings for Unsupervised Shape Correspondence with Locally Linear Transformations" has been accepted in TPAMI
- Joined Auburn University as a tenure-track assistant professor. War Eagle!
- Our paper "A Spatiotemporal Correspondence Approach to Unsupervised LiDAR Segmentation with Traffic Applications" has been accepted in ITSC
- Finished my PhD defense. Dissertation Title "Deep Learning on Spatiotemporal Point Cloud Modeling for Motion and Correspondence"
- Our paper "An Efficient Semi-Automated Scheme for LiDAR Annotation and A Benchmark Infrastructure Dataset" has been accepted in ICLR ML4IoT
- Our paper "Automated Truck Taxonomy Classification Using Deep Convolutional Neural Networks" has been accepted in IJTSR
- Received the CVPR'22 Doctoral Consortium Award
- Our paper "Machine Learning based Real-time Multi-Camera Vehicle Tracking and Travel Time Estimation" has been accepted in J. Imaging
- Our paper "Machine Learning-based Highway Truck Commodity Classification Using Logo Data" has been accepted in Appl. Sci.
- Our paper "Self-Supervised Robust Scene Flow Estimation via the Alignment of Probability Density Functions" has been accepted in AAAI
- Our paper "Learning Scene Dynamics from Point Cloud Sequences" has been accepted in IJCV
- Received the ICCV'21 Doctoral Consortium Award
- Our paper "Learning Fast and Slow: PROPEDEUTICA for Real-time Malware Detection" has been accepted in TNNLS
- Our paper "Ego-Deliver: A Large-Scale Dataset for Egocentric Video Analysis" has been accepted in ACM-MM
- Our paper "Efficient Iterative Amortized Inference for Learning Symmetric and Disentangled Multi-Object Representations" has been accepted in ICML
- Our paper "SparsePipe: Parallel Deep Learning for 3D Point Clouds" has been accepted in HiPC
Experience
Full CV →- Aug 2023–present
Assistant Professor
Auburn University
Department of Computer Science and Software Engineering
- Aug 2017–Aug 2023
Research Assistant
MALT Lab, University of Florida
- May–Aug 2017
Research Intern
Megvii Research US
- Aug 2016–May 2017
Research Assistant
NSF IUCRC Center for Big Learning, University of Florida
- Oct 2015–Jul 2016
Research Assistant
Multimedia Laboratory, The Chinese University of Hong Kong
- Sep 2014–Jul 2016
Research Intern
Multimedia Laboratory, SIAT, Chinese Academy of Sciences
- Jul–Sep 2014
Summer Intern
National University of Singapore
- Sep 2013–May 2014
Project Developer
Facebook Open Academy
Awards and Honors →
Faculty recognition, fellowships, and student achievements.
Books, Patents, and Dissertation →
Patent records, supporting documents, and other scholarly work.