Dr. Xudong Pan 潘旭东 博士


Assistant Professor
System Software and Security Lab
School of Computer Science
Fudan University
Email: xdpan at fudan.edu.cn

Google Scholar| GitHub| DBLP| Lab Homepage | CV

About me


Welcome! My name is Xudong Pan (潘旭东). I earned my Bsc. and PhD degree from Fudan University in 2018/2023, under the supervision of Prof. Min Yang and Prof. Mi Zhang. My research focus is AI Security/Safety. My past research outcomes include (x: first-authored):
I was awarded with the ACM SIGSAC China Distinguished Doctoral Prize and WAIC Youth Distinguished Paper Nomination Prize for my work on the privacy risks of large language models in 2020.


My current interests:
[🔥🔥🔥] Our lab is always looking for self-motivated (undergraduate/master/doctoral) students. If you are interested in working with me on AI safety/security, please feel free to drop me an email at (xdpan at fudan.edu.cn) with your CV.

News


[2024/05] Our test benchmark for LLM safety is published at the CRAD journal (in Chinese, Link). The benchmark exposes the vulnerability of over ten open-sourced/proprietary LLMs (including ChatGPT and LLaMA2-70B-Chat).
[2024/03] Our BELT approach to substantially improve the stealthiness of a number of old-school backdoor attacks (e.g., BadNet) is accepted by IEEE S&P 2024 (Link).
[2023/05] Another attack based on neuron invariance against white-box DNN watermarks is accepted by KDD 2023 (Link).
[2023/02] Our work on defending LiDAR-based object detectors on self-driving cars is accepted to USENIX Security 2023 (Link).
[2023/01] Our work on successfully cracking 9 SOTA white-box DNN watermarks is accepted to USENIX Security 2023 (Link).

Publications


Cracking White-box DNN Watermarks via Invariant Neuron Transforms

Xudong Pan, Mi Zhang, Yifan Yan, Yining Wang, Min Yang

KDD 2023

pdf



Exorcising “Wraith”: Protecting LiDAR-based Object Detector in Automated Driving System from Appearing Attacks

Qifan Xiao*, Xudong Pan*, Yifan Lu, Mi Zhang, Min Yang

USENIX Security 2023

pdf



Rethinking White-Box Watermarks on Deep Learning Models under Neural Structural Obfuscation

Yifan Yan*, Xudong Pan*, Mi Zhang, Min Yang.

USENIX Security 2023

pdf



MaSS: Model-agnostic, Semantic and Stealthy Data Poisoning Attack on Knowledge Graph Embedding

Xiaoyu You, Beina Sheng, Daizong Ding, Mi Zhang, Xudong Pan, Min Yang, Fuli Feng.

The Web Conference, 2023

pdf



Anti-FakeU: Defending Shilling Attacks on Graph Neural Network based Recommender Model

Xiaoyu You, Chi Lee, Daizong Ding, Mi Zhang, Fuli Feng, Xudong Pan, Min Yang

The Web Conference, 2023

pdf



RØROS: Building a Responsive Online Recommender System via Meta-Gradients Updating

Xudong Pan, Mi Zhang, Duocai Wu.

2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

pdf



House of Cans: Covert Transmission of Internal Datasets via Capacity-Aware Neuron Steganography

Xudong Pan, Shengyao Zhang, Mi Zhang, Yifan Yan, Min Yang

The 36th Annual Conference on Neural Information Processing Systems (NeurIPS), 2022

pdf



MetaV: A Meta-Verifier Approach to Task-Agnostic Model Fingerprinting

Xudong Pan, Yifan Yan, Mi Zhang, Min Yang

The 28th SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2022

pdf



Exploring the Security Boundary of Data Reconstruction via Neuron Exclusivity Analysis

Xudong Pan, Mi Zhang, Yifan Yan, Jiaming Zhu, Min Yang

The 31st USENIX Security Symposium (USENIX Security), 2022

pdf



Hidden Trigger Backdoor Attack on NLP Models via Linguistic Style Manipulation

Xudong Pan, Mi Zhang, Beina Sheng, Jiaming Zhu, Min Yang

The 31st USENIX Security Symposium (USENIX Security), 2022

pdf



Towards Backdoor Attack on Deep Learning based Time Series Classification

Daizong Ding, Mi Zhang, Yuanmin Huang, Xudong Pan, Fuli Feng, Erling Jiang, Min Yang.

The 38th IEEE International Conference on Data Engineering (ICDE), 2022

pdf



Enhancing Time Series Predictors with Generalized Extreme Value Loss

Mi Zhang, Daizong Ding, Xudong Pan, Min Yang

IEEE Transactions on Knowledge and Data Engineering (TKDE), 2021

pdf



Understanding the Threats of Trojaned Quantized Neural Network in Model Supply Chains

Xudong Pan, Mi Zhang, Yifan Yan, Min Yang

The 38th Annual Computer Security Applications Conference (ACSAC), 2021

pdf



TAFA: A Task-Agnostic Fingerprinting Algorithm for Neural Networks

Xudong Pan, Mi Zhang, Yifan Lu, Min Yang

The 26th European Symposium on Research in Computer Security (ESORICS), 2021

pdf



A Deep Learning Framework for Self-evolving Hierarchical Community Detection

Daizong Ding, Mi Zhang, Hanrui Wang, Xudong Pan, Xiangnan He, Min Yang

The 30th ACM International Conference on Information and Knowledge Management (CIKM), 2021

pdf



Privacy Risks of General-Purpose Language Models

Xudong Pan, Mi Zhang, Shouling Ji, Min Yang

2020 IEEE Symposium on Security and Privacy (S&P) WAIC Youth Distinguished Paper Mention

pdf



Justinian’s GAAvernor: Robust Distributed Learning with Gradient Aggregation Agent

Xudong Pan, Mi Zhang, Duocai Wu, Qifan Xiao, Min Yang.

The 29th USENIX Security Symposium (USENIX Security), 2020

pdf



A Geometrical Perspective on Image Style Transfer with Adversarial Learning

Xudong Pan, Mi Zhang, Daizong Ding, Min Yang

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020

pdf



Improving the Robustness of Wasserstein Embedding by Adversarial PAC-Bayesian Learning

Daizong Ding, Mi Zhang, Xudong Pan, Xiangnan He, Min Yang.

The 34th AAAI Conference on Artificial Intelligence (AAAI), 2020

pdf



Modeling Personalized Out-of-Town Distances in Location Recommendation

Daizong Ding, Mi Zhang, Xudong Pan, Xiangnan He, Min Yang.

The 20th IEEE International Conference on Data Mining (ICDM), 2020

pdf



Modeling Extreme Events in Time Series Prediction

Daizong Ding, Mi Zhang, Xudong Pan, Xiangnan He, Min Yang

The 25th SIGKDD Conference on Knowledge Discovery and Data Mining (KDD), 2019

pdf



Theoretical Analysis of Image-to-Image Translation with Adversarial Learning

Xudong Pan, Mi Zhang, Daizong Ding

The 35th International Conference on Machine Learning (ICML), 2018

pdf



Geographical Feature Extraction for Entities in Location-based Social Networks

Daizong Ding, Mi Zhang, Xudong Pan, Duocai Wu, Pearl Pu

The 2018 World Wide Web Conference (WWW), 2018

pdf






Impact


Patents


A Defense Agent for Enhancing the Robustness of Distributed Learning Systems
Invention Patent (No. CN111967015A), China, 2020

A Meta-Verifier Approach to Deep Neural Network Fingerprinting
Invention Patent (No. CN202210879918.2), China, 2022

A Training Data Reconstruction Algorithm based on Neuron Exclusivity
Invention Patent (No. CN202210183023.5), China, 2022

A Task-Agnostic Fingerprinting Scheme for Deep Neural Networks
Invention Patent (No. CN202111178549.6), China, 2021

Selected Awards


  • ACM SIGSAC China Doctoral Dissertation Award (2023, three awardees per year)
  • National Scholarships, Ministry of Education, China (2022, $4,250)
  • Academic Star, Fudan University (2022, 10 winners across all the STEM graduate schools)
  • Student Grant, The USENIX Association (2022, $1,000)
  • Youth Outstanding Paper Finalist, World Artificial Intelligence Conference (2022)
  • 1st Place of AutoDriving CTF, DEFCON 30 (2022, Team Co-Leader)
  • 1st Place of AutoDriving CTF, DEFCON 29 (2021, Team Co-Leader)
  • Student Grant, The USENIX Association (2020, $500)
  • National Scholarships, Ministry of Education, China (2020, $4,250)

Service & Outreach


  • Invited reviewer for CVPR (2023), AAAI (2022, 2021), ICML (2022), IJCAI (2021).
  • Invited speaker and panel speaker for IJCAI China (2022).
  • In-depth participation in a new revision on the "AI Security Standardization White-book", China Academy of Information and Communications Technology (CAICT).
  • Co-founder of the Theoretical Tools for AI Security study group (weekly meeting, 2022/03-current) and the Introduction to System Security for AI Researcher reading group (covering program analysis, fuzzing, symbolic execution, network intrusion detection and how AI helps them, 2022/03-2022/06) at Fudan University.

Teaching


@Fudan University
  • Academic English, Undergraduate Course, Teacher Assistant, Spring, 2021/2019

  • Responsibility: Teaching how to do presentation on technical topics in English.
  • Introduction to Computing, Undergraduate Course, Teacher, Spring, 2018
  • Responsibility: Teaching introductory python programming and basic computation notions (e.g., loop, condition, recursion, Turing machine) to 100 overseas students (from Asia, Europe, America, Africa, and Australia) with medical backgrounds.
# of Visitors: .