Yi Zhu

About Me

I am currently a researhc scientist at Reality Defender. I have obtained my phd from Multisensory Signal Analysis and Enhancement Lab (MuSAE), National Institute of Scientific Research (INRS) (Montreal, Canada) in Feb 2025.

My recent research has been centered around self-supervised learning, speech and audio foundation model pretraining, and the downstream applications of audio language models. Previously I have also worked closely with different sensor signals, such as physiological signals (e.g., EMG), humidity, temperature, etc.

Awards

• [June. 2023] Rising Star in Signal Processing at ICASSP 2023 .

News

• [Oct, 2025] Release a unified audio deepfake detection benchmarking toolkit .
• [Sep, 2025] Foundation model for health applications available now on IEEE-JBHI .
• [Dec, 2024] Paper accepted and presented at NeurIPS 2024 on a novel speech SSL representation for deepfake detection.
• [Apr, 2024] Two Oral presentations at ICASSP 2024 on deepfake detection and speech health diagnostics.
• [Apr, 2024] Paper on Speech anonymization for health monitoring is published at IEEE-TIFS!
• [Jan, 2024] Interning as an Applied Scientist on audio deepfake detection at Reality Defender (Finished in August).

Recent Publications

• [Sept, 2024] SLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detection, accepted at NeurIPS 2024
• [Sept, 2024] WavRx: a Disease-Agnostic, Generalizable, and Privacy-Preserving Speech Health Diagnostic Model, published at IEEE Journal of Biomedical Health Informatics
• [Aug. 2024] MSPB:a longitudinal multi-sensor dataset with phenotypic trait measurements from honeybees, published at Nature Scientific Data
• [Jan, 2024] On the Impact of Voice Anonymization on Speech-Based Health Diagnostics, published at IEEE Transactions on Information Forensics and Security

Datasets, toolboxes, and other useful resources

• AUDDT: Audio Unified Deepfake Detection Benchmarking Toolkit
• WavRx: a Foundation Model for speech-based health applications
• Multimodal dataset catalog
• Segmented and annotated COVID-19 cough phases
• Modulation Dynamics Block for Generalizable Deepfake Speech Detection
• Speech modulation spectrum toolbox
• Lecture code for the online workshop with UPFE (Brazil)