Brief Bio.
Hi ๐ I am Wei Xu ( ่ฎธไผ in Chinese ), a Ph.D. candidate at USTC advised by Prof. Tingrui Pan and Prof. Kang Li. Before that, I received my masterโs degree in Computer Vision from UESTC in 2021, advised by Prof. Guotai Wang, Prof. Shaoting Zhang, and Prof. Kang Li.
My Research Interests:
- ๐ง human-centric multimodal learning
- ๐งฉ vision-language models
- ๐ง human/hand pose estimation
- ๐ถ gait analysis and recognition
News
Projects
๐งช Resources for human-centric multimodal learning.
ViPLab develops resources and research systems for human-centric multimodal learning, covering pose estimation, hand pose estimation, gait recognition, and gait analysis.
๐ฉบ Foundation model for localizing and segmenting anatomy targets in 3D medical images.
MedLSAM is a localization-and-segmentation foundation model for 3D medical images, designed to segment anatomy targets without additional task-specific annotation.
๐ง PyTorch code for human pose estimation, especially for CAREN-style rehabilitation data.
This project provides an improved framework for accurate 2D and 3D pose estimation in CAREN systems using multi-view videos.
Education
USTC
Ph.D in Computer Vision
SEPT. 2021 - JUL. 2024 (Expected)
University of Science and Technology of China (USTC)
- Supervised by Prof. Tingrui Pan and Prof. Kang Li
UESTC
Master in Computer Vision
SEPT. 2018 - JUL. 2021
University of Electronic Science and Technology of China (UESTC)
- Supervised by Prof. Guotai Wang, Prof. Shaoting Zhang and Prof. Kang Li.
- Master Thesis: โDeep Learning Based Human Pose Estimationโ
UESTC
Bachelor in Mechanical Engineering
SEPT. 2014 - JUL. 2018
University of Electronic Science and Technology of China (UESTC)
- Supervised by Prof. Yating Yu
Experience
RAWest China Biomedical Big Data Center, West China Hospital, Sichuan University
West China Hospital-SenseTime Joint Lab
- Advisor: Prof. Kang Li
- ๐ถ Gait Recognition, Human Pose Estimation, Human-centric Multimodal Learning with Vision-language Models
Research InternTacSense Technology (Suzhou) Co., Ltd.
- Advisor: Prof. Tingrui Pan
- Research and Design of Medical Cloud Platform
West China Biomedical Big Data Center, West China Hospital, Sichuan University
West China Hospital-SenseTime Joint Lab
- Advisor: Prof. Kang Li
- ๐ถ Gait Recognition, Gait Analysis
Healthcare Intelligence Lab, University of Electronic Science and Technology of China
- Advisor: Prof. Guotai Wang, Prof. Shaoting Zhang and Prof. Kang Li
- ๐ง Human Pose Estimation, Hand Pose Estimation, Medical Image Analysis
Digital Design and Simulation Lab, University of Electronic Science and Technology of China
- Advisor: Prof. Yating Yu
- โ๏ธ Simulation and Optimization of High-speed Rotating Experimental Platform for Dynamic Eddy Current Detection
Publications
โจ * indicates equal contribution. Selected publications are grouped with venue tags, authors, and direct links.
iDPA: Instance Decoupled Prompt Attention for Incremental Medical Object Detection
Evaluation of a smartphone-based markerless system to measure lower-limb kinematics in patients with knee osteoarthritis
MedLSAM: Localize and Segment Anything Model for 3D Medical Images
ConES: Concept Embedding Search for Parameter Efficient Tuning Large Vision Language Models
Towards General Purpose Medical AI: Continual Learning Medical Foundation Model
MTMVC: Semi-supervised 3D hand pose estimation using multi-task and multi-view consistency
Expert-level Immunofixation Electrophoresis Image Recognition based on Explainable and Generalizable Deep Learning
HMRNet: High-and-Multi- Resolution Network With Bidirectional Feature Calibration for Brain Structure Segmentation in Radiotherapy
Multiview Video-Based 3-D Pose Estimation of Patients in Computer-Assisted Rehabilitation Environment (CAREN)
Contrastive Learning of Relative Position Regression for One-Shot Object Localization in 3D Medical Images
Velocity effect in defect detection for ferrite metals by electromagnetic NDT
Challenges
๐ MICCAI 2022 Diabetic Foot Ulcer Challenge (DFUC) 2022
- Won 2nd Place in the MICCAI 2022 Diabetic Foot Ulcer Challenge
- OCRNet for Diabetic Foot Ulcer Segmentation Combined with Edge Loss
- Huahui Yi, Zekun Jiang, Jun Gao, Qingbo Kang, Wei Xu
- LkRobotAI Lab, West China Biomedical Big Data Center, China
Services
๐ Journal Reviewer
- IEEE Transactions on Human-Machine Systems (THMS)
๐ค Conference Reviewer
- ACM The Web Conference 2024 (ACM TheWebConf 2024)
A Little More
Outside research, I keep a few simple rituals that help me stay curious and reset.
- ๐ Basketball
- ๐ด Riding
- ๐ Sneakers