Brief Bio.
Hi 👋 my name is Wei Xu ( 许伟 in Chinese ). I am now studying for my PhD at USTC, advised by Prof. Tingrui Pan and Prof. Kang Li. Before that, I obtained my Master Degree in Computer Vision from UESTC in 2021, advised by Prof. Guotai Wang, Prof. Shaoting Zhang and Prof. Kang Li.
My Research Interests:
- human-centric multimodal learning
- vision-language models
- human/hand pose estimation
- gait analysis/recognition
News
Projects
Resources for human-centric multimodal learning.
ViPLab focuses on human-centric multimodal learning. Our research covers topics such as human pose estimation, hand pose estimation, gait recognition, and gait analysis.
Foundation Model for 3D Medical Image Localization and Segment Any Anatomy Target Without Additional Annotation.
We propose an Localize and Segment Anything Model for 3D Medical Images called MedLSAM which is a foundation model for 3D medical image localization and segment any anatomy target without additional annotation.
Pytorch code for human pose estimation, especially for CAREN dataset.
We propose an improved framework for accurate 2-D (and 3-D) pose estimation for the CAREN system through using multiview videos.
Education
USTC
Ph.D in Computer Vision
SEPT. 2021 - JUL. 2024 (Expected)
University of Science and Technology of China (USTC)
- Supervised by Prof. Tingrui Pan and Prof. Kang Li
UESTC
Master in Computer Vision
SEPT. 2018 - JUL. 2021
University of Electronic Science and Technology of China (UESTC)
- Supervised by Prof. Guotai Wang, Prof. Shaoting Zhang and Prof. Kang Li.
- Master Thesis: “Deep Learning Based Human Pose Estimation”
UESTC
Bachelor in Mechanical Engineering
SEPT. 2014 - JUL. 2018
University of Electronic Science and Technology of China (UESTC)
- Supervised by Prof. Yating Yu
Experience
RAWest China Biomedical Big Data Center, West China Hospital, Sichuan University
West China Hospital-SenseTime Joint Lab
- Advisor: Prof. Kang Li
- Gait Recognition, Huamn Pose Estimation, Human-centric Multimodal Learning with Vision-language Models
Research InternTacSense Technology (Suzhou) Co., Ltd.
- Advisor: Prof. Tingrui Pan
- Research and Design of Medical Cloud Platform
West China Biomedical Big Data Center, West China Hospital, Sichuan University
West China Hospital-SenseTime Joint Lab
- Advisor: Prof. Kang Li
- Gait Recognition, Gait Analysis
Healthcare Intelligence Lab, University of Electronic Science and Technology of China
- Advisor: Prof. Guotai Wang, Prof. Shaoting Zhang and Prof. Kang Li
- Human Pose Estimation, Hand Pose Estimation, Medical Image Analysis
Digital Design and Simulation Lab, University of Electronic Science and Technology of China
- Advisor: Prof. Yating Yu
- Simulation and Optimization of High-speed Rotating Experimental Platform for Dynamic Eddy Current Detection
Publications
( * indicates equal contributions )
MedLSAM: Localize and Segment Anything Model for 3D Medical Images
- arXiv preprint (2023)
- Wenhui Lei, Xu Wei, Xiaofan Zhang, Kang Li, Shaoting Zhang
- 🔖link: arXiv
ConES: Concept Embedding Search for Parameter Efficient Tuning Large Vision Language Models
- arXiv preprint (2023)
- Huahui Yi, Ziyuan Qin, Wei Xu, Miaotian Guo, Kun Wang, Shaoting Zhang, Kang Li, Qicheng Lao
- 🔖link: arXiv
Towards General Purpose Medical AI: Continual Learning Medical Foundation Model
- arXiv preprint (2023)
- Huahui Yi, Ziyuan Qin, Qicheng Lao, Wei Xu, Zekun Jiang, Dequan Wang, Shaoting Zhang, Kang Li
- 🔖link: arXiv
MTMVC: Semi-supervised 3D hand pose estimation using multi-task and multi-view consistency
- Journal of Visual Communication and Image Representation (2023)
- Donghai Xiang, Wei Xu, Yuting Zhang, Bei Peng, Guotai Wang, Kang Li
- 🔖link: JVIS
Expert-level Immunofixation Electrophoresis Image Recognition based on Explainable and Generalizable Deep Learning
- Clinical Chemistry (2022)
- Honghua Hu*, Wei Xu*, Ting Jiang, Yuheng Cheng, Xiaoyan Tao, Wenna Liu, Meiling Jian, Kang Li, Guotai Wang
- 🔖link: Clinical Chemistry
HMRNet: High-and-Multi- Resolution Network With Bidirectional Feature Calibration for Brain Structure Segmentation in Radiotherapy
- IEEE Journal of Biomedical and Health Informatics (2022)
- Hao Fu, Guotai Wang, Wenhui Lei, Wei Xu, Qianfei Zhao, Shichuan Zhang, Kang Li, Shaoting Zhang
- 🔖link: JBHI
Multiview Video-Based 3-D Pose Estimation of Patients in Computer-Assisted Rehabilitation Environment (CAREN)
- IEEE Transactions on Human-Machine Systems (2022)
- Wei Xu, Donghai Xiang, Guotai Wang, Ruisong Liao; Ming Shao; Kang Li
- 🔖link: THMS 🔧Code: Github
Contrastive Learning of Relative Position Regression for One-Shot Object Localization in 3D Medical Images
- Medical Image Computing and Computer Assisted Interventions 2021 (MICCAI 2021)
- Wenhui Lei*, Wei Xu*, Ran Gu, Hao Fu, Shaoting Zhang, Shichuan Zhang, Guotai Wang
- 🔖link: MICCAI21 🔧Code: Github
Velocity effect in defect detection for ferrite metals by electromagnetic NDT
- 2018 IEEE Far East NDT New Technology & Application Forum (FENDT 2018)
- Fei Yuan, Yating Yu, Na Yu, Wei Xu, Ning Zhao, Guiyun Tian
- 🔖link: FENDT
Challenges
MICCAI 2022 Diabetic Foot Ulcer Challenge (DFUC) 2022
- Won the 2nd Place in MICCAI 2022 Diabetic Foot Ulcer Challenge 2022
- OCRNet for Diabetic Foot Ulcer Segmentation Combined with Edge Loss
- Huahui Yi, Zekun Jiang, Jun Gao, Qingbo Kang, Wei Xu
- LkRobotAI Lab, West China Biomedical Big Data Center, China
Services
Journal Reviewer
- IEEE Transactions on Human-Machine Systems (THMS)
Conference Reviewer
- ACM The Web Conference 2024 (ACM TheWebConf 2024)
a little more ‧‧‧
Alongside my interests in computer vision and deep learning some of my other interests and hobbies are:
- Basketball
- Riding
- Sneakers