mRI: Multi-modal 3D Human Pose Estimation Dataset using mmWave, RGB-D, and Inertial Sensors
Nov 28, 2022
Speakers
About
The ability to estimate 3D human body pose and movement, also known as human pose estimation (HPE), enables many applications for home-based health monitoring, such as remote rehabilitation training. Several possible solutions have emerged using sensors ranging from RGB cameras, depth sensors, millimeter-Wave (mmWave) radars, and wearable inertial sensors. Despite previous efforts on datasets and benchmarks for HPE, few dataset exploits multiple modalities and focuses on home-based health monitoring. To bridge the gap, we present mRI, a multi-modal 3D human pose estimation dataset with mmWave, RGB-D, and Inertial Sensors. Our dataset consists of over 160k synchronized frames from 20 subjects performing rehabilitation exercises and supports the benchmarks of HPE and action detection. We perform extensive experiments using our dataset and delineate the strength of each modality. We hope that the release of mRI can catalyze the research in pose estimation, multi-modal learning, and action understanding, and more importantly facilitate the applications of home-based health monitoring.The ability to estimate 3D human body pose and movement, also known as human pose estimation (HPE), enables many applications for home-based health monitoring, such as remote rehabilitation training. Several possible solutions have emerged using sensors ranging from RGB cameras, depth sensors, millimeter-Wave (mmWave) radars, and wearable inertial sensors. Despite previous efforts on datasets and benchmarks for HPE, few dataset exploits multiple modalities and focuses on home-based health monito…
Organizer
NeurIPS 2022
Účet · 962 sledujících
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
CLaP: Conditional Latent Planners for Offline Reinforcement Learning
Zhlédnout později
Harry Shin, …
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
A Boosting Approach to Reinforcement Learning
Zhlédnout později
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
Posted Pricing and Dynamic Prior-independent Mechanisms with Value Maximizers
Zhlédnout později
Yuan Deng, …
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
Multitasking Models are Robust to Structural Failure: A Neural Model for Bilingual Cognitive Reserve
Zhlédnout později
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
A Versatile and Efficient Reinforcement Learning Approach for Autonomous Driving
Zhlédnout později
Guan Wang, …
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %
Distributional Privacy for Data Sharing
Zhlédnout později
Zinan Lin, …
Pro uložení prezentace do věčného trezoru hlasovalo 0 diváků, což je 0.0 %