ConfLab: A Data Collection Concept, Dataset, and Benchmark for Marichne Analysis of Free-Standing Social Interactions In-the-Wild
Nov 28, 2022
Speakers
Chirag Raman
Speaker · 0 followers
Jose Vargas Quiros
Speaker · 0 followers
Stephanie Tan
Speaker · 0 followers
Ashraful Islam
Speaker · 0 followers
Ekin Gedik
Speaker · 0 followers
Hayley Hung
Speaker · 0 followers
About
Recording the dynamics of unscripted human interactions in-the-wild is challenging due to the delicate trade-offs between several factors: participant privacy, ecological validity, data fidelity, and logistical overheads. To address these, following a 'datasets for the community by the community' ethos, we propose the Conference Living Lab (ConfLab): a new concept for multimodal multisensor data collection of in-the-wild free-standing social conversations. For the first instantiation of ConfLab described here, we organized a real-life professional networking event at a major international conference. Involving 48 conference attendees, the dataset captures a diverse mix of status, acquaintance, and networking motivations. Our capture setup improves upon the data fidelity of prior in-the-wild datasets while retaining privacy sensitivity: 8 videos (1920x1080, 60fps) from a non-invasive overhead view, and custom wearable sensors with onboard recording of body motion (full 9-axis IMU), privacy-preserving low-frequency audio (1250Hz), and Bluetooth-based proximity. Additionally, we developed custom solutions for distributed hardware synchronization at acquisition, and time-efficient continuous annotation of body keypoints and actions at high sampling rates. Our benchmarks showcase some of the open research tasks related to in-the-wild privacy-preserving social data analysis: keypoints detection from overhead camera views, skeleton-based no-audio speaker detection, and F-formation detection.Recording the dynamics of unscripted human interactions in-the-wild is challenging due to the delicate trade-offs between several factors: participant privacy, ecological validity, data fidelity, and logistical overheads. To address these, following a 'datasets for the community by the community' ethos, we propose the Conference Living Lab (ConfLab): a new concept for multimodal multisensor data collection of in-the-wild free-standing social conversations. For the first instantiation of ConfLab…
Organizer
NeurIPS 2022
Account · 953 followers
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Bi-directional Weakly Supervised Knowledge Distillation for Whole Slide Image Classification
Watch later
Linhao Qu, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
A Unified Hard-Constraint Framework for Solving Geometrically Complex PDEs
Watch later
Songming Liu, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Privacy Induces Robustness: Information-Computation Gaps and Sparse Mean Estimation
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Momentum Aggregation for Private Non-convex ERM
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Confident Adaptive Language Modeling
Watch later
Tal Schuster, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Cost-Sensitive Self-Training for Optimizing Non-Decomposable Metrics
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%