Communication Dans Un Congrès Année : 2026

HUMAPS-4D : A Multimodal Dataset for HUman Motion Analysis with Physiological and Semantic informations

Résumé

Current advancements in human motion understanding are strongly reliant on video data. Nevertheless, privacy regulations and operational constraints increasingly restrict the use of visual data in real-world scenarios. Inferring posture through wearable sensors, such as instrumented insoles measuring plantar activation, presents itself as a promising alternative. However, the absence of large-scale multimodal datasets hinders the rigorous benchmarking of these methodologies. We introduce HUMAPS-4D, a novel multimodal dataset designed for human motion analysis, effectively bridging computer vision and biomechanics. This dataset integrates synchronized motion capture, multi-view video, IMUs, plantar pressure signals, sEMG activation patterns, and high-level semantic annotations. The data was collected from 32 subjects performing 30 actions over a total duration of 14 hours. Participants demonstrate substantial anthropometric variability (age, body proportions, and morphology), which supports robust generalization across diverse body types. Distinct from existing resources, this collection offers a unique pairing of low-level physiological signals and high-level human motor descriptors. This capability enables the development of generative and inference models conditioned by both physical and semantic constraints, while simultaneously reducing the reliance on personally identifiable visual data. We establish benchmark tasks specifically targeting posture reconstruction from plantar pressure, semantic motion segmentation, physics-informed motricity analysis, and multimodal fusion under privacy-preserving conditions.

Fichier principal
Vignette du fichier
CVPR_HUMAPS4D.pdf (2.36 Mo) Télécharger le fichier

Dates et versions

hal-05531226 , version 1 (26-03-2026)

Licence

Identifiants

  • HAL Id : hal-05531226 , version 1

Citer

Matthieu Dabrowski, Ouala Ben Jemaa, Benjamin Allaert. HUMAPS-4D : A Multimodal Dataset for HUman Motion Analysis with Physiological and Semantic informations. The IEEE/CVF Conference on Computer Vision and Pattern Recognition 2026, Jun 2026, Denver (Colorado), United States. ⟨hal-05531226⟩
126 Consultations
52 Téléchargements

Partager

  • More