From Smartphone Images to Musculoskeletal Models: Personalized Inertial Parameter Estimation

Markus Gambietz1, Putri Qistina Azam1, Philipp Amon1, Iris Wechsler2, Eva Maria Hille3, Timo Menzel4, Tabea Ott5, Mario Botsch4, Matthias Braun3, Jörg Miehling2, Katie L. McMahon6, Anne D. Koelewijn1
Show affiliations ▼
 
 
SIPP Workflow
Method Overview: Workflow for creating personalized musculoskeletal models using smartphone-based body hulls. A) shows the automated SIPP pipeline, which takes a body hull or smartphone pictures as input and outputs participant-specific BSIPs. B) displays the current optical motion capture data workflow that scales a generic model to the participant's body segment lengths, for which we use addBiomechanics. We then combine the BSIPs from SIPP with the scaled model to create a personalized MSK model. When using smartphone pictures, arms were removed from the body hull as they are affected by sway during recording.
Personalized MSK Models
>13%
Lower residuals
<5 min
Additional recording time

Abstract

Every human body is different, however, current movement analysis does not reflect that, as it heavily relies on generic musculoskeletal models. Usually, these models are scaled to match the participants' body segment lengths and body weight, but not taking individual body shape into account. This can lead to errors in the estimation of joint forces and torques, which are important to accurately estimate musculoskeletal variables. Thus, we developed a method to estimate body segment inertial parameters based on smartphone pictures. From the pictures, we reconstruct the body hull, estimate the skeletal shape and pose, and then estimate the distribution of bone, lean, and fatty tissues. We then segment the body hull and assign each tissue type a density, which is used to calculate the body segment inertial parameters. These personalized models were validated with an experiment including gait and magnetic resonance imaging measurements. We found that our method leads to a reduction of residual forces of up to 14.9% and a reduction of metabolic cost of up to 12.8% when compared to generic musculoskeletal models. Furthermore, the shape-based inertial parameter personalization method creates participant-specific musculoskeletal models that are closer to the MRI-derived ground truth than generic models. To allow for the use of our method with existing data, we also introduce two new generic musculoskeletal models, which are based on the average standing body shapes and show similar joint moment outcomes, but less reduction of residual forces as the personalized models.

SIPP - Shape-based Inertial Parameter Personalization:
Web App

We are developing a web application to allow users to create personalized musculoskeletal models using body hull recordings - no coding required!
Sign up for our web-app here!

Citation

If you find our work useful, please cite:

@article {Gambietz2025.07.08.663673, author = {Gambietz, Markus and Azam, Putri Qistina and Amon, Philipp and Wechsler, Iris and Hille, Eva Maria and Menzel, Timo and Ott, Tabea and Botsch, Mario and Braun, Matthias and Miehling, J{\"o}rg and McMahon, Katie L. and Koelewijn, Anne D.}, title = {From Smartphone Images to Musculoskeletal Models: Personalized Inertial Parameter Estimation}, elocation-id = {2025.07.08.663673}, year = {2025}, doi = {10.1101/2025.07.08.663673}, publisher = {Cold Spring Harbor Laboratory}, URL = {https://www.biorxiv.org/content/early/2025/07/11/2025.07.08.663673}, eprint = {https://www.biorxiv.org/content/early/2025/07/11/2025.07.08.663673.full.pdf}, journal = {bioRxiv} }

Contact

For questions or collaborations, please reach out to:

Impressum