2025

36th British Machine Vision Conference (BMVC 2025)

FootFormer: Estimating Stability from Visual Input

Keaton Kraiger, Skanda Bharadwaj, Robert T. Collins, Jingjing Li, Jesse Scott, Yanxi Liu

School of Electrical Engineering and Computer Science, Pennsylvania State University, University Park, USA

Keywords

human motion dynamics, foot pressure, stability estimation, center of mass, spatiotemporal transformer, deep learning, computer vision

Abstract

We propose FootFormer, a cross-modality approach for jointly predicting human motion dynamics directly from visual input. On multiple datasets, FootFormer achieves statistically significantly better or equivalent estimates of foot pressure distributions, foot contact maps, and center of mass (CoM), as compared with existing methods that generate one or two of those measures. Furthermore, FootFormer achieves SOTA performance in estimating stability-predictive components (CoP, COM, BOS) used in classic kinesiology metrics. Code and data are available at https://github.com/keatonkraiger/Vision-to-Stability.git.

Moticon's Summary

This publication introduces FootFormer, a spatiotemporal transformer model designed to predict physical stability metrics from monocular video. The researchers utilized Moticon OpenGo Sensor Insoles as a critical component of the UnderPressure (UP) dataset used for model validation. Specifically, the Moticon insoles provided the ground truth for 16 plantar pressure sensors and vertical ground reaction forces (vGRFs), which were used to define binary foot contact labels for the heel and toe regions. By providing high-fidelity pressure and contact data, the Moticon sensor insoles enabled the training and evaluation of FootFormer's ability to accurately regress foot-ground interactions, which are essential for calculating classic kinesiology metrics like the Center of Pressure (CoP) and Base of Support (BoS).

Contact Us
Book a free online demo or use the contact form to get in touch
Newsletter
Subscribe to our newsletter for regular updates

You Would Like to Get in Touch?

Write us a message on product related questions or with regards to your application.  We are here to assist!


Schedule an Online Demo

Get a hands-on overview of our products, find the best choice, discuss your application and ask questions.

30 minutes

Web conferencing details will be provided upon confirmation

You are currently viewing a placeholder content from Google Calendar. To access the actual content, click the button below. Please note that doing so will share data with third-party providers.

More Information

Stay one step ahead!

Subscribe to our newsletter for the latest information on case studies, webinars, product updates and company news

The form was sent successfully.

You will be contacted shortly.

Get Support

Check our FAQ database for answers to frequently asked questions

Describe your issue in as much detail as possible. Include screenshots or files if applicable.