MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry

Smart glasses can track where you are with only their built-in motion sensor, an inertial measurement unit (IMU); estimating position this way is called inertial odometry. It is low-power and privacy-friendly, but tiny errors accumulate: after minutes of walking, the estimate has drifted metres away.

MARIO starts from one observation: the IMU is attached to a person. A model infers from head motion how the body below is moving, keeping estimates consistent with human walking, and three sensors glasses already carry (a second IMU, a barometer, a magnetometer) steady them further.

The pose prior. A human-pose-grounded framework that injects a learnt IMU-inferred kinematics prior into the odometry model, improving stability and reducing drift.
The sensor fusion. A framework integrating barometer, magnetometer, and dual-IMU signals, substantially improving vertical and heading cues.
The evidence. Both modules drop into four existing architectures (TLIO, AirIO, RoNIN, EqNIO) with consistent gains across three datasets.

up to 44% less position error over long walks

up to 42% less drift as the walk gets longer

315 FPS inference speed, well beyond real time

Implementation

MARIO is not a new tracker built from scratch. It is two add-on modules that plug into existing inertial odometry systems; the same two modules improved all four systems we tried them on.

Architecture of the pose model. IMU acceleration and orientation streams enter a feature encoder followed by stacked GRU layers, which output joint positions and then joint rotations; a separate velocity decoder outputs joint velocities. — **The pose model.** A neural network reads the head’s acceleration and rotation and predicts how the **pelvis and legs** are moving. Its prediction anchors the tracker physically: position estimates must stay consistent with how a walking body actually moves. Arms and hands are left out; head motion says too little about them.

A block diagram of the sensor fusion pipeline: streams from the second IMU, barometer, and magnetometer are time-aligned with the primary IMU, each encoded into a compact feature, then concatenated with the pose model's prediction and fed into the host inertial odometry model. — **Sensor fusion.** Each additional sensor stream is aligned in time with the main IMU and compressed into a compact summary of what it is currently reporting. The summaries are then fed into the host tracker together with the pose model’s prediction, so any of the four trackers can use them without changing its own design.

Each fused sensor fixes a different kind of error:

Barometer: senses air pressure, which falls as you climb. This anchors altitude on stairs and slopes.
Magnetometer: senses the Earth’s magnetic field, giving a compass heading that stops the estimated path from slowly rotating away from the real one.
Second IMU: sits a few centimetres from the first, so any head rotation reads slightly differently on each. Comparing the two pins rotation down more firmly.

How we tested it

We trained and evaluated on Nymeria: 264 people wore sensor-equipped glasses for about 300 hours and 400 kilometres across 50 environments, with motion capture recording their true position.

Evaluation walks are held out from training, and we also ran the model, without any retraining, on a second dataset of home activities. We report how far the estimate ends up from the truth and how fast that error grows.

Results

The pose model alone already reduces error. Adding the fused sensors helps most on long walks, exactly where inertial odometry drifts the worst.

10.2 m → 5.7 m average error of a widely used tracker, before and with MARIO

4 / 4 trackers improved by the same two add-on modules

up to 53% less drift on home recordings it never trained on

Another tracker’s error fell from roughly 7 metres to 4.6, and the remaining two improved similarly, so the idea is not tied to any one design. On unseen home recordings, error still dropped by roughly a third, and inference runs comfortably in real time.

Removing one sensor at a time shows they are not redundant: the barometer contributes most to vertical accuracy, while the magnetometer and second IMU remove much of the remaining drift.

Team

This is research from the SPICE Lab at Northwestern University by:

Publication

This work appears at CVPR 2026 (Findings). The preprint is available on arXiv, and the authors’ print is available here (PDF).

Li, Y., Yeon, T., Gao, C., Xu, V., Liu, X., & Ahuja, K. (2026). MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (Findings).

@inproceedings{li2026mario,
  title={MARIO: Motion-Augmented Real-Time Multi-Sensor Inertial Odometry},
  author={Li, Yiquan and Yeon, Taeyoung and Gao, Chenfeng and Xu, Vasco and Liu, Xuanyou and Ahuja, Karan},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year={2026}
}

Overview

Implementation

How we tested it

Results

Team

Publication