Overview
A wristband that reads electrical impedance tomography (EIT) can follow the hand without a camera: tiny currents cross the forearm, and moving tendons and muscles change the voltages. But a wrist is attached to an arm, and the arm does not stay put. What happens when the same hand pose is held at a different arm position?
We recorded 22 people holding 12 hand poses across 32 arm postures, measured how far the signal and the prediction error move with the arm, and tested two remedies: covering more arm positions in training, and learning representations that know about the user and the arm position.
Same hand pose, different arm position
Hold a fist with the arm forward, then overhead. The hand has not changed, but the picture the wristband reconstructs has.
The shift is larger than the signal we want to read. For every one of the 22 participants, the EIT signal for a given pose moved further between arm positions than between different hand poses at one position (median ratio 3.9, paired Wilcoxon p < 0.00001).
A dataset built around the arm
Participants held each hand pose at a grid of arm positions and two forearm orientations while an EIT band and a headset recorded in sync.
An eight-electrode EIT band on the right forearm injects current between adjacent pairs and measures voltages across the rest, giving 40 measurements per frame at about 10 Hz.
Headset hand tracking provides the reference pose. We score 19 joints with mean per-joint position error (MPJPE) in millimetres.
The result is 346,540 synchronized frames from 22 right-handed participants, about 30 minutes each.
What the arm costs a pose estimator
Train a model at one arm position, then test it at the same person’s other positions. Error rises by 20 to 30% for every learned model we tried.
Each model is trained per participant and per arm position, then scored on held-out data at the training position and at that participant’s other positions. A constant-pose baseline that ignores the EIT signal rises only 10% over the same comparison, so the learned models lose more than a shift in the poses themselves would explain.
Fix 1: cover more arm positions
More people at one arm position barely helps. More arm positions does.
The practical reading: when data is expensive, sample the arm workspace before adding wearers, and report error on arm positions the model has never seen.
Fix 2: tell the model who and where
A small Transformer learns embeddings that group samples by user and by arm position, then fuses them before predicting the hand.
What we take from this
- Treat arm position as a factor in wrist EIT sensing, alongside wearer and session.
- Collect position-diverse data instead of only recruiting more people at one pose.
- Evaluate on unseen arm positions, separately from unseen wearers.
- Put position variation into the representation, not only into the training set.
The cohort is right-handed, the poses are prescribed holds, each person wore the band once, and the reference comes from headset tracking, so drift across days, free-form motion, and higher-fidelity references remain open. The dataset and code will be released for research purposes upon publication.
Status
This work is under anonymous review for the ACM Conference on Human Factors in Computing Systems (CHI 2027), full paper track. Author names and the manuscript are withheld until the review process is complete. This page will be updated with the full details afterwards.