Papers for

assistive device makers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Russian fingerspelling dataset supports new sign language recognition models

Znaki: A Russian Fingerspelling Recognition Dataset

Abstract: Fingerspelling - the sequential signing of letters that compose proper names, technical terms, and out-of-vocabulary words - is an integral component of any sign language. Despite Russian Sign Language (RSL) being used by more than 150,000 native signers, no public fingerspelling dataset for RSL exists, in contrast to American, British, German, and several other sign languages. We introduce Znaki the first open RSL fingerspelling dataset: 37,252 video recordings (35.4 hours) of 1,593 unique sequences - proper names sampled from 16 domain categories - recorded by 68 native RSL signers (37 Deaf, 29 hard-of-hearing, and 2 certified interpreters) through a crowdsourcing pipeline with a two-stage signer qualification procedure and expert validation. The dataset covers all 33 Cyrillic handshapes, and its letter-frequency distribution matches the Russian National Corpus. As reference points for future research, we establish two baselines adapted from American Sign Language fingerspelling recognition: a Squeezeformer-based encoder-decoder, reaching a character-level accuracy ($1-\mathrm{CER}$) of 0.932 and a sequence accuracy of 0.596, and Fingerspelling-PoseNet, reaching 0.886 and 0.545, respectively.

Mon 2 NovComputer Vision and Pattern Recognition
The gist
Fingerspelling is spelling out words letter by letter using hand signs, vital in sign languages. The authors created Znaki, the first public dataset of Russian Sign Language fingerspelling videos, with thousands of recordings from native signers. This helps researchers build better recognition systems that can understand fingerspelled words in Russian. They also tested two recognition methods to provide a starting point for future work.
Open → 2611.03136v1

Pedestrian perspective dataset improves urban obstacle detection accuracy

ROD-Dataset: A Pedestrian-Perspective Benchmark of Urban Obstacle Classes for YOLO-Based Detection

Abstract: Two groups of pedestrians face avoidable risk on the city sidewalk: people living with visual impairment, who reach an obstacle before anything warns them, and people walking with divided attention, who register a hazard late or not at all. A vision system can warn them only about obstacles it has learned to recognize, so its training data limits the protection it offers. No suitable training set exists: public benchmarks are recorded from vehicles, aerial platforms, or fixed rigs, general-purpose detectors omit the street furniture that causes trips, and pedestrian-focused collections are confined to single regions with incompatible class schemes. This paper introduces the Real-time Obstacle Detection (ROD) dataset: more than 24,000 images and 40,000 annotated obstacles across 25 classes, from vehicles and people to the stairs, manholes, traffic cones, and benches that general-purpose detectors overlook. Because street furniture differs between cities, ROD unifies twenty-nine public collections onto one taxonomy and adds eye-level imagery from two contrasting cities on two continents, Tehran and Toronto. Every label is human-verified, and each capture campaign is admitted only after a compact detector shows it can learn the class. Six lightweight YOLO detectors (nano and tiny variants) benchmarked on ROD all exceed 0.86 recall; YOLO12n attains the highest recall (0.889), YOLO26n the highest precision (0.925), and YOLOv9t the best mAP@0.50 (0.882) with the fewest parameters. Because the recall and mAP rankings disagree, selecting a model by mAP does not minimize missed obstacles, so per-class recall is reported for all 25 classes.

Sat 31 OctComputer Vision and Pattern RecognitionComputers and Society
The gist
People walking in cities can be in danger when they encounter obstacles they do not see in time, especially those with vision issues or distracted walkers. The authors provide a large set of labeled images taken from a pedestrian's view to train AI systems to spot common street obstacles like stairs, benches, and manholes. They combined data from many sources and cities to make the dataset more useful across locations. They also tested several lightweight AI models and found that some versions of YOLO detectors can identify most obstacles reliably. This helps build warning systems to alert pedestrians earlier about hazards.
Open → 2611.00681v1

Exoskeleton provides personalized hip haptic cues for blind navigation

XoNav: An Exoskeleton as a Personalized Haptic Interface for Assisted Navigation

Abstract: Walking without vision requires timely, unambiguous guidance, yet many wearable aids encode directions as audio or vibrotactile signals that users must translate into movement. We present XoNav, a four-actuator hip exoskeleton that renders guidance cues directly at the hip joints. It renders an Advance cue and two-level Braking cues through sagittal-plane actuators and two-level Steering cues through frontal-plane actuators. A bilateral LSTM-based gait-state classifier uses two thigh-mounted IMUs to identify gait states, enabling haptic cues to be delivered in coordination with the wearer's gait while suppressing them during standing. The classifier generalized to unseen users with recalls of 95.2-97.9%, with mean detection delays of 38.6 and 63.1 ms for stance-to-swing and swing-to-stance transitions, respectively. Constrained human-in-the-loop Bayesian optimization personalized Braking for minimum resistance and Steering for maximum comfort while ensuring detectability and safety. All participants reliably distinguished between grades of their personalized cues and the firmest Braking cue remained below 53% of the safety limit. In blindfolded Wizard-of-Oz navigation trials along three paths, the participants kept 98.8% of the walked distance within a 0.75 m wide passage, with a 4.9% increase in mean progression speed per trial. A body-worn camera, RTAB-Map and Nav2 further enabled a feasibility study of autonomous navigation and detours around previously unmapped obstacles.

Mon 19 OctRobotics
The gist
Walking without sight is hard because people need clear and quick signals to tell them where to go. The authors built a wearable device with motors on the hips that give gentle taps to show when to move forward, stop, or turn. It uses sensors on the legs to know when a person is walking and sends the signals at the right times. People who tried it could easily tell different signals and walk accurately while blindfolded. The device also showed promise for helping with autonomous navigation around obstacles.
Open → 2610.27271v1