Papers for

mobile health app developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Hyperparameter tuning improves atrial fibrillation detection accuracy

Enhancing Atrial Fibrillation Detection Through Hyperparameter Optimization

Abstract: This study explores the role of hyperparameter optimization (HPO) in enhancing the detection of Atrial Fibrillation (AF) using both machine learning and deep learning models. We evaluated a range of standard classifiers - Decision Tree, Random Forest, and XGBoost classifiers, alongside deep learning architectures including Recurrent Neural Networks, Deep Neural Networks, and Siamese Neural Networks. To fine-tune these models, we applied four HPO methods: Genetic Algorithm, Hyperband, Optuna, and SMAC3. The experiments were conducted using inter-patient and intra- patient data splits to assess model generalization and robustness in the presence of class imbalance, which is reflective of real-world AF occurrence. Our results, based on PhysioNet electrocardiogram datasets, showed that the Hyperband-optimized XGBoost model outperformed all others, achieving a peak F1 score of 96.95%. These findings highlight the critical role of suitable HPO strategies in enhancing the accuracy and robustness of AF classification outcomes in clinical settings.

Thu 29 OctMachine Learning
The gist
Atrial fibrillation is a heart condition that can be detected using computer models analyzing heart rate data. The authors studied how adjusting settings called hyperparameters can improve the accuracy of different computer models. They tested several machine learning and deep learning methods and found that one method, using Hyperband to tune an XGBoost model, worked best. This helps build better tools for detecting atrial fibrillation in real-world medical data.
Open → 2610.40001v1

Lightweight model achieves broad medical image segmentation with 211k parameters

A 211K Parameter Foundation Model: Genetic Prompting in Neural Cellular Automata

Abstract: The scale of modern foundation models enables broad task generalization. In medical imaging, where segmentation demands vary widely across clinical contexts, such flexibility is invaluable. But current models, such as SAM trade adaptability for scale, locking their utility behind high-end infrastructure and leaving behind the low-resource environments most in need of diagnostic support. To bridge this gap, we introduce Foundational-NCA, a lightweight foundation model capable of adapting to a wide range of medical segmentation tasks without retraining. Built on Neural Cellular Automata (NCA), Foundational-NCA incorporates gradient-based learning with genetic optimization over a latent task space, using a compact task vector to guide predictions. This enables dynamic adaptation via a genetic prompt mechanism, allowing the model to generalize across tasks while keeping the parameter count magnitudes lower at just 211 thousand, compared to SAM-based models with 38.9 to 636 million parameters. We evaluate Foundational-NCA on 15 trained and 6 entirely unseen segmentation tasks from the TotalSegmentator dataset, achieving an average Dice score of 84.5% on known tasks and 60.4% on unseen ones. These results demonstrate that task generalization is possible in ultra-compact models, laying the groundwork for resource-efficient, deployable foundation models in clinical environments where infrastructure is limited. By reducing model size by over 180 times, Foundational-NCA takes a step toward a more equitable future for medical AI, one where powerful tools are within reach of every healthcare setting.

Wed 28 OctComputer Vision and Pattern Recognition
The gist
Medical image segmentation is important for diagnosing many illnesses, but typically requires large computer models that need powerful equipment. The authors created a very small model called Foundational-NCA that can handle many different segmentation tasks without retraining. It uses a special technique combining cellular automata and genetic prompting to adapt dynamically to various tasks. This small model performs well on both known and new tasks, making it easier to use in places with limited computing resources.
Open → 2610.38776v1

Agent system improves wrist heart rate estimates by selective correction

An Agent Architecture with Tools and Memory for Selective Correction of Wrist PPG Heart Rate Estimates

Abstract: Wrist photoplethysmography (PPG) heart rate estimates are vulnerable to motion artifacts, and corrections that reduce mean error can worsen individual windows. We propose an agent architecture with tools and memory around a fixed heart rate estimator. Pulse, motion, and limited historical evidence generate candidate estimates, whose predicted benefits and harms guide selection. An independent risk gate determines whether to retain, correct, or reject each output. We trained the architecture on PPG-DaLiA and tested it on Wrist Exercise, GalaxyPPG, and WildPPG with frozen weights. Across these four public datasets, mean absolute error (MAE), macro-averaged over ten estimators, decreased by up to 44.5%, with the largest reduction on GalaxyPPG. Beneficial and harmful corrections decreased and increased absolute error by more than 1 bpm, respectively. Their ten-estimator macro-averaged proportions ranged from 16.06% to 36.64% and from 1.68% to 6.77%, respectively, across the four datasets. At 60% and 80% target coverage, numerical correction on the same accepted windows contributed more to total error reduction than window selection. We implemented real-time wearable acquisition, Bluetooth reception, and smartphone deployment of a selected estimator and the framework. In backend analysis of four prototype recordings from one participant, ten-estimator macro-averaged MAE decreased from 9.09 to 4.45 bpm without additional rejection. Under the evaluated conditions, the architecture improved average accuracy while quantifying correction benefits and harms, supporting wearable heart rate analysis that considers error, correction risk, and coverage.

Thu 22 OctMachine Learning
The gist
Wrist heart rate sensors often give wrong readings when you move because of motion noise. The authors created a smart system that uses past data and different signals to decide when to fix or keep heart rate readings. This system reduces errors across many datasets and can run in real-time on phones connected to wearables. It also knows when changes might help or hurt the reading, making the results more reliable overall.
Open → 2610.30688v1

Streaming model improves real-time personalized diabetes forecasting

SSMCGM-Stream: A Streaming State-Space Model for Personalized Diabetes Management

Abstract: Continuous glucose monitoring supports diabetes management but requires forecasting models that are accurate, interpretable, and efficient enough for real-time deployment. We present SSMCGM-Stream, a streaming state-space model that maintains a personalized hidden state updated with each incoming glucose reading to provide constant-time forecasting, physiologically structured counterfactual reasoning, and interpretable forecasts through hidden-state attribution. Built on this foundation, SSMCGM-Agent delivers risk-aware, natural-language decision support by translating forecasts, explanations, and counterfactuals into grounded recommendations through a guarded language-model interface. Evaluated on the T1DEXI cohort, SSMCGM-Stream achieves forecasting performance comparable to strong neural baselines while substantially reducing computational cost, enabling continuous on-device diabetes decision support.

Tue 20 OctMachine LearningArtificial Intelligence
The gist
Managing diabetes requires predicting blood sugar levels continuously and accurately. The authors developed a model that updates its understanding of a person’s glucose in real time as new data arrives, making it fast and personalized. This model also explains its predictions and suggests how different actions might affect glucose levels. Their approach performs as well as complex neural networks but is much faster and can run directly on a user’s device.
Open → 2610.28976v1

Smartphone skin lesion classification improves with grouped clinical data fusion

GAMF-Net: Grouped Availability-Aware Multimodal Fusion for Smartphone Skin Lesion Classification

Abstract: Smartphone clinical images provide a low-cost data source for computer-aided skin lesion classification in resource-constrained settings, but images alone cannot fully capture patients' medical histories and lesion symptoms. To address the lack of structured organization among heterogeneous clinical variables, the ambiguity between observed and imputed values, and the risk that clinical information may interfere with visual evidence, we propose GAMF-Net, a grouped availability-aware multimodal fusion network. Ten clinical variables are divided into three semantic groups---demographics, history-related risk, and lesion presentation---and each group jointly encodes field values and field-level availability masks. The image branch produces the base classification logits, while each clinical group generates image-conditioned class-level residual evidence. Only available groups participate in availability-normalized equal-weight fusion; when all clinical information is unavailable, the model reduces exactly to the image-only pathway. We evaluate the method on PAD-UFES-20 under a patient-disjoint five-fold protocol with separate training, validation, and test partitions. GAMF-Net achieves an Accuracy of $74.17\pm2.85\%$, a balanced accuracy (BACC) of $70.11\pm2.11\%$, a Macro-F1 of $68.85\pm0.85\%$, and a Macro-AUROC of $93.42\pm1.20\%$, outperforming all image-only and multimodal baselines reimplemented under a unified protocol. Compared with the strongest baseline, MetaBlock, the corresponding improvements are 2.37, 2.59, 4.14, and 1.02 percentage points, respectively. Ablation results show that clinical information substantially improves class-balanced performance, constrained equal-weight fusion is more effective than dynamic fusion, and the lesion-presentation group provides the most informative clinical complement.

Tue 20 OctComputer Vision and Pattern Recognition
The gist
Classifying skin lesions using just smartphone images can miss important health information. The authors propose GAMF-Net, a new method that groups patients' clinical data into categories and combines them with images only when available. This approach helps the system better decide if a lesion is dangerous by balancing evidence from both images and clinical details. Their tests show it performs better than methods using images alone or mixing data without grouping.
Open → 2610.28129v1

Electric toothbrush monitors brushing habits using motor signals

FreeBrush: Motor Signals-Based Toothbrushing Monitoring System for Electric Toothbrushes

Abstract: Oral health is vital for overall well-being, yet many users brush different tooth surfaces for insufficient or excessive durations. Toothbrushing monitoring systems can help improve brushing habits by reminding users of under-brushed and over-brushed surfaces, but existing approaches often rely on external sensors, increasing cost and reducing practicality. We observe that the intrinsic motor signals of electric toothbrushes can reflect the brushing surfaces and durations. When brushing different tooth surfaces, the brush head experiences different constraints from the surrounding oral cavity, changing the motor's driving currents and position feedback. Based on this observation, we propose FreeBrush, a toothbrushing monitoring system that uses the intrinsic motor signals of electric toothbrushes to recognize brushed tooth surfaces and estimate brushing durations without any external sensors. We prototype the system on a commercial off-the-shelf electric toothbrush and conduct a comprehensive evaluation with 18 participants. FreeBrush achieves 92.8% accuracy for 16-surface recognition and 92.0% accuracy for brushing duration estimation. The system further shows robustness across different toothpastes, brush heads, vibration modes, usage scenarios, and long-term use, and is capable of running on edge devices. By recognizing brushed tooth surfaces and estimating the brushing duration, FreeBrush can help users identify under-brushed and over-brushed surfaces and build balanced brushing habits.

Sun 11 OctHuman-Computer Interaction
The gist
Many people don’t brush their teeth evenly, spending too little or too much time on some spots. The authors found that the electric toothbrush’s own motor signals change when it brushes different parts of the mouth. They built a system called FreeBrush that can tell which tooth surface is being brushed and for how long, just by looking at these motor signals. This helps users know if they are missing spots or brushing too much, without needing extra sensors.
Open → 2610.15800v1

Personalized neural network improves blood sugar predictions for type 1 diabetes

Personalized Physiological-Model-Based Neural Network for Glucose Forecasting in Type 1 Diabetes

Abstract: Accurate, physiologically consistent glucose forecasts could help people with type 1 diabetes respond to impending excursions. We applied our physiological-model-based neural network (PMB--NN) framework to glucose forecasting. A temporal convolutional network (TCN) used 180 min of history, constrained during training by a personalized four-parameter physiological model. The main PMB--NN combined forecast and neural--physiological agreement losses; a three-term variant additionally fitted physiological predictions to measured glucose. Data comprised 6--8 weeks of continuous glucose monitoring, pump, and meal records from 25 AZT1D participants. Person-specific models used chronological 70/10/20 train/validation/test splits and 30-, 60-, and 120-min horizons. Median mean absolute errors were 16.24, 25.00, and 30.20 mg/dL with basal insulin records and 15.38, 24.21, and 31.79 mg/dL before these records became available. In the latter setting, PMB--NN had the lowest median error at 30 and 60 min; it outperformed the physiological model alone in all six settings. In input-increase tests, glucose predictions changed in the expected direction for 85\% of correction boluses and 100\% of carbohydrate rescues, versus 57\% for active insulin and 56\% for active carbohydrates. Most standalone physiological fits showed locally distinguishable parameter effects, with glucose-related coefficients more stable under resampling than insulin- or carbohydrate-related coefficients. The three-term variant improved hyperglycaemia accuracy with basal records, but did not significantly change overall MAE and reduced directional plausibility in three tests. PMB--NN combines personalized forecasting with an explicit physiological model, allowing assessment of predictive accuracy, physiological response behavior, and participant-specific coefficients.

Sun 11 OctMachine Learning
The gist
People with type 1 diabetes need to keep their blood sugar levels stable, which can be hard to predict. The authors created a computer model that uses both personalized body data and neural networks to forecast blood sugar changes ahead of time. This helps predict glucose levels more accurately compared to just using traditional physiological models. Their system learns from each person’s unique insulin, meal, and glucose patterns to make better forecasts up to two hours ahead.
Open → 2610.15456v1

Multimodal verification improves food portion estimation from images

Improving Image-Based Nutrition Estimation Through Multimodal Food-Item Verification and Recovery

Abstract: Single-image nutrition estimation can fail silently when visible foods are missed. Even when a food is correctly identified, its proposed region may not support portion estimation. We propose a framework that uses multimodal large language models (MLLMs) to inventory visible foods and separately verify food identity and whether each proposed 2D region supports portion estimation. One whole-image review uses these verification results to identify unresolved gaps and omitted foods, triggering at most one targeted recovery pass. Recovered regions are re-verified without access to the recovery prompt, then reconciled into a final item set for nutrition estimation. The framework requires no task-specific fine-tuning. Matched evaluation on common valid-output samples shows that item-level grounding improves mass accuracy across all tested settings and energy accuracy relative to an adapted retrieval baseline, with item-identity precision and recall also improving, while post-recovery visual coverage is assessed separately at inference time without ground-truth annotations.

Thu 8 OctComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Estimating how much food is on your plate from just one photo can be tricky, especially if some foods are missed or not clearly identified. The authors developed a method that uses large language models combining text and images to double-check which foods are visible and whether the photo areas are good enough to guess portion sizes. They then fix any missing or uncertain parts with a second check, making the final nutrition estimates more accurate. This approach doesn’t need extra training for the specific task, yet it improves the accuracy of identifying and measuring food portions compared to some existing methods.
Open → 2610.11144v1

Self supervised learning improves human activity recognition from motion sensors

MorphCL: Morphological Contrastive Learning for Inertial-based Human Activity Recognition

Abstract: Despite the ubiquity of sensors in wearable and mobile devices and the abundance of human movement data they generate, translating unlabeled recordings into foundational motion models remains an open challenge. Self-supervised learning (SSL) has alleviated the need for costly annotations, yet existing approaches leave the global structure of large-scale motion data largely untapped, relying on randomly sampled batches and local comparisons that become particularly problematic for in-the-wild inertial data dominated by stationary, low-variance behaviors. Here we introduce Morphological Contrastive Learning (MorphCL), a self-supervised pretraining framework that uses structure-aware grouping to inject explicit modeling of global structure into inertial-based SSL approaches. Building on two well-established pillars of motion analysis, the discovery of motion primitives, or motifs, and domain-specific feature descriptors, we show that MorphCL substantially improves linear probing and finetuning results of learned encoders by up to 15 percentage points in F1-score. In a comparison with existing foundation models, we demonstrate that MorphCL-pretrained encoders match or surpass them models in linear probing performance while trained on $4600\times$ less data. Qualitative analysis of the resulting embedding spaces further reveals morphologically meaningful cluster structure, with improved separation of kinematically similar activity classes.

Wed 7 OctMachine LearningHuman-Computer Interaction
The gist
Recognizing what people are doing based on movement sensors often requires lots of labeled data, which is expensive to gather. The authors developed a new way, called MorphCL, that groups similar motion patterns to better learn from unlabeled sensor data. This method captures the overall structure of movement better than before, leading to more accurate recognition of activities. It also needs far less data to match or beat previous advanced models.
Open → 2610.10245v1

Beatflow ecg reconstructs heart signals from wearable motion data

BeatFlow-ECG: Rectified Flow for ECG Reconstruction from Indirect Wearable Signals

Abstract: Continuous cardiac monitoring outside clinical settings requires signals that are both informative and practical to collect during daily life. Electrocardiography (ECG) provides rich information about cardiac rhythm and waveform morphology, while wearable photoplethysmography (PPG) is easier to acquire continuously but is only an indirect cardiovascular measurement and is highly sensitive to motion. We present BeatFlow-ECG, a conditional rectified-flow model for reconstructing single-channel ECG from synchronized PPG and inertial measurements. BeatFlow-ECG models reconstruction as conditional transport from noise to ECG using a convolutional encoder-decoder with a transformer bottleneck and explicit flow-time conditioning. Motion information is incorporated through IMU-derived conditioning features, motion-dependent loss weighting, and an easy-to-hard training curriculum. We evaluate the model under leave-one-subject-out protocols on PPG-DaLiA and WESAD. BeatFlow-ECG achieves the best results among the evaluated deterministic, adversarial, and diffusion-based baselines across all reported waveform and beat-timing metrics, with Pearson correlations of 0.983 and 0.986 and R-peak F1 scores of 0.946 and 0.955, respectively. Compared with Conditional DDPM-1D, L1 error decreases from 0.085 to 0.062 on PPG-DaLiA and from 0.074 to 0.055 on WESAD. Additional analyses on PPG-DaLiA show higher correlation in fixed R-peak-relative waveform regions and lower reconstruction error across low-, medium-, and high-motion subsets.

Tue 6 OctMachine Learning
The gist
Monitoring heart health outside hospitals requires easy and reliable data collection. Electrocardiography (ECG) gives detailed heart information but is tricky to wear all day. Wearable devices often use photoplethysmography (PPG), which is easier to collect but less direct and prone to errors from movement. The authors introduce BeatFlow-ECG, a new AI model that turns wearable PPG and motion sensor data into accurate ECG signals. Their method outperforms previous techniques in capturing heartbeat details and handling motion noise.
Open → 2610.09052v1

Minimal preprocessing improves skin lesion analysis with fast small model

Less Is More: A Leakage-Controlled Study of Dermoscopic Preprocessing for Joint Skin Lesion Classification and Segmentation with YOLO26

Abstract: Handcrafted preprocessing is widely employed in automated dermoscopic analysis to suppress imaging artifacts and enhance lesion visibility. Nevertheless, its actual contribution to modern real-time models remains unclear, particularly when evaluation protocols do not adequately control correlations among images of the same lesion. This study presents a leakage-controlled, lesion-disjoint evaluation of dermoscopic preprocessing and augmentation for joint multi-class lesion classification and instance segmentation using a fixed nano-scale YOLO26 segmentation model (YOLO26n-seg). From HAM10000 (10,015 images), quality control yields 10,013 valid image-mask pairs from 7,468 unique lesions, partitioned into mutually exclusive sets by lesion identity. With the architecture, resolution, training budget, and evaluation protocol held fixed, we compare minimally processed images plus online augmentation against offline class balancing, DullRazor-CLAHE preprocessing, and raw-processed hybrid views, over three random seeds. On the lesion-disjoint test set, the raw baseline achieves a mask mAP$_{50:95}$ of $0.5636 \pm 0.0234$, a Dice score of $0.9356 \pm 0.0024$, and a macro-F1 score of $0.6917 \pm 0.0202$. Offline augmentation does not improve the mean performance, while the combined and hybrid strategies reduce both class-aware segmentation and classification accuracy. At only 2.69 million parameters, the model runs at approximately 50 frames per second. Under a leakage-controlled, lesion-disjoint protocol with all non-input factors held fixed, minimally processed dermoscopic images combined with standard online augmentation deliver a better accuracy-efficiency trade-off than increasingly complex deterministic preprocessing, which yields no consistent joint benefit across three seeds on HAM10000.

Tue 6 OctMachine LearningComputer Vision and Pattern Recognition
The gist
Images of skin lesions often have artifacts that can confuse automatic analysis. This study tested whether complex image cleaning steps actually help a small, fast AI model that identifies and outlines different types of skin lesions. The researchers found that keeping images mostly natural and using simple, standard image tweaks during training worked better than using more complex pre-processing methods. Their setup was carefully designed to avoid confusing the model with repeated images of the same lesion, making the results more trustworthy.
Open → 2610.08570v1

Smaller ai model improves skin lesion diagnosis with missing patient data

Masked Privileged-Information Distillation for Multimodal Skin Lesion Classification Under Missing Clinical Metadata

Abstract: Multimodal skin lesion classification combines clinical images with patient metadata to improve diagnostic accuracy. However, complete metadata available during training may be only partially accessible at deployment, and resource-constrained settings additionally require computational efficiency. We address these challenges with a privileged-information distillation framework in which a multimodal teacher trained on complete metadata supervises a 9.2x smaller student trained with randomly masked clinical fields. Clinical fields are masked as whole groups at a per-sample rate drawn from U(0,1), so one training run covers the full metadata availability range. Fusion is residual, with metadata added as a gated correction to an unconditional image base. On the PAD-UFES-20 dataset, distillation under masked training improves balanced accuracy over cross-entropy training at every availability level, by an average of +4.7 points versus +1.8 points without masking. The masked student loses only 7.8 balanced-accuracy points as metadata decreases from complete to absent, compared with 36.6 points for the same student trained on complete metadata, highlighting the role of masked training in graceful degradation beyond distillation alone. Grad-CAM visualizations further show that the masked student's attention generally remains lesion-centered as metadata is withdrawn. The resulting compact model targets point-of-care settings, where clinical metadata is often incomplete.

Fri 2 OctComputer Vision and Pattern RecognitionMachine Learning
The gist
Skin lesion diagnosis can be improved by combining photos with patient information, but sometimes this information is missing. The authors created a smaller AI model that learns from a bigger model using complete patient data, but trains with some information randomly hidden. This helps the smaller model still do a good job even when some patient details are missing at use time. Their approach works well on a real skin lesion dataset and keeps its focus on the actual lesion when patient data is less available.
Open → 2610.03991v1

Feature level warping improves remote physiological measurement accuracy

FLOW: Feature-Level Optimal Warping for Generalized Remote Physiological Measurement

Abstract: Remote photoplethysmography (rPPG) enables non-contact physiological measurement but remains vulnerable to domain shifts from illumination, motion, and sensors. We propose \textbf{FLOW (Feature-Level Optimal Warping)}, an \emph{optimal transport--driven} framework for domain-generalized rPPG. FLOW integrates a \textbf{Temporal Refinement Module (TRM)} to stabilize temporal dynamics and a \textbf{Prototype-based Cross-Temporal Optimal Transport (PCOT)} module to achieve domain-invariant alignment via learnable prototypes.Beyond feature alignment, FLOW employs soft cross-temporal correspondence modeling that aligns temporal features in a flexible manner, allowing the model to respect and preserve the intrinsic rhythmic patterns of physiological signals. Moreover, the lightweight design of our modules allows seamless integration into existing end-to-end rPPG architectures without additional preprocessing. Two regularization terms further enforce source consistency and identity preservation. Theoretically, we derive a generalization bound under conditional optimal transport. Extensive experiments across four rPPG benchmarks show that FLOW achieves state-of-the-art cross-domain performance with lightweight design and strong physiological fidelity.

Wed 30 SeptComputer Vision and Pattern Recognition
The gist
Measuring heart rate and other vital signs using just a camera is hard because different lighting, movement, and camera types can confuse the system. The authors created a new way called FLOW that matches and adjusts features of the input video over time to keep the measurement stable and accurate across different conditions. Their method is lightweight and can be added to current camera-based health tools without extra steps. They tested it on several datasets and found it works better than existing methods, while still capturing true physiological signals.
Open → 2609.38913v1

Vision language method improves acne lesion detection from images

VL-AcneSeg: A Vision-Language Framework for Region-Aware Acne Lesion Segmentation

Abstract: Acne assessment is crucial for clinical decision-making, yet traditional grading and counting are subjective and fail to account for lesion size. While area-based assessment has emerged as a promising alternative, acne segmentation has continued to rely on general-purpose architectures. To address this gap, we propose VL-AcneSeg, a multimodal framework for acne lesion segmentation that leverages CLIP and region-level text prompts to incorporate spatial priors, enabling lesions to be localized across the whole face. Because region-level prompts indicate which facial areas contain lesions, we report a single global prompt, which requires no such information, as our primary setting. On our internal clinical dataset, VL-AcneSeg achieves a Dice score of 0.5082 and an IoU of 0.3407 under this protocol, the highest among all compared methods, including recent vision-language segmentation methods that are themselves given region-level prompts; region-level prompting raises these to 0.5296 and 0.3602. Moreover, lesion area measurements derived from our segmentation correlate with IGA scores at a level comparable to expert annotations (Pearson r = 0.719 versus 0.658). Notably, our framework maintains consistent performance across external validation datasets, performing reliably even on uncontrolled smartphone images without requiring additional training or fine-tuning. By pairing a protocol that requires no lesion-location information with area-based severity estimation, this work provides a foundation for objective acne assessment outside the clinic. Our implementation is publicly available at: https://github.com/sukjuoh/VL-AcneSeg

Mon 28 SeptComputer Vision and Pattern RecognitionArtificial Intelligence
The gist
Acne severity is hard to measure because traditional ways are subjective and don’t consider how big the pimples actually are. The authors developed a new computer method called VL-AcneSeg that uses both pictures and text clues about face areas to better find and measure acne lesions. Their method works well even on photos taken with smartphones and does not need extra training for new datasets. This could make acne assessment more objective and easier to do outside of clinics.
Open → 2609.34472v1

Sliding-window test counts overstate classification confidence

When 10,000 Windows Are Not 10,000 Tests: Auditing Statistical Confidence in Sliding-Window Time-Series Classification

Abstract: Sliding-window classifiers are often evaluated on thousands of overlapping test windows, even though neighboring predictions share observations and remain nested within recordings and subjects. Subject-disjoint evaluation prevents one form of leakage but does not make those test windows independent. We present a practical audit that maps three claims - performance on observed recordings, future recordings from observed subjects, and unseen subjects - to explicit aggregation rules and established dependence-robust inference. At 75% overlap, controlled simulations give 16.9% Type-I error for IID observed-record inference and 7.2% for session-centered Bartlett-HAC: a substantial improvement with residual miscalibration. Audits of frozen WISDM and HARTH predictions show that nearly fourfold growth in test rows yields only 1.75-1.94-fold variance-equivalent information growth. At that overlap, fixed-record paired Accuracy-difference intervals are 1.22-1.66 times the IID widths; this inflation is not universal at zero overlap. On HARTH, paired Accuracy-difference intervals include zero across three overlap settings, whereas Macro-F1 favors MiniROCKET. Independent recomputation, common-session checks, class-level results, and separately seeded calibration make the audit's scope and limitations inspectable. The resulting workflow distinguishes additional predictions from additional independent evidence.

Fri 25 SeptMachine Learning
The gist
When evaluating how well a computer program recognizes patterns over time, people often test many overlapping pieces of the data. The authors show that counting each overlapping piece as a separate test exaggerates how confident we can be in the results. They introduce a careful way to check which parts of the tests really provide new information and how to better trust the performance claims. Their methods work even when test pieces overlap a lot or come from the same people or sessions.
Open → 2609.30721v1

Temporal noise acts like sensor bias in wearable activity sensors

When Temporal Perturbations Act Like Sensor Biases: Label-Free Auditing of Wearable Activity Recognizers

Abstract: Wearable human-activity recognition (HAR) models operate across sensors, subjects, and backbones, yet a smooth waveform may appear temporal while exploiting a persistent sensor offset primarily. We introduce SpectrumAudit, a label-sealed audit that fits a phase-randomized full-window stimulus on calibration windows from subjects held out from training and testing. After selection, it replays its exact DC projection and budget-constrained zero-mean residual on the same frozen victim without refitting. Across 27 victims from three datasets and three backbones, the selected waveforms cause 2.87-40.83-point three-phase robust accuracy losses. Under this replay budget, DC is more damaging than AC on 24/27 victims and recovers at least 90% of the full drop on 22/27; all 5 failures occur on WISDM. In a held-out UTD-MHAD check, the selected waveform causes 13.49-pp accuracy and 11.68-pp macro-F1 losses, versus -0.66 pp for matched random changes. The audit diagnoses offset versus zero-mean variation under a common peak-budget cap. The code will be released upon acceptance.

Thu 24 SeptMachine LearningArtificial IntelligenceCryptography and Security
The gist
Wearable devices that track human activities can sometimes mistake steady sensor errors for actual motion changes. The authors present SpectrumAudit, a method that tests these devices without needing activity labels to see if constant sensor offsets harm accuracy. They found that for many devices and datasets, these steady errors cause bigger mistakes than normal fluctuations. This helps identify when sensor biases are the real problem behind misclassifications.
Open → 2609.29937v1

Earbud cardiac monitoring works best with left finger contact

Finger-to-Ear ECG: Systematic Evaluation of an Earbud-Based Cardiac Monitoring Approach

Abstract: Ear-ECG enables unobtrusive cardiac monitoring, but existing approaches often struggle with low signal amplitudes and limited morphology preservation. We evaluate a finger-to-ear ECG paradigm that combines an in-ear electrode with a rear housing finger-contact electrode in a speaker-equipped earbud. A study with 30 participants investigated four finger-to-ear electrode geometries against chest-reference ECG and additionally assessed robustness under music playback, talking, and walking disturbances. Left-finger configurations achieved R peak detection F1-scores >99% with high agreement of key ECG morphology features. In contrast, right finger configurations as well as walking led to severe signal degradation. The results reveal a trade-off: while cross-body setups provided the highest signal fidelity, users preferred same-side contacts for comfort reasons. This establishes finger-to-ear ECG as a robust, morphology-aware paradigm for opportunistic sensing in earables.

Mon 21 SeptHuman-Computer Interaction
The gist
Measuring your heart's electrical signals clearly and comfortably using earbuds can be tricky. The authors tested a new way to get these signals by touching one finger to an earbud's back. They found that using the left finger gave the best heart signal quality, while the right finger or walking made it harder to read. This method balances accurate heart readings with user comfort in everyday situations.
Open → 2609.24530v1

Multimodal model predicts blood sugar response from meal images and health data

Predicting Postprandial Glycemic Response from Meal Images, Clinical Variables, and Gut Microbiome Information

Abstract: Predicting postprandial glycemic response (PPGR) is fundamental to personalized nutrition and type 2 diabetes management, yet existing approaches typically rely on manually reported dietary intake, limiting their scalability in free-living settings. We propose a multimodal framework that replaces manual dietary logging with image-derived macronutrient estimates and integrates them with clinical variables and gut microbiome information for personalized PPGR prediction. The framework jointly performs image-based macronutrient estimation and glucose prediction, while an attention-based prediction module models interactions between dietary and host-specific information. We evaluate the proposed approach on a real-world dataset comprising meal images, continuous glucose monitoring, clinical variables, and gut microbiome profiles. The proposed model outperforms existing PPGR baselines using image-derived nutritional inputs and approaches the performance of methods that rely on manually reported macronutrients despite using automatically estimated nutritional information. These results demonstrate that combining image-derived nutrition with complementary clinical and gut microbiome information provides a practical foundation for scalable personalized PPGR prediction.

Mon 21 SeptArtificial Intelligence
The gist
Managing blood sugar after eating is important for people with diabetes and for personalized diets, but tracking what people eat is hard and slow. The authors created a computer model that looks at pictures of meals to guess nutrients, then combines that with health info and gut bacteria data to predict blood sugar changes. Their model works almost as well as methods that need manual food logging, making it easier to track blood sugar responses in daily life. This could help people get personal advice about food without detailed food diaries.
Open → 2609.24453v1

Dual path network improves wearable blood pressure estimation accuracy

SIFPBPNet: A Dual-Path Network for Wearable and Cuffless Blood Pressure Estimation via Individualized Steady-state Representation

Abstract: Continuous and cuffless blood pressure (BP) monitoring using photoplethysmography (PPG) is of great interest for low-cost and personalized cardiovascular health management. However, significant population heterogeneity and the "one-to-many mapping" problem, where similar waveforms across individuals correspond to different BP levels, limit the accuracy of conventional population-based models. To address this challenge, we propose a dual-path architecture termed SIFPBPNet, which separately represents steady-state and instantaneous features, through a Steady-state Feature Path (SFP) and an Instantaneous Feature Path (IFP). The SFP employs a Graph Attention Network (GAT) to extract individual-specific and long-term characteristics from multi-day historical PPG trajectories. In parallel, the IFP captures short-term dynamics from current PPG segments and incorporates the steady-state prior via a cross-attention mechanism. Experiments on a large-scale wearable dataset demonstrate that SIFPBPNet achieves a Mean Absolute Error (MAE) of 8.57 and 5.97 mmHg for systolic and diastolic BP, respectively, outperforming state-of-the-art models. Furthermore, the SFP module consistently improves performance when integrated into various backbone architectures, yielding 2.8-13.1% relative MAE reductions for systolic BP. These results highlight the strong generalizability and plug-and-play transferability of the SFP module, underscoring its great potential for accurate cuffless BP monitoring.

Fri 11 SeptMachine Learning
The gist
Blood pressure is an important health measure but usually needs a cuff to check, which isn’t convenient all the time. This paper presents a new computer method that uses data from wearable devices to estimate blood pressure without a cuff by learning both steady and changing patterns in the data. Their method also learns from longer-term history to understand personal differences, making it more accurate than existing approaches. The authors tested it on a large dataset and showed it works better for predicting blood pressure continuously and comfortably.
Open → 2609.12690v1

Deep learning estimates heart rate without contact sensors using video

Beyond Contact Sensors: Deep learning with Pseudo-Labeling for remote Photoplethysmography

Abstract: Heart rate is a critical biomarker of health, and remote photoplethysmography (rPPG) enables its contactless estimation from video data for telemedicine applications. Recent advancements in deep learning based rPPG methods achieve state-of-the-art results, outperforming classical signal-processing methods in complex scenarios. However, deep learning methods depend on datasets with precise synchronization between videos and ground truth signals collected via contact sensors, whereas signal-processing-based methods do not. To address this dependence on labeled datasets, which are labor-intensive to collect, we investigate under which circumstances pseudo-labels extracted using unsupervised signal-processing methods can replace contact sensors labels for training deep learning methods. Our systematic evaluations found that for datasets with imperfect synchronization, the pseudo-label approach outperforms supervised training on contact sensors. For datasets with good synchronization, results are mixed: within-dataset evaluation shows no significant difference between training methods, while cross-dataset evaluation favors supervised training. However, removing a single outlier participant significantly improves the pseudo-label approach's cross-dataset performance, highlighting the importance of label quality. These results demonstrate that signal-processing methods can generate valid training signals for deep learning models, reducing dependency on labor-intensive dataset collection while maintaining competitive performance.

Wed 9 SeptMachine Learning
The gist
Measuring heart rate usually requires close contact sensors, but remote photoplethysmography (rPPG) can do it from videos without touching a person. Deep learning methods can get better results but need carefully matched video and heart rate data from sensors to learn. The authors show that they can train these models using estimated heart rates from traditional signal-processing methods instead of needing sensor data, especially when the sensor data is not perfectly matched with the video. This makes collecting data easier for building heart rate estimation tools that work remotely.
Open → 2609.10026v1

Simple temporal interpolation improves missing joint data in gait analysis

Recovering Biomechanical Signals from Missing Keypoints Using Temporal Interpolation in Monocular Gait Analysis

Abstract: Monocular pose estimation enables low-cost gait analysis but is sensitive to missing keypoints caused by occlusion, detection errors, or efficiency-driven model reduction. While prior work on recovering missing joints focuses on complex learned models, the effectiveness of simple temporal methods remains underexplored. We evaluate knee-angle estimation under a missing-ankle-keypoint condition and test a first-order temporal interpolation scheme as a recovery mechanism. Across 527 frames of monocular walking video (428 with valid baseline detections), removing the ankle keypoint increased mean angular error to 23.4° +/- 46.7° and collapsed signal variance to near zero. Temporal interpolation reduced error to 1.1° +/- 6.7° and restored variance and smoothness to within a few percent of baseline. These results indicate that gait signals possess sufficient temporal redundancy for a simple, computationally trivial interpolation scheme to recover a critical missing joint, without resorting to learned reconstruction models. The findings support low-complexity, real-time-compatible designs for gait analysis in resource-constrained or occlusion-prone monocular settings.

Wed 9 SeptComputer Vision and Pattern Recognition
The gist
Gait analysis with a single camera can miss important body points like ankles because of obstacles or errors. The authors show that a very simple method, interpolating data over time, can almost perfectly fill in missing ankle positions. This method made knee angle measurements much more accurate without needing complicated computer models. Their findings suggest that quick and easy fixes can work well for tracking walking in less-than-ideal conditions.
Open → 2609.09670v1

SynthGait19K dataset improves gait parameter estimation from video

SynthGait-19K: A Physically Grounded Synthetic Video Dataset for Gait Parameter Estimation

Abstract: Accurate estimation of clinically meaningful gait parameters from monocular video is important for scalable mobility assessment, yet progress is limited by the small scale, restricted viewpoints, and limited visual diversity of existing datasets. We introduce SynthGait-19k, a physically grounded synthetic video dataset containing 19,272 walking videos derived from 6,427 MoCap sequences across 437 subjects, with paired SMPL motion and annotations for six gait parameters. To construct the dataset, we develop Gait2Vid, which unifies heterogeneous MoCap recordings through SMPL and synthesizes diverse RGB walking videos under controllable viewpoints and scene appearances. We assess the generated videos for consistency with their conditioning gait kinematics and validate extracted gait events against force-platform measurements. Using SynthGait-19K, we benchmark direct RGB, pose-based, biomechanical, and human-mesh-recovery approaches and analyze viewpoint, training-data scale, and synthetic-to-real domain shift. We also introduce GaitXFormer as a direct RGB reference model for estimating gait parameters. Synthetic supervision transfers effectively to real videos across both GaitXFormer and a pose-based architecture, demonstrating utility across different representations. We further find that spatial gait parameters are more sensitive to visual domain shift and that improved HMR reconstruction alone does not necessarily translate to improved downstream gait estimation.

Tue 8 SeptComputer Vision and Pattern Recognition
The gist
Measuring how people walk using just regular video is hard because existing data is limited and not very diverse. The authors created SynthGait-19K, a large synthetic video dataset of people walking, based on detailed motion capture data, which includes important walking measurements. They built a system to make realistic walking videos from this data that can be viewed from different angles and settings. Their tests show that training computer models with this synthetic data helps predict walking parameters on real videos better, especially for some types of walking features.
Open → 2609.08108v1