Evaluation of Automated Hypnogram Analysis on Multi-Scored Polysomnographies

Van der Plas, Dries and Verbraecken, Johan and Willemen, Marc and Meert, Wannes and Davis, Jesse (2021) Evaluation of Automated Hypnogram Analysis on Multi-Scored Polysomnographies. Frontiers in Digital Health, 3. ISSN 2673-253X

[thumbnail of pubmed-zip/versions/1/package-entries/fdgth-03-707589/fdgth-03-707589.pdf] Text
pubmed-zip/versions/1/package-entries/fdgth-03-707589/fdgth-03-707589.pdf - Published Version

Download (927kB)

Abstract

A new method for automated sleep stage scoring of polysomnographies is proposed that uses a random forest approach to model feature interactions and temporal effects. The model mostly relies on features based on the rules from the American Academy of Sleep Medicine, which allows medical experts to gain insights into the model. A common way to evaluate automated approaches to constructing hypnograms is to compare the one produced by the algorithm to an expert's hypnogram. However, given the same data, two expert annotators will construct (slightly) different hypnograms due to differing interpretations of the data or individual mistakes. A thorough evaluation of our method is performed on a multi-labeled dataset in which both the inter-rater variability as well as the prediction uncertainties are taken into account, leading to a new standard for the evaluation of automated sleep stage scoring algorithms. On all epochs, our model achieves an accuracy of 82.7%, which is only slightly lower than the inter-rater disagreement. When only considering the 63.3% of the epochs where both the experts and algorithm are certain, the model achieves an accuracy of 97.8%. Transition periods between sleep stages are identified and studied for the first time. Scoring guidelines for medical experts are provided to complement the certain predictions by scoring only a few epochs manually. This makes the proposed method highly time-efficient while guaranteeing a highly accurate final hypnogram.

Item Type: Article
Subjects: Oalibrary Press > Multidisciplinary
Depositing User: Managing Editor
Date Deposited: 30 Nov 2022 05:21
Last Modified: 02 May 2024 09:09
URI: http://asian.go4publish.com/id/eprint/476

Actions (login required)

View Item
View Item