Level of Agreement Between Human-Rated and Instrumented Balance Error Scoring System Scores

Megan N. Houston, Matthew C. Hoch, Steven R. Malvasi, Karen Y. Peck, Steven J. Svoboda, Kenneth L. Cameron

Research output: Contribution to journalArticlepeer-review

7 Scopus citations


Clinicians have used the Balance Error Scoring System (BESS) to quantify postural control for concussion management. However, the reliability of the human rated BESS has varied prompting the development of instrumented BESSs. A cross-sectional design was used to determine the level of agreement (LOA) between human rated and instrumented BESS scores. Sixty participants completed the BESS on video. An instrumented mat was used to quantify BESS errors while a live human rater simultaneously scored the BESS. A second human rated BESS performance via video. Bland-Altman LOA analyses evaluated agreement between scoring methods (Mat-Human, Mat-Video, Video-Live) for each stance. Mean biases between scores, for each stance, with 95% confidence intervals (95%CIs) were calculated. Agreement between scoring methods was not assessed for the Firm-Double-Limb stance because very few errors were recorded. Agreement between both human raters and the mat was poor based on mean bias estimates > ± 1 and/or wide 95%CIs for all stances including BESS-Total. Agreement between the human raters was better, having displayed consistently smaller mean bias estimates and tighter 95%CIs for all stances and BESS Total. As a result, human rated and instrumented BESS scores may not be comparable. One method should be used to measure BESS errors for consistency.

Original languageEnglish
Pages (from-to)2128-2135
Number of pages8
JournalAnnals of Biomedical Engineering
Issue number10
StatePublished - Oct 1 2019

Bibliographical note

Funding Information:
The views and opinions expressed are those of the investigators and they do not reflect the official position of the U.S. Army, the Department of Defense, or the U.S. Government. This work was supported by the Office of the Assistant Secretary of Defense for Health Affairs under Award # HU0001-15-2-0037/2988.

Publisher Copyright:
© 2019, Biomedical Engineering Society.


  • Concussion
  • Postural stability
  • Pressure mat

ASJC Scopus subject areas

  • Biomedical Engineering


Dive into the research topics of 'Level of Agreement Between Human-Rated and Instrumented Balance Error Scoring System Scores'. Together they form a unique fingerprint.

Cite this