Multi-Site Cross-Site Inter-Rater and Test-Retest Reliability and Construct Validity of the MarkVCID White Matter Hyperintensity Growth and Regression Protocol

Ahmed A. Bahrani; Erin L. Abner; Charles S. Decarli; Justin M. Barber; Abigail C. Sutton; Pauline Maillard; Francisco Sandoval; Konstantinos Arfanakis; Yung Chuan Yang; Arnold M. Evia; Julie A. Schneider; Mohamad Habes; Crystal G. Franklin; Sudha Seshadri; Claudia L. Satizabal; Arvind Caprihan; Jeffrey F. Thompson; Gary A. Rosenberg; Danny J.J. Wang; Kay Jann; Chenyang Zhao; Hanzhang Lu; Paul B. Rosenberg; Marilyn S. Albert; Doaa G. Ali; Herpreet Singh; Kristin Schwab; Steven M. Greenberg; Karl G. Helmer; David K. Powel; Brian T. Gold; Larry B. Goldstein; Donna M. Wilcock; Gregory A. Jicha

doi:10.3233/JAD-230629

Multi-Site Cross-Site Inter-Rater and Test-Retest Reliability and Construct Validity of the MarkVCID White Matter Hyperintensity Growth and Regression Protocol

Ahmed A. Bahrani, Erin L. Abner, Charles S. Decarli, Justin M. Barber, Abigail C. Sutton, Pauline Maillard, Francisco Sandoval, Konstantinos Arfanakis, Yung Chuan Yang, Arnold M. Evia, Julie A. Schneider, Mohamad Habes, Crystal G. Franklin, Sudha Seshadri, Claudia L. Satizabal, Arvind Caprihan, Jeffrey F. Thompson, Gary A. Rosenberg, Danny J.J. Wang, Kay JannChenyang Zhao, Hanzhang Lu, Paul B. Rosenberg, Marilyn S. Albert, Doaa G. Ali, Herpreet Singh, Kristin Schwab, Steven M. Greenberg, Karl G. Helmer, David K. Powel, Brian T. Gold, Larry B. Goldstein, Donna M. Wilcock, Gregory A. Jicha

Research output: Contribution to journal › Article › peer-review

Abstract

Background: White matter hyperintensities (WMH) that occur in the setting of vascular cognitive impairment and dementia (VCID) may be dynamic increasing or decreasing volumes or stable over time. Quantifying such changes may prove useful as a biomarker for clinical trials designed to address vascular cognitive-impairment and dementia and Alzheimer's Disease. Objective: Conducting multi-site cross-site inter-rater and test-retest reliability of the MarkVCID white matter hyperintensity growth and regression protocol. Methods: The NINDS-supported MarkVCID Consortium evaluated a neuroimaging biomarker developed to track WMH change. Test-retest and cross-site inter-rater reliability of the protocol were assessed. Cognitive test scores were analyzed in relation to WMH changes to explore its construct validity. Results: ICC values for test-retest reliability of WMH growth and regression were 0.969 and 0.937 respectively, while for cross-site inter-rater ICC values for WMH growth and regression were 0.995 and 0.990 respectively. Word list long-delay free-recall was negatively associated with WMH growth (p < 0.028) but was not associated with WMH regression. Conclusions: The present data demonstrate robust ICC validity of a WMH growth/regression protocol over a one-year period as measured by cross-site inter-rater and test-retest reliability. These data suggest that this approach may serve an important role in clinical trials of disease-modifying agents for VCID that may preferentially affect WMH growth, stability, or regression.

Original language	English
Pages (from-to)	683-693
Number of pages	11
Journal	Journal of Alzheimer's Disease
Volume	96
Issue number	2
DOIs	https://doi.org/10.3233/JAD-230629
State	Published - Nov 7 2023

Bibliographical note

Publisher Copyright:
© 2023 - IOS Press. All rights reserved.

Funding

This work was funded by NIH UH3 NS100599, U24 NS100591, NIGMS S10 OD023573, S10 OD025313, UH3 NS100588, UH3 NS100608, P30 AG010129, P30 AG072946, P30 AG066546, UH3 NS100605, UH3 NS100599 and UH 3NS100606.

Funders	Funder number
National Institutes of Health (NIH)	U24 NS100591, UH3 NS100599
National Institutes of Health (NIH)
National Institute of General Medical Sciences DP2GM119177 Sophie Dumont National Institute of General Medical Sciences	UH 3NS100606, S10 OD023573, UH3 NS100608, P30 AG066546, UH3 NS100605, P30 AG010129, P30 AG072946, S10 OD025313, UH3 NS100588
National Institute of General Medical Sciences DP2GM119177 Sophie Dumont National Institute of General Medical Sciences

Keywords

Aging
Alzheimer's disease
MarkVCID
cerebrovascular disease
dementia
longitudinal
small vessel ischemic disease
white matter hyperintensity

ASJC Scopus subject areas

General Neuroscience
Clinical Psychology
Geriatrics and Gerontology
Psychiatry and Mental health

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.3233/JAD-230629

Cite this

Bahrani, A. A., Abner, E. L., Decarli, C. S., Barber, J. M., Sutton, A. C., Maillard, P., Sandoval, F., Arfanakis, K., Yang, Y. C., Evia, A. M., Schneider, J. A., Habes, M., Franklin, C. G., Seshadri, S., Satizabal, C. L., Caprihan, A., Thompson, J. F., Rosenberg, G. A., Wang, D. J. J., ... Jicha, G. A. (2023). Multi-Site Cross-Site Inter-Rater and Test-Retest Reliability and Construct Validity of the MarkVCID White Matter Hyperintensity Growth and Regression Protocol. Journal of Alzheimer's Disease, 96(2), 683-693. https://doi.org/10.3233/JAD-230629

@article{a9819a7320aa494d87144ab21e6eae7b,

title = "Multi-Site Cross-Site Inter-Rater and Test-Retest Reliability and Construct Validity of the MarkVCID White Matter Hyperintensity Growth and Regression Protocol",

abstract = "Background: White matter hyperintensities (WMH) that occur in the setting of vascular cognitive impairment and dementia (VCID) may be dynamic increasing or decreasing volumes or stable over time. Quantifying such changes may prove useful as a biomarker for clinical trials designed to address vascular cognitive-impairment and dementia and Alzheimer's Disease. Objective: Conducting multi-site cross-site inter-rater and test-retest reliability of the MarkVCID white matter hyperintensity growth and regression protocol. Methods: The NINDS-supported MarkVCID Consortium evaluated a neuroimaging biomarker developed to track WMH change. Test-retest and cross-site inter-rater reliability of the protocol were assessed. Cognitive test scores were analyzed in relation to WMH changes to explore its construct validity. Results: ICC values for test-retest reliability of WMH growth and regression were 0.969 and 0.937 respectively, while for cross-site inter-rater ICC values for WMH growth and regression were 0.995 and 0.990 respectively. Word list long-delay free-recall was negatively associated with WMH growth (p < 0.028) but was not associated with WMH regression. Conclusions: The present data demonstrate robust ICC validity of a WMH growth/regression protocol over a one-year period as measured by cross-site inter-rater and test-retest reliability. These data suggest that this approach may serve an important role in clinical trials of disease-modifying agents for VCID that may preferentially affect WMH growth, stability, or regression.",

keywords = "Aging, Alzheimer's disease, MarkVCID, cerebrovascular disease, dementia, longitudinal, small vessel ischemic disease, white matter hyperintensity",

author = "Bahrani, \{Ahmed A.\} and Abner, \{Erin L.\} and Decarli, \{Charles S.\} and Barber, \{Justin M.\} and Sutton, \{Abigail C.\} and Pauline Maillard and Francisco Sandoval and Konstantinos Arfanakis and Yang, \{Yung Chuan\} and Evia, \{Arnold M.\} and Schneider, \{Julie A.\} and Mohamad Habes and Franklin, \{Crystal G.\} and Sudha Seshadri and Satizabal, \{Claudia L.\} and Arvind Caprihan and Thompson, \{Jeffrey F.\} and Rosenberg, \{Gary A.\} and Wang, \{Danny J.J.\} and Kay Jann and Chenyang Zhao and Hanzhang Lu and Rosenberg, \{Paul B.\} and Albert, \{Marilyn S.\} and Ali, \{Doaa G.\} and Herpreet Singh and Kristin Schwab and Greenberg, \{Steven M.\} and Helmer, \{Karl G.\} and Powel, \{David K.\} and Gold, \{Brian T.\} and Goldstein, \{Larry B.\} and Wilcock, \{Donna M.\} and Jicha, \{Gregory A.\}",

year = "2023",

month = nov,

day = "7",

doi = "10.3233/JAD-230629",

language = "English",

volume = "96",

pages = "683--693",

number = "2",

}

Bahrani, AA , Abner, EL, Decarli, CS, Barber, JM, Sutton, AC, Maillard, P, Sandoval, F, Arfanakis, K, Yang, YC, Evia, AM, Schneider, JA, Habes, M, Franklin, CG, Seshadri, S, Satizabal, CL, Caprihan, A, Thompson, JF, Rosenberg, GA, Wang, DJJ, Jann, K, Zhao, C, Lu, H, Rosenberg, PB, Albert, MS, Ali, DG, Singh, H, Schwab, K, Greenberg, SM, Helmer, KG, Powel, DK , Gold, BT , Goldstein, LB, Wilcock, DM & Jicha, GA 2023, 'Multi-Site Cross-Site Inter-Rater and Test-Retest Reliability and Construct Validity of the MarkVCID White Matter Hyperintensity Growth and Regression Protocol', Journal of Alzheimer's Disease, vol. 96, no. 2, pp. 683-693. https://doi.org/10.3233/JAD-230629

TY - JOUR

T1 - Multi-Site Cross-Site Inter-Rater and Test-Retest Reliability and Construct Validity of the MarkVCID White Matter Hyperintensity Growth and Regression Protocol

AU - Bahrani, Ahmed A.

AU - Abner, Erin L.

AU - Decarli, Charles S.

AU - Barber, Justin M.

AU - Sutton, Abigail C.

AU - Maillard, Pauline

AU - Sandoval, Francisco

AU - Arfanakis, Konstantinos

AU - Yang, Yung Chuan

AU - Evia, Arnold M.

AU - Schneider, Julie A.

AU - Habes, Mohamad

AU - Franklin, Crystal G.

AU - Seshadri, Sudha

AU - Satizabal, Claudia L.

AU - Caprihan, Arvind

AU - Thompson, Jeffrey F.

AU - Rosenberg, Gary A.

AU - Wang, Danny J.J.

AU - Jann, Kay

AU - Zhao, Chenyang

AU - Lu, Hanzhang

AU - Rosenberg, Paul B.

AU - Albert, Marilyn S.

AU - Ali, Doaa G.

AU - Singh, Herpreet

AU - Schwab, Kristin

AU - Greenberg, Steven M.

AU - Helmer, Karl G.

AU - Powel, David K.

AU - Gold, Brian T.

AU - Goldstein, Larry B.

AU - Wilcock, Donna M.

AU - Jicha, Gregory A.

PY - 2023/11/7

Y1 - 2023/11/7

N2 - Background: White matter hyperintensities (WMH) that occur in the setting of vascular cognitive impairment and dementia (VCID) may be dynamic increasing or decreasing volumes or stable over time. Quantifying such changes may prove useful as a biomarker for clinical trials designed to address vascular cognitive-impairment and dementia and Alzheimer's Disease. Objective: Conducting multi-site cross-site inter-rater and test-retest reliability of the MarkVCID white matter hyperintensity growth and regression protocol. Methods: The NINDS-supported MarkVCID Consortium evaluated a neuroimaging biomarker developed to track WMH change. Test-retest and cross-site inter-rater reliability of the protocol were assessed. Cognitive test scores were analyzed in relation to WMH changes to explore its construct validity. Results: ICC values for test-retest reliability of WMH growth and regression were 0.969 and 0.937 respectively, while for cross-site inter-rater ICC values for WMH growth and regression were 0.995 and 0.990 respectively. Word list long-delay free-recall was negatively associated with WMH growth (p < 0.028) but was not associated with WMH regression. Conclusions: The present data demonstrate robust ICC validity of a WMH growth/regression protocol over a one-year period as measured by cross-site inter-rater and test-retest reliability. These data suggest that this approach may serve an important role in clinical trials of disease-modifying agents for VCID that may preferentially affect WMH growth, stability, or regression.

AB - Background: White matter hyperintensities (WMH) that occur in the setting of vascular cognitive impairment and dementia (VCID) may be dynamic increasing or decreasing volumes or stable over time. Quantifying such changes may prove useful as a biomarker for clinical trials designed to address vascular cognitive-impairment and dementia and Alzheimer's Disease. Objective: Conducting multi-site cross-site inter-rater and test-retest reliability of the MarkVCID white matter hyperintensity growth and regression protocol. Methods: The NINDS-supported MarkVCID Consortium evaluated a neuroimaging biomarker developed to track WMH change. Test-retest and cross-site inter-rater reliability of the protocol were assessed. Cognitive test scores were analyzed in relation to WMH changes to explore its construct validity. Results: ICC values for test-retest reliability of WMH growth and regression were 0.969 and 0.937 respectively, while for cross-site inter-rater ICC values for WMH growth and regression were 0.995 and 0.990 respectively. Word list long-delay free-recall was negatively associated with WMH growth (p < 0.028) but was not associated with WMH regression. Conclusions: The present data demonstrate robust ICC validity of a WMH growth/regression protocol over a one-year period as measured by cross-site inter-rater and test-retest reliability. These data suggest that this approach may serve an important role in clinical trials of disease-modifying agents for VCID that may preferentially affect WMH growth, stability, or regression.

KW - Aging

KW - Alzheimer's disease

KW - MarkVCID

KW - cerebrovascular disease

KW - dementia

KW - longitudinal

KW - small vessel ischemic disease

KW - white matter hyperintensity

UR - https://www.scopus.com/pages/publications/85176977308

UR - https://www.scopus.com/inward/citedby.url?scp=85176977308&partnerID=8YFLogxK

U2 - 10.3233/JAD-230629

DO - 10.3233/JAD-230629

M3 - Article

C2 - 37840499

AN - SCOPUS:85176977308

SN - 1387-2877

VL - 96

SP - 683

EP - 693

JO - Journal of Alzheimer's Disease

JF - Journal of Alzheimer's Disease

IS - 2

ER -

Multi-Site Cross-Site Inter-Rater and Test-Retest Reliability and Construct Validity of the MarkVCID White Matter Hyperintensity Growth and Regression Protocol

Abstract

Bibliographical note

Funding

Keywords

ASJC Scopus subject areas

UN SDGs

Access to Document

Other files and links

Fingerprint

Cite this