18–21 May 2026
Europe/Warsaw timezone

Covariate adjustment, factorial designs and clustered data in diagnostic accuracy studies

21 May 2026, 11:21
18m
Room 13 A

Room 13 A

Speaker

Philipp Weber (Institute of Medical Biometry and Epidemiology)

Description

The accuracy of diagnostic tests is commonly evaluated by estimating the area under the receiver operating characteristic curve (AUC), as well as sensitivity and specificity at given diagnostic cut-offs. However, many diagnostic trials use factorial designs. For example, different combinations of readers and methods may be used to diagnose a patient. Furthermore, diagnostic studies may generate clustered data by repeated measurements over time or several lesions, for example different brain regions. Dependencies between a person's observations must be taken into account in the analysis in order to prevent variance deflation. Lange [1] developed a nonparametric mathematical framework to deal with both of these design aspects, and Lange and Brunner generalized the approach from the AUC to sensitivity and specificity [3].
Additionally, it may be of interest to adjust the estimation procedure of the above mentioned accuracy measures for covariates. For example, it may be the case that age, weight or height influence the diagnostic accuracy of a test. Zapf [2] proposed a nonparametric methodological approach to adjust the AUC for such covariates, while also allowing for factorial designs, but not yet for clustered data. In this talk we present a new, unified method that enables covariate adjustment of the AUC, sensitivity and specificity in studies with factorial designs and clustered data. We will show the properties of the approach using simulated data and illustrate the approach with an example study.

1) Lange, K. (2011, March 4). Nichtparametrische analyse diagnostischer Gütemaße bei Clusterdaten. Retrieved February 27, 2023, from DOI: 10.53846/goediss-3538
2) Zapf, A. (2009, October 23). Multivariates nichtparametrisches Behrens-Fisher-problem MIT Kovariablen. Retrieved February 27, 2023, DOI: 10.53846/goediss-2488
3) Lange, K., & Brunner, E. (2012). Sensitivity, specificity and ROC-curves in multiple reader diagnostic trials—a unified, nonparametric approach. Statistical Methodology, 9(4), 490–500. DOI: 10.1016/j.stamet.2011.12.002

75002919688

Author

Philipp Weber (Institute of Medical Biometry and Epidemiology)

Co-authors

Antonia Zapf (Institute of Medical Biometry and Epidemiology) Daniel Dümmler (Institute of Epidemiology and Social Medicine) Frank Konietschke (Institute of Biometry and Clinical Epidemiology) Frederike Vogel (Institute of Medical Biometry and Epidemiology) Nicole Rübsamen (Institute of Epidemiology and Social Medicine)

Presentation materials

There are no materials yet.