When Participant Disjoint Validation Is Not Enough to Establish Generalization in Parkinson's Gait Classification
Critical methodological insight for ML researchers working on healthcare applications with multi-site data.
AI Summary
Research paper demonstrates that participant-disjoint validation can produce overly optimistic results in Parkinson's gait classification due to site-label dependencies.
Excerpt
Participant-disjoint cross-validation prevents direct participant overlap, but it may still produce optimistic estimates when acquisition site and diagnosis are structurally dependent. We examined Parkinson's disease classification using 159 pressure-walkway summary features from 133 WearGait-PD participants, including 65 participants with Parkinson's disease and 68 controls. The cohort was non-factorial: two sites contained only one diagnostic group, whereas VA-Seattle was the only site contain
