Problem Statement

Preventing Data Leakage During Standardization A researcher standardizes every feature using the mean and standard deviation from the entire dataset before splitting it into training and test sets. Which assessment is correct? This is fine because normalization is scale-invariant and cannot leak information. This leaks test-set information into training; fit preprocessing statistics on the training data only, then apply them to the test data. This only matters for tree-based models.