causal
Split-sample validation detects changes in crowd behavior
For crowdsourced datasets whose contributor panel changes over time, first-half versus second-half validation is preferred because it reveals whether the decision quality behind the signal is intrinsic or whether participants' heuristics and platform changes have altered it.
causalpending
Speaker
LeighEvidence Quote
“So it actually is good to go first half, the second half to see if the regressions that were run in the first half.”
Created: 11/19/2026, 8:46:10 AM
Your notes
Loading notes...