Mental chronometry in big noisy data
Temporal measures (latencies) in the event-related potentials of the EEG (ERPs) are a valuable tool for mental chronometry. In large scale studies with a multitude of single EEG-based tasks the quality of latency measures often suffers from high and low frequency noise due to low trial counts (because of compressed tasks) and the missing opportunity of visual inspection. In the present study, we systematically evaluated two different approaches to latency estimation (peak latencies and fractional area latencies) with respect to their data quality and the application of noise reduction by jackknifing methods. Additionally, we tested the recently introduced method of Standardized Measurement Error (SME) to prune the dataset. We demonstrate that fractional area latency in pruned and jackknifed data may amplify within-subjects effect sizes by the factor ten in the analyzed data set. Between-subjects effects were less affected by the applied procedure, but remained stable regardless of procedure.