LAUSR

&NA; Attention is crucial to speech comprehension in real‐world, noisy environments. Selective phase‐tracking between low‐frequency brain dynamics and the envelope of target speech is a proposed mechanism to reject competing distractors. Studies have supported this theory in the case of a single distractor, but have not considered how tracking is systematically affected by varying distractor set sizes. We recorded electroencephalography (EEG) during selective listening to both natural and vocoded speech as distractor set‐size varied from two to six voices. Increasing set‐size reduced performance and attenuated EEG tracking of target speech. Further, we found that intrusions of distractor speech into perception were not accompanied by sustained tracking of the distractor stream. Our results support the theory that tracking of speech dynamics is a mechanism for selective attention, and that the mechanism of distraction is not simple stimulus‐driven capture of sustained entrainment of auditory mechanisms by the acoustics of distracting speech.