Theory suggests that threat stimuli may be perceived closer or bigger than they are, resulting in enhanced response preparation. In contrast to this notion, the present data from two VR experiments consistently demonstrate that angry voice stimuli are perceived at greater distances than neutral voice stimuli. Based on these findings, we suggest that for auditory stimuli, distance processing seems to be driven by listeners’ top-down expectations of the relationship of speaker’s affect and acoustic features rather than stimulus threat or motivational tendencies. The present study adds to our understanding of how stimulus properties and top-down mechanisms help us perceive the world around us.