Understanding the origins of political authoritarianism is of key importance for modern democracies. Recent works in evolutionary psychology suggest that human cognitive preferences may be the output of a biological response to early stressful environments. In this paper, we hypothesized that people's leader preferences are partly driven by early signals of harshness. We experimentally elicited children's (Study 1) and adults' (Study 2) political preferences using faces controlled for dominance and trustworthiness and showed that early childhood harshness has an enduring effect on adult political attitudes. Importantly, this effect was further confirmed using self-reported extreme authoritarianism (Study 2) and by the analysis of the large database of the European Value Survey (Study 3). We discuss the potential political implications of this early calibration of leader preferences.