Two experimental studies were conducted to replicate the effect found by Baus et al. where language as a marker of social categories affected recognition of faces in an old/new paradigm. In Study 1, we presented faces along with utterances in Swedish and in English to native Swedish speakers. Faces presented along with Swedish utterances were not recognized better than faces presented along with English utterances. In Study 2, we used another language pair and presented faces along with utterances in Swedish and in Spanish to native Swedish speakers. Faces presented along with Swedish utterances were recognized better than faces presented along with Spanish utterances. Our results suggest that language functions as a marker of social categories and that, similarly to other markers of social categories, it can be modulated by various factors and is not unconditional.