Using the spectral as a conceptual metaphor, we explore narratives within Sweden’s welfare institutions and policy discourses surrounding vulnerable EU citizens. We aim to provide a new understanding of vulnerable EU citizens as the social ghosts of our time by exploring how the concept of the social ghost and hauntology can be used to perform ethical critique of social injustice. By excavating examples from already gathered material, we explore the unseen within the already seen to critically examine how vulnerable EU citizens are constructed in social welfare narratives. We argue that the terminology of vulnerable EU citizens not only is constructed as uncanny and abject but also as social ghosts, denied a social and political identity and forced to haunt the margins of societal life. Moreover, we argue that the Swedish state becomes a site for necropolitical power, enabling but also perpetuating lingering violent effects on Roma people.