This chapter uses the stories of three families, the ‘Kallikaks’, the Kennedys and the Fergusons, to narrate the key stages of the history of intellectual disability in the twentieth century. The so-called‘Kallikaks’ were used as part of the vicious eugenic libel against the intellectually disabled population that stoked the cruel mass institutionalization programmes of the early century. This section tells the story of Emma Wolverton, one of those on whose life stories the mythical Kallikaks were based and created to spread fear and drive segregational policy. The story of the famous Kennedy family shows the post-war journey of the intellectually disabled person from a hidden site of shame to the policy reforms of the community return. Finally, the story of the author’s own family shows some of the great post-reform liberating shifts towards a life of choice and inclusion that have taken place, and alerts us to the brooding threats that still lurk.