Acid mine drainage (AMD) has properties of extreme acidification, quantities of sulfate and elevated levels of soluble heavy metals. It was a widespread environmental problem that caused adverse effects to the qualities of ground water and surface water. In the past decades, most of investigations were focused on the heavy metals as their toxicities for human and animals. As another main constitution of AMD, sulfate ion is nontoxic, yet high concentration of sulfate ion can cause many problems such as soil acidification, metal corrosion and health problems. More attention should be paid on the sulfate ion when people focus on the AMD. In the paper, sulfate removal mechanisms include adsorption, precipitation, co-precipitation and biological reduction were analyzed and summarized. Meanwhile, the remediation technologies, especially the applications of them in China were also presented and discussed.