“They must vote with the party that shed their blood … in giving them liberty”