FT-Raman, FTIR, and SERS spectra of the structurally related gallnut polyphenols tannic acid, gallic acid, pyrogallol, and syringic acid are reported in this work aiming at performing a comparative assignation of the bands and finding specific marker features that can identify these compounds in complex polyphenol mixtures. Tannic and gallic acids are the principal components in oak gallnuts, and they can be found in iron gall inks. The different functional groups existing in these molecules and their spatial distribution lead to slight changes of the vibrations. The Raman spectra are dominated by bands corresponding to the ring vibrations, but the substituents in the ring strongly affect these vibrations. In contrast, the FTIR spectra of these molecules are dominated by the peripheral oxygen-containing substituents of the aromatic ring and afford complementary information. SERS spectroscopy can be used to analyze trace amounts of these compounds, but the spectra of these polyphenols show strong changes in comparison with the Raman spectra, indicating a strong interaction with the metal. The most significant modification observed in the SERS spectra of these compounds is the weakening of the benzene 8a ring vibration and the subsequent intensification of the 19a mode of the benzene ring. This mode is also more intense in the FTIR spectra, and its intensification in the SERS spectra could be related to a drastic change in the molecular polarizability associated with the interaction of the polyphenol with the metal in Ag NPs.