This paper presents an automatic prediction model for ground vibration induced by Taiwan high-speed trains on embankment structures. The prediction model is developed using different field-measured ground vibration data. The main characteristics that affect the overall vibration level are established based on the database of measurement results. The influence factors include train speed, ground condition, measurement distance, and supported structure. Support vector machine (SVM) algorithm, a widely used prediction model, is adopted to predict the vibration level induced by high-speed trains on embankments. The measured and predicted vibration levels are compared to verify the reliability of the prediction model. Analysis results show that the developed SVM model can reasonably predict vibration level with an accuracy rate of 72% to 84% for four types of vibration level, including overall, low, middle, and high frequency ranges. The methodology in developing the automatic prediction system for ground vibration level is also presented in this paper.