To improve the ability to prepare for and adapt to potential hazards in a city, efforts are being invested in evaluating the performance of the built environment under multiple hazard conditions. An integrated physics-based multi-hazard simulation framework covering both individual buildings and urban areas can help improve analysis efficiency and is significant for urban planning and emergency management activities. Therefore, a city information model-powered multi-hazard simulation framework is proposed considering three types of hazards (i.e., earthquake, fire, and wind hazards). The proposed framework consists of three modules: (1) data transformation, (2) physics-based hazard analysis, and (3) high-fidelity visualization. Three advantages are highlighted: (1) the database with multi-scale models is capable of meeting the various demands of stakeholders, (2) hazard analyses are all based on physics-based models, leading to rational and scientific simulations, and (3) high-fidelity visualization can help non-professional users better understand the disaster scenario. A case study of the Tsinghua University campus is performed. The results indicate the proposed framework is a practical method for multi-hazard simulations of both individual buildings and urban areas and has great potential in helping stakeholders to assess and recognize the risks faced by important buildings or the whole city.