The optimal operation of microgrids is challenging due to the presence of various uncertain factors, i.e., renewable energy sources, loads, market price signals, and arrival and departure times of electric vehicles (EVs). In order to incorporate these uncertainties into the operation model of microgrids, an adaptive robust optimization-based operation method is proposed in this paper. In particular, the focus is on the uncertainties in arrival and departure times of EVs. The optimization problem is divided into inner and outer problems and is solved iteratively by introducing column and constraint cuts. The unit commitment status of dispatchable generators is determined in the outer problem. Then, the worst-case realizations of all the uncertain factors are determined in the inner problem. Based on the values of uncertain factors, the generation amount of dispatchable generators, the amount of power trading with the utility grid, and the charging/discharging amount of storage elements are determined. The performance of the proposed method is evaluated using three different cases, and sensitivity analysis is carried out by varying the number of EVs and the budget of uncertainty. The impact of the budget of uncertainty and number of EVs on the operation cost of the microgrid is also evaluated considering uncertainties in arrival and departure times of EVs.