As one kind of fluid machinery related to the two-phase flow, the refrigeration system encounters more problems of instability. It is essential to ensure the stability of the refrigeration systems for the operation and efficiency. This paper presents the experimental investigation on the static and dynamic instability in an evaporator of refrigeration system. The static instability experiments showed that the oscillatory period and swing of the mixture-vapor transition point by observation with a camera through the transparent quartz glass tube at the outlet of the evaporator. The pressure drop versus mass flow rate curves of refrigerant two phase flow in the evaporator were obtained with a negative slope region in addition to two positive slope regions, thus making the flow rate a multi-valued function of the pressure drop. For dynamic instabilities in the evaporation process, three types of oscillations (density wave type, pressure drop type and thermal type) were observed at different mass flow rates and heat fluxes, which can be represented in the pressure drop versus mass flow rate curves. For the dynamic instabilities, density wave oscillations happen when the heat flux is high with the constant mass flow rate. Thermal oscillations happen when the heat flux is correspondingly low with constant mass flow rate. Though the refrigeration system do not have special tank, the accumulator and receiver provide enough compressible volume to induce the pressure drop oscillations. The representation and characteristic of each oscillation type were also analyzed in the paper.