Optical fiber sensor which is based on palladium is highly sensitive to detect hydrogen. In this paper we analyzed the effect of buffer on sensitivity. Sensitivity is affected due to presence of buffer between side polished fiber core and hydrogen absorbing palladium layer. We optimized the buffer thicknesses for different palladium thickness to achieve maximum sensitivity.