We first show that the infinitesimal generator of Lie symmetry of a time-fractional partial differential equation (PDE) takes a unified and simple form, and then separate the Lie symmetry condition into two distinct parts, where one is a linear time-fractional PDE and the other is an integer-order PDE that dominates the leading position, even completely determining the symmetry for a particular type of time-fractional PDE. Moreover, we show that a linear time-fractional PDE always admits an infinite-dimensional Lie algebra of an infinitesimal generator, just as the case for a linear PDE and a nonlinear time-fractional PDE admits, at most, finite-dimensional Lie algebra. Thus, there exists no invertible mapping that converts a nonlinear time-fractional PDE to a linear one. We illustrate the results by considering two examples.