In this paper we provide a construction of theta series on the real symplectic group of signature (1,1) or the 4-dimensional hyperbolic space. We obtain these by considering the restriction of some vector-valued singular theta series on the unitary group of signature (2,2) to this indefinite symplectic group. Our (vector-valued) theta series are proved to have algebraic Fourier coefficients, and lead to a new explicit construction of automorphic forms generating quaternionic discrete series representations and automorphic functions on the hyperbolic space.