Abstract. The accuracy of solar radiation measurements (for direct and diffuse radiation) depends significantly on the precision of the operational sun-tracking device. Thus rigid targets for instrument performance and operation have been specified for international monitoring networks, such as e.g., the Baseline Surface Radiation Network (BSRN) operating under the auspices of the World Climate Research Program (WCRP). Sun-tracking devices fulfilling these accuracy requirements are available from various instrument manufacturers, however none of the commercially available systems comprises an automatic accuracy control system, allowing platform operators to independently validate the pointing accuracy of sun-tracking sensors during operation. Here we present KSO-STREAMS (KSO-SunTRackEr Accuracy Monitoring System), a fully automated, system independent and cost-effective method for evaluating the pointing accuracy of sun-tracking devices. We detail the monitoring system setup, its design and specifications and results from its application to the sun-tracking system operated at the Austrian RADiation network (ARAD) site Kanzelhöhe Observatory (KSO). Results from an evaluation campaign from March to June 2015 show that the tracking accuracy of the device operated at KSO lies for the vast majority of observations (99.8 %) within BSRN specifications (i.e., 0.1° tracking accuracy). Evaluation of manufacturer specified active tracking accuracies (0.02°), during periods with direct solar radiation exceeding 300 W m−2, shows that these are satisfied for 72.9 % of observations. Tracking accuracies are highest during clear-sky conditions and on days where prevailing clear-sky conditions are interrupted by frontal movement: in these cases we obtain complete fulfillment of BSRN requirements and 76.4 % of observations within manufacturer specified active tracking accuracies. Limitations to tracking surveillance arise during overcast conditions and periods of partial solar limb coverage by clouds. On days with variable cloud-cover 78.1 % (99.9 %) of observations meet active tracking (BSRN) accuracy requirements while for days with prevailing overcast conditions these numbers reduce to 64.3 % (99.5 %), respectively.