Categorical interpolation: Descent and the Beck-Chevalley condition without direct images