With the continuous development of social economy, robots gradually replace human beings in many aspects of auxiliary work, but it is worth noting that orderly, accurate, and safe operation is the reasonable form of robot movement. In view of the existing limitations, this study combines the gradient matching algorithm, by using a high-precision motion matching for the visual system, improves the automation precision, and, at the same time, picking fruit image smoothing and enhancement, achieves fruit edge feature extraction; the simulation experiments proved that matching the gradient algorithm is effective and can realize the visual and actions match together and support picking robot movement.