Visual Sensor Network (VSN) is a network of distributed battery-powered low-cost cameras and CMOS image sensors, each with the capability of capturing, processing, sending, and receiving images. VSN applications include remote monitoring, Security, elderly assistance, Visual Ubiquity, home monitoring, tracking. The highly sensitive nature of images makes security and privacy in VSNs even more important than in most other sensor and data networks. However, the direct use of security techniques developed for scalar WSN will not be suitable for VSN due to its resource constraint. Hence light weight security mechanisms need to be explored. In this chapter the challenging security issues at various layers in VSN are addressed. It also fosters discussion on privacy protection techniques like subjective privacy, Video masking techniques and identifies recent trends in VSN security and privacy. A discussion of open research issues concludes this chapter.