Clustering is an unsupervised technique used in various application, namely machine learning, image segmentation, social network analysis, health analytics, and financial analysis. It is a task of grouping similar objects together and dissimilar objects in different group. The quality of the cluster relies on two factors: distance metrics and data representation. Deep learning is a new field of machine learning research that has been introduced to move machine learning closer to artificial intelligence. Learning using deep network provides multiple layers of representation that helps to understand images, sound, and text. In this chapter, the need for deep network in clustering, various architecture, and algorithms for unsupervised learning is discussed.