In today's information overloaded era, recommender system is a necessity and it is widely used in most of the domains of e-commerce. Over the years, recommender system is improved to meet the main purpose of achieving better user experience, where accuracy is considered as one of the important aspects in its design. However, other aspects such as diversity, long tail item recommendation, novelty and serendipity are equally important while providing recommendations to the users. Research to improve above mentioned aspects is limited. In this paper, we propose an efficient approach to improve diversity and long tail item recommendations. The experiments are conducted on two real world movie rating datasets namely, MovieLens and Netflix. Experimental analysis shows that the proposed method outperforms the state-of-the art approaches in recommending diverse and long tail items.