"Olivia" is a Virtual Assistant developed specifically for homes, which can be integrated into any home to make it a Smart Home. The user can interact solely through his/her voice with Olivia (the virtual assistant) to get any his/her work done around the house. Olivia-the virtual assistant can be installed anywhere inside any house as it lives inside Raspberry Pi which is a really compact and inexpensive computer and can be connected easily to devices such as microphone, speakers, cameras, PIR etc. Thus having the ability to convert any home into a smart home. In this system we have integrated Olivia into smart door lock for The Smart Home Surveillance System' implemented on Raspberry Pi. The system is smart enough to identify and differentiate between the owner and stranger using face recognition and act accordingly. In this system, Olivia can interact with the stranger at the door in case the owner is not present at home and will notify the owner about the visit using Email and SMS along with the image of the stranger. Similarly, Olivia can be integrated to other systems and appliances such as tube lights, air conditioners etc. making them smarter. The virtual assistant is highly beneficial for visually impaired people as it can perform various functions inside the house such as telling about the weather, stock prices, performing various calculations, telling jokes or playing songs all solely through voice.