Knowledge in rural communities is largely created, preserved, and is transferred verbally, and it is limited. This information is valuable to these communities, and managing and making it available digitally with state-of-the-art approaches enriches awareness and collective knowledge of people of these communities. The large amounts of data and information produced on the Internet are inaccessible to the population in these rural communities due to factors like lack of infrastructure, connectivity, and limited literacy. Knowledge internal to rural communities is also not conserved and made available in any global Big Data information systems. Artificial Intelligence (AI) technologies such as Automatic Speech Recognition (ASR) and Natural Language Processing (NLP) provide substantial assistance when vast quantities of data, like Big Data, are available to build solutions. In the case of low-resource languages like Kannada and rural colloquial dialects, publicly available corpora are significantly less. Building state-of-the-art AI solutions is challenging in this context, and we address this problem in this work. Knowledge management in rural communities requires a low-cost and efficient approach that social workers can use. This paper proposes an architecture for oral knowledge management for rural communities speaking colloquial Kannada. The proposed architecture has an interface for oral knowledge retrieval using text processing on transcripts generated from the smallest state-of-the-art ASR model. We propose three interfaces to search for content: an n-gram based fuzzy search to search for texts in audios, the most frequent entities search based on the Kannada Named Entity Recognition (NER) model, and question answering with Large Language Model (LLM) using a community knowledge vector store.