Mental model for handwritten keyword spotting

Most of existing approaches in keyword spotting are system-oriented, which did not take into consideration the user's needs. However, a user may want to find words, sentences, or texts that match his target image in his mind. The challenge here is how to formulate one's mental image to reach what he is looking for. The key idea is to design and build a model that properly adapts the human reasoning in information searching through an interactive process. We propose a mental model for handwritten keyword spotting based on relevance feedback, feature weighting, and optimization. This model meets simultaneously the user's needs, the system behavior, and the user-system relationship. In an appropriate feature space, the query is progressively built from user-supplied keywords, old queries, and spotted images. This dynamic process not only converges toward the desired word images, but also helps the hesitant user to clarify progressively what he is looking for. The proposed model was showcased via a user-friendly interface, which we tested including real users on three well-known handwritten datasets; Institute for Communications, Braunschweig University, Germany/Ecole Nationale d'Ingenieurs de Tunis, Tunisia, Institut fur informatik und Angewandte Mathematik, and George Washington. The experimental results show that the proposed method provides promising scores with a reasonable number of refinements. (C) 2018 SPIE and IS&T