Ontology-Based Improvement to Human Activity Recognition

Human activity recognition has often prioritized low-level features extracted from imagery or video over higher-level class attributes and ontologies because they have traditionally been more effective on small datasets. However, by including knowledge-driven associations between actions and attributes while recognizing the lower-level attributes with their temporal relationships, we can attempt a hybrid approach that is more easily extensible to much larger datasets. We demonstrate a combination of hard and soft features with a comparison factor that prioritizes one approach over the other with a relative weight. We then exhaustively search over the comparison factor to evaluate the performance of a hybrid human activity recognition approach in comparison to the base hard approach at 84% accuracy and the current state-of-the-art.