With the development of computing technology and artificial intelligence, an environment in which we can use advanced information and communication services in our daily lives is rapidly being established. By installing mechanisms that recognize and understand in a more human-oriented manner than conventional technologies, we aim to create a society in which people and machines can coexist in harmony. In this article, we introduce our research themes for achieving this aim. © 2021 Nippon Telegraph and Telephone Corp.. All rights reserved.