In recent years we have witnessed a flourishing of automated and community-based question answering services, which have emerged as an effective paradigm for oceanic information seeking, diverse knowledge disseminating, and outstanding expert routing. However, existing QA services usually provide only textual answers which are not intuitive and informative for many questions. On the other hand, the available amount of multimedia data on the internet has increased exponentially and has wide coverage on many practical topics. Naturally, it is time to shift the efforts from traditional text-based QA to multimedia QA.
To address the above problems, we focus on tackling the following key research issues:
To demonstrate the above capabilities, we will focus on several vertical domains such as medical, community health and product.
Figure 3.1: The schematic illustration of the proposed multimedia answering scheme.
Figure 3.2: The proposed framework for multimedia answer re-ranking for complex queries.
Figure 3.3: Question annotation framework for social QA.