基於記憶庫問答的記憶輔助機器人

Abstract

在日常生活，人們需要記憶各式各樣的事情，也時常需要作筆記，避免日後遺忘。因此，本論文提出一個基於記憶庫問答的記憶輔助機器人，主要以語音作為輸入，幫助使用者儲存記憶和回憶。 我們所提出系統有多個模組，包含記憶儲存模組、記憶庫問答模組和記憶日曆模組。記憶儲存模組能讓使用者透過語音來儲存記憶，我們的系統會通過語音辨識來得到逐字稿，接著使用多種方法抽取特徵，建立記憶並存儲在記憶庫中。而記憶庫問答模組，目的是讓使用者透過問答的方式回憶。根據問題，我們基於開放領域問答的架構來進行檢索與預測，接著使用一個答案排序的方法來得到最終的答案。除此之外，為了幫助使用者瀏覽記憶，我們提出一個記憶日曆模組，從逐字稿中提取日常事件，並顯示在日曆上。實驗部分，我們使用兩個實驗進行評估，第一個實驗為開放領域問答的實驗，而第二個實驗則是人機互動實驗。

In daily life, people need to memorize various things and often need to write notes to avoid forgetting in the future. Therefore, this thesis proposes a memory assistance robot based on memory bank question answering, which mainly uses speech as input to help the user store and recall memories. Our proposed system contains multiple modules, including memory storage module, memory bank question answering module, and memory calendar module. The memory storage module allows users to store memories through speech. Our system will obtain transcript through speech recognition and then use various methods to extract features, construct the memory, and store it in the memory bank. For the memory bank question answering module, the purpose is to allow the user to recall through question answering. According to the query, we perform retrieval and prediction based on the open-domain question answering architecture. Then, we use an answer ranking method to get the final answer. In addition, to help the user view memories, we propose a memory calendar module, which extracts daily events from the transcript and shows them on the calendar. In the experiment part, we use two experiments for evaluation. The first experiment is the open-domain question answering experiment, and the second experiment is the human-robot interaction experiment.