規則系統之適應性測試計畫產生之流程建立

Abstract

目前的做法，測試計畫是由手動或由工具針對特定的應用來產生。但這樣是費時且容易發生錯誤的並且不容易和應用範圍的知識有所相關聯。我們提出一個規則基礎的開放式架構來解決這個問題。測試專家只需將他們的應用範圍的知識轉換為一組測試控制規則。每次一條規則被執行，測試控制器將會檢查被提供的測試案例和測試記錄，接著會選定一條試測案例並執行它，並在執行完畢將執行結果記錄在測試記錄中。我們所設計的規則和記錄方試及架構可應用在不同的測試策略。我們利用TTCN-3實作我們的想法並提出不同測試策略的實驗。在實驗中我們發現我們的架構可以靈活的再利用並減輕測試計畫建構的成本。

In previous work, test plans were either constructed manually or generated with tools adapted to specific application domains. In either way, it is labor-intensive, error-prone, and difficult to incorporate the knowledge of application domains. We propose a rule-based open framework to solve this problem. Test experts only need to materialize their knowledge in an application domain as a set of test-control rules. Each time a rule is executed, our test-controller will check the available testcases and the test log, select the next testcase accordingly, execute the selected testcase, and update the test log. The design of our rule and log allows for the implementation of a wide variety of test strategies. We have implemented our ideas in the framework of TTCN-3, an international standard for testing language. We experimented our tool with requirement coverage testing, fault-based testing, and performance testing. We found that our tool could be flexibly reused for the three test strategies and significantly reduce the cost in constructing test plans.