GUI Testing Using Computer Vision

被引：0

作者：

Chang, Tsung-Hsiang ^{[1
]}

Yeh, Tom ^{[2
,3
]}

Miller, Robert C. ^{[1
]}

机构：

[1] MIT, CSAIL, Cambridge, MA 02139 USA

[2] Univ Maryland, UMIACS, College Pk, MD 20742 USA

[3] Univ Maryland, HCIL, College Pk, MD 20742 USA

来源：

CHI2010: PROCEEDINGS OF THE 28TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1-4 | 2010年

基金：

美国国家科学基金会;

关键词：

GUI testing; GUI automation; test by demonstration;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Testing a GUI's visual behavior typically requires human testers to interact with the GUI and to observe whether the expected results of interaction are presented. This paper presents a new approach to GUI testing using computer vision for testers to automate their tasks. Testers can write a visual test script that uses images to specify which GUI components to interact with and what visual feedback to be observed. Testers can also generate visual test scripts by demonstration. By recording both input events and screen images, it is possible to extract the images of components interacted with and the visual feedback seen by the demonstrator, and generate a visual test script automatically. We show that a variety of GUI behavior can be tested using this approach. Also, we show how this approach can facilitate good testing practices such as unit testing, regression testing, and test-driven development.

引用

页码：1535 / +

页数：2

共 18 条

[1]

Boshernitsan M, 2007, CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1 AND 2, P567

[2]

Kasik D. J., 1996, Human Factors in Computing Systems. Common Ground. CHI 96 Conference Proceedings, P244, DOI 10.1145/238386.238519

[3]

Ko A. J., 2004, P SIGCHI C HUM FACT, P151, DOI [10.1145/985692.985712, DOI 10.1145/985692.985712]

[4]

Ko A, 2009, CHI2009: PROCEEDINGS OF THE 27TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1-4, P1569

[5]

Leshed G, 2008, CHI 2008: 26TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS VOLS 1 AND 2, CONFERENCE PROCEEDINGS, P1719

[6]

Little G, 2007, CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1 AND 2, P943

[7] GUI Ripping: Reverse engineering of graphical user interfaces for testing [J].

Memon, A ;

Banerjee, I ;

Nagarajan, A .

10TH WORKING CONFERENCE ON REVERSE ENGINEERING, PROCEEDINGS, 2003, :260-269

[8] GUI testing: Pitfalls and process [J].

Memon, AM .

COMPUTER, 2002, 35 (08) :87-88

[9]

Ostrand T., 1998, Software Engineering Notes, V23, P82, DOI 10.1145/271775.271793

[10]

SINGH G, 1994, CHI 94, P297

← 1 2 →