Corpus ID: 235795495

Automated Mobile App Test Script Intent Generation via Image and Code Understanding

  title={Automated Mobile App Test Script Intent Generation via Image and Code Understanding},
  author={Shengcheng Yu and Chunrong Fang and Tongyu Li and Mingzhe Du and Xuan Li and Jing Zhang and Yexiao Yun and Xu Wang and Zhenyu Chen},
Testing is the most direct and effective technique to ensure software quality. However, it is a burden for developers to understand the poorly-commented tests, which are common in industry environment projects. Mobile applications (app) are GUI-intensive and event-driven, so test scripts focusing on GUI interactions play a more important role in mobile app testing besides the test cases for the source code. Therefore, more attention should be paid to the user interactions and the corresponding… Expand

Figures and Tables from this paper


Automated Cross-Platform GUI Code Generation for Mobile Apps
This work proposes an automated cross-platform GUI code generation framework that leverages image processing and deep learning classification techniques and makes it possible for large-scale, platform -independent code generation. Expand
Code Attention: Translating Code to Comments by Exploiting Domain Features
A new attention module called Code Attention is proposed to translate code to comments, which is able to utilize the domain features of code snippets, such as symbols and identifiers, which has better performance over existing approaches in both BLEU and METEOR. Expand
A Survey of Automatic Generation of Source Code Comments: Algorithms and Techniques
This work generally analyzes the challenges and research framework of automatic generation of program comments, the classification of representative algorithms, the design principles, strengths and weaknesses of each category of algorithms, and an overview of the quality assessment of the generated comments. Expand
Automatic Comment Generation using a Neural Translation Model
Comments help developers quickly understand the functionality of programming code. Unfortunately, creating these comments remains a labour-intensive task despite various help utilities for softwareExpand
Deep Code Comment Generation
DeepCom applies Natural Language Processing (NLP) techniques to learn from a large code corpus and generates comments from learned features for better comments generation of Java methods. Expand
AutoComment: Mining question and answer sites for automatic comment generation
A new automatic comment generation approach, which mines comments from a large programming Question and Answer (Q&A) site, which shows that the majority of the participants consider the generated comments accurate, adequate, concise, and useful in helping them understand the code. Expand
Reverse Engineering Mobile Application User Interfaces with REMAUI (T)
  • T. Nguyen, C. Csallner
  • Computer Science
  • 2015 30th IEEE/ACM International Conference on Automated Software Engineering (ASE)
  • 2015
The first technique to automatically Reverse Engineer Mobile Application User Interfaces (REMAUI) is introduced, which identifies user interface elements such as images, texts, containers, and lists, via computer vision and optical character recognition (OCR) techniques. Expand
On the Use of Automated Text Summarization Techniques for Summarizing Source Code
The paper presents a solution which mitigates the two approaches, i.e., short and accurate textual descriptions that illustrate the software entities without having to read the details of the implementation. Expand
Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Apps
This paper presents an approach that automates this process by enabling accurate prototyping of GUIs via three tasks: detection, classification, and assembly, and implemented this approach for Android in a system called ReDraw. Expand
Measuring Program Comprehension: A Large-Scale Field Study with Professionals
This paper extends the ActivitySpace framework to collect and analyze Human-Computer Interaction data across many applications (not just the IDEs), and finds that on average developers spend on average 58 percent of their time on program comprehension activities, and that they frequently use web browsers and document editors to performprogram comprehension activities. Expand