Performance Assessments of Android-powered Military Applications Operating on Tactical Handheld Devices

Published

August 1, 2013

Author(s)

Brian A. Weiss, Lisa J. Fronczek, Emile L. Morse, Zeid Kootbally, Craig I. Schlenoff

Abstract

Transformative Apps (TransApps) is a DARPA-funded program whose goal is to develop a range of militarily-relevant software applications ("apps") to enhance the operational-effectiveness of military personnel on (and off) the battlefield. TransApps is also developing a military apps marketplace to facilitate rapid development and dissemination of applications to address user needs by connecting engaged communities of end-users with development groups. The National Institute of Standards and Technology's (NIST) role in the TransApps program is to design and implement evaluation procedures to assess the performance of: 1) the various software applications, 2) software-hardware interactions, and 3) the supporting online application marketplace. Specifically, NIST is responsible for evaluating 50+ tactically-relevant applications operating on numerous Android-powered platforms. NIST efforts include functional regression testing and quantitative performance testing. This paper discusses the evaluation methodologies employed to assess the performance of three key program elements: 1) handheld-based applications and their integration with various hardware platforms, 2) client-based applications and 3) network technologies operating on both the handheld and client systems along with their integration into the application marketplace. Handheld-based applications are assessed using a combination of utility and usability-based checklists and quantitative performance tests. Client-based applications are assessed to replicate current overseas disconnected (i.e. no network connectivity between handhelds) operations and to assess connected operations envisioned for later use. Finally, networked applications are assessed on handhelds to establish baselines of performance for when connectivity will be common usage.

Proceedings Title

SPIE Defense, Security, and Sensing: Mobile Multimedia/Image Processing Security, and Applications 2013 Conference

Conference Dates

April 29-May 3, 2013

Conference Location

Baltimore, MD

Pub Type

Conferences

Download Paper

Local Download

Keywords

Performance Evaluation, Metrics, Android, Military, Functional Testing, Regression Testing, Usability

Citation

Weiss, B. , Fronczek, L. , Morse, E. , Kootbally, Z. and Schlenoff, C. (2013), Performance Assessments of Android-powered Military Applications Operating on Tactical Handheld Devices, SPIE Defense, Security, and Sensing: Mobile Multimedia/Image Processing Security, and Applications 2013 Conference, Baltimore, MD, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=913756 (Accessed December 17, 2024)