Improved Operational Testing and Evaluation : Better Measurement and Test Design for the Interim Brigade Combat Team with Stryker Vehicles: Phase I Report

The U.S. Army Test and Evaluation Command (ATEC) is responsible for the operational testing and evaluation of Army systems in development. ATEC requested that the National Research Council form the Panel on Operational Test Design and Evaluation of the Interim Armored Vehicle (Stryker) to explore three issues concerning the initial operation test plans for the Stryker/Interim Brigade Combat Team (IBCT). First, the panel was asked to examine the measures selected to assess the performance and effectiveness of the Stryker/IBCT in comparison both to requirements and to the baseline system. Second, the panel was asked to review the test design for the Stryker/IBCT initial operational test to see whether it is consistent with best practices. Third, the panel was asked to identify the advantages and disadvantages of techniques for combining operational test data with data from other sources and types of use. In this report the panel presents findings, conclusions, and recommendations pertaining to the first two issues: measures of performance and effectiveness, and test design. The panel intends to prepare a second report that discusses techniques for combining information. Table of ContentsFront MatterExecutive Summary1. Introduction2. Test Process3. Test Measures4. Statistical Design5. Data Analysis6. Assessing the IBCT/Stryker Operational Test in a Broad ContextReferencesAppendix A: Letter Report of the Panel to the Army Test and Evalution CommandAppendix B: Force Exchange Ratio, Historical Win Probability, and Winning with Decisive ForceAppendix C: Biographical Sketches of Panel Members and Staff