Tuesday, May 26, 2009

Racetrack Repository

Racetrack is a designed to store and display the results of automated tests. At VMware, over 2,000,000 test results have been stored in Racetrack Repository. Over 25 different teams use the repository to report results. It has a very simple data model, just three basic tables. ResultSet (stores information about a set of tests (Product, Build, etc.) Result, which stores information about the testcase itself, and ResultDetail, which stores the details of each verification performed within the test. ResultDetails also include screenshots and log files, make it easy for the triage engineer to determine the cause of the failure.
We are very excited to offer Racetrack to the public as an Open Source project. It offers complete visibility on test results to the organization, much more than Pass/Fail. QA Engineers, Developers, QA Managers, Project Managers all find it useful to quickly see the results of Basic Acceptance Tests, available within an hour of the build completing. Racetrack Triage Report makes it easy to see the number of defects found by a set of tests, and the number of failures caused by Product Changes, and Script failures. By adding a reference to your Bugzilla and Build systems, you can easily provide links directly from Racetrack to a defect or a build information page. The Web Services API is already part of the package, and SilkTest and Java APIs will be added shortly.

No comments: