Functional
Testing of a Test Preparation System
The client
The client is an IT branch of an American educational service
organization which is a senior provider of various test preparation
service. More and more educators who want to help their students
succeed or people who want to pass certain test consider it
a high quality, affordable solution to high test scores to
choose this kind of service. They could also get superior
customer service.
What the client wanted
This system which has both standalone version and web-based
version allows for test preparation and practice. People who
intend to pass certain test may utilize the enormous content
of test preparation materials in the system and get sufficient
practice. It is developed with Java Swing, MySQL, Jboss technology
compatible with Windows, Linux, and Mac platforms.
The client required us to test both standalone and web-based
versions on all compatible platforms (Windows, Mac, Linux)
according to the System Requirement Specifications, record
and track defects, generate defect detail description and
test report. We assumed the following responsibilities:
- Testing should be timely finished within budget.
- Defects should be correctly characterized and clearly
written. Client may ask for more in-depth investment on
characterizing defects.
- Status and other reporting should be completed timely
and well documented.
For defects found within 3 months after product shipment,
we are liable for bearing the further testing cost if the
defect escalated is found to be omitted due to the following:
- Poorly developed test cases and/or test scripts
- Omitted in the course of testing
- Tested but failure not reported
Approach
- Set up the testing environment, analyzed System Requirement
Specifications.
- Developed the Test Plan including test methods, test strategy,
tools selection, resource assignment (human resources and
other resources), schedule arrangement, etc.
- Designed test cases to cover System Requirement Specifications.
- Executed test cases and implemented ad hoc testing, recorded
and tracked the detected defects, generated Defect Description
Report.
| Testing Tasks |
Project |
| Design test plan |
Required |
| Design test cases |
Required |
| Test execution and record results |
Required |
| Performance test |
Not Required |
| Automatic test scripts |
Not Required |
| Bug tracking |
Required |
| Defect Sheet |
Required |
| Defect Description Report |
Required |
| Test report |
Not Required |
Benefits
- 400 test cases were designed about and over 200 defects
were found in the system. Definition of the test processes
resulted in defect capturing early in the development lifecycle
thus resulting in on-time, on-budget high quality products.
- System stability was tested, thus reducing time-to-market.
Testimonials
"I just wanted to report on the excellent work and leadership of the
Java team on their work for the project. The core application work is very
good and we are most pleased and amazed with their progress. "
-- Michael Payne ,
CEO, CTI