Overview
The 2000MAN project developed a car reservation and sales management system with two subsystems: SalesSupport for handling reservations and sales, and XMAP for managing warehouse operations, branches, and order statuses—streamlining dealership operations.
Testing Scope
- UI Testing: Verified UI elements on web and mobile using image comparison.
- Functional Testing: Tested core functionalities of both Sales Support and XMAP subsystems, ensuring smooth operations for reservations, sales, and warehouse management.
- Integration Testing: Validated seamless data flow between SalesSupport and XMAP.
- Environment Setup: Configured Selenium grid for web testing and a Mac mini on EC2 for iOS testing.
Challenges and Solutions
- Challenge 1: Detecting minor UI changes after frequent updates.
=> Solution: Automated UI tests using Selenium (web) and Detox.js (mobile). Integrated OpenCV and Resemble.js for precise image comparisons, with dynamic updates after manual verification.
- Challenge 2: Creating a Scalable Testing Environment.
=> Solution: Set up a Selenium grid for web testing and a Mac mini on EC2 for iOS testing, automating cross-platform testing and streamlining operations.
Testing Results
- Total Internal Bugs Found: 629 bugs were identified and resolved during the testing phase.
- Total External Bugs: 63 bugs were reported post-deployment, indicating a relatively low bug leakage rate.
- Bug Leakage Rate: Approximately 0.5 bugs per 1,000 lines of code, demonstrating a high level of quality assurance.
- Defect Density: Reduced by 30% after implementing automated UI testing and refining image comparison techniques.
- Codebase Size: 125,800 lines of code.
- Flow (run daily)
- Evaluate
Customer Feedback
Compares a website’s UI before and after testing
“The 2000MAN project’s testing approach was highly effective in identifying and resolving issues before deployment. Image comparison tools ensured the system maintained visual integrity, even with frequent updates. The team’s technical expertise and commitment to quality greatly enhanced the overall product.”
