iSQI CTFL-PT Exam - Topic 2 Question 6 Discussion

You have been asked to test the performance of a software and system update to a North American mobile trivia quiz game application The quiz app is available on major app stores serving English-speaking users. The number of concurrent users planned for is 5 million Winning quiz participants are promised a share of an allocated cash prize Once participants start playing, their quiz sessions must not be lost especially if all previous questions were answered correctly. The application owner wants to ensure that 99% of quiz sessions are maintained (up to 4.95 million sessions) until the last answer has been successfully recorded.

You performed 100 test runs that provided 5 million virtual concurrent users. You have measurements of participant concurrency at the last question for each test run In your analysis, you order all the concurrency test results by measured concurrency value from best to worst. You determine 85%. 90%. 95% and 100% values by selecting the 85th. 90th. 95th and 100th (last and worst) measured values by counting list positions starting from the best value going towards the worst until you reach the desired list position (ex. 85). Keep in mind, the results in lower list positions are as good or better than the results chosen for reporting.

After analyzing the results of the performance tests, you present the following results

85% 4.92 million valid concurrent users

90% 4.90 million valid concurrent users

95%: 4.0 million valid concurrent users

100%. 3.8 million valid concurrent users

Based on these results, what should you report to the stakeholders?