iSQI CT-AI Exam - Topic 9 Question 31 Discussion

Actual exam question for iSQI's CT-AI exam

Question #: 31
Topic #: 9

A mobile app start-up company is implementing an AI-based chat assistant for e-commerce customers. In the process of planning the testing, the team realizes that the specifications are insufficient.

Which testing approach should be used to test this system?

AExploratory testing

BStatic analysis

CEquivalence partitioning

DState transition testing

Show Suggested Answer

Suggested Answer: A

When testing an AI-based chat assistant for e-commerce customers, the lack of sufficient specifications makes it difficult to use structured test techniques. The ISTQB CT-AI Syllabus recommends exploratory testing in such cases:

Why Exploratory Testing?

Exploratory testing is useful when specifications are incomplete or unclear.

AI-based systems, particularly those using natural language processing (NLP), may not behave deterministically, making scripted test cases ineffective.

The tester interacts dynamically with the system, identifying unexpected behaviors not documented in the specification.

Analysis of Answer Choices:

A (Exploratory testing) Correct, as it is the best approach when specifications are incomplete.

B (Static analysis) Incorrect, as static analysis checks code without execution, which is not helpful for AI chatbots.

C (Equivalence partitioning) Incorrect, as this technique requires well-defined inputs and outputs, which are missing due to insufficient specifications.

D (State transition testing) Incorrect, as state-based testing requires knowledge of valid and invalid transitions, which is difficult with a chatbot lacking a clear specification.

Thus, Option A is the correct answer, as exploratory testing is the best approach when dealing with insufficient specifications in AI-based systems.

Certified Tester AI Testing Study Guide Reference:

ISTQB CT-AI Syllabus v1.0, Section 7.7 (Selecting a Test Approach for an ML System)

ISTQB CT-AI Syllabus v1.0, Section 9.6 (Experience-Based Testing of AI-Based Systems).

by Sharmaine at Nov 22, 2025, 06:26 PM

Limited Time Offer

25%

Off

Get Premium CT-AI Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Cecil

8 days ago

I feel exploratory testing is best for understanding user behavior.

upvoted 0 times

...

Rene

13 days ago

State transition testing could be useful too, especially for chat flows.

upvoted 0 times

...

Delfina

18 days ago

True, but static analysis won't help with user interactions.

upvoted 0 times

...

Buffy

23 days ago

Agreed! It allows us to discover issues we might miss otherwise.

upvoted 0 times

...

Peggie

28 days ago

I think exploratory testing is the way to go.

upvoted 0 times

...

Rebeca

1 month ago

State transition testing could be useful too, but not my first choice.

upvoted 0 times

...

Cristina

1 month ago

Static analysis might miss some real-world issues.

upvoted 0 times

...

Clement

2 months ago

Wait, can exploratory testing really cover all edge cases?

upvoted 0 times

...

Haydee

2 months ago

Totally agree, it allows for flexibility in testing.

upvoted 0 times

...

Peggie

2 months ago

I think exploratory testing is the way to go here.

upvoted 0 times

...

Leota

2 months ago

Haha, the team should've just asked Siri for the answer. That's some real AI expertise right there.

upvoted 0 times

...

Deonna

3 months ago

Static analysis? Nah, this is all about dynamic testing for that AI magic.

upvoted 0 times

...

Nida

3 months ago

Equivalence partitioning sounds like a good approach to cover the key scenarios.

upvoted 0 times

...

Victor

3 months ago

State transition testing could be useful to ensure the chatbot handles different user inputs correctly.

upvoted 0 times

...

Ines

3 months ago

Exploratory testing seems like the way to go here. Gotta be flexible with those AI-powered chatbots!

upvoted 0 times

...

Fletcher

3 months ago

State transition testing could work if we had clear states defined, but with insufficient specs, I lean towards exploratory testing too.

upvoted 0 times

...

Teri

3 months ago

Equivalence partitioning seems relevant, but I feel like it requires more defined inputs. The lack of specifications makes me hesitant.

upvoted 0 times

...

Ming

4 months ago

I'm a bit confused on this one. I feel like I'd need more information about the system to decide the best testing approach. Maybe I'd start with exploratory testing and then go from there.

upvoted 0 times

...

Launa

4 months ago

Static analysis might be a good place to start, just to check the code for any obvious issues before we dive into testing. Then we can layer on other approaches.

upvoted 0 times

...

Tanesha

4 months ago

I'm leaning towards equivalence partitioning. With the incomplete specs, we'll need to identify the key input partitions and test each one thoroughly.

upvoted 0 times

...

Yuonne

4 months ago

I'm not entirely sure, but I remember something about static analysis being useful for code reviews. Would it apply here?

upvoted 0 times

...

Annamaria

4 months ago

I think exploratory testing might be the best choice here since the specs are lacking. It allows testers to explore and find issues without strict guidelines.

upvoted 0 times

...

Jennifer

5 months ago

But what about static analysis? It could catch some early bugs.

upvoted 0 times

...

Shonda

5 months ago

Hmm, I'm not sure. Exploratory testing could work, but maybe state transition testing would be better to cover all the different states the chat assistant could be in.

upvoted 0 times

...

Janella

5 months ago

I think I'd go with exploratory testing for this one. The specs are lacking, so we'll need to really dig in and explore the system to find the issues.

upvoted 0 times

Leonora

2 days ago

I agree, exploratory testing seems best here.

upvoted 0 times

...

Anissa

5 months ago

Static analysis won't cut it with vague specs.

upvoted 0 times

...