SAP C_AIG_2412 Exam - Topic 4 Question 8 Discussion

Actual exam question for SAP's C_AIG_2412 exam

Question #: 8
Topic #: 4

What are some metrics to evaluate the effectiveness of a Retrieval Augmented Generation system? Note: There are 2 correct answers to this question.

ACarbon footprint

BFaithfulness

CSpeed

DRelevance

Show Suggested Answer

Suggested Answer: B, D

by William at Feb 08, 2025, 11:01 PM

Limited Time Offer

25%

Off

Get Premium C_AIG_2412 Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Xochitl

3 months ago

Not sure about relevance, isn't it too subjective?

upvoted 0 times

...

Ty

3 months ago

Totally agree with faithfulness being crucial!

upvoted 0 times

...

William

3 months ago

Wait, carbon footprint? That seems off for RAG systems.

upvoted 0 times

...

Sherell

4 months ago

I think speed is important too, but not a top metric.

upvoted 0 times

...

Flo

4 months ago

Faithfulness and relevance are key metrics!

upvoted 0 times

...

Teresita

4 months ago

I feel like carbon footprint is not relevant here, but I can't quite remember what the other correct metric could be.

upvoted 0 times

...

Chantay

4 months ago

Speed seems important too, but I can't recall if it was specifically mentioned as a metric for RAG systems.

upvoted 0 times

...

Keneth

4 months ago

I remember discussing relevance in class, so that could definitely be one of the correct answers.

upvoted 0 times

...

Nobuko

5 months ago

I think faithfulness might be one of the metrics, but I'm not sure about the second one.

upvoted 0 times

...

Carlee

5 months ago

Ah, I see what they're getting at. Faithfulness and relevance are key for evaluating the effectiveness of a Retrieval Augmented Generation system. I feel good about this one.

upvoted 0 times

...

Cherilyn

5 months ago

Speed could be a useful metric, especially if the system needs to respond quickly. But I'm not sure if that's one of the two correct answers. I'll have to double-check my understanding.

upvoted 0 times

...

Leonard

5 months ago

Hmm, I'm a bit unsure about this. I know faithfulness is important, but I'm not sure what other metrics would be relevant. I'll have to think this through carefully.

upvoted 0 times

...

Elke

5 months ago

I'm pretty confident about this one. Faithfulness and relevance seem like the obvious metrics to evaluate a Retrieval Augmented Generation system.

upvoted 0 times

...

Bettina

12 months ago

Haha, carbon footprint? I didn't know we were evaluating the system's environmental impact. But seriously, B and D are the way to go. Faithfulness and relevance are key.

upvoted 0 times

...

Merlyn

12 months ago

Hmm, I'd say B, D, and C. Gotta consider the speed too - what's the point of a fancy system if it takes forever to generate anything?

upvoted 0 times

...

Kristofer

12 months ago

Carbon footprint? Really? I think the developers need to lay off the science fiction and focus on the practical metrics. Give me speed and relevance any day!

upvoted 0 times

Thora

11 months ago

I see your point, but I still believe that speed and relevance should be the main focus when evaluating the system.

upvoted 0 times

...

Sheridan

11 months ago

Carbon footprint may not be a top priority, but it's still worth considering in the long run.

upvoted 0 times

...

Frederica

11 months ago

I think faithfulness is also crucial in evaluating the effectiveness of a Retrieval Augmented Generation system.

upvoted 0 times

...

Kris

11 months ago

I agree, speed and relevance are definitely more important metrics to consider.

upvoted 0 times

...

Emile

1 year ago

Speed is also crucial, but carbon footprint is not really relevant in this context.

upvoted 0 times

...

Carin

1 year ago

I agree, those two metrics can determine how well the system performs.

upvoted 0 times

...

Launa

1 year ago

I think faithfulness and relevance are important metrics.

upvoted 0 times

...

Colby

1 year ago

Definitely B and D - faithfulness and relevance are crucial for a Retrieval Augmented Generation system. How else will we know if it's actually giving us the right information?

upvoted 0 times

Dyan

1 year ago

Speed is important too, but ultimately, if it's not giving us accurate and relevant information, what's the point?

upvoted 0 times

...

Dyan

1 year ago

I agree, faithfulness and relevance are key metrics to evaluate the effectiveness of the system.

upvoted 0 times

...