Deal of The Day! Hurry Up, Grab the Special Discount - Save 25% - Ends In 00:00:00 Coupon code: SAVE25
Welcome to Pass4Success

- Free Preparation Discussions

Google Generative AI Leader Exam - Topic 4 Question 13 Discussion

A global news company is using a large language model to automatically generate summaries of news articles for their website. The model's summary of an international summit was accurate until it hallucinated by stating a detail that did not occur. How should the company overcome this hallucination?
D) Use grounding to base the model output on the source articles.
A) Implement stricter safety settings to filter out potentially controversial topics.
B) Fine-tune the model on a larger dataset of news articles.
C) Increase the temperature setting of the model to encourage more diverse outputs.

Google Generative AI Leader Exam - Topic 4 Question 13 Discussion

Actual exam question for Google's Generative AI Leader exam
Question #: 13
Topic #: 4
[All Generative AI Leader Questions]

A global news company is using a large language model to automatically generate summaries of news articles for their website. The model's summary of an international summit was accurate until it hallucinated by stating a detail that did not occur. How should the company overcome this hallucination?

Show Suggested Answer Hide Answer
Suggested Answer: D

The core problem is the model's hallucination---it invented a factual detail---in a context (news reporting) where factual accuracy is non-negotiable. To correct a factual error in a generative summary, the model must be constrained to speak only based on verifiable facts from a reliable source.

The most effective technique to combat hallucinations and ensure factual adherence is Grounding (D). Grounding connects the Large Language Model's (LLM's) output to a specific, trusted, and verifiable source of information. This is often implemented using Retrieval-Augmented Generation (RAG). In this scenario, grounding the summary model on the original source articles ensures that every generated statement is directly entailed by the provided facts (the source article content).

Option B, fine-tuning, is expensive and only updates the model's general knowledge and style; it does not prevent the model from guessing or fabricating details when retrieving information. Option C, increasing temperature, would make the output less consistent and more diverse, likely increasing the chance of hallucination, which is the opposite of the desired effect. Option A is unrelated to factual accuracy. Therefore, Grounding is the necessary step to anchor the model's responses to the true content of the source articles.

(Reference: Google Cloud documentation on RAG/Grounding emphasizes that its primary purpose is to address the ''knowledge cutoff'' and hallucination issues of LLMs by retrieving relevant, up-to-date information from external knowledge sources and using this retrieved information to ground the LLM's generation, ensuring factual accuracy.)

===========


Contribute your Thoughts:

0/2000 characters
Sharika
4 days ago
I’d go with fine-tuning for better context.
upvoted 0 times
...
Buddy
9 days ago
Grounding seems safest to avoid hallucinations.
upvoted 0 times
...
Tiffiny
14 days ago
Increasing temperature could lead to more errors, though.
upvoted 0 times
...
Annamaria
19 days ago
Stricter safety settings might limit useful info.
upvoted 0 times
...
Leonora
24 days ago
But what if the dataset is biased?
upvoted 0 times
...
Martina
30 days ago
Fine-tuning could also improve the model's performance.
upvoted 0 times
...
Ruby
1 month ago
I agree, grounding helps ensure accuracy.
upvoted 0 times
...
Donte
1 month ago
This is a tricky question. I think grounding is key.
upvoted 0 times
...
Carmen
2 months ago
Stricter safety settings might just limit useful info.
upvoted 0 times
...
Marylyn
2 months ago
Totally agree, grounding is the way to go!
upvoted 0 times
...
Cyril
2 months ago
Wait, increasing the temperature? That sounds risky!
upvoted 0 times
...
Amie
2 months ago
I think fine-tuning on more data could help too.
upvoted 0 times
...
Kenneth
2 months ago
Definitely need to use grounding to avoid hallucinations!
upvoted 0 times
...
Therese
2 months ago
Increasing the temperature seems risky; it might lead to even more inaccuracies. I’d lean towards grounding as a safer option.
upvoted 0 times
...
Roxane
4 months ago
I think implementing stricter safety settings could limit the model's creativity, but I'm not convinced it would solve the hallucination issue.
upvoted 0 times
...
Dominga
4 months ago
I'm not entirely sure, but I feel like fine-tuning the model could help reduce hallucinations too, like in that practice case we did.
upvoted 0 times
...
Emmanuel
4 months ago
I remember discussing how grounding can help improve accuracy in model outputs, so I think option D makes sense.
upvoted 0 times
...

Save Cancel