MENU
A company is building a large language model (LLM) question answering chatbot. The company wants to decrease the number of actions call center employees need to take to respond to customer questions.
Which business objective should the company use to evaluate the effect of the LLM chatbot?
Experimenting and refining the prompt is the best approach to ensure that the chatbot using a foundation model (FM) produces responses that adhere to the company's tone.
Prompt Engineering:
Adjusting and refining the prompt allows for better control over the FM's outputs, ensuring they align with the desired tone and style.
This iterative process involves testing different prompts and modifying them based on the model's responses to achieve the desired outcome.
Why Option C is Correct:
Directly Influences Output Quality: Allows for fine-tuning of the model's responses to match the company's tone.
Cost-Effective: Does not require modifying the model itself, only the inputs to it.
Why Other Options are Incorrect:
A . Low limit on tokens: Limits response length but not the adherence to company tone.
B . Batch inferencing: Relates to processing multiple inputs, not controlling response tone.
D . Higher temperature: Increases randomness in responses, which could deviate from the desired tone.