Free Preparation Discussions
MENU
NVIDIA NCA-GENL Exam - Topic 7 Question 8 Discussion
Topic #: 7
[Fundamentals of Machine Learning and Neural Networks]
What are the main advantages of instructed large language models over traditional, small language models (< 300M parameters)? (Pick the 2 correct responses)
Instructed large language models (LLMs), such as those supported by NVIDIA's NeMo framework, have significant advantages over smaller, traditional models:
Option D: LLMs often have cheaper computational costs during inference for certain tasks because they can generalize across multiple tasks without requiring task-specific retraining, unlike smaller models that may need separate models per task.
Option E: A single generic LLM can perform multiple tasks (e.g., text generation, classification, translation) due to its broad pre-training, unlike smaller models that are typically task-specific.
Option A is incorrect, as LLMs require large amounts of data, often labeled or curated, for pre-training. Option B is false, as LLMs typically have higher latency and lower throughput due to their size. Option C is misleading, as LLMs are often less interpretable than smaller models.
NVIDIA NeMo Documentation: https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/stable/nlp/intro.html
Brown, T., et al. (2020). 'Language Models are Few-Shot Learners.'
Colby
6 months agoRaina
6 months agoZona
7 months agoJacki
7 months agoFrederic
7 months agoAlaine
7 months agoGladis
8 months agoChau
8 months agoJess
8 months agoAlecia
8 months agoLisbeth
9 months agoGlenna
9 months agoClarence
9 months agoGilma
9 months agoJoana
11 months agoKina
11 months agoCheryl
12 months agoWilliam
12 months agoHannah
11 months agoCordelia
11 months agoLorean
12 months agoTanesha
12 months agoMike
12 months agoVincent
11 months agoHerminia
11 months agoDeane
12 months ago