MENU
You recently developed a deep learning model using Keras, and now you are experimenting with different training strategies. First, you trained the model using a single GPU, but the training process was too slow. Next, you distributed the training across 4 GPUs using tf.distribute.MirroredStrategy (with no other changes), but you did not observe a decrease in training time. What should you do?
Suggested Answer: D
Get Premium Professional Machine Learning Engineer Questions
as Interactive Web-Based Practice Test or PDF
Real Exam Format
Detailed Explanations
Instant Access
Get Your Practice Test
33 comments · newest first
CH
Cherilyn
10 months ago
TPUs are cool, but not always necessary for speed.
DE
Denise
10 months ago
Definitely try distributing the dataset first.
NA
Nadine
11 months ago
I disagree, a custom training loop might be more effective.
BR
Britt
11 months ago
Surprised that 4 GPUs didn't help at all!
MY
Myra
11 months ago
Increasing the batch size can help speed things up!
AN
Anastacia
11 months ago
Using a TPU sounds interesting, but I think it might be overkill for this situation. I’d lean towards option A or D instead.
MA
Mary
11 months ago
I practiced a similar question, and I feel like a custom training loop could give more control, but I’m not confident that’s necessary here.
LU
Luz
12 months ago
I'm not entirely sure, but I think increasing the batch size could help utilize the GPUs better. That might be option D?
CO
Corazon
12 months ago
I remember reading that distributing the dataset can help with performance, so maybe option A is the right choice?
VI
Viva
1 year ago
This seems like a good opportunity to try out a custom training loop. I've heard that can really help optimize the training process, especially when working with multiple GPUs. I'm going to go with option B.
WY
Wynell
1 year ago
I'm a bit confused here. Distributing the dataset seems like a logical step, but the question says that didn't work. Maybe I should consider creating a custom training loop or using a TPU instead?
MA
Marge
1 year ago
Okay, let's think this through. If the training time didn't improve with 4 GPUs, then the issue might not be with the hardware. A custom training loop could help optimize the process, so I'm leaning towards option B.
RA
Raina
1 year ago
Hmm, this is a tricky one. I'm not sure why the training time didn't decrease with the 4 GPUs. Maybe I need to look into how to properly distribute the dataset.
JO
Joanne
1 year ago
Ah, I see now. Routers are layer 3 devices that use protocols to learn paths, not layer 2 switching. And they definitely aren't layer 4 devices. I've got my answer.
CL
Clorinda
1 year ago
Hmm, I'm a little unsure about this one. I'll need to think through the different IP addressing scenarios carefully.
HA
Halina
1 year ago
I'm a bit unsure about this one. I know enterprise analysis is important, but I'm not totally clear on the specific document that would outline the governances. I'll have to think this through carefully.
SH
Sharmaine
1 year ago
Ah, the age-old dilemma of training a deep learning model - GPUs, TPUs, and batch sizes, oh my! I say we just throw the whole thing in the microwave and see what happens. *chuckles*
RE
Rebbecca
1 year ago
Well, this is a tough one. I'm leaning towards option A - distributing the dataset with tf.distribute.Strategy.experimental_distribute_dataset. Seems like the most straightforward approach to me.
TR
Trinidad
1 year ago
Let's give it a try and see if it makes a difference.
CA
Carol
1 year ago
I agree, distributing the dataset might be the key to improving training time.
VE
Verona
1 year ago
I think option A is a good choice. It could help speed up the training process.
NA
Nada
1 year ago
Oh, I bet option D is the way to go! Increasing the batch size might just do the trick. After all, who needs GPUs when you have big batches, right? *wink*
CU
Curt
1 year ago
User 3: I agree, let's give it a shot and see if it makes a difference.
DO
Dorathy
1 year ago
User 2: Yeah, that could be a good solution to try out.
LO
Lourdes
1 year ago
User 1: I think increasing the batch size might help speed up the training process.
MI
Micheal
2 years ago
Interesting question. I think option C looks promising - using a TPU with tf.distribute.TPUStrategy could really speed up the training process.
LE
Leoma
1 year ago
C) Use a TPU with tf.distribute.TPUStrategy.
CH
Chi
1 year ago
B) Create a custom training loop.
DO
Dominque
1 year ago
A) Distribute the dataset with tf.distribute.Strategy.experimental_distribute_dataset
OM
Omega
2 years ago
Hmm, I would say option B. Creating a custom training loop can help you fine-tune the distribution of the training process and potentially improve the performance.
GA
Gail
2 years ago
I think we should also consider using a TPU with tf.distribute.TPUStrategy for faster training.
PO
Pok
2 years ago
I agree with Ellsworth. That might help improve the training time.
EL
Ellsworth
2 years ago
I think we should try distributing the dataset with tf.distribute.Strategy.experimental_distribute_dataset.