You trained a model on data stored in a Cloud Storage bucket. The model needs to be retrained frequently in Vertex AI Training using the latest data in the bucket. Data preprocessing is required prior to retraining. You want to build a simple and efficient near-real-time ML pipeline in Vertex AI that will preprocess the data when new data arrives in the bucket. What should you do?
Cloud Run can be triggered on new data arrivals, which makes it ideal for near-real-time processing. The function then initiates the Vertex AI Pipeline for preprocessing and storing features in Vertex AI Feature Store, aligning with the retraining needs. Cloud Scheduler (Option A) is suitable for scheduled jobs, not event-driven triggers. Dataflow (Option C) is better suited for batch processing or ETL rather than ML preprocessing pipelines.
Shizue
4 months agoFelix
5 months agoDetra
5 months agoRaina
5 months agoLettie
5 months agoRebbeca
6 months agoWinifred
6 months agoEladia
6 months agoMatthew
6 months agoVerona
6 months agoHelga
6 months agoAntonette
6 months agoKeva
6 months agoMike
1 year agoDoug
1 year agoErnest
1 year agoCarri
12 months agoWynell
1 year agoDalene
1 year agoAmie
1 year agoJoesph
1 year agoJolanda
1 year agoCharlesetta
1 year agoCassie
1 year agoVirgina
1 year agoCherrie
1 year agoEve
1 year agoHan
1 year agoTammara
1 year agoTula
1 year agoNieves
1 year agoJavier
1 year agoDallas
1 year agoJackie
1 year ago