MENU
You operate a database that stores stock trades and an application that retrieves average stock price for a given company over an adjustable window of time. The data is stored in Cloud Bigtable where the datetime of the stock trade is the beginning of the row key. Your application has thousands of concurrent users, and you notice that performance is starting to degrade as more stocks are added. What should you do to improve the performance of your application?
Suggested Answer: A
Get Premium Professional Data Engineer Questions
as Interactive Web-Based Practice Test or PDF
Real Exam Format
Detailed Explanations
Instant Access
Get Your Practice Test
Data Fusion's advantages:
Visual interface: Offers a user-friendly interface for designing data pipelines without extensive coding, making it accessible to a wider range of users.
Built-in transformations: Includes a wide range of pre-built transformations to handle common data quality issues, such as:
Data type conversions
Data cleansing (e.g., removing invalid characters, correcting formatting)
Data validation (e.g., checking for missing values, enforcing constraints)
Data enrichment (e.g., adding derived fields, joining with other datasets)
Custom transformations: Allows for custom transformations using SQL or Java code for more complex cleaning tasks.
Scalability: Can handle large datasets efficiently, making it suitable for processing CSV files with potential data quality issues.
Integration with BigQuery: Integrates seamlessly with BigQuery, allowing for direct loading of transformed data.
37 comments · newest first
NI
Nicolette
11 months ago
Wait, why would we switch to Cloud Storage? That seems unnecessary.
DO
Douglass
11 months ago
Definitely agree on needing to optimize the row key structure!
FE
Felicitas
11 months ago
Not sure about that random number idea, sounds risky.
AN
Anabel
11 months ago
I think using BigQuery might be a better long-term solution.
IR
Irene
12 months ago
Changing the row key to stock symbol could help with performance.
HI
Hildegarde
12 months ago
I vaguely recall that using Cloud Dataflow for summarizing data might improve efficiency, but I'm not entirely clear on how it integrates with Bigtable for real-time queries.
MA
Makeda
1 year ago
I practiced a similar question about optimizing database performance, and I feel like using BigQuery could be a solid choice for handling large datasets.
BR
Britt
1 year ago
I think changing the row key to a random number could help with write performance by avoiding hotspots, but it might complicate querying.
OL
Ollie
1 year ago
I remember we discussed row key design in Cloud Bigtable, and starting with the stock symbol could help with read performance, but I'm not sure if it's the best option here.
DA
Darrin
1 year ago
I'm a bit confused by all the options, but I think I'll start by sketching out the pros and cons of each one to help me decide.
MA
Mable
1 year ago
The Dataflow and Cloud Storage approach in option D seems like it could work, but I'm worried about the added complexity. I'll have to weigh the pros and cons.
JU
Julieta
1 year ago
Option C looks promising, using BigQuery could scale better, but I'll need to research the migration process and impact on the application.
EL
Ellsworth
1 year ago
Hmm, changing the row key syntax could help with querying, but I'm not sure if that's the best long-term solution. I'll have to think this through.
EL
Ellsworth
1 year ago
This seems like a tricky performance issue. I'll need to carefully consider the trade-offs of each option.
KA
Kaycee
1 year ago
Hmm, I'm a bit unsure about this one. I'm not entirely familiar with CPV codes and their purpose in the tender process. I'll have to think it through carefully.
KA
Katheryn
1 year ago
Hmm, I'm a bit unsure about this one. I know we covered resource controls in class, but I can't quite remember the specific command that would fetch the information we need here. I'll have to think this through carefully.
CH
Chan
1 year ago
Okay, let's see. According to NIST, the two elements missing to calculate the risk assessment are asset vulnerability assessment and malware analysis report. I'm confident in this answer.
MI
Mireya
1 year ago
Wait, you're telling me the row key isn't already 'STONKS'? I'm shocked, shocked I tell you!
MA
Mari
1 year ago
D) Use Cloud Dataflow to write summary of each day's stock trades to an Avro file on Cloud Storage. Update your application to read from Cloud Storage and Cloud Bigtable to compute the responses.
AU
Audra
1 year ago
C) Change the data pipeline to use BigQuery for storing stock trades, and update your application.
TA
Taryn
1 year ago
B) Change the row key syntax in your Cloud Bigtable table to begin with a random number per second.
AH
Ahmed
1 year ago
A) Change the row key syntax in your Cloud Bigtable table to begin with the stock symbol.
WH
Whitney
1 year ago
D) Combining Cloud Dataflow, Cloud Storage, and Cloud Bigtable sounds like a lot of moving parts. Might be overkill for this use case.
CL
Clarence
1 year ago
A) Change the row key syntax in your Cloud Bigtable table to begin with the stock symbol.
ST
Stephanie
1 year ago
D) Combining Cloud Dataflow, Cloud Storage, and Cloud Bigtable sounds like a lot of moving parts. Might be overkill for this use case.
DE
Delpha
1 year ago
A) Change the row key syntax in your Cloud Bigtable table to begin with the stock symbol.
KA
Kassandra
2 years ago
C) Using BigQuery for storing the stock trades and updating the application seems like a reasonable approach. It could help handle the increased data volume and concurrency.
AR
Arlen
1 year ago
D) Use Cloud Dataflow to write summary of each day's stock trades to an Avro file on Cloud Storage. Update your application to read from Cloud Storage and Cloud Bigtable to compute the responses.
CO
Coral
1 year ago
C) Using BigQuery for storing the stock trades and updating the application seems like a reasonable approach. It could help handle the increased data volume and concurrency.
AL
Alva
1 year ago
A) Change the row key syntax in your Cloud Bigtable table to begin with the stock symbol.
EL
Elke
2 years ago
I see both points, but I think option C) changing the data pipeline to use BigQuery might be the most efficient solution in the long run.
AD
Adelina
2 years ago
B) A random number per second? That's just crazy! How are we supposed to query that efficiently? Definitely not the way to go.
EM
Emeline
1 year ago
User 2: That sounds like a good idea, it would definitely help with querying efficiently.
RE
Regenia
1 year ago
User 1: I think we should change the row key syntax to begin with the stock symbol.
AM
Ammie
2 years ago
A) Changing the row key syntax to start with the stock symbol sounds like a good idea. That way, we can group all the trades for a single stock together and improve query performance.
JA
Jaime
2 years ago
I disagree, I believe option D) using Cloud Dataflow to write summary of each day's stock trades to an Avro file is the best approach.
TI
Tiera
2 years ago
I think we should go with option A) Change the row key syntax to begin with the stock symbol.