Google Cloud Professional Data Engineer PDE — Topic 1 Question 68

Question

You are selecting services to write and transform JSON messages from Cloud Pub/Sub to BigQuery for a data pipeline on Google Cloud. You want to minimize service costs. You also want to monitor and accommodate input data volume that will vary in size with minimal manual intervention. What should you do?

Accepted Answer

Correct answer: C. The correct answer is C. Option C: Use Cloud Dataflow to run your transformations. Monitor the job system lag with Stackdriver. Use the default autoscaling setting for worker instances. Dataflow runs serverless Apache Beam pipelines for stream and batch data processing with autoscaling. Cloud Operations (formerly Stackdriver) provides monitoring, logging, and tracing for reliability.

Google Cloud Professional Data Engineer PDE — Question 68