Google Cloud Professional Data Engineer PDE — Topic 1 Question 117

Question

You are designing a data processing pipeline. The pipeline must be able to scale automatically as load increases. Messages must be processed at least once and must be ordered within windows of 1 hour. How should you design the solution?

Accepted Answer

Correct answer: D. The correct answer is D. Option D: Use Cloud Pub/Sub for message ingestion and Cloud Dataflow for streaming analysis. Dataflow runs serverless Apache Beam pipelines for stream and batch data processing with autoscaling. Pub/Sub is a serverless, global messaging service that decouples services and ingests high-volume event streams.

Google Cloud Professional Data Engineer PDE — Question 117