A data engineer needs to deploy a complex pipeline. The stages of the pipeline must be able to run a script. The data engineer must use only fully managed and serverless services in the pipeline. Which solution will meet these requirements?
- ADeploy AWS Glue jobs and workflows. Use AWS Glue to run the jobs and workflows on a schedule. (correct answer)
- BUse Amazon Managed Workflows for Apache Airflow (Amazon MWAA) to build and schedule the pipeline.
- CDeploy the script to Amazon EC2 instances. Use Amazon EventBridge to run the script on a schedule.
- DUse Aws Glue DataBrew to build the pipeline. Use Amazon EventBridge to run the pipeline on a schedule.
Reveal answer & explanationHide answer
The correct answer is A. Option A: Deploy AWS Glue jobs and workflows. Use AWS Glue to run the jobs and workflows on a schedule.
Explanation
AWS Glue is a serverless ETL and data-catalog service that prepares and integrates data.