Google Exam Associate Data Practitioner Topic 1 Question 6 Discussion

Actual exam question for Google's Associate Data Practitioner exam

Question #: 6
Topic #: 1

[All Associate Data Practitioner Questions]

Your team is building several data pipelines that contain a collection of complex tasks and dependencies that you want to execute on a schedule, in a specific order. The tasks and dependencies consist of files in Cloud Storage, Apache Spark jobs, and data in BigQuery. You need to design a system that can schedule and automate these data processing tasks using a fully managed approach. What should you do?

AUse Cloud Scheduler to schedule the jobs to run.

BUse Cloud Tasks to schedule and run the jobs asynchronously.

CCreate directed acyclic graphs (DAGs) in Cloud Composer. Use the appropriate operators to connect to Cloud Storage, Spark, and BigQuery.

DCreate directed acyclic graphs (DAGs) in Apache Airflow deployed on Google Kubernetes Engine. Use the appropriate operators to connect to Cloud Storage, Spark, and BigQuery.

Show Suggested Answer

Suggested Answer: C

Using Cloud Composer to create Directed Acyclic Graphs (DAGs) is the best solution because it is a fully managed, scalable workflow orchestration service based on Apache Airflow. Cloud Composer allows you to define complex task dependencies and schedules while integrating seamlessly with Google Cloud services such as Cloud Storage, BigQuery, and Dataproc for Apache Spark jobs. This approach minimizes operational overhead, supports scheduling and automation, and provides an efficient and fully managed way to orchestrate your data pipelines.

by Natalie at Jan 23, 2025, 02:23 AM

Limited Time Offer

25%

Off

Get Premium Associate Data Practitioner Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Trevor

2 months ago

If I had a dollar for every time I heard 'directed acyclic graph' in a cloud exam, I'd be a millionaire by now. But seriously, C or D are the best options here.

upvoted 0 times

...

Tawanna

2 months ago

Haha, I bet the exam writer is trying to trick us. They're probably looking for the fully managed solution - Cloud Composer all the way!

upvoted 0 times

Lorrie

1 months ago

D) Create directed acyclic graphs (DAGs) in Apache Airflow deployed on Google Kubernetes Engine. Use the appropriate operators to connect to Cloud Storage, Spark, and BigQuery.

upvoted 0 times

...

Adolph

1 months ago

C) Create directed acyclic graphs (DAGs) in Cloud Composer. Use the appropriate operators to connect to Cloud Storage, Spark, and BigQuery.

upvoted 0 times

...

Graham

1 months ago

B) Use Cloud Tasks to schedule and run the jobs asynchronously.

upvoted 0 times

...

Merilyn

2 months ago

A) Use Cloud Scheduler to schedule the jobs to run.

upvoted 0 times

...

Willodean

2 months ago

Hmm, option B might be easier to set up, but I'm not sure it can handle the level of complexity in the question. I'd go with C or D.

upvoted 0 times

Rutha

1 months ago

I agree, D might offer more flexibility and control over the data pipelines compared to the other options.

upvoted 0 times

...

Alesia

1 months ago

D could also work well with Apache Airflow on GKE, it's a powerful combination for scheduling and executing tasks.

upvoted 0 times

...

Karon

2 months ago

Yeah, C with Cloud Composer seems like a solid choice for automating the data processing tasks.

upvoted 0 times

...

Filiberto

2 months ago

I think C is the best option for handling the complex tasks and dependencies.

upvoted 0 times

...

Reta

3 months ago

I think using Apache Airflow deployed on Google Kubernetes Engine is the best choice for this scenario.

upvoted 0 times

...

France

3 months ago

I prefer creating DAGs in Cloud Composer with the appropriate operators.

upvoted 0 times

...

Deeanna

3 months ago

I think option D is the way to go. Airflow on GKE gives you more flexibility and control over your pipeline orchestration.

upvoted 0 times

Margurite

2 months ago

Yeah, Airflow on GKE allows for more customization and scalability compared to the other options.

upvoted 0 times

...

Tandra

2 months ago

I agree, option D with Apache Airflow on GKE seems like the best choice for complex data pipelines.

upvoted 0 times

...

Almeta

3 months ago

I agree with Ammie, Cloud Scheduler seems like a good option.

upvoted 0 times

...

Ammie

3 months ago

I think we should use Cloud Scheduler to schedule the jobs.

upvoted 0 times

...

Lizbeth

3 months ago

Definitely going with option C. Cloud Composer is the perfect tool for managing complex data pipelines with dependencies.

upvoted 0 times

Pamella

2 months ago

I agree, Cloud Composer with DAGs is the way to go for scheduling and automating data processing tasks.

upvoted 0 times

...

Wayne

3 months ago

Option C sounds like the best choice. Cloud Composer is designed for managing complex data pipelines.

upvoted 0 times

...