Amazon Exam BDS-C00 Topic 5 Question 70 Discussion

Actual exam question for Amazon's BDS-C00 exam

Question #: 70
Topic #: 5

A large grocery distributor receives daily depletion reports from the field in the form of gzip archives of CSV files uploading to Amazon S3. The files range from 500MB to 5GB. These files are processes daily by an EMR job.

Recently it has been observed that the file sizes vary, and the EMR jobs take too long. The distributor needs to tune and optimize the data processing workflow with this limited information to improved the performance of the EMR job.

Which recommendation should an administrator provide?

AReduce the HDFS block size to increase the number of task processors

BUse bzip2 or Snappy rather than gzip for the archives

CDecompress the gzip archives and store the data as CSV files

DUse Avro rather than gzip for the archives

Show Suggested Answer

Suggested Answer: A

by Georgene at Feb 06, 2023, 10:49 AM

Limited Time Offer

25%

Off

Get Premium BDS-C00 Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Goldie

Using bzip2 or Snappy could be a good option to reduce the file sizes and potentially improve the processing time. Gzip is a common compression format, but there might be better alternatives for these large files.

upvoted 0 times

...

Alaine

17 days ago

Reducing the HDFS block size to increase the number of task processors seems like a logical solution, but I'm not sure if that's the best approach here. The file sizes are quite large, so the overhead of managing more tasks might outweigh the benefits.

upvoted 0 times

...