Databricks Exam Databricks-Machine-Learning-Associate Topic 1 Question 21 Discussion

Actual exam question for Databricks's Databricks-Machine-Learning-Associate exam

Question #: 21
Topic #: 1

[All Databricks-Machine-Learning-Associate Questions]

Which of the following statements describes a Spark ML estimator?

AAn estimator is a hyperparameter arid that can be used to train a model

BAn estimator chains multiple alqorithms toqether to specify an ML workflow

CAn estimator is a trained ML model which turns a DataFrame with features into a DataFrame with predictions

DAn estimator is an alqorithm which can be fit on a DataFrame to produce a Transformer

EAn estimator is an evaluation tool to assess to the quality of a model

Show Suggested Answer

Suggested Answer: D

In the context of Spark MLlib, an estimator refers to an algorithm which can be 'fit' on a DataFrame to produce a model (referred to as a Transformer), which can then be used to transform one DataFrame into another, typically adding predictions or model scores. This is a fundamental concept in machine learning pipelines in Spark, where the workflow includes fitting estimators to data to produce transformers.

Reference

Spark MLlib Documentation: https://spark.apache.org/docs/latest/ml-pipeline.html#estimators

by Becky at Nov 14, 2024, 11:24 AM

Limited Time Offer

25%

Off

Get Premium Databricks-Machine-Learning-Associate Questions as Interactive Web-Based Practice Test or PDF

Contribute your Thoughts:

Submit Cancel

Shawn

5 months ago

Hmm, that makes sense too. I guess we'll have to review the material again to be sure.

upvoted 0 times

...

Sabra

5 months ago

I disagree, I believe the answer is D. It mentions fitting an algorithm on a DataFrame to produce a Transformer.

upvoted 0 times

...

Shawn

5 months ago

I think the answer is B, because it mentions chaining multiple algorithms together.

upvoted 0 times

...

Vashti

5 months ago

Ha, this question is a real spark-ler! Get it? Spark? Anyway, I think D is the way to go. Estimators are like the superheroes of Spark ML, turning DataFrames into Transformers with a single bound!

upvoted 0 times

Lonny

4 months ago

D) An estimator is an algorithm which can be fit on a DataFrame to produce a Transformer

upvoted 0 times

...

Dante

4 months ago

B) An estimator chains multiple algorithms together to specify an ML workflow

upvoted 0 times

...

Yvonne

5 months ago

A) An estimator is a hyperparameter that can be used to train a model

upvoted 0 times

...

5 months ago

I think option D is the correct answer. An estimator is an algorithm that can be fit on a DataFrame to produce a Transformer, which then can be used to transform new data.

upvoted 0 times