Summer Sale Special Limited Time 70% Discount Offer - Ends in 0d 00h 00m 00s - Coupon code: xmas50

Databricks Databricks-Certified-Data-Engineer-Associate - Databricks Certified Data Engineer Associate Exam

A data engineer needs to ingest from both streaming and batch sources for a firm that relies on highly accurate data. Occasionally, some of the data picked up by the sensors that provide a streaming input are outside the expected parameters. If this occurs, the data must be dropped, but the stream should not fail.

Which feature of Delta Live Tables meets this requirement?

A.

Monitoring

B.

Change Data Capture

C.

Expectations

D.

Error Handling

A new data engineering team has been assigned to work on a project. The team will need access to database customers in order to see what tables already exist. The team has its own group team.

Which of the following commands can be used to grant the necessary permission on the entire database to the new team?

A.

GRANT VIEW ON CATALOG customers TO team;

B.

GRANT CREATE ON DATABASE customers TO team;

C.

GRANT USAGE ON CATALOG team TO customers;

D.

GRANT CREATE ON DATABASE team TO customers;

E.

GRANT USAGE ON DATABASE customers TO team;

A developer is building a data pipeline that processes records from a Bronze table into a Silver table. The Bronze table, bronze_events, contains duplicate records because of at-least-once delivery guarantees from the upstream ingestion system. The developer writes the following PySpark code:

deduped_df = df.dropDuplicates()

deduped_df.summary( " count " , " mean " , " stddev " ).show()

from pyspark.sql.functions import approx_count_distinct

deduped_df.select(approx_count_distinct( " user_id " )).show()

After running dropDuplicates() without arguments, some rows that differ only in the event_timestamp column remain. The developer wants to deduplicate records based only on user_id and event_type, keeping one row for each unique combination of those two columns.

Which code change achieves this deduplication requirement?

A.

Replace df.dropDuplicates() with df.groupBy( " user_id " , " event_type " ).count().

B.

Replace df.dropDuplicates() with df.dropDuplicates([ " user_id " , " event_type " ]).

C.

Replace df.dropDuplicates() with df.drop( " event_timestamp " ).dropDuplicates().

D.

Replace df.dropDuplicates() with df.distinct().select( " user_id " , " event_type " ).

The Delta transaction log for the ‘students’ tables is shown using the ‘DESCRIBE HISTORY students’ command. A Data Engineer needs to query the table as it existed before the UPDATE operation listed in the log.

Which command should the Data Engineer use to achieve this? (Choose two.)

A.

SELECT * FROM students@v4

B.

SELECT * FROM students TIMESTAMP AS OF ‘2024-04-22T 14:32:47.000+00:00’

C.

SELECT * FROM students FROM HISTORY VERSION AS OF 3

D.

SELECT * FROM students VERSION AS OF 5

E.

SELECT * FROM students TIMESTAMP AS OF ‘2024-04-22T 14:32:58.000+00:00’

A data engineering project involves processing large batches of data on a daily schedule using ETL. The jobs are resource-intensive and vary in size, requiring a scalable, cost-efficient compute solution that can automatically scale based on the workload.

Which compute approach will satisfy the needs described?

A.

Databricks SQL Serverless

B.

Dedicated Cluster

C.

All-Purpose Cluster

D.

Job Cluster

A data engineer triggers a scheduled job but finds that the new run was not executed. The run history shows that the run was skipped with a concurrency-related queue message.

Which configuration should the engineer investigate?

A.

The cluster spot-instance availability in the cloud provider

B.

The SQL warehouse permissions for the task

C.

The job-level max_concurrent_runs setting and whether queueing is enabled

D.

The task-level timeout_seconds configuration

A data engineer has configured a Structured Streaming job to read from a table, manipulate the data, and then perform a streaming write into a new table.

The cade block used by the data engineer is below:

If the data engineer only wants the query to execute a micro-batch to process data every 5 seconds, which of the following lines of code should the data engineer use to fill in the blank?

A.

trigger( " 5 seconds " )

B.

trigger()

C.

trigger(once= " 5 seconds " )

D.

trigger(processingTime= " 5 seconds " )

E.

trigger(continuous= " 5 seconds " )

A data engineering team is using Kafka to capture event data and then ingest it into Databricks. The team wants to be able to see these historical events. Medallion architecture is already in place. The team wants to be mindful of costs.

Where should this historical event data be stored?

A.

Gold

B.

Silver

C.

Bronze

D.

Raw layer

A data engineer is working on a personal laptop and needs to perform complex transformations on data stored in a Delta Lake on cloud storage. The engineer decides to use Databricks Connect to interact with Databricks clusters and work in their local IDE.

How does Databricks Connect enable the engineer to develop, test, and debug code seamlessly on their local machine while interacting with Databricks clusters?

A.

By allowing direct execution of Spark jobs from the local machine without needing a network connection

B.

By providing a local environment that mimics the Databricks runtime, enabling the engineer to develop, test, and debug code using a specific IDE that is required by Databricks

C.

By providing a local environment that mimics the Databricks runtime, enabling the engineer to develop, test, and debug code using their preferred ide

D.

By providing a local environment that mimics the Databricks runtime, enabling the engineer to develop, test, and debug code only through Databricks ' own web interface

A data engineer is designing a Gold-layer table for a BI team that needs to query complex aggregations. The data should be precomputed to provide low latency for dashboard users, while the underlying source data changes only once every few hours.

Which object type should be implemented in Unity Catalog?

A.

Streaming table

B.

Materialized view

C.

External table

D.

View