Databricks Databricks-Certified-Data-Engineer-Associate - Databricks Certified Data Engineer Associate Exam
Total 230 questions
A data engineer needs to ingest from both streaming and batch sources for a firm that relies on highly accurate data. Occasionally, some of the data picked up by the sensors that provide a streaming input are outside the expected parameters. If this occurs, the data must be dropped, but the stream should not fail.
Which feature of Delta Live Tables meets this requirement?
A new data engineering team has been assigned to work on a project. The team will need access to database customers in order to see what tables already exist. The team has its own group team.
Which of the following commands can be used to grant the necessary permission on the entire database to the new team?
A developer is building a data pipeline that processes records from a Bronze table into a Silver table. The Bronze table, bronze_events, contains duplicate records because of at-least-once delivery guarantees from the upstream ingestion system. The developer writes the following PySpark code:
deduped_df = df.dropDuplicates()
deduped_df.summary( " count " , " mean " , " stddev " ).show()
from pyspark.sql.functions import approx_count_distinct
deduped_df.select(approx_count_distinct( " user_id " )).show()
After running dropDuplicates() without arguments, some rows that differ only in the event_timestamp column remain. The developer wants to deduplicate records based only on user_id and event_type, keeping one row for each unique combination of those two columns.
Which code change achieves this deduplication requirement?
The Delta transaction log for the ‘students’ tables is shown using the ‘DESCRIBE HISTORY students’ command. A Data Engineer needs to query the table as it existed before the UPDATE operation listed in the log.

Which command should the Data Engineer use to achieve this? (Choose two.)
A data engineering project involves processing large batches of data on a daily schedule using ETL. The jobs are resource-intensive and vary in size, requiring a scalable, cost-efficient compute solution that can automatically scale based on the workload.
Which compute approach will satisfy the needs described?
A data engineer triggers a scheduled job but finds that the new run was not executed. The run history shows that the run was skipped with a concurrency-related queue message.
Which configuration should the engineer investigate?
A data engineer has configured a Structured Streaming job to read from a table, manipulate the data, and then perform a streaming write into a new table.
The cade block used by the data engineer is below:

If the data engineer only wants the query to execute a micro-batch to process data every 5 seconds, which of the following lines of code should the data engineer use to fill in the blank?
A data engineering team is using Kafka to capture event data and then ingest it into Databricks. The team wants to be able to see these historical events. Medallion architecture is already in place. The team wants to be mindful of costs.
Where should this historical event data be stored?
A data engineer is working on a personal laptop and needs to perform complex transformations on data stored in a Delta Lake on cloud storage. The engineer decides to use Databricks Connect to interact with Databricks clusters and work in their local IDE.
How does Databricks Connect enable the engineer to develop, test, and debug code seamlessly on their local machine while interacting with Databricks clusters?
A data engineer is designing a Gold-layer table for a BI team that needs to query complex aggregations. The data should be precomputed to provide low latency for dashboard users, while the underlying source data changes only once every few hours.
Which object type should be implemented in Unity Catalog?
