최신 Databricks-Certified-Data-Engineer-Professional 무료덤프 - Databricks Certified Data Engineer Professional

문제1

Where in the Spark UI can one diagnose a performance problem induced by not leveraging predicate push-down?

A. In the Storage Detail screen, by noting which RDDs are not stored on disk

B. In the Delta Lake transaction log. by noting the column statistics

C. In the Executor's log file, by gripping for "predicate push-down"

D. In the Stage's Detail screen, in the Completed Stages table, by noting the size of data read from the Input column

E. In the Query Detail screen, by interpreting the Physical Plan

정답: E

설명: (DumpTOP 회원만 볼 수 있음)

문제2

A Structured Streaming job deployed to production has been resulting in higher than expected cloud storage costs. At present, during normal execution, each microbatch of data is processed in less than 3s; at least 12 times per minute, a microbatch is processed that contains 0 records. The streaming write was configured using the default trigger settings. The production job is currently scheduled alongside many other Databricks jobs in a workspace with instance pools provisioned to reduce start-up time for jobs with batch execution.
Holding all other variables constant and assuming records need to be processed in less than 10 minutes, which adjustment will meet the requirement?

A. Use the trigger once option and configure a Databricks job to execute the query every 10 minutes; this approach minimizes costs for both compute and storage.

B. Increase the number of shuffle partitions to maximize parallelism, since the trigger interval cannot be modified without modifying the checkpoint directory.

C. Set the trigger interval to 10 minutes; each batch calls APIs in the source storage account, so decreasing trigger frequency to maximum allowable threshold should minimize this cost.

D. Set the trigger interval to 3 seconds; the default trigger interval is consuming too many records per batch, resulting in spill to disk that can increase volume costs.

E. Set the trigger interval to 500 milliseconds; setting a small but non-zero trigger interval ensures that the source is not queried too frequently.

정답: C

문제3

A user new to Databricks is trying to troubleshoot long execution times for some pipeline logic they are working on. Presently, the user is executing code cell-by-cell, using display() calls to confirm code is producing the logically correct results as new transformations are added to an operation. To get a measure of average time to execute, the user is running each cell multiple times interactively.
Which of the following adjustments will get a more accurate measure of how code is likely to perform in production?

A. The only way to meaningfully troubleshoot code execution times in development notebooks Is to use production-sized data and production-sized clusters with Run All execution.

B. Production code development should only be done using an IDE; executing code against a local build of open source Spark and Delta Lake will provide the most accurate benchmarks for how code will perform in production.

C. Calling display () forces a job to trigger, while many transformations will only add to the logical query plan; because of caching, repeated execution of the same logic does not provide meaningful results.

D. Scala is the only language that can be accurately tested using interactive notebooks; because the best performance is achieved by using Scala code compiled to JARs. all PySpark and Spark SQL logic should be refactored.

E. The Jobs Ul should be leveraged to occasionally run the notebook as a job and track execution time during incremental code development because Photon can only be enabled on clusters launched for scheduled jobs.

정답: A

문제4

A junior data engineer has configured a workload that posts the following JSON to the Databricks REST API endpoint 2.0/jobs/create.

Assuming that all configurations and referenced resources are available, which statement describes the result of executing this workload three times?

A. The logic defined in the referenced notebook will be executed three times on new clusters with the configurations of the provided cluster ID.

B. Three new jobs named "Ingest new data" will be defined in the workspace, and they will each run once daily.

C. The logic defined in the referenced notebook will be executed three times on the referenced existing all purpose cluster.

D. One new job named "Ingest new data" will be defined in the workspace, but it will not be executed.

E. Three new jobs named "Ingest new data" will be defined in the workspace, but no jobs will be executed.

정답: E

설명: (DumpTOP 회원만 볼 수 있음)

문제5

Review the following error traceback:
Get Latest & Actual Certified-Data-Engineer-Professional Exam's Question and Answers from

Which statement describes the error being raised?

A. There is a syntax error because the heartrate column is not correctly identified as a column.

B. There is a type error because a DataFrame object cannot be multiplied.

C. There is no column in the table named heartrateheartrateheartrate

D. There is a type error because a column object cannot be multiplied.

E. The code executed was PvSoark but was executed in a Scala notebook.

정답: C

설명: (DumpTOP 회원만 볼 수 있음)

문제6

The data architect has mandated that all tables in the Lakehouse should be configured as external (also known as "unmanaged") Delta Lake tables.
Which approach will ensure that this requirement is met?

A. When tables are created, make sure that the EXTERNAL keyword is used in the CREATE TABLE statement.

B. When a database is being created, make sure that the LOCATION keyword is used.

C. When the workspace is being configured, make sure that external cloud object storage has been mounted.

D. When configuring an external data warehouse for all table storage, leverage Databricks for all ELT.

E. When data is saved to a table, make sure that a full file path is specified alongside the Delta format.

정답: A

설명: (DumpTOP 회원만 볼 수 있음)

문제7

All records from an Apache Kafka producer are being ingested into a single Delta Lake table with the following schema:
key BINARY, value BINARY, topic STRING, partition LONG, offset LONG, timestamp LONG There are 5 unique topics being ingested. Only the "registration" topic contains Personal Identifiable Information (PII). The company wishes to restrict access to PII. The company also wishes to only retain records containing PII in this table for 14 days after initial ingestion.
However, for non-PII information, it would like to retain these records indefinitely.
Which of the following solutions meets the requirements?

A. Separate object storage containers should be specified based on the partition field, allowing isolation at the storage level.

B. All data should be deleted biweekly; Delta Lake's time travel functionality should be leveraged to maintain a history of non-PII information.

C. Data should be partitioned by the registration field, allowing ACLs and delete statements to be set for the PII directory.

D. Data should be partitioned by the topic field, allowing ACLs and delete statements to leverage partition boundaries.

E. Because the value field is stored as binary data, this information is not considered PII and no special precautions should be taken.

정답: D

설명: (DumpTOP 회원만 볼 수 있음)

문제8

The Databricks CLI is use to trigger a run of an existing job by passing the job_id parameter. The response that the job run request has been submitted successfully includes a filed run_id.
Get Latest & Actual Certified-Data-Engineer-Professional Exam's Question and Answers from Which statement describes what the number alongside this field represents?

A. The total number of jobs that have been run in the workspace.

B. The job_id and number of times the job has been are concatenated and returned.

C. The job_id is returned in this field.

D. The number of times the job definition has been run in the workspace.

E. The globally unique ID of the newly triggered run.

정답: E

설명: (DumpTOP 회원만 볼 수 있음)

문제9

The data engineering team has configured a job to process customer requests to be forgotten (have their data deleted). All user data that needs to be deleted is stored in Delta Lake tables using default table settings.
The team has decided to process all deletions from the previous week as a batch job at 1am each Sunday. The total duration of this job is less than one hour. Every Monday at 3am, a batch job executes a series of VACUUM commands on all Delta Lake tables throughout the organization.
The compliance officer has recently learned about Delta Lake's time travel functionality. They are concerned that this might allow continued access to deleted data.
Assuming all delete logic is correctly implemented, which statement correctly addresses this concern?

A. Because the vacuum command permanently deletes all files containing deleted records, deleted records may be accessible with time travel for around 24 hours.

B. Because the default data retention threshold is 24 hours, data files containing deleted records will be retained until the vacuum job is run the following day.

C. Because Delta Lake's delete statements have ACID guarantees, deleted records will be permanently purged from all storage systems as soon as a delete job completes.

D. Because Delta Lake time travel provides full access to the entire history of a table, deleted records can always be recreated by users with full admin privileges.

E. Because the default data retention threshold is 7 days, data files containing deleted records will be retained until the vacuum job is run 8 days later.Get Latest & Actual Certified-Data-Engineer-Professional Exam's Question and Answers from

정답: E

설명: (DumpTOP 회원만 볼 수 있음)

문제10

When scheduling Structured Streaming jobs for production, which configuration automatically recovers from query failures and keeps costs low?

A. Cluster: Existing All-Purpose Cluster;
Retries: None;
Maximum Concurrent Runs: 1

B. Cluster: Existing All-Purpose Cluster;
Retries: Unlimited;
Maximum Concurrent Runs: 1

C. Cluster: New Job Cluster;
Retries: Unlimited;
Maximum Concurrent Runs: Unlimited

D. Cluster: Existing All-Purpose Cluster;
Retries: Unlimited;
Maximum Concurrent Runs: 1

E. Cluster: New Job Cluster;
Retries: None;
Maximum Concurrent Runs: 1

정답: B

설명: (DumpTOP 회원만 볼 수 있음)

최신 Databricks-Certified-Data-Engineer-Professional 무료덤프 - Databricks Certified Data Engineer Professional

우리와 연락하기

유용한 링크

최신 업데이트