Spark Associate Developer Certification Guide

labinotvila

Labinot Vila

Posted on March 19, 2024

Spark Associate Developer Certification Guide

This content is all about what is needed to pass the Databricks: Spark Associate Developer exam.

Books

Spark: The Definitive Guide
Learning Spark: 2nd Edition
The Data Engineering's Guide to Apache Spark

Lectures

Youtube

Advanced Apache Spark Training - Sameer Farooqui (Databricks)
Apache Spark Core—Deep Dive

Udemy

Apache Spark 3 - Beyond Basics
Apache Spark 3 - Databricks Certified

Exams

Databricks Apache Spark 3.0 Dev Certification - Tests(Scala)
Databricks Certified Apache Spark 3.0 TESTS (Scala & Python)
Databricks Certified Developer for Spark 3.0 Practice Exams

PDF Exams

Databricks Certified Developer for Spark 3.0 Practice Exams
PDF Exams

More Demo Dumps

Topics touched on the exam

  1. When does a Spark application fail? (when executor fails, when driver fails, when data is not fully cached, etc.)
  2. What is the most granular unit in the Spark hierarchy? (jobs, stages, tasks, etc.)
  3. What does NOT help in optimizing a Spark application? (related to partitions, column merging, etc.)
  4. What happens if there are more slots than tasks to process in a worker node? (resources are not fully utilized, etc.)
  5. What is a task? (a unit of work that can fit into an executor, a unit of work that can fit into a machine, etc.)
  6. What is a job?
  7. What is the difference between actions and transformations?
  8. Which one of Dataset API methods is most likely to invoke a shuffle? (union, groupBy, filter, etc.)
  9. How many % of the following code will cache the dataframe? (a .show() is called on a Scala range)
  10. How many jobs will the following code create? (a dataframe reading and schema infering)
  11. A wide partitions exchanges data between which units? (partitions, executors, clusters, etc.)
  12. We want to generate 25 partitions after a join, what is the right configuration to use?
  13. What are valid Spark deployment modes? (YARN, Local, Standalone, etc.)
  14. Which of the options helps garbage collecting? (increasing java heap space, serialization or deserialization, etc.)
  15. Dataset API Questions
  16. Split function
  17. Explode function
  18. Joins (inner, left, crossJoin and anti)
  19. Renaming column
  20. Overwriting column
  21. Filtering with multiple conditions
  22. Using where vs using filter difference
  23. Date and time manipulation (to and from unix, formatting, etc.)
  24. Sorting asc and desc with and without nulls
  25. Literals
  26. Repartition and coalesce (more than 2 questions)
  27. UDFs
  28. Aggregate functions (dense rank and rank)
  29. Printing schema
  30. Finding transformations and actions
  31. Collecting a dataset, extracting values and casting
  32. Casting columns of a dataset
  33. Dataset Reading and Writing
  34. Reading a raw CSV file
  35. Reading a CSV file with schema and with separators
  36. Read and write modes
  37. Writing and overwriting a parquet
  38. Partitioning by a column and writing

Do not rely on documentation online!

💖 💪 🙅 🚩
labinotvila
Labinot Vila

Posted on March 19, 2024

Join Our Newsletter. No Spam, Only the good stuff.

Sign up to receive the latest update from our blog.

Related