Debugging Spark Code Locally Like A Boss
Published in
6 min readJan 4, 2021
Stepping through Spark internals can be helpful. If anything, it helps make sense of what your code is doing under the hood. In this post, I’m going to explain how I set up my debugger to hit breakpoints within the Spark codebase to be able to debug Spark Scala, Java and Python code.