Feedback (No discussion tab available so opened an Issue)

[Kwill3]

Background:

• Databricks experience level: Junior - no industry experience

1. Were the notebook instructions clear at each step? Where did you pause or re-read?

• Cell 8, creating a simple log table. I had difficulty locating the 'Spark UI' to scan node and scan details. I did however managed to find the values for the metrics from the 'See performance' link in the cell after running it.
• Cell 53, Look at the operation and operationMetrics columns. I am able to see the OPTIMIZE operation from the table history from the Catalog Explorer but could not locate the aforementioned columns.

2. Which optimization concept remained fuzzy, and what supporting visual or explanation would help?

• I think for me the concepts are well explained, I can understand the use-case and the 'When to use' 'When NOT to use' points give clarity on the scope of the techniques.

3. Would a short video walkthrough add value, or do you prefer self-discovery?

• I think a video walkthrough on the points I struggled with would be helpful for beginners like me, especially on how to access the SparkUI and locating the operation/operationMetrics columns.

I'm grateful for the effort you put into creating this project, I definitely learned the optimization techniques on this hands-on project and will always be following you for more data engineering insights on LinkedIn.

[jrlasak]

Great, thanks a lot!