Here’s a categorized Spark SQL function reference, which organizes common Spark SQL functions by functionality. This can help with selecting the right function based on the operation you want to perform. 1. Aggregate Functions Function Description Example avg() Calculates the average value. SELECT avg(age) FROM table; count() Counts the number of rows. SELECT count(*) FROM … Continue reading Functions in Spark SQL- Cheatsheets, Complex Examples