Why We are excited about spark 3.2

Why We are excited about spark 3.2

i wanted to use this post to summarize what is exciting about the spark 3.2.x release from the perspective of tresata. background: tresata uses spark for analytics and machine learning on large amounts of data. we exclusively use the scala api (mostly dataframes but...