Developments for Delta Lake

Developments for Delta Lake

at tresata we have been using and supporting the delta open source format since 2019 (the year it was open sourced). for us it has been more or less parquet+, e.g. parquet format with some added benefits. the main benefit to us is better/safer support for concurrent...
Developments for Delta Lake

Why We are excited about spark 3.2

i wanted to use this post to summarize what is exciting about the spark 3.2.x release from the perspective of tresata. background: tresata uses spark for analytics and machine learning on large amounts of data. we exclusively use the scala api (mostly dataframes but...