Hands-on Guide to Apache Spark 3

Аннотация

Apache Spark started as a research project at the UC Berkeley AMPLab in 2009. It became open source in 2010 and was transferred to the Apache Software Foundation in 2013 and boasts the largest open source big data community. From its genesis, Spark was designed with a significant change in mind, to store intermediate data computations in Random Access Memory (RAM), taking advantage of the coming-down RAM prices that occurred in the 2010s, in comparison with Hadoop that keeps information in slower disks