Alchemist: An Apache Spark ⇔ MPI interface
Alchemist: An Apache Spark ⇔ MPI interface
Summary The Apache Spark framework for distributed computation is popular in the data analytics community due to its ease of use, but its MapReduce‐style programming model can incur significant overheads when performing computations that do not map directly onto this model. One way to mitigate these costs is to off‐load …