This site is currently under development for the RSE-ops community.
Published:
Reading time: 1 min
Magpie allows Hadoop and similar data analytics frameworks to run on LLNL’s HPC systems. Magpie instantiates the framework within the context of a batch job – rather than on a persistent, dedicated cluster – and by reading and writing from the Lustre parallel HPC file system instead of local disk drives.
v2.1 includes support for several versions of Hbase, Spark, Hadoop, and Zeppelin.
Learn more:
Help improve its content by opening a Pull Request on GitHub.