This paper takes a step in bridging these two fields by extending MPI to support Hadoop-like Big Data Computing jobs, where processing and communication of a ...
This paper takes a step in bridging these two fields by extending MPI to support Hadoop-like Big Data Computing jobs.
Abstract—MPI has been widely used in High Performance. Computing. In contrast, such efficient communication support is lacking in the field of Big Data ...
DataMPI [26] communication library is an extended MPI specification to achieve Hadoop-like communications. Currently it only supports single program and ...
Bibliographic details on DataMPI: Extending MPI to Hadoop-Like Big Data Computing.
Xiaoyi Lu, Fan Liang, Bing Wang, Li Zha, Zhiwei Xu. DataMPI: Extending MPI to Hadoop-like Big Data Computing. In Proceedings of the 28th IEEE International ...
Mar 14, 2014 · From our experiments, we observe that the job execution time of DataMPI has up to 55% and 39% speedups compared with those of Hadoop and Spark, ...
People also ask
What is MPI in Hadoop?
Which big data tool is designed with the goal to speed up the Hadoop big data processing?
Mar 13, 2015 · DataMPI: Extending MPI to Hadoop-like big data computing. In Proc. the 28th International Parallel and Distributed Processing Symposium ...
Datampi: extending mpi to hadoop-like big data computing. X Lu, F Liang, B Wang, L Zha, Z Xu. 2014 IEEE 28th International Parallel and Distributed Processing ...
which extends MPI for Hadoop/Spark-like Big Data Computing systems ... Hadoop/DataMPI task and 128 MB data per Spark worker with in- creasing the ...