Big data analysis requires parallel processing. While the standard technology for huge non-embarrassingly parallel, but rather tightly-coupled computational problems is High-Performance Computing (HPC), highly praised contenders for huge parallel processing problems are big data processing frameworks such as Apache Hadoop or Apache Spark. To be able to decide whether HPC or big data platforms are better suited for big data problems, this projects investigates and compares the two paradigms and their platforms.
\nAs a case study, the run-time performance and scalability of different implementations of the Density-Based Spatial Clustering of Applications with Noise (DBSCAN) clustering algorithm is investigated and compared.<\/p>\n
Helmut Neukirchen. Helmut Neukirchen. Helmut Neukirchen. Big data analysis requires parallel processing. While the standard technology for huge non-embarrassingly parallel, but rather tightly-coupled computational problems is High-Performance Computing (HPC), highly praised contenders for huge parallel processing problems are big data processing frameworks such as Apache Hadoop or Apache Spark. To be able to decide whether HPC or big data platforms are […]<\/p>\n","protected":false},"author":512,"featured_media":0,"parent":20,"menu_order":6,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-1278","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/pages\/1278","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/users\/512"}],"replies":[{"embeddable":true,"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/comments?post=1278"}],"version-history":[{"count":3,"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/pages\/1278\/revisions"}],"predecessor-version":[{"id":1557,"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/pages\/1278\/revisions\/1557"}],"up":[{"embeddable":true,"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/pages\/20"}],"wp:attachment":[{"href":"https:\/\/uni.hi.is\/helmut\/wp-json\/wp\/v2\/media?parent=1278"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\nElephant against Goliath: Performance of Big Data versus High-Performance Computing DBSCAN Clustering Implementations.<\/i>Simulation Science. First International Workshop, SimScience 2017, G\u00f6ttingen, Germany, April 27\u201328, 2017, Revised Selected Papers, Communications in Computer and Information Science (CCIS), volume 889, DOI: 978-3-319-96271-9_16<\/a>, Springer 2018.
\nDownload<\/a><\/p>\n
\nPerformance of Big Data versus High-Performance Computing: Some Observations.<\/i>
\nExtended Abstract. Clausthal-G\u00f6ttingen International Workshop on Simulation Science, 27-28 April 2017, G\u00f6ttingen, Germany. Proceedings of Accepted Abstracts<\/a>, Clausthal-G\u00f6ttingen Simulation Science Center, 2017, pp. 93-95.
\nDownload<\/a><\/p>\n
\nSurvey and Performance Evaluation of DBSCAN Spatial Clustering Implementations for Big Data and High-Performance Computing Paradigms.<\/i>Technical Report VHI-01-2016, Engineering Research Institute, University of Iceland, Reykjavik, Iceland, November 2016.
\nDownload<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"