GRAM: A GPU-based property graph traversal and query for HPC rich metadata management

Wenke Li, Xuanhua Shi, Hong Huang, Peng Zhao, Hai Jin, Dong Dai, Yong Chen

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In HPC systems, rich metadata are defined to describe rich information about data files, like the executions that lead to the data files, the environment variables, and the parameters of all executions, etc. Recent studies have shown the feasibility of using property graph to model rich metadata and utilizing graph traversal to query rich metadata stored in the property graph. We propose to utilize GPU to process the rich metadata graphs. There are generally two challenges to utilize GPU for metadata graph query. First, there is no proper data representation for the metadata graph on GPU yet. Second, there is no optimization techniques specifically for metadata graph traversal on GPU neither. In order to tackle these challenges, we propose GRAM, a GPU-based property graph traversal and query framework. GRAM uses GPU to express metadata graph in Compressed Sparse Row (CSR) format, and uses Structure of Arrays (SoA) layout to store properties. In addition, we propose two new optimizations, parallel filtering and basic operations merging, to accelerate the metadata graph traversal. Our evaluation results show that GRAM can be effectively applied to user scenarios in HPC systems, and the performance of metadata management is greatly improved.

Original languageEnglish
Title of host publicationNetwork and Parallel Computing - 15th IFIP WG 10.3 International Conference, NPC 2018, Proceedings
EditorsMarc Snir, Mateo Valero, Feng Zhang, Hironori Kasahara, Jidong Zhai, Hai Jin
PublisherSpringer-Verlag
Pages77-89
Number of pages13
ISBN (Print)9783030056766
DOIs
StatePublished - 2018
Event15th IFIP International Conference on Network and Parallel Computing, NPC 2018 - Muroran, Japan
Duration: Nov 29 2018Dec 1 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11276 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference15th IFIP International Conference on Network and Parallel Computing, NPC 2018
CountryJapan
CityMuroran
Period11/29/1812/1/18

Keywords

  • GPU
  • Graph traversal
  • Property graph
  • Rich metadata management

Fingerprint Dive into the research topics of 'GRAM: A GPU-based property graph traversal and query for HPC rich metadata management'. Together they form a unique fingerprint.

Cite this