Journal Article

Seismic data IO and sorting optimization in HPC through ANNs prediction based auto-tuning for ExSeisDat

Conbhuí, Pádraig Ó, Tipu, Abdul Jabbar Saeed, Howley, Enda

2023

Overview

ExSeisDat is designed using standard message passing interface (MPI) library for seismic data processing on high-performance super-computing clusters. These clusters are generally designed for efficient execution of complex tasks including large size IO. The IO performance degradation issues arise when multiple processes try accessing data from parallel networked storage. These complications are caused by restrictive protocols running by a parallel file system (PFS) controlling the disks and due to less advancement in storage hardware itself as well. This requires and leads to the tuning of specific configuration parameters to optimize the IO performance, commonly not considered by users focused on writing parallel application. Despite its consideration, the changes in configuration parameters are required from case to case. It adds up to further degradation in IO performance for a large SEG-Y format seismic data file scaling to petabytes. The SEG-Y IO and file sorting operations are the two of the main features of ExSeisDat. This research paper proposes technique to optimize these SEG-Y operations based on artificial neural networks (ANNs). The optimization involves auto-tuning of the related configuration parameters, using IO bandwidth prediction by the trained ANN models through machine learning (ML) process. Furthermore, we discuss the impact on prediction accuracy and statistical analysis of auto-tuning bandwidth results, by the variation in hidden layers nodes configuration of the ANNs. The results have shown the overall improvement in bandwidth performance up to 108.8% and 237.4% in the combined SEG-Y IO and file sorting operations test cases, respectively. Therefore, this paper has demonstrated the significant gain in SEG-Y seismic data bandwidth performance by auto-tuning the parameters settings on runtime by using an ML approach.

• Publisher: Springer London,Springer Nature B.V
• Subject: Artificial Intelligence / Artificial neural networks / Bandwidths / Clusters / Computational Biology/Bioinformatics / Computational Science and Engineering / Computer Science / Configurations / Data Mining and Knowledge Discovery / Data processing / Disks / Image Processing and Computer Vision / Machine learning / Message passing / Optimization / Original Article / Parameters / Performance degradation / Probability and Statistics in Computer Science / Seismic response / Statistical analysis / Task complexity / Tuning