Thu 18 Jul 2019 15:40 - 16:00 at Mancy - Concurrency and Parallelism Chair(s): Stephen Kell

Object-oriented programming has long been regarded as too inefficient for SIMD high-performance computing, despite the fact that many important applications in HPC have an inherent object structure. On SIMD accelerators including GPUs, this is mainly due to performance problems with memory allocation: There are a few libraries that support parallel memory allocation directly on accelerator devices, but all of them suffer from uncoalesed memory accesses.

In this work, we present DynaSOAr, a C++/CUDA data layout DSL for object-oriented programming, combined with a parallel dynamic object allocator. DynaSOAr was designed for a class of object-oriented programs that we call Single-Method Multiple Objects (SMMO), in which parallelism is expressed over a set of objects. DynaSOAr is the first GPU object allocator that provides a parallel do-all operation, which is the foundation of SMMO applications.

DynaSOAr improves the usage of allocated memory with a Structure of Arrays (SOA) data layout and achieves low memory fragmentation through efficient management of free and allocated memory blocks with lock-free, hierarchical bitmaps. In our benchmarks, DynaSOAr achieves a significant speedup of application code of up to 3x over state-of-the-art allocators. Moreover, DynaSOAr manages heap memory more efficiently than other allocators, allowing programmers to run up to 2x larger problem sizes with the same amount of memory.

Thu 18 Jul
Times are displayed in time zone: (GMT+01:00) Greenwich Mean Time : Belfast change

15:40 - 17:00: Research Papers - Concurrency and Parallelism at Mancy
Chair(s): Stephen KellUniversity of Kent
ecoop-2019-papers15:40 - 16:00
Research paper
Matthias SpringerTokyo Institute of Technology, Hidehiko MasuharaTokyo Institute of Technology
DOI Pre-print Media Attached
ecoop-2019-papers16:00 - 16:20
Research paper
Suvam MukherjeeMicrosoft Research India, Nitin John RajInternational Institute of Information Technology, Hyderabad, Krishnan GovindrajMicrosoft Research, Pantazis DeligiannisMicrosoft Research, Chandramouleswaran RavichandranMicrosoft Azure, Akash LalMicrosoft Research India, Aseem RastogiMicrosoft Research, Raja KrishnaswamyMicrosoft Azure
DOI Media Attached
ecoop-2019-papers16:20 - 16:40
Research paper
Jafar Haminimec-DistriNet, Depatrmant of Computer Science, KU Leuven, Belgium, Bart JacobsKU Leuven
DOI Media Attached
ecoop-2019-papers16:40 - 17:00
Research paper
Rupak MajumdarMPI-SWS, Germany, Marcus PirronMPI-SWS, Nobuko YoshidaImperial College London, Damien ZuffereyMPI-SWS
DOI Media Attached