Efficient OpenCL system integration of non-blocking FPGA accelerators

Topi Leppänen, Atro Lotvonen, Panagiotis Mousouliotis, Joonas Multanen, Georgios Keramidas, Pekka Jääskeläinen

Research output: Contribution to journalArticleScientificpeer-review

3 Citations (Scopus)
12 Downloads (Pure)

Abstract

OpenCL functions as a portability layer for diverse heterogeneous hardware platforms including CPUs, GPUs, FPGAs, and hardware accelerators. However, OpenCL programs utilizing multiple of these devices in the same computing platform suffer from poor coordination between OpenCL implementations of different hardware vendors. This paper proposes a vendor-independent open source method for integrating custom FPGA accelerators into a common OpenCL platform. The accelerators are wrapped in a common hardware interface to enable efficient synchronization and data sharing between devices on the same chip. The provided software connects the accelerator to OpenCL runtime and enables the control of diverse FPGA accelerators with OpenCL command queues. The benefits of the integration methodology are demonstrated by creating FPGA accelerators with different development tools and integrating them together on two different types of FPGA devices while showing minimal integration overhead. Direct memory access of the accelerator to external memory is shown to increase the performance by a factor of 8. Non-blocking execution enabled by the on-chip synchronization between devices is shown to remove a 250 μs overhead from dependent kernel launches. Additionally, as a proof of concept and a case study, a fully OpenCL-controllable computing platform with two devices is implemented on an FPGA to compute CNN inference on a real-world input signal.

Original languageEnglish
Article number104772
JournalMicroprocessors and Microsystems
Volume97
DOIs
Publication statusPublished - Mar 2023
Publication typeA1 Journal article-refereed

Keywords

  • FPGA
  • Hardware acceleration
  • Hardware integration
  • Heterogeneous computing
  • OpenCL

Publication forum classification

  • Publication forum level 1

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Networks and Communications
  • Artificial Intelligence

Fingerprint

Dive into the research topics of 'Efficient OpenCL system integration of non-blocking FPGA accelerators'. Together they form a unique fingerprint.

Cite this