Quality Optimization of Adaptive Applications via Deep Reinforcement Learning in Energy Harvesting Edge Devices

Fupeng Chen, Heng Yu, Weixiong Jiang, Yajun Ha

Research output: Journal PublicationArticlepeer-review

2 Citations (Scopus)

Abstract

Applications with adaptability are widely available on the edge devices with energy harvesting capabilities. For their runtime quality optimization, however, current approaches cannot tackle the variations of quality modeling and harvested energy simultaneously. Therefore, in this article, we are the first to propose a deep reinforcement learning (DRL)-based dynamic voltage frequency scaling (DVFS) method that optimizes the application execution quality of energy harvesting edge devices to mitigate the variations. First, we propose a baseline DRL formulation that novelly migrates the objective of quality maximization into a reward function and constructs a DRL quality agent. Second, we devise a long short-term memory (LSTM)-based selector that performs DRL quality agent selection based on the energy harvesting history. Third, we further propose two optimization methods to alleviate the nonnegligible overhead of DRL computations: 1) an improved thinking-while-moving concurrent DRL scheme to compromise the 'state drifting' issue during the DRL decision process and 2) a variable interstate duration decision scheme that compromises the DVFS overhead incurred in each action taken. The experiments take an adaptive stereo matching application as a case study. The results show that the proposed DRL-based DVFS method on average achieves 17.9% runtime reduction and 22.05% quality improvement compared to state-of-the-art solutions.

Original languageEnglish
Pages (from-to)4873-4886
Number of pages14
JournalIEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
Volume41
Issue number11
DOIs
Publication statusPublished - 1 Nov 2022

Keywords

  • Adaptive application
  • deep reinforcement learning (DRL)
  • energy harvesting
  • quality optimization
  • stereo matching

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Quality Optimization of Adaptive Applications via Deep Reinforcement Learning in Energy Harvesting Edge Devices'. Together they form a unique fingerprint.

Cite this