Application of Edge-to-Cloud Methods Toward Deep Learning

Khushi Choudhary, Nona Nersisyan, Edward Lin, Shobana Chandrasekaran, Rajiv Mayani, Loic Pottier, Angela P. Murillo, Nicole K. Virdone, Kerk Kee, Ewa Deelman

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Scientific workflows are important in modern computational science and are a convenient way to represent complex computations, which are often geographically distributed among several computers. In many scientific domains, scientists use sensors (e.g., edge devices) to gather data such as CO2 level or temperature, that are usually sent to a central processing facility (e.g., a cloud). However, these edge devices are often not powerful enough to perform basic computations or machine learning inference computations and thus applications need the power of cloud platforms to generate scientific results. This work explores the execution and deployment of a complex workflow on an edge-to-cloud architecture in a use case of the detection and classification of plankton. In the original application, images were captured by cameras attached to buoys floating in Lake Greifensee (Switzerland). We developed a workflow based on that application. The workflow aims to pre-process images locally on the edge devices (i.e., buoys) then transfer data from each edge device to a cloud platform. Here, we developed a Pegasus workflow that runs using HTCondor and leveraged the Chameleon cloud platform and its recent CHI@Edge feature to mimic such deployment and study its feasibility in terms of performance and deployment.

Original languageEnglish
Title of host publicationProceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages415-416
Number of pages2
ISBN (Electronic)9781665461245
DOIs
StatePublished - 2022
Event18th IEEE International Conference on e-Science, eScience 2022 - Salt Lake City, United States
Duration: Oct 10 2022Oct 14 2022

Publication series

NameProceedings - 2022 IEEE 18th International Conference on e-Science, eScience 2022

Conference

Conference18th IEEE International Conference on e-Science, eScience 2022
Country/TerritoryUnited States
CitySalt Lake City
Period10/10/2210/14/22

Keywords

  • Edge Computing
  • Machine Learning
  • Pegasus
  • Scientific Workflows
  • Workflow Management Systems
  • Zooplankton

Fingerprint

Dive into the research topics of 'Application of Edge-to-Cloud Methods Toward Deep Learning'. Together they form a unique fingerprint.

Cite this