skip to main content
10.1145/3363347.3363364acmconferencesArticle/Chapter ViewAbstractPublication PagessensysConference Proceedingsconference-collections
research-article

Enhancing Support for Machine Learning and Edge Computing on an IoT Data Marketplace

Published:10 November 2019Publication History

ABSTRACT

IoT applications are increasingly employing machine learning (ML) algorithms to manage and control the operational environment autonomously while predicting future actions. To leverage these emerging technologies, the application developers require an enormous amount of data to build models. Data marketplaces enable the IoT application developers to buy data from IoT device owners to train machine learning models. Contemporary data marketplaces only focus on connecting the IoT infrastructure owner (seller) with application developers (buyer) while lacking integrated support for data analytics. Application developers are required to manually create and manage machine learning pipelines by combining edge computing resources with data sources. In this paper, we present an architectural framework to build machine learning pipelines for data marketplaces automatically. Our framework enables application developers (buyers) to leverage the edge computing resources provided by the sellers and compose low-latency IoT applications that incorporate ML-based processing. We present a proof-of-concept implementation on the I3 data marketplace and outline open challenges in combining machine-learning, AI, and edge computing technologies with data marketplaces.

References

  1. Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: A System for Large-Scale Machine Learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16). USENIX Association, Savannah, GA, 265--283. https://www.usenix.org/conference/osdi16/technical-sessions/presentation/abadiGoogle ScholarGoogle ScholarDigital LibraryDigital Library
  2. G. Ananthanarayanan, P. Bahl, P. BodÃŋk, K. Chintalapudi, M. Philipose, L. Ravindranath, and S. Sinha. 2017. Real-Time Video Analytics: The Killer App for Edge Computing. Computer 50, 10 (2017), 58--67. https://doi.org/10.1109/MC.2017.3641638Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Giorgos Constantinou, Abdullah Alfarrarjeh, Seon Ho Kim, Gowri Sankar Ramachandran, Bhaskar Krishnamachari, and Cyrus Shahabi. 2019. A Crowd-Based Image Learning Framework Using Edge Computing for Smart City. In To appear at the Fifth IEEE International Conference on Multimedia Big Data.Google ScholarGoogle Scholar
  4. IOTA Foundation. 2019. IOTA Data Marketplace. https://data.iota.org/#/demo/#list.Google ScholarGoogle Scholar
  5. Y. He, F. R. Yu, N. Zhao, V. C. M. Leung, and H. Yin. 2017. Software-Defined Networks with Mobile Edge Computing and Caching for Smart Cities: A Big Data Deep Reinforcement Learning Approach. IEEE Communications Magazine 55, 12 (Dec 2017), 31--37. https://doi.org/10.1109/MCOM.2017.1700246Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Nikhil Ketkar. 2017. Introduction to pytorch. In Deep learning with python. Springer, 195--208.Google ScholarGoogle Scholar
  7. Bhaskar Krishnamachari, Jerry Power, Seon Ho Kim, and Cyrus Shahabi. 2018. 13: an IoT marketplace for smart communities. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 498--499.Google ScholarGoogle Scholar
  8. H. Li, K. Ota, and M. Dong. 2018. Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing. IEEE Network 32, 1 (Jan 2018), 96--101. https://doi.org/10.1109/MNET.2018.1700202Google ScholarGoogle ScholarCross RefCross Ref
  9. Michael Naehrig, Kristin Lauter, and Vinod Vaikuntanathan. 2011. Can Homomorphic Encryption Be Practical?. In Proceedings of the 3rd ACM Workshop on Cloud Computing Security Workshop (CCSW '11). ACM, New York, NY, USA, 113--124. https://doi.org/10.1145/2046660.2046682Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. P. Patel, M. Intizar Ali, and A. Sheth. 2017. On Using the Intelligent Edge for IoT Analytics. IEEE Intelligent Systems 32, 5 (Sep. 2017), 64--69. https://doi.org/10.1109/MIS.2017.3711653Google ScholarGoogle ScholarCross RefCross Ref
  11. Gowri Sankar Ramachandran, Sharon L.G Contreras, and Bhaskar Krishnamachari. 2019. Publish-Pay-Subscribe Protocol for Payment-driven Edge Computing. In 2nd USENIX Workshop on Hot Topics in Edge Computing (HotEdge 19). USENIX Association, Renton, WA. https://www.usenix.org/conference/hotedge19/presentation/ramachandranGoogle ScholarGoogle Scholar
  12. Streamr. 2019. Streamr. https://www.streamr.com/marketplace.Google ScholarGoogle Scholar
  13. Terbine.IO. 2019. Terbine.IO. https://www.terbine.io/.Google ScholarGoogle Scholar
  14. Kwame-Lante Wright, Martin Martinez, Uday Chadha, and Bhaskar Krishnamachari. 2018. SmartEdge: A Smart Contract for Edge Computing. In 2018 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData). IEEE, 1685--1690.Google ScholarGoogle Scholar

Index Terms

  1. Enhancing Support for Machine Learning and Edge Computing on an IoT Data Marketplace

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      AIChallengeIoT'19: Proceedings of the First International Workshop on Challenges in Artificial Intelligence and Machine Learning for Internet of Things
      November 2019
      68 pages
      ISBN:9781450370134
      DOI:10.1145/3363347

      Copyright © 2019 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 10 November 2019

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader