ABSTRACT
IoT applications are increasingly employing machine learning (ML) algorithms to manage and control the operational environment autonomously while predicting future actions. To leverage these emerging technologies, the application developers require an enormous amount of data to build models. Data marketplaces enable the IoT application developers to buy data from IoT device owners to train machine learning models. Contemporary data marketplaces only focus on connecting the IoT infrastructure owner (seller) with application developers (buyer) while lacking integrated support for data analytics. Application developers are required to manually create and manage machine learning pipelines by combining edge computing resources with data sources. In this paper, we present an architectural framework to build machine learning pipelines for data marketplaces automatically. Our framework enables application developers (buyers) to leverage the edge computing resources provided by the sellers and compose low-latency IoT applications that incorporate ML-based processing. We present a proof-of-concept implementation on the I3 data marketplace and outline open challenges in combining machine-learning, AI, and edge computing technologies with data marketplaces.
- Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: A System for Large-Scale Machine Learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16). USENIX Association, Savannah, GA, 265--283. https://www.usenix.org/conference/osdi16/technical-sessions/presentation/abadiGoogle ScholarDigital Library
- G. Ananthanarayanan, P. Bahl, P. BodÃŋk, K. Chintalapudi, M. Philipose, L. Ravindranath, and S. Sinha. 2017. Real-Time Video Analytics: The Killer App for Edge Computing. Computer 50, 10 (2017), 58--67. https://doi.org/10.1109/MC.2017.3641638Google ScholarDigital Library
- Giorgos Constantinou, Abdullah Alfarrarjeh, Seon Ho Kim, Gowri Sankar Ramachandran, Bhaskar Krishnamachari, and Cyrus Shahabi. 2019. A Crowd-Based Image Learning Framework Using Edge Computing for Smart City. In To appear at the Fifth IEEE International Conference on Multimedia Big Data.Google Scholar
- IOTA Foundation. 2019. IOTA Data Marketplace. https://data.iota.org/#/demo/#list.Google Scholar
- Y. He, F. R. Yu, N. Zhao, V. C. M. Leung, and H. Yin. 2017. Software-Defined Networks with Mobile Edge Computing and Caching for Smart Cities: A Big Data Deep Reinforcement Learning Approach. IEEE Communications Magazine 55, 12 (Dec 2017), 31--37. https://doi.org/10.1109/MCOM.2017.1700246Google ScholarDigital Library
- Nikhil Ketkar. 2017. Introduction to pytorch. In Deep learning with python. Springer, 195--208.Google Scholar
- Bhaskar Krishnamachari, Jerry Power, Seon Ho Kim, and Cyrus Shahabi. 2018. 13: an IoT marketplace for smart communities. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 498--499.Google Scholar
- H. Li, K. Ota, and M. Dong. 2018. Learning IoT in Edge: Deep Learning for the Internet of Things with Edge Computing. IEEE Network 32, 1 (Jan 2018), 96--101. https://doi.org/10.1109/MNET.2018.1700202Google ScholarCross Ref
- Michael Naehrig, Kristin Lauter, and Vinod Vaikuntanathan. 2011. Can Homomorphic Encryption Be Practical?. In Proceedings of the 3rd ACM Workshop on Cloud Computing Security Workshop (CCSW '11). ACM, New York, NY, USA, 113--124. https://doi.org/10.1145/2046660.2046682Google ScholarDigital Library
- P. Patel, M. Intizar Ali, and A. Sheth. 2017. On Using the Intelligent Edge for IoT Analytics. IEEE Intelligent Systems 32, 5 (Sep. 2017), 64--69. https://doi.org/10.1109/MIS.2017.3711653Google ScholarCross Ref
- Gowri Sankar Ramachandran, Sharon L.G Contreras, and Bhaskar Krishnamachari. 2019. Publish-Pay-Subscribe Protocol for Payment-driven Edge Computing. In 2nd USENIX Workshop on Hot Topics in Edge Computing (HotEdge 19). USENIX Association, Renton, WA. https://www.usenix.org/conference/hotedge19/presentation/ramachandranGoogle Scholar
- Streamr. 2019. Streamr. https://www.streamr.com/marketplace.Google Scholar
- Terbine.IO. 2019. Terbine.IO. https://www.terbine.io/.Google Scholar
- Kwame-Lante Wright, Martin Martinez, Uday Chadha, and Bhaskar Krishnamachari. 2018. SmartEdge: A Smart Contract for Edge Computing. In 2018 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData). IEEE, 1685--1690.Google Scholar
Index Terms
- Enhancing Support for Machine Learning and Edge Computing on an IoT Data Marketplace
Recommendations
Cybersecurity Challenges and Opportunities in the New "Edge Computing + IoT" World
SDN-NFV Sec'18: Proceedings of the 2018 ACM International Workshop on Security in Software Defined Networks & Network Function VirtualizationThe paradigm shift to the Internet of Things (IoT) and the emergence of the edge computing concept have brought huge potentials for various future IoT application scenes such as smart home, smart transportation, smart health, smart grids, and smart ...
A top-down survey on securing IoT with machine learning: goals, recent advances and challenges
The Internet of Things (IoT) has seen it all from being just another innovation to a leading technology; it is now a binding force that interconnects various aspects of our lives. The IoT's tremendous growth is driven by emerging applications and evolving ...
Machine learning and data analytics for the IoT
AbstractThe Internet of Things (IoT) applications have grown in exorbitant numbers, generating a large amount of data required for intelligent data processing. However, the varying IoT infrastructures (i.e., cloud, edge, fog) and the limitations of the ...
Comments