Distributed Fog Computing Based on Improved LT codes for Deep Learning in Web of Things
Authors: 
Lei Zhang, Jie Liu, Fuquan Zhang, Yu MaoAuthors Info & Claims
Lei Zhang, Jie Liu, Fuquan Zhang, Yu MaoAuthors Info & ClaimsPages 57 - 62
Abstract
With the rapid development of the Web of Things, there have been a lot of sensors deployed. Advanced knowledge can be achieved by deep learning method and easier integration with open Web standards. A large number of the data generated by sensors required extra processing resources due to the limited resources of the sensors. Due to the limitation of bandwidth or requirement of low latency, it is impossible to transfer such large amounts of data to cloud servers for processing. Thus, the concept of distributed fog computing has been proposed to process such big data into knowledge in real-time. Large scale fog computing system is built using cheap devices, denotes as fog nodes. Therefore, the resiliency to fog node failures should be considered in design of distributed fog computing. LT codes (LTC) have important applications in the design of modern distributed computing, which can reduce the latency of the computing tasks, such as matrix multiplication in deep learning methods. In this paper, we consider that fog nodes may be failure, and an improved LT codes are applied to matrix multiplication of distributed fog computing process to reduce latency. Numerical results show that the improved LTC based scheme can reduce average overhead and degree simultaneously, which reduce the latency and computation complexity of distributed fog computing.
References
[1]
Atzori L, Iera A, Morabito G . The Internet of Things: A survey[J]. Computer Networks, 2010, 54(15):2787-2805.
[2]
Jara A J, Zamora M A, Skarmeta A . Glowbal IP: An adaptive and transparent IPv6 integration in the Internet of Things[J]. Mobile Information Systems, 2012, 8(3):177-197.
[3]
Al-Fuqaha A, Guizani M, Mohammadi M, Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications[J]. IEEE Communications Surveys & Tutorials, 2015, 17(4):2347-2376.
[4]
Raggett D . The Web of Things: Challenges and Opportunities[J]. Computer, 2015, 48(5):26-32.
[5]
Stirbu, V.: ‘Towards a restful plug and play experience in the Web of Things’. 2008 IEEE Int. Conf. Semantic Computing, August 2008, pp. 512–517.
[6]
Tran, N.K., Sheng, Q.Z., Babar, M.A., : ‘Searching the Web OF Things: state of the art, challenges, and solutions’, ACM Comput. Surv., 2017, 50, pp. 55:1–55:34.
[7]
Yao S, Zhao Y, Zhang A, Deep Learning for the Internet of Things[J]. Computer, 2018, 51(5):32-41.
[8]
Li L, Ota K, Dong M . Deep Learning for Smart Industry: Efficient Manufacture Inspection System With Fog Computing[J]. IEEE Transactions on Industrial Informatics, 2018, PP(10):1-1.
[9]
J. Cabrera G., D. Lucani R., F. Fitzek, “On network coded distributed storage: How to repair in a fog of unreliable peers,” in Proc. of IEEE ISWCS’16, Poznan, Poland, Sep. 20-23, 2016, pp. 188– 193.
[10]
J. Cabrera G., D. Lucani R., F. Fitzek, “On network coded distributed storage: How to repair in a fog of unreliable peers,” in Proc. of IEEE ISWCS’16, Poznan, Poland, Sep. 20-23, 2016, pp. 188–193.
[11]
C. Huang, R. Lu, and K. Choo, “Vehicular fog computing: Architecture, use case, and security and forensic challenges,” IEEE Communications Magazine, vol. 55, no. 11, pp. 105–111, Nov., 2017.
[12]
Y. Li, E. Soljanin, and P. Spasojevc, “Effect of the generation size and overlap on throughput and comlexity in randomized linear network coding,” IEEE Trans. Inform. Theory, vol. 57, no. 2, pp. 1111–1123, Feb., 2011.
[13]
Yue J, Xiao M, Pang Z . Distributed Fog Computing Based on Batched Sparse Codes for Industrial Control[J]. IEEE Transactions on Industrial Informatics, 2018, PP(10):1-1.
[14]
S. Li, M. Maddah-Ali, and A. Avestimehr, “Coded distributed computing: Straggling servers and multistage dataflows,” in Proc. of 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton), Monticello, IL, USA, Sep. 27-30, 2016, pp. 164–171.
[15]
S. Li, M. Maddah-Ali, and A. Avestimehr, “Fundamental tradeoff between computation and communication in distributed computing,” in Proc. of ISIT’16, Barcelona, Spain, Jul. 10-15, 2016, pp. 1814– 1818.
[16]
K. Lee, M. Lam, R. Pedarsani, D. Papailiopoulos, K. Ramchandran, “Speeding up distributed machine learning using codes,” in Proc. of ISIT’16, Barcelona, Spain, Jul. 10-15, 2016, pp. 1143–1147.
[17]
A. Severinson, A. Amat, and E. Rosnes, “Block-diagonal and LT codes for distributed computing with straggling servers,” IEEE Trans. Communications, vol. 67, no. 3, pp. 1739–1753, Mar., 2019.
[18]
Q. Yu, M. A. Maddah-Ali, and A. S. Avestimehr, “Straggler mitigation in distributed matrix multiplication: Fundamental limits and optimal coding,” in Proc. IEEE Int. Symp. Inf. Theory (ISIT), Jun. 2018, pp. 2022–2026.
[19]
Rensen J H S, Popovski P, Ostergaard J . Design and Analysis of LT Codes with Decreasing Ripple Size[J]. IEEE Transactions on Communications, 2012, 60(11):3191-3197.
[20]
Okpotse T, Yousefi S. Systematic fountain codes for massive storage using the truncated Poisson distribution[J]. IEEE Transactions on Communications, 2018, 67(2): 943-954.
Recommendations
Fog Computing: Issues and Challenges in Security and Forensics
COMPSAC '15: Proceedings of the 2015 IEEE 39th Annual Computer Software and Applications Conference - Volume 03Although Fog Computing is defined as the extension of the Cloud Computing paradigm, its distinctive characteristics in the location sensitivity, wireless connectivity, and geographical accessibility create new security and forensics issues and ...
Fog computing: from architecture to edge computing and big data processing
Cloud computing plays a vital role in processing a large amount of data. However, with the arrival of the Internet of Things, huge data are generated from these devices. Thus, there is the need for bringing characteristics of cloud closer to the request ...
Fog Computing: Platform and Applications
HOTWEB '15: Proceedings of the 2015 Third IEEE Workshop on Hot Topics in Web Systems and Technologies (HotWeb)Despite the broad utilization of cloud computing, some applications and services still cannot benefit from this popular computing paradigm due to inherent problems of cloud computing such as unacceptable latency, lack of mobility support and location-...
Comments
Information & Contributors
Information
Published In
April 2021
726 pages
ISBN:9781450383134
DOI:10.1145/3442442
Copyright © 2021 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 03 June 2021
Check for updates
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
WWW '21
Sponsor:
Acceptance Rates
Overall Acceptance Rate 1,899 of 8,196 submissions, 23%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 60Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)0
Reflects downloads up to 19 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format