Machine Learning Based Unmanned Aerial Vehicle Enabled Fog-Radio Aerial Vehicle Enabled Fog-Radio Access Network and Edge Computing

doi:10.12142/ZTECOM.201904006

ZTE Communications ›› 2019, Vol. 17 ›› Issue (4): 33-45.DOI: 10.12142/ZTECOM.201904006

• Special Topic • Previous Articles Next Articles

Machine Learning Based Unmanned Aerial Vehicle Enabled Fog-Radio Aerial Vehicle Enabled Fog-Radio Access Network and Edge Computing

Mohammed SEID^1,²(), Stephen ANOKYE^1,³, SUN Guolin¹

^1.University of Electronic Science and Technology of China, Chengdu, Sichuan 611731, China
^2.Dilla University, Dilla, Ethiopia
^3.University of Mines and Technology, Tarkwa 237, Ghana

Received:2019-10-27 Online:2019-12-25 Published:2020-04-16
About author:Mohammed SEID (Julian. Ahrens@dfki.de)received his B. Sc. and M. Sc. degrees in computer sci? ence from Ambo University, Ethiopia in 2010 and Addis Ababa University, Ethiopia in 2015, respectively. He is currently pursuing his Ph. D. degree in computer science and technology at University of Electronic Science and Technology of China. From 2010 to 2016 he worked in Dilla University, Ethiopia as a graduate assistant and lecturer. His interests include mobile edge computing, fog computing, UAV networks, IoT, and 5G wireless networks.|Stephen ANOKYEreceived his M. Eng. degree in computer science from Hunan University, China in 2009 and his B. Sc. in computer science from Kwame Nkrumah University of Science and Technology, Ghana in 2004. He’s currently a Ph. D. candidate at the University of Electronic Science and Technology of China. Between 2010 and 2012, he worked as a lecturer in the department of computer science at Garden City University College in Ghana. Since 2012, he has become a lecturer at the Department of Computer Science and Engineering, the University of Mines and Technology, Ghana. His research interests are security in wireless sensor networks, mobile and cloud networks with AI, UAV networks, IoT, and 5G wireless networks.|SUN Guolinreceived his B. S. , M. S. and Ph. D. degrees all in communication and information system from University of Electronic Science and Technology of China (UESTC) in 2000, 2003 and 2005 respectively. After his Ph. D. graduation in 2005, he has got eightyear industrial work experience in wireless research and development for LTE, Wi-Fi, and IoT, Cognitive radio, Localization and navigation. Before he joined the UESTC as an associate professor in August 2012, he worked in Huawei Technologies Sweden. Dr. SUN has filed over 30 patents and published over 40 scientific conference and journal papers. He acted as TPC member of several conferences. Currently, he serves as a vice-chair of the 5G oriented cognitive radio SIG of the IEEE Technical Committee on Cognitive Networks (TCCN). His general research interests are software defined networks, network function virtualization, and radio resource management.

Abstract

Abstract:

The emerging unmanned aerial vehicle (UAV) technology and its applications have become part of the massive Internet of Things (mIoT) ecosystem for future cellular networks. Internet of things (IoT) devices have limited computation capacity and battery life and the cloud is not suitable for offloading IoT tasks due to the distance, latency and high energy consumption. Mobile edge computing (MEC) and fog radio access network (F-RAN) together with machine learning algorithms are an emerging approach to solving complex network problems as described above. In this paper, we suggest a new orientation with UAV enabled F-RAN architecture. This architecture adopts the decentralized deep reinforcement learning (DRL) algorithm for edge IoT devices which makes independent decisions to perform computation offloading, resource allocation, and association in the aerial to ground (A2G) network. Additionally, we summarized the works on machine learning approaches for UAV networks and MEC networks, which are related to the suggested architecture and discussed some technical challenges in the smart UAV-IoT, F-RAN 5G and Beyond 5G (6G).

Key words: unmanned aerial vehicle, machine learning, F-RAN, edge computing

Mohammed SEID, Stephen ANOKYE, SUN Guolin. Machine Learning Based Unmanned Aerial Vehicle Enabled Fog-Radio Aerial Vehicle Enabled Fog-Radio Access Network and Edge Computing[J]. ZTE Communications, 2019, 17(4): 33-45.

Figures/Tables 4

References 72

1	ASSUNÇÃO M D,CALHEIROS R N,BIANCHI S,et al.Big Data Computing and Clouds: Trends and Future Directions [J].Journal of Parallel and Distributed Computing,2015,79–80:3–15.DOI:10.1016/j.jpdc.2014.08.003 DOI
2	ALHADDADIN F,LIU W,GUTIERREZ J A.A User Profile⁃Aware Policy⁃Based Management Framework for Greening the Cloud [C]//IEEE Fourth International Conference on Big Data and Cloud Computing,Sydney, Australia,2014:682–687.DOI:10.1109/bdcloud.2014.116 DOI
3	DASTJERDI A V,GUPTA H,CALHEIROS R N,et al.Fog Computing: Principles, Architectures, and Applications [M]//Internet of Thing Principles and Paradigms,Burlington, USA:Morgan Kaufmann,2016.DOI:10.1016/b978-0-12-805395-9.00004-6 DOI
4	CHIANG M,ZHANG T.Fog and IoT: an Overview of Research Opportunities [J].IEEE Internet of Things Journal,2016,3(6):854–864.DOI:10.1109/jiot.2016.2584538 DOI
5	YU W,LIANG F,HE X,HATCHER W G,et al.A Survey on the Edge Computing for the Internet of Things [J].Mobile Edge Computing,2017,6(88):6900–6919.DOI:10.1109/access.2017.2778504 DOI
6	MAHMUD R,KOTAGIRI R,BUYYA R.Fog Computing: A Taxonomy, Survey and Future Directions [M]//Internet of Things.Singapore, Singapore:Springer,2017:103–130.DOI:10.1007/978-981-10-5861-5_5 DOI
7	GAO L X,LUAN T H,YU S,et al.FogRoute: DTN⁃Based Data Dissemination Model in Fog Computing [J].IEEE Internet of Things Journal,2016,4(1):225–235.DOI:10.1109/jiot.2016.2645559 DOI
8	YI S,LI C,LI Q.A Survey of Fog Computing: Concepts, Applications and Issues [C]//Proc.2015 Workshop on Mobile Big Data,New York, USA:Association for Computing Machinery,2015:37–42.DOI:10.1145/2757384.2757397 DOI
9	HU P F,DHELIM S,NING H S,et al.Survey on Fog Computing: Architecture, Key Technologies, Applications and Open Issues [J].Journal of Network and Computer Applications,2017,98:27–42.DOI:10.1016/j.jnca.2017.09.002 DOI
10	BACCARELLI E,NARANJO P G V,SCARPINITI M,et al.Fog of Everything: Energy⁃Efficient Networked Computing Architectures, Research Challenges, and a Case Study [J].IEEE Access,2017,5:9882–9910.DOI:10.1109/access.2017.2702013 DOI
11	VARSHNEY P,SIMMHAN Y.Demystifying Fog Computing: Characterizing Architectures, Applications and Abstractions [C]//IEEE 1st International Conference on Fog and Edge Computing (ICFEC),Madrid, Spain,2017:115–124.DOI:10.1109/icfec.2017.20 DOI
12	MOURADIAN C,NABOULSI D,YANGUI S M,et al.A Comprehensive Survey on Fog Computing: State⁃of⁃the⁃Art and Research Challenges [J].IEEE Communications Surveys & Tutorials,2018,20(1):416–464.DOI:10.1109/comst.2017.2771153 DOI
13	PERERA C,QIN Y R,ESTRELLA J C,et al.Fog Computing for Sustainable Smart Cities [J].ACM Computing Surveys (CSUR),2017,50(3):1–43.DOI:10.1145/3057266 DOI
14	YOUSEFPOUR A,FUNG C,NGUYEN T,et al.All One Needs to Know about Fog Computing and Related Edge Computing Paradigms: A Complete Survey [J].Journal of Systems Architecture,2019,98:289–330.DOI:10.1016/j.sysarc.2019.02.009 DOI
15	FRENCH A M,SHIM J P.The Digital Revolution: Internet of Things, 5G and Beyond [J].Communications of the Association for Information Systems (CAIS),206,38(40):40.DOI:10.17705/1CAIS.03840 DOI
16	MACH P,BECVAR Z.Mobile Edge Computing: A Survey on Architecture and Computation Offloading [J].IEEE Communications Surveys & Tutorials,2017,19(3):1628–1656.DOI:10.1109/ comst.2017.2682318 DOI
17	BUYYA R,SRIRAMA S N.Fog and Edge Computing: Principles and Paradigms [M].Hoboken,USA: John Wiley & Sons,2019.DOI:10.1002/9781119525080 DOI
18	ALNOMAN A,SHARMA S K,EJAZ W,et al.Emerging Edge Computing Technologies for Distributed IoT Systems [J].IEEE Network,2019,33(6):140–147.DOI:10.1109/mnet.2019.1800543 DOI
19	HUSAIN S,KUNZ A,PRASAD A,et al.Mobile Edge Computing with Network Resource Slicing for Internet⁃of⁃Things [C]//IEEE 4th World Forum on Internet of Things (WF-IoT).Singapore, Singapore,2018:1–6.DOI:10.1109/wf⁃iot.2018.8355232 DOI
20	BESHLEY H,BESHLEY M,MAKSYMYUK T,et al.Method of Centralized Resource Allocation in Virtualized Small Cells Network with IoT Overlay [C]//14th International Conference on Advanced Trends in Radioelecrtronics, Telecommunications and Computer Engineering (TCSET).Lviv⁃Slavske,Ukraine,2018:1147–1151.DOI:10.1109/tcset.2018.8336397 DOI
21	GUO H Z,LIU J J,ZHANG J,et al.Mobile⁃Edge Computation Offloading for Ultradense IoT Networks [J].IEEE Internet of Things Journal,2018,5(6):4977–4988.DOI:10.1109/jiot.2018.2838584 DOI
22	PARK Y,KIM S.Game⁃Based Data Offloading Scheme for IoT System Traffic Congestion Problems [J].EURASIP Journal on Wireless Communications and Networking,2015,2015(1):192.DOI:10.1186/s13638-015-0418-y DOI
23	ZHANG H J,QIU Y,CHU X L,et al.Fog Radio Access Networks: Mobility Management, Interference Mitigation, and Resource Optimization [J].IEEE Wireless Communications,2017,24(6):120–127.DOI:10.1109/mwc.2017.1700007 DOI
24	TRAN T X,HAJISAMI A,PANDEY P,et al.Collaborative Mobile Edge Computing in 5G Networks: New Paradigms, Scenarios, and Challenges [J].IEEE Communications Magazine,2017,55(4):54–61.DOI:10.1109/mcom.2017.1600863 DOI
25	ZENG Y,WU Q Q,ZHANG R.Accessing from the Sky: A Tutorial on UAV Communications for 5G and Beyond [J].Proceedings of the IEEE,2019,107(12):2327–2375.DOI:10.1109/jproc.2019.2952892 DOI
26	HOSSEIN MOTLAGH N,TALEB T,AROUK O.Low⁃Altitude Unmanned Aerial Vehicles⁃Based Internet of Things Services: Comprehensive Survey and Future Perspectives [J].IEEE Internet of Things Journal,2016,3(6):899–922.DOI:10.1109/jiot.2016.2612119 DOI
27	MOZAFFARI M,SAAD W,BENNIS M,et al.A Tutorial on UAVs for Wireless Networks: Applications, Challenges, and Open Problems [J].IEEE Communications Surveys & Tutorials,2019,21(3):2334–2360.DOI:10.1109/comst.2019.2902862 DOI
28	FENG W,WANG J C,CHEN Y F,et al.UAV⁃Aided MIMO Communications for 5G Internet of Things [J].IEEE Internet of Things Journal,2019,6(2):1731–1740.DOI:10.1109/jiot.2018.2874531 DOI
29	WANG J J,JIANG C X,ZHANG H J,et al.Thirty Years of Machine Learning: The Road to Pareto⁃Optimal Next⁃Generation Wireless Networks [EB/OL]. (2019-01-24).
30	BOUTABA R,SALAHUDDIN M A,LIMAM N,et al.A Comprehensive Survey on Machine Learning for Networking: Evolution, Applications and Research Opportunities [J].Journal of Internet Services and Applications,2018,9(1):16.DOI:10.1186/s13174-018-0087-2 DOI
31	LUONG N C,HOANG D T,GONG S M,et al.Applications of Deep Reinforcement Learning in Communications and Networking: A Survey [J].IEEE Communications Surveys & Tutorials,2019,21(4):3133–3174.DOI:10.1109/comst.2019.2916583 DOI
32	CHEN M Z,CHALLITA U,SAAD W,et al.Artificial Neural Networks⁃Based Machine Learning for Wireless Networks: A Tutorial [J].IEEE Communications Surveys & Tutorials,2019,21(4):3039–3071.DOI:10.1109/comst.2019.2926625 DOI
33	KLAINE P V,IMRAN M A,ONIRETI O,et al.A Survey of Machine Learning Techniques Applied to Self⁃Organizing Cellular Networks [J].IEEE Communications Surveys & Tutorials,2017,19(4):2392–2431.DOI:10.1109/comst.2017.2727878 DOI
34	SUN Y H,PENG M G,ZHOU Y C,et al.Application of Machine Learning in Wireless Networks: Key Techniques and Open Issues [J].IEEE Communications Surveys & Tutorials,2019,21(4):3072–3108.DOI:10.1109/comst.2019.2924243 DOI
35	FOTOUHI A,QIANG H R,DING M,et al.Survey on UAV Cellular Communications: Practical Aspects, Standardization Advancements, Regulation, and Security Challenges [J].IEEE Communications Surveys & Tutorials,2019,21(4):3417–3442.DOI:10.1109/comst.2019.2906228 DOI
36	ZHANG J,ZHOU L,TANG Q,et al.Stochastic Computation Offloading and Trajectory Scheduling for UAV⁃Assisted Mobile Edge Computing [J].IEEE Internet of Things Journal,2018,6(2):3688–3699.DOI:10.1109/jiot.2018.2890133 DOI
37	CHENG F,ZHANG S,LI Z,et al.UAV Trajectory Optimization for Data Offloading at the Edge of Multiple Cells [J].IEEE Transactions on Vehicular Technology,2018,67(7):6732–6736.DOI:10.1109/tvt.2018.2811942 DOI
38	LIU B C,HUANG H W,GUO S,et al.Joint Computation Offloading and Routing Optimization for UAV⁃Edge⁃Cloud Computing Environments [C]//IEEE SmartWorld,Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), Guangzhou, China,2018:1745–1752.DOI:10.1109/smartworld.2018.00295 DOI
39	TI N T,LE L B.Joint Resource Allocation, OffloadingComputation, and Path Planning for UAV Based Hierarchical Fog⁃Cloud Mobile Systems[C]//IEEE Seventh International Conference on Communications and Electronics (ICCE),Hue, Vietnam,2018:373–378.DOI:10.1109/cce.2018.8465572 DOI
40	MERWADAY A,GUVENC I.UAV Assisted Heterogeneous Networks for Public Safety Communications[C]//IEEE Wireless Communications and Networking Conference Workshops (WCNCW),New Orleans, USA,2015:329–334.DOI:10.1109/wcncw.2015.7122576 DOI
41	HAINZL M.Integrating UAVs into Public Safety LTE Networks [R],Tech.Rep.,2014.
42	ZHAO N,LU W D,SHENG M,et al.UAV⁃Assisted Emergency Networks in Disasters [J].IEEE Wireless Communications,2019,26(1):45–51.DOI:10.1109/mwc.2018.1800160 DOI
43	LIU X N,LI Z,ZHAO N,et al.Transceiver Design and Multi-Hop D2D for UAV IoT Coverage in Disasters [J].IEEE Internet of Things Journal,2018,6(2):1803–1815.DOI:10.1109/jiot.2018.2877504 DOI
44	MOHRI M,ROSTAMIZADEH A,TALWALKAR A.Foundations of Machine Learning[M].Cambridge, USA:MIT press,2012
45	SUTTON R S,BARTO A G.Reinforcement Learning: An Introduction [M].Cambridge, USA:MIT press,1998.DOI:10.1109/tnn.1998.712192 DOI
46	HOWARD R A.Dynamic Programming and Markov Processes [M].New York, USA:Technology Press of the Massachusetts Institute of Technology,1960.DOI:10.2307/2312519 DOI
47	MNIH V,KAVUKCUOGLU K,SILVER D,et al.Human⁃Level Control through Deep Reinforcement Learning [J].Nature,2015,518(7540):529–533.DOI:10.1038/nature14236 DOI
48	MNIH V,BADIA A P,MIRZA M,et al.Asynchronous Methods for Deep Reinforcement Learning [C]//International Conference on Machine Learning,New York, USA,2016:1928–1937
49	LILLICRAP T P,HUNT J J,PRITZEL A,et al.Continuous Control with Deep Reinforcement Learning [EB/OL]. (2015-09-09).
50	HE Y,ZHANG Z,ZHANG Y H.A Big Data Deep Reinforcement Learning Approach to Next Generation Green Wireless Networks [C]//IEEE Global Communications Conference,Singapore, Singapore,2017:1–6.DOI:10.1109/glocom.2017.8254717 DOI
51	YU S,WANG X,LANGAR R.Computation Offloading for Mobile Edge Computing: A Deep Learning Approach [C]//IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).Montreal,Canada,2017:1–6.DOI:10.1109/pimrc.2017.8292514 DOI
52	HE Y,LIANG C C,ZHANG Z,et al.Resource Allocation in Software⁃Defined and Information⁃Centric Vehicular Networks with Mobile Edge Computing [C]//IEEE 86th Vehicular Technology Conference (VTC-Fall),Toronto, Canada,2017:1–5.DOI:10.1109/vtcfall.2017.8288203 DOI
53	HE Y,ZHAO N,YIN H X.Integrated Networking, Caching, and Computing for Connected Vehicles: A Deep Reinforcement Learning Approach [J].IEEE Transactions on Vehicular Technology,2018,67(1):44–55.DOI:10.1109/tvt.2017.2760281 DOI
54	HE Y,YU F R,ZHAO N,et al.Software⁃Defined Networks with Mobile Edge Computing and Caching for Smart Cities: A Big Data Deep Reinforcement Learning Approach [J].IEEE Communications Magazine,2017,55(12):31–37.DOI:10.1109/mcom.2017.1700246 DOI
55	ZHANG C,LIU Z,GU B,et al.A Deep Reinforcement Learning Based Approach for Cost⁃ and Energy⁃Aware Multi⁃Flow Mobile Data Offloading [J].IEICE Transactions on Communications,2018, E101.B(7:1625–1634.DOI:10.1587/transcom.2017cqp0014 DOI
56	TAN L T,HU R Q.Mobility⁃Aware Edge Caching and Computing in Vehicle Networks: A Deep Reinforcement Learning [J].IEEE Transactions on Vehicular Technology,2018,67(11):10190–10203.DOI:10.1109/tvt.2018.2867191 DOI
57	LI J,GAO H,LV T,et al.Deep Reinforcement Learning Based Computation Offloading and Resource Allocation for MEC [C]//2018 IEEE Wireless Communications and Networking Conference (WCNC).Barcelona, Spain,2018:1–6.DOI:10.1109/wcnc.2018.8377343 DOI
58	CHEN X F,ZHANG H G,WU C,et al.Performance Optimization in Mobile⁃Edge Computing Via Deep Reinforcement Learning[C]//2018 IEEE 88th Vehicular Technology Conference (VTC-Fall).Chicago, USA,2018.DOI:10.1109/vtcfall.2018.8690980 DOI
59	CHEN X F,ZHANG H G,WU C,et al.Optimized Computation Offloading Performance in Virtual Edge Computing Systems Via Deep Reinforcement Learning [J].IEEE Internet of Things Journal,2019,6(3):4005–4018.DOI:10.1109/jiot.2018.2876279 DOI
60	MIN M H,XIAO L,CHEN Y,et al.Learning⁃Based Computation Offloading for IoT Devices with Energy Harvesting [J].IEEE Transactions on Vehicular Technology,2019,68(2):1930–1941.DOI:10.1109/tvt.2018.2890685 DOI
61	QUAN L,WANG Z L,REN F J.A Novel Two⁃Layered Reinforcement Learning for Task Offloading with Tradeoff Between Physical Machine Utilization Rate and Delay [J].Future Internet,2018,10(7):60.DOI:10.3390/fi10070060 DOI
62	HUANG L,FENG X,ZHANG L X,et al.Multi⁃Server Multi⁃User Multi⁃Task Computation Offloading for Mobile Edge Computing Networks [J].Sensors,2019,19(6):1446.DOI:10.3390/s19061446 DOI
63	GHANAVI R,KALANTARI E,SABBAGHIAN M,et al.Efficient 3D Aerial Base Station Placement Considering Users Mobility by Reinforcement Learning [C]//IEEE Wireless Communications and Networking Conference (WCNC),Barcelona, Spain,2018:1–6.DOI:10.1109/wcnc.2018.8377340 DOI
64	WU J,YU P,FENG L,et al.3D Aerial Base Station Position Planning Based on Deep Q⁃network for Capacity Enhancement [C]//FIP/IEEE Symposium on Integrated Network and Service Management (IM),Arlington, USA,2019:482–487
65	ZHANG Q Q,SAAD W,BENNIS M,et al.Predictive Deployment of UAV Base Stations in Wireless Networks: Machine Learning Meets Contract Theory [EB/OL]. (2018-11-03).
66	VALENTINO R,JUNG W S,KO Y B.A Design and Simulation of the Opportunistic Computation Offloading with Learning⁃Based⁃Prediction for Unmanned Aerial Vehicle (UAV) Clustering Networks [J].Sensors,2018,18(11):3751.DOI:10.3390/s18113751 DOI
67	BAYERLEIN H,DE KERRET P,GESBERT D.Trajectory Optimization for Autonomous Flying Base Station via Reinforcement Learning [C]//IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC),Kalamata, Greece,2018:1–5.DOI:10.1109/spawc.2018.8445768 DOI
68	CUI J J,LIU Y W,NALLANATHAN A.Multi⁃Agent Reinforcement Learning Based Resource Allocation for UAV Networks [J].IEEE Transactions on Wireless Communications,2019:1.DOI:10.1109/twc.2019.2935201 DOI
69	LIU C H,CHEN Z Y,TANG J,et al.Energy⁃Efficient UAV Control for Effective and Fair Communication Coverage: A Deep Reinforcement Learning Approach [J].IEEE Journal on Selected Areas in Communications,2018,36(9):2059–2070.DOI:10.1109/jsac.2018.2864373 DOI
70	NAWAZ S J,SHARMA S K,WYNE S,et al.Quantum Machine Learning for 6G Communication Networks: State⁃of⁃the⁃Art and Vision for the Future [J].IEEE Access,2019,7:46317–46350.DOI:10.1109/access.2019.2909490 DOI
71	LETAIEF K B,CHEN W,SHI Y M,et al.The Roadmap to 6G: AI Empowered Wireless Networks [J].IEEE Communications Magazine,2019,57(8):84–90.DOI:10.1109/mcom.2019.1900271 DOI
72	O’BRIEN C.Why 6G Research Is Starting Before We Have 5G[EB/OL]. (2019-7-1).

Terrestrial Networks	UAV Networks
Insufficient spectrum	Insufficient spectrum
Well defined energy constraints and models	Elaborate and stringent energy constraints and models
Mainly static association	Varying cell association
No timing constraints, with BS being always there	Hover and flight time constraints
Terrestrial BS	UAV BS
Typical two-dimensional deployment	By nature, three-dimensional deployment
Mostly long-term and permanent deployments	Short-term and frequently changing deployments
Few and selected locations	Mostly unrestricted locations
Fixed and static	Mobility dimension
Not suitable for mobility tracking	Suitable for mobility tracking

Terrestrial Networks	UAV Networks
Insufficient spectrum	Insufficient spectrum
Well defined energy constraints and models	Elaborate and stringent energy constraints and models
Mainly static association	Varying cell association
No timing constraints, with BS being always there	Hover and flight time constraints
Terrestrial BS	UAV BS
Typical two-dimensional deployment	By nature, three-dimensional deployment
Mostly long-term and permanent deployments	Short-term and frequently changing deployments
Few and selected locations	Mostly unrestricted locations
Fixed and static	Mobility dimension
Not suitable for mobility tracking	Suitable for mobility tracking

Paper	Network	Agent	Model	Learning Algorithm
[50]	CRN	Base station	MDP	DQN using FNN
[52]	Vehicular Network	Service Provider	MDP	DQN using FNN
[53]	Vehicular Network	Service Provider	MDP	DQN using CNN
[55]	Cellular System	Base Station	MDP	DQN using CNN
[56]	Cellular System	Mobile User	MDP	DQN using CNN
[57]	Cellular System	Base Station	MDP	DQN using FNN
[58]	Cellular System	Mobile User	MDP	DQN using FNN
[59]	Cellular System	Mobile User	MDP	DDQN, SARSA
[60]	Cellular System	Mobile User	Game theory	DQN using CNN, Q-learning

Paper	Network	Agent	Model	Learning Algorithm
[50]	CRN	Base station	MDP	DQN using FNN
[52]	Vehicular Network	Service Provider	MDP	DQN using FNN
[53]	Vehicular Network	Service Provider	MDP	DQN using CNN
[55]	Cellular System	Base Station	MDP	DQN using CNN
[56]	Cellular System	Mobile User	MDP	DQN using CNN
[57]	Cellular System	Base Station	MDP	DQN using FNN
[58]	Cellular System	Mobile User	MDP	DQN using FNN
[59]	Cellular System	Mobile User	MDP	DDQN, SARSA
[60]	Cellular System	Mobile User	Game theory	DQN using CNN, Q-learning

[1]	WEI Zhiqing, ZHANG Yongji, JI Danna, LI Chenfei. Sensing and Communication Integrated Fast Neighbor Discovery for UAV Networks [J]. ZTE Communications, 2024, 22(3): 69-82.
[2]	ZHAO Yaqiong, KE Hongqin, XU Wei, YE Xinquan, CHEN Yijian. RIS-Assisted Cell-Free MIMO: A Survey [J]. ZTE Communications, 2024, 22(1): 77-86.
[3]	CHEN Jiajun, GAO Yin, LIU Zhuang, LI Dapeng. Future Vision on Artificial Intelligence Assisted Green Energy Efficiency Network [J]. ZTE Communications, 2023, 21(2): 34-39.
[4]	AWADA Uchechukwu, ZHANG Jiankang, CHEN Sheng, LI Shuangzhi, YANG Shouyi. Machine Learning Driven Latency Optimization for Internet of Things Applications in Edge Computing [J]. ZTE Communications, 2023, 21(2): 40-52.
[5]	LI Yuting, DING Yi, GAO Jiangchuan, LIU Yusha, HU Jie, YANG Kun. UAV Autonomous Navigation for Wireless Powered Data Collection with Onboard Deep Q-Network [J]. ZTE Communications, 2023, 21(2): 80-87.
[6]	CAI Weibo, YANG Shulin, SUN Gang, ZHANG Qiming, YU Hongfang. Adaptive Load Balancing for Parameter Servers in Distributed Machine Learning over Heterogeneous Networks [J]. ZTE Communications, 2023, 21(1): 72-80.
[7]	ZHAO Zipiao, ZHAO Yongli, YAN Boyuan, WANG Dajiang. Auxiliary Fault Location on Commercial Equipment Based on Supervised Machine Learning [J]. ZTE Communications, 2022, 20(S1): 7-15.
[8]	CAO Yinfeng, CAO Jiannong, WANG Yuqin, WANG Kaile, LIU Xun. Security in Edge Blockchains: Attacks and Countermeasures [J]. ZTE Communications, 2022, 20(4): 3-14.
[9]	NAN Yucen, FANG Minghao, ZOU Xiaojing, DOU Yutao, Albert Y. ZOMAYA. A Collaborative Medical Diagnosis System Without Sharing Patient Data [J]. ZTE Communications, 2022, 20(3): 3-16.
[10]	LI Xiuxian, LI Zhetao, OUYANG Yan, DUAN Haohua, XIANG Liyao. Using UAV to Detect Truth for Clean Data Collection in Sensor‑Cloud Systems [J]. ZTE Communications, 2021, 19(3): 30-45.
[11]	LIU Zhuang, GAO Yin, LI Dapeng, CHEN Jiajun, HAN Jiren. Enabling Energy Efficiency in 5G Network [J]. ZTE Communications, 2021, 19(1): 20-29.
[12]	LIN Xinhua, ZHANG Jing, LI Qiang. Cluster Head Selection Algorithm for UAV Assisted Clustered IoT Network Utilizing Blockchain [J]. ZTE Communications, 2021, 19(1): 30-38.
[13]	SHI Wenqi, SUN Yuxuan, HUANG Xiufeng, ZHOU Sheng, NIU Zhisheng. Scheduling Policies for Federated Learning in Wireless Networks: An Overview [J]. ZTE Communications, 2020, 18(2): 11-19.
[14]	WU Hequan. Ten Reflections on 5G [J]. ZTE Communications, 2020, 18(1): 1-4.
[15]	Julian AHRENS, Lia AHRENS, Hans D. SCHOTTEN. A Machine Learning Method for Prediction of Multipath Channels [J]. ZTE Communications, 2019, 17(4): 12-18.

Machine Learning Based Unmanned Aerial Vehicle Enabled Fog-Radio Aerial Vehicle Enabled Fog-Radio Access Network and Edge Computing

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 4

References 72

Related Articles 15

Recommended Articles

Metrics