v1.0withoutAck
This commit is contained in:
+18
-2
@@ -2,11 +2,27 @@
|
||||
% Public domain.
|
||||
|
||||
\begin{cabstract}
|
||||
\pkuthssffaq % 中文测试文字。
|
||||
近些年随着卫星互联网、手机直连卫星以及第六代无线通信技术的发展,卫星通信的需求有了巨大的发展。目前,卫星多采用多波束以及频率复用等技术来应对巨大的通信需求
|
||||
但受限于功率、频率等资源,卫星通信系统的资源分配问题变得愈发复杂。除此之外,卫星通信的业务存在着空间分布和时间分布不均匀,服务质量要求多样等特点,这要求寻找到一种有效的动态资源分配算法,提升卫星通信系统整体的资源利用率。
|
||||
|
||||
本文针对卫星通信系统中资源分配进行了研究,主要针对两个方面的问题,一个是考虑时空关联性的动态信道分配问题,另一个考虑卫星跳波束的动态规划问题。本文在研究方法主要与目前广受关注的深度强化学习技术相结合,在信道分配问题上利用神经网络发掘时空关联性,在跳波束问题上利用多智能体等技术解决跳波束问题信道与波束点亮联合分配的问题。
|
||||
|
||||
首先,本文概述了多波束卫星通信系统的基本架构、卫星的信道传输特性以及马尔科夫决策过程和强化学习等技术的基本知识。然后,建立起基于深度强化学习的信道分配问题的基本场景与用户通信模型。为了保证用户质量通信质量,设计一用户通信的阻塞率作为优化目标,设计了基于深度强化学习的动态信道分配算法。该算法以将用户的地理位置通过状态转换使用多通道的图片描述。通过基于卷积神经网络和深度Q网络的求解得到实时的信道分配策略。仿真结果表明,基于深度强化学习的信道分配算法相比其他算法,能够有效保证系统的接通率,提高频谱效率。
|
||||
|
||||
最后,针对跳波束问题,本文概述了跳波束卫星通信系统的前向链路模型,以优化通信吞吐量和时延的公平性为优化目标函数,建立起基于深度强化学习的跳波束与信道联合分配算法。该算法包含两个独立的深度Q网络,分别对波束点亮方案和信道分配方式进行优化,通过多头输出的方式解决跳波束分配问题中空间复杂度过高的问题。仿真结果表明,与传统算法相比,该方法能有效提高系统的吞吐量,并且能够保证系统的时延公平性,同时相比遗传算法等启发式算法能够有效减少系统的决策时间,能够应对动态变化的系统环境。
|
||||
\end{cabstract}
|
||||
|
||||
\ifblind\begin{beabstract}\else\begin{eabstract}\fi
|
||||
Test of the English abstract.
|
||||
|
||||
In recent years, with the development of satellite internet, direct satellite connections for mobile phones, and sixth-generation wireless communication technologies, the demand for satellite communication has experienced significant growth. Currently, satellites often employ multiple techniques such as multi-beam and frequency reuse to meet the vast communication needs.
|
||||
|
||||
However, limited by resources such as power and frequency, the resource allocation problem in satellite communication systems has become increasingly complex. In addition, the services in satellite communication have characteristics like uneven spatial and temporal distribution and diverse quality of service requirements. This demands an effective dynamic resource allocation algorithm to enhance the overall resource utilization of satellite communication systems.
|
||||
|
||||
This paper focuses on the resource allocation in satellite communication systems, mainly addressing two issues: one is the dynamic channel allocation problem considering spatiotemporal correlations, and the other is the dynamic planning problem for satellite beam hopping. The study primarily combines the currently popular deep reinforcement learning techniques, using neural networks to explore spatiotemporal correlations in channel allocation and multi-agent technologies to solve the joint allocation problem of channel and beam lighting in the beam hopping issue.
|
||||
|
||||
First, this paper outlines the basic architecture of multi-beam satellite communication systems, the channel transmission characteristics of satellites, and the fundamental knowledge of Markov decision processes and reinforcement learning. Then, it establishes the basic scenario and user communication model for the channel allocation problem based on deep reinforcement learning. To ensure the quality of user communication, the user communication blocking rate is designed as the optimization objective, and a dynamic channel allocation algorithm based on deep reinforcement learning is developed. This algorithm describes the user's geographic location through state transitions using multi-channel images. The real-time channel allocation strategy is obtained through solutions based on convolutional neural networks and deep Q networks. Simulation results show that the channel allocation algorithm based on deep reinforcement learning can effectively ensure the system's connection rate and improve spectral efficiency compared to other algorithms.
|
||||
|
||||
Finally, for the beam hopping issue, this paper outlines the forward link model of the beam hopping satellite communication system and establishes the joint allocation algorithm for beam hopping and channels based on deep reinforcement learning, with the optimization of communication throughput and fairness of delay as the objective function. This algorithm contains two independent deep Q networks, optimizing the beam lighting scheme and channel allocation method, respectively, and solves the problem of high spatial complexity in beam hopping allocation using multi-head output. Simulation results indicate that compared to traditional algorithms, this method can effectively improve the system's throughput and ensure the fairness of system delay. Compared to heuristic algorithms like genetic algorithms, it can significantly reduce the system's decision time, enabling it to cope with dynamically changing environments.
|
||||
\ifblind\end{beabstract}\else\end{eabstract}\fi
|
||||
|
||||
% vim:ts=4:sw=4
|
||||
|
||||
Reference in New Issue
Block a user