基于GAN的社会和场景感知行人轨迹预测

SOCIAL AND SCENE AWARENESS PEDESTRIAN TRAJECTORY PREDICTION BASED ON GAN

  • 摘要: 针对状态精细化长短期记忆网络(SR-LSTM)未考虑周围物理场景对行人轨迹预测的影响,且无法生成多种可能性样本的问题,提出一种基于生成对抗网络(Generative Adversarial Networks,GAN)的社会和场景感知行人轨迹预测模型。此模型引入社会注意力及语义池机制,社会注意力建模邻人当前重要意图,以从相邻行人中选择重要的信息,语义池定义物理场景语义并学习与行人轨迹相关性。由于GAN易发生模式崩溃和下降,采用Info-GAN进行训练生成更真实的样本。在ETH和UYC两个数据集上进行实验,结果表明该方法较于SR-LSTM,ADE降低8.9百分点,FDE降低12.8百分点,且可生成更多合理的样本。

     

    Abstract: In order to solve the problem that state refinement for LSTM (SR-LSTM) does not consider the influence of surrounding physical scenes on pedestrian trajectory prediction, and can not generate a variety of possible samples, a social and scene awareness pedestrian trajectory prediction model based on GAN is proposed. This model introduced social attention and semantic pool mechanism, and social attention mechanism was used to model the current important intention of adjacent pedestrians in order to select important information from adjacent pedestrians. Semantic pools defined the semantics of physical scenes and learn their correlation with pedestrian tracks. Because GAN was prone to mode collapse and decline, Info-GAN was used for antagonistic training to generate more real samples. The experiments on ETH and UYC data sets show that compared with SR-LSTM, ADE of this method is 8.9 percentage points lower and FDE is 12.8 percentage points lower, and more reasonable samples can be generated.

     

/

返回文章
返回