利用图像的空间相对特征进行细粒度草图检索

FINE-GRAINED SKETCH-BASED IMAGE RETRIEVAL USING SPATIAL RELATIVE FEATURE OF IMAGES

  • 摘要: 细粒度草图检索(Fine-Grained Sketch-Based Image Retrieval,FG-SBIR)旨在以手绘草图作为查询样例进行图像数据的实例级检索。由于草图有偏移扭曲等问题难以在图像空间上与真实图像对齐,提出一种新的基于空间相对注意力(Spatial Relative Attention,SRA)模型的草图检索方法:使用坐标图提取空间感知特征,基于相对自注意力机制提取空间相对关系。同时引入对比损失 NT-Xent 以获取更强的特征表示。在两个公开数据集上的实验表明,该方法在检索准确率上超过了多个最新的细粒度草图检索方法。

     

    Abstract: Fine-grained sketch-based image retrieval (FG-SBIR) aims to use hand-drawn sketches as queries sample to perform instance-level retrieval in image databases. Due to problems such as offset and distortion, it is difficult for sketches to align with real images in space. A new FG-SBIR method based on spatial relative attention (SRA) is proposed. The coordinate map was used to extract spatial-aware features, and the spatial relative relationship was extracted based on the relative self-attention module. At the same time, a contrastive loss NT-Xent was introduced to obtain stronger feature representation. Experiments on two public datasets show that the method outperforms several state-of-the-art FG-SBIR methods on retrieval accuracy.

     

/

返回文章
返回