Enhancing Remote Sensing Image Retrieval: A Hierarchical Approach Integrating Visual and Semantic Similarities
Date
Authors
Supervisor
Item type
Journal Article
Degree name
Journal Title
Journal ISSN
Volume Title
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Abstract
The heightened revisiting frequency and expanded observation capabilities of satellites lead to the daily generation of a substantial volume of remote sensing images. Retrieving relevant data accurately from this extensive archive holds significant importance. Deep learning content-based image retrieval (CBIR) uses a feature extraction network pretrained on image classification tasks to derive image-level features. Subsequently, a similarity measure is applied on these features to identify the archive images most closely resembling the query image. While image-level labels facilitate CBIR in retrieving images from the same category as the query image, they do not empower CBIR to differentiate between implicit subcategories. For instance, although CBIR can discern between broader categories such as “residential” and “forest,” it lacks the necessary semantic statistical information to distinguish more nuanced distinctions such as “high-density residential” from “medium-density residential.” To enhance image retrieval for greater similarity, we propose a hierarchical image retrieval (HIR) approach that combines visual similarity with semantic statistics. In the first stage, visually similar images are identified using CBIR, while the second stage refines the selection based on semantic similarity derived from land-cover classification. The experimental results indicate that HIR achieves 20% higher retrieval accuracy for “residential” subcategories and over 1% increase in retrieval accuracy across all classes.Description
Keywords
3709 Physical Geography and Environmental Geoscience, 37 Earth Sciences, 40 Engineering, 4013 Geomatic Engineering, 3704 Geoinformatics, 15 Life on Land, 0801 Artificial Intelligence and Image Processing, 0906 Electrical and Electronic Engineering, 0909 Geomatic Engineering, Geological & Geomatics Engineering, 3704 Geoinformatics, 3709 Physical geography and environmental geoscience, 4013 Geomatic engineering
Source
IEEE Geoscience and Remote Sensing Letters, ISSN: 1545-598X (Print); 1558-0571 (Online), Institute of Electrical and Electronics Engineers (IEEE), PP(99), 1-1. doi: 10.1109/lgrs.2024.3397673
Publisher's version
Rights statement
Copyright © 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.