Lu, WenNguyen, Minh2024-05-162024-05-162024-05-07IEEE Geoscience and Remote Sensing Letters, ISSN: 1545-598X (Print); 1558-0571 (Online), Institute of Electrical and Electronics Engineers (IEEE), PP(99), 1-1. doi: 10.1109/lgrs.2024.33976731545-598X1558-0571http://hdl.handle.net/10292/17554The heightened revisiting frequency and expanded observation capabilities of satellites lead to the daily generation of a substantial volume of remote sensing images. Retrieving relevant data accurately from this extensive archive holds significant importance. Deep learning content-based image retrieval (CBIR) uses a feature extraction network pretrained on image classification tasks to derive image-level features. Subsequently, a similarity measure is applied on these features to identify the archive images most closely resembling the query image. While image-level labels facilitate CBIR in retrieving images from the same category as the query image, they do not empower CBIR to differentiate between implicit subcategories. For instance, although CBIR can discern between broader categories such as “residential” and “forest,” it lacks the necessary semantic statistical information to distinguish more nuanced distinctions such as “high-density residential” from “medium-density residential.” To enhance image retrieval for greater similarity, we propose a hierarchical image retrieval (HIR) approach that combines visual similarity with semantic statistics. In the first stage, visually similar images are identified using CBIR, while the second stage refines the selection based on semantic similarity derived from land-cover classification. The experimental results indicate that HIR achieves 20% higher retrieval accuracy for “residential” subcategories and over 1% increase in retrieval accuracy across all classes.Copyright © 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.3709 Physical Geography and Environmental Geoscience37 Earth Sciences40 Engineering4013 Geomatic Engineering3704 Geoinformatics15 Life on Land0801 Artificial Intelligence and Image Processing0906 Electrical and Electronic Engineering0909 Geomatic EngineeringGeological & Geomatics Engineering3704 Geoinformatics3709 Physical geography and environmental geoscience4013 Geomatic engineeringJournal ArticleOpenAccess10.1109/lgrs.2024.3397673