Journal Article

Assessing the Accuracy and Consistency of Six Fine-Resolution Global Land Cover Products Using a Novel Stratified Random Sampling Validation Dataset

Zhang, Xiao, Gao, Yuan, Liu, Liangyun, Wang, Jinqing, Liu, Wendi, Jiang, Mihang, Mi, Jun, Zhao, Tingting

2023

Overview

Over the past decades, benefiting from the development of computing capacity and the free access to Landsat and Sentinel imagery, several fine-resolution global land cover (GLC) products (with a resolution of 10 m or 30 m) have been developed (GlobeLand30, FROM-GLC30, GLC_FCS30, FROM-GLC10, European Space Agency (ESA) WorldCover and ESRI Land Cover). However, there is still a lack of consistency analysis or comprehensive accuracy assessment using a common validation dataset for these GLC products. In this study, a novel stratified random sampling GLC validation dataset (SRS_Val) containing 79,112 validation samples was developed using a visual interpretation method, significantly increasing the number of samples of heterogeneous regions and rare land-cover types. Then, we quantitatively assessed the accuracy of these six GLC products using the developed SRS_Val dataset at global and regional scales. The results reveal that ESA WorldCover achieved the highest overall accuracy (of 70.54% ± 9%) among the global 10 m land cover products, followed by FROM-GLC10 (68.95% ± 8%) and ESRI Land Cover (58.90% ± 7%) and that GLC_FCS30 had the best overall accuracy (of 72.55% ± 9%) among the global 30 m land cover datasets, followed by GlobeLand30 (69.96% ± 9%) and FROM-GLC30 (66.30% ± 8%). The mapping accuracy of the GLC products decreased significantly with the increased heterogeneity of landscapes, and all GLC products had poor mapping accuracies in countries with heterogeneous landscapes, such as some countries in Central and Southern Africa. Finally, we investigated the consistency of six GLC products from the perspective of area distributions and spatial patterns. It was found that the area consistencies between the five GLC products (except ESRI Land Cover) were greater than 85% and that the six GLC products showed large discrepancies in area consistency for grassland, shrubland, wetlands and bare land. In terms of spatial patterns, the totally inconsistent pixel proportions of the 10 m and 30 m GLC products were 23.58% and 14.12%, respectively, and these inconsistent pixels were mainly distributed in transition zones, complex terrains regions, heterogeneous landscapes, or mixed land-cover types. Therefore, the SRS_Val dataset well supports the quantitative evaluation of fine-resolution GLC products, and the assessment results provide users with quantitative metrics to select GLC products suitable for their needs.

• Publisher: MDPI AG
• Subject: Accuracy / accuracy assessment / Artificial satellites in remote sensing / Classification / Consistency / consistency analysis / Crowdsourcing / data collection / Datasets / global land cover / Grasslands / Heterogeneity / Image processing / Land cover / Landsat / Mapping / Methods / Performance evaluation / Pixels / Population density / Quantitative analysis / Random sampling / Regional development / Remote sensing / Sample size / Satellite imagery / shrublands / Southern Africa / Statistical sampling / stratified random sampling / Transition zone / validation