Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
110
result(s) for
"Reinartz, P."
Sort by:
BUILDING EXTRACTION FROM REMOTE SENSING DATA USING FULLY CONVOLUTIONAL NETWORKS
2017
Building detection and footprint extraction are highly demanded for many remote sensing applications. Though most previous works have shown promising results, the automatic extraction of building footprints still remains a nontrivial topic, especially in complex urban areas. Recently developed extensions of the CNN framework made it possible to perform dense pixel-wise classification of input images. Based on these abilities we propose a methodology, which automatically generates a full resolution binary building mask out of a Digital Surface Model (DSM) using a Fully Convolution Network (FCN) architecture. The advantage of using the depth information is that it provides geometrical silhouettes and allows a better separation of buildings from background as well as through its invariance to illumination and color variations. The proposed framework has mainly two steps. Firstly, the FCN is trained on a large set of patches consisting of normalized DSM (nDSM) as inputs and available ground truth building mask as target outputs. Secondly, the generated predictions from FCN are viewed as unary terms for a Fully connected Conditional Random Fields (FCRF), which enables us to create a final binary building mask. A series of experiments demonstrate that our methodology is able to extract accurate building footprints which are close to the buildings original shapes to a high degree. The quantitative and qualitative analysis show the significant improvements of the results in contrast to the multy-layer fully connected network from our previous work.
Journal Article
DIGITAL ELEVATION MODELS FROM STEREO, VIDEO AND MULTI-VIEW IMAGERY CAPTURED BY SMALL SATELLITES
2021
Small satellites play an increasing role in earth observation. This article evaluates different possibilities of utilizing data from Planet’s SkySat and PlanetScope satellites constellations for derivation of digital elevation models. While SkySat provides high resolution image data with a ground sampling distance of up to 50 cm, the PlanetScope constellation consisting of Dove 3U cubesats provide images with a resolution of around 4 m. The PlanetScope acquisition strategy was not designed for stereo acquisitions, but for daily acquisition of nadir viewing imagery. Multiple different products can be acquired by the SkySat satellites: Collects covering an area of usually 12 by 6 km, tri-stereo collects and video products with a framerate of 30 Hz. This study evaluates DSM generation using a Semi-Global Matching from multi date stereo pairs for SkySat and PlanetScope, and the dedicated Video and tri-stereo SkySat acquisitions. DSMs obtained by merging many PlanetScope across track stereo pairs show an normalized median deviation against LiDaR first pulse data of 5.2 meter over diverse landcover at the test sites around the city of Terrassa in Catalonia, Spain. SkySat tri-stereo products with 80 cm resolution reach an NMAD of 1.3 m over Terrassa.
Journal Article
GENERATING ARTIFICIAL NEAR INFRARED SPECTRAL BAND FROM RGB IMAGE USING CONDITIONAL GENERATIVE ADVERSARIAL NETWORK
2020
Near infrared bands (NIR) provide rich information for many remote sensing applications. In addition to deriving useful indices to delineate water and vegetation, near infrared channels could also be used to facilitate image pre-processing. However, synthesizing bands from RGB spectrum is not an easy task. The inter-correlations between bands are not clearly identified in physical models. Generative adversarial networks (GAN) have been used in many tasks such as generating photorealistic images, monocular depth estimation and Digital Surface Model (DSM) refinement etc. Conditional GAN is different in that it observes some data as a condition. In this paper, we explore a cGAN network structure to generate a NIR spectral band that is conditioned on the input RGB image. We test different discriminators and loss functions, and evaluate results using various metrics. The best simulated NIR channel has a mean absolute error of around 5 percent in Sentinel-2 dataset. In addition, the simulated NIR image can correctly distinguish between various classes of landcover.
Journal Article
FDG-PET in patients with painful hip and knee arthroplasty: technical breakthrough or just more of the same
by
Reinartz, P
in
Accuracy
,
Arthroplasty, Replacement, Hip - adverse effects
,
Arthroplasty, Replacement, Knee - adverse effects
2009
The two major complications of joint replacement are loosening and infection. A reliable differentiation between these pathological processes can be challenging because both are accompanied by similar clinical symptoms. Nuclear medicine examinations are frequently used in the management of patients with painful arthroplasty since they are not impaired by the metallic implants. This report evaluates the pooled data of the major publications in the English literature analyzing the accuracy of the triple-phase bone scan (TPBS), white blood cell imaging (WBC imaging) and positron emission tomography (PET). TPBS yielded the least favorable results with an accuracy of 80% for hip prostheses and 81% for knee arthroplasty. PET finished second with values of 89% (hip) and 83% (knee), respectively. WBC imaging exceeded the results of TPBS and PET, yielding values of 91% (hip) and 84% (knee). Although bested by WBC imaging, PET is still highly attractive since it combines several of the positive aspects of the two other methods. Its accuracy is only slightly lower than that of WBC imaging while at the same time it provides most of the comfort of the bone scan: only one injection, no processing of blood samples and the results are available within 4 h. In conclusion, the data indicate that PET is a highly effective imaging procedure for diagnosing complications of hip and knee arthroplasty. Its only limitations are the restricted availability and the costs. Whether the same holds true for PET/CT has yet to be proven. While the hybrid devices are highly beneficial in oncology, their use in the diagnosis of pathological processes of joint prostheses is questionable due to the CT artifacts induced by the metallic implants. WBC imaging on the other hand has to be considered as gold standard since it yields the highest accuracy of the three diagnostic approaches, especially when combined with bone marrow scintigraphy. In departments where neither the equipment nor the know-how for PET and WBC imaging is available, TPBS is a viable alternative. Compared to the other diagnostic approaches it yields a slightly lower accuracy, but excels in simplicity and cost-effectiveness. Especially in knee prostheses, it nearly reaches the accuracy of WBC imaging and PET (TPBS 81%, WBC imaging 84%, PET 83%).
Journal Article
LONG-SHORT SKIP CONNECTIONS IN DEEP NEURAL NETWORKS FOR DSM REFINEMENT
by
Bittner, K.
,
Körner, M.
,
Liebel, L.
in
Angles (geometry)
,
Artificial neural networks
,
Change detection
2020
Detailed digital surface models (DSMs) from space-borne sensors are the key to successful solutions for many remote sensing problems, like environmental disaster simulations, change detection in rural and urban areas, 3D urban modeling for city planning and management, etc. Traditional methodologies, e.g., stereo matching, used to generate photogrammetric DSMs from stereo imagery, usually deliver low-quality results due to the matching errors in homogeneous areas or the lack of information when observing the scene under different viewing angles. This makes the tasks related to building reconstruction very challenging since in most cases it is difficult to recognize the type of roofs, especially if overlaid with trees. This work represents a continuation of research regarding the automatic optimization of building geometries in photogrammetric DSMs with half-meter resolution and introduces an improved generative adversarial network (GAN) architecture which allows to reconstruct complete and detailed building structures without neglecting even low-rise urban constructions. The generative part of the network is constructed in a way that it simultaneously processes height and intensity information, and combines short and long skip connections within one architecture. To improve different aspects of the surface, several loss terms are used, the contributions of which are automatically balanced during training. The obtained results demonstrate that the proposed methodology can achieve two goals without any manual intervention: improve the roof surfaces by making them more planar and also recognize and optimize even small residential buildings which are hard to detect.
Journal Article
DENSE MATCHING COMPARISON BETWEEN CLASSICAL AND DEEP LEARNING BASED ALGORITHMS FOR REMOTE SENSING DATA
2020
Deep learning and convolutional neural networks (CNN) have obtained a great success in image processing, by means of its powerful feature extraction ability to learn specific tasks. Many deep learning based algorithms have been developed for dense image matching, which is a hot topic in the community of computer vision. These methods are tested for close-range or street-view stereo data, however, not well studied with remote sensing datasets, including aerial and satellite data. As more high-quality datasets are collected by recent airborne and spaceborne sensors, it is necessary to compare the performance of these algorithms to classical dense matching algorithms on remote sensing data. In this paper, Guided Aggregation Net (GA-Net), which belongs to the most competitive algorithms on KITTI 2015 benchmark (street-view dataset), is tested and compared with Semi-Global Matching (SGM) on satellite and airborne data. GA-Net is an end-to-end neural network, which starts from an stereo pair and directly outputs a disparity map indicating the scene’s depth information. It is based on a differentiable approximation of SGM embedded into a neural network, performing well for ill-posed regions, such as textureless areas, slanted surfaces, etc. The results demonstrate that GA-Net is capable of producing a smoother disparity map with less errors, particularly for across track data acquired at different dates.
Journal Article
PERFORMANCE EVALUATION OF FUSION TECHNIQUES FOR CROSS-DOMAIN BUILDING ROOFTOP SEGMENTATION
2022
Convolutional Neural Networks have been widely introduced to building rooftop segmentation using satellite and aerial imagery. Preparing efficient training data is still among the critical issues on this topic. Therefore, adopting available annotated cross-domain multisource dataset is needed. This paper evaluates the performance of fusing the state-of-art deep learning neural network architectures for cross-domain building rooftop segmentation. We have selected three semantic image segmentation neural networks, including Swin transformer, OCRNet and HRNet. The predictions from these three neural networks are combined with majority voting, max value and union fusion techniques, a refined building rooftop segmentation mask is therefore delivered. The experiments on two benchmark datasets show that the proposed fusion techniques outperform single models and other state-of-art cross-domain segmentation approaches.
Journal Article
CUBESAT-DERIVED DETECTION OF SEAGRASSES USING PLANET IMAGERY FOLLOWING UNMIXING-BASED DENOISING: IS SMALL THE NEXT BIG?
2017
Seagrasses are one of the most productive and widespread yet threatened coastal ecosystems on Earth. Despite their importance, they are declining due to various threats, which are mainly anthropogenic. Lack of data on their distribution hinders any effort to rectify this decline through effective detection, mapping and monitoring. Remote sensing can mitigate this data gap by allowing retrospective quantitative assessment of seagrass beds over large and remote areas. In this paper, we evaluate the quantitative application of Planet high resolution imagery for the detection of seagrasses in the Thermaikos Gulf, NW Aegean Sea, Greece. The low Signal-to-noise Ratio (SNR), which characterizes spectral bands at shorter wavelengths, prompts the application of the Unmixing-based denoising (UBD) as a pre-processing step for seagrass detection. A total of 15 spectral-temporal patterns is extracted from a Planet image time series to restore the corrupted blue and green band in the processed Planet image. Subsequently, we implement Lyzenga’s empirical water column correction and Support Vector Machines (SVM) to evaluate quantitative benefits of denoising. Denoising aids detection of Posidonia oceanica seagrass species by increasing its producer and user accuracy by 31.7 % and 10.4 %, correspondingly, with a respective increase in its Kappa value from 0.3 to 0.48. In the near future, our objective is to improve accuracies in seagrass detection by applying more sophisticated, analytical water column correction algorithms to Planet imagery, developing time- and cost-effective monitoring of seagrass distribution that will enable in turn the effective management and conservation of these highly valuable and productive ecosystems.
Journal Article
A fuzzy decision making system for building damage map creation using high resolution satellite imagery
2013
Recent studies have shown high resolution satellite imagery to be a powerful data source for post-earthquake damage assessment of buildings. Manual interpretation of these images, while being a reliable method for finding damaged buildings, is a subjective and time-consuming endeavor, rendering it unviable at times of emergency. The present research, proposes a new state-of-the-art method for automatic damage assessment of buildings using high resolution satellite imagery. In this method, at the first step a set of pre-processing algorithms are performed on the images. Then, extracting a candidate building from both pre- and post-event images, the intact roof part after an earthquake is found. Afterwards, by considering the shape and other structural properties of this roof part with its pre-event condition in a fuzzy inference system, the rate of damage for each candidate building is estimated. The results obtained from evaluation of this algorithm using QuickBird images of the December 2003 Bam, Iran, earthquake prove the ability of this method for post-earthquake damage assessment of buildings.
Journal Article
ROOF TYPE SELECTION BASED ON PATCH-BASED CLASSIFICATION USING DEEP LEARNING FOR HIGH RESOLUTION SATELLITE IMAGERY
by
Azimi, S.
,
Partovi, T.
,
Fraundorfer, F.
in
Artificial neural networks
,
Buildings
,
Classification
2017
3D building reconstruction from remote sensing image data from satellites is still an active research topic and very valuable for 3D city modelling. The roof model is the most important component to reconstruct the Level of Details 2 (LoD2) for a building in 3D modelling. While the general solution for roof modelling relies on the detailed cues (such as lines, corners and planes) extracted from a Digital Surface Model (DSM), the correct detection of the roof type and its modelling can fail due to low quality of the DSM generated by dense stereo matching. To reduce dependencies of roof modelling on DSMs, the pansharpened satellite images as a rich resource of information are used in addition. In this paper, two strategies are employed for roof type classification. In the first one, building roof types are classified in a state-of-the-art supervised pre-trained convolutional neural network (CNN) framework. In the second strategy, deep features from deep layers of different pre-trained CNN model are extracted and then an RBF kernel using SVM is employed to classify the building roof type. Based on roof complexity of the scene, a roof library including seven types of roofs is defined. A new semi-automatic method is proposed to generate training and test patches of each roof type in the library. Using the pre-trained CNN model does not only decrease the computation time for training significantly but also increases the classification accuracy.
Journal Article