Detection of trees on street-view images using a convolutional neural network

Abstract

Real-time detection of possible deforestation of urban landscapes is an essential task for many urban forest monitoring services. Computational methods emerge as a rapid and efficient solution to evaluate bird's-eye-view images taken by satellites, drones, or even street-view photos captured at the ground level of the urban scenery. Identifying unhealthy trees requires detecting the tree itself and its constituent parts to evaluate certain aspects that may indicate unhealthiness, being street-level images a cost-effective and feasible resource to support the fieldwork survey. This paper proposes detecting trees and their specific parts on street-view images through a Convolutional Neural Network model based on the well-known You Only Look Once network with a MobileNet as the backbone for feature extraction. Essentially, from a photo taken from the ground, the proposed method identifies trees, isolates them through their bounding boxes, identifies the crown and stem, and then estimates the height of the trees by using a specific handheld object as a reference in the images. Experiment results demonstrate the effectiveness of the proposed method.