Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

Protected Designation of Origin (D.P.O.) Valdepeñas: classification and map of soils

The objective of the work described here is the elaboration of a map of the different types of vineyard soils that to guide the famers in the choice of the most productive vine rootstocks and varieties. 90 vineyard soils profiles were analysed in the entire territory of the Origen Denominations of Valdepeñas. The sampling was carried out in 2018 (June to October) by making a sampling grid, followed by photointerpretation and control in the field. The studied soils can be grouped into 9 different soil types (according to FAO 2006 classification): Leptosols, Regosols, Fluvisols, Gleysols, Cambisols, Calcisols, Luvisols and Anthrosols. A map showing the soil distribution with different type of soils has been made with the ArcGIS program. Regarding to the choice of rootstock, Calcisoles are soils with a high active limestone content, so the rootstocks used in these soils must be resistant to this parameter; Luvisols are deep soils with high clay content, so they will support vigorous rootstocks. Because the cartographic units are composed of two or more subgroups, with are associated in variable proportions, 9 different soil associations have been established; Unit 1: Leptosols, Cambisols and Luvisols (80%, 15% and 5% respectively); Unit 2: Cambisols with Regosols and Luvisols (40%, 30% and 30% respectively); Unit 3: Cambisols and Gleysols with Regosols (40%, 40% and 20% respectively); Unit 4: Regosols with Cambisols, Leptosols and Calcisols (40%, 30%, 15% and 15% respectively); Unit 5: Cambisols, Leptosols, Calcisols and Regosols (25% each of them); Unit 6: Luvisols with Cambisol and Calcisols (80%, 10% and 10% respectively); Unit 7: Luvisols and Calcisols with Cambisols (40%, 40% and 20% respectively); Unit 8: Calcisols with, Cambisols and Luvisols (80%, 10% and 10% respectively); Unit 9: Anthrosols. These study allow to elaborate the first map of vineyard soils of this Protected Designation of Origin in Castilla-La Mancha.

Spatial variability of temperature is linked to grape composition variability in the Saint-Emilion winegrowing area

Elevated temperature during the grape maturation period is a major threat for grape quality and thus wine quality. Therefore, characterizing the grape composition response to temperature at a larger scale would represent a crucial step towards adaptation to climate change. In response to changes in temperature, various physiological mechanisms regulate grape composition. Primary and secondary metabolisms are both involved in this response, with well-known effects, for example on anthocyanins, and lesser known effects, for example on aromas or aroma precursors. At the field scale or at the regional scale, however, numerous environmental or plant-specific factors intervene to make the effects of temperature difficult to distinguish from overall variability. In this study, it was attempted to overcome this difficulty by selecting well-characterized situations with differing temperatures.
A long-term study of air temperature variability across several Merlot vineyards in the Saint-Emilion and Pomerol wine producing area found significant temperature differences and gradients at various time scales linked to environmental factors. From this study area, a few sites were selected with similar age, soil and training system conditions, and with repeated and contrasted temperature differences during the maturation period. The average temperature difference during the maturation period was about 2°C between cooler and warmer sites, a difference similar to that expected under future climate change scenarios. In close vicinity to the temperature sensors at each site, grape berries were sampled at different times until full maturity during 2019 and 2020. Also, berries from bunches on either side of the row were analyzed separately, allowing an investigation of bunch exposure effect associated with the coupling of berry temperature and solar radiation. Four replicates of pooled berries for each time – site – bunch exposure combination were obtained and analyzed for biochemical composition. Analyses of variance of the biochemical composition data collected at different sampling times reveal significant effects associated with temperature, site, and bunch azimuth. For instance, anthocyanins in grape skins are clearly influenced by temperature and solar radiation exposure, with up to 30% reduction in warmer conditions.

Effect of multi-level and multi-scale spectral data source on vineyard state assessment

Currently, the main goal of agriculture is to promote the resilience of agricultural systems in a sustainable way through the improvement of use efficiency of farm resources, increasing crop yield and quality under climate change conditions. This last is expected to drastically modify plant growth, with possible negative effects, especially in arid and semi-arid regions of Europe on the viticultural sector. In this context, the monitoring of spatial behavior of grapevine during the growing season represents an opportunity to improve the plant management, winegrowers’ incomes, and to preserve the environmental health, but it has additional costs for the farmer. Nowadays, UAS equipped with a VIS-NIR multispectral camera (blue, green, red, red-edge, and NIR) represents a good and relatively cheap solution to assess plant status spatial information (by means of a limited set of spectral vegetation indices), representing important support in precision agriculture management during the growing season. While differences between UAS-based multispectral imagery and point-based spectroscopy are well discussed in the literature, their impact on plant status estimation by vegetation indices is not completely investigated in depth. The aim of this study was to assess the performance level of UAS-based multispectral (5 bands across 450-800nm spectral region with a spatial resolution of 5cm) imagery, reconstructed high-resolution satellite (Sentinel-2A) multispectral imagery (13 bands across 400-2500 nm with spatial resolution of <2 m) through Convolutional Neural Network (CNN) approach, and point-based field spectroscopy (collecting 600 wavelengths across 400-1000 nm spectral region with a surface footprint of 1-2 cm) in a plant status estimation application, and then, using Bayesian regularization artificial neural network for leaf chlorophyll content (LCC) and plant water status (LWP) prediction. The test site is a Greco vineyard of southern Italy, where detailed and precise records on soil and atmosphere systems, in-vivo plant monitoring of eco-physiological parameters have been conducted.

Towards a regional mapping of vine water status based on crowdsourcing observations

Monitoring vine water status is a major challenge for vineyard management because it influences both yield and harvest quality. It is also a challenge at the territorial scale for identifying periods of high water restriction or zones regularly impacted by water stress. This information is of major importance for defining collective strategies, anticipating harvest logistic or applying for irrigation authorisation. At this spatial scale, existing tools and methods for monitoring vine water status are few and often require strong assumptions (e.g. water balance model). This paper proposes to consider a collaborative collection of observations by winegrowers and wine industry stakeholders (crowdsourcing) as an interesting alternative. Indeed, it allows the collection of a large number of field observations while pooling the collection effort. However, the feasibility of such a project and its interest in monitoring vine water status at regional scale has never been tested.

The objective of this article is to explore the possibility of making a regional map of vine water status based on crowdsourcing observations. It is based on the study of the free mobile application ApeX-Vigne, which allows the collection of observations about vine shoot growth. This information is easy to collect and can be considered, under certain conditions, as a proxy for vine water status. This article presents the first results obtained from the nearly 18,000 observations collected by winegrowers and wine industry stakeholders during 2019, 2020 and 2021 seasons. It presents the vine shoot growth maps obtained at regional scale and their evolution over the three vintages studied. It also proposes an analysis of the factors that favoured the number of observations collected and those that favoured their quality. These results open up new perspectives for monitoring vine water status at a regional scale but above they provide references for other crowdsourcing projects in viticulture.

Use of a new, miniaturized, low-cost spectral sensor to estimate and map the vineyard water status from a mobile 

Optimizing the use of water and improving irrigation strategies has become increasingly important in most winegrowing countries due to the consequences of climate change, which are leading to more frequent droughts, heat waves, or alteration of precipitation patterns. Optimized irrigation scheduling can only be based on a reliable knowledge of the vineyard water status.

In this context, this work aims at the development of a novel methodology, using a contactless, miniaturized, low-cost NIR spectral tool to monitor (on-the-go) the vineyard water status variability. On-the-go spectral measurements were acquired in the vineyard using a NIR micro spectrometer, operating in the 900–1900 nm spectral range, from a ground vehicle moving at 3 km/h. Spectral measurements were collected on the northeast side of the canopy across four different dates (July 8th, 14th, 21st and August 12th) during 2021 season in a commercial vineyard (3 ha). Grapevines of Vitis vinifera L. Graciano planted on a VSP trellis were monitored at solar noon using stem water potential (Ψs) as reference indicators of plant water status. In total, 108 measurements of Ψs were taken (27 vines per date).

Calibration and prediction models were performed using Partial Least Squares (PLS) regression. The best prediction models for grapevine water status yielded a determination coefficient of cross-validation (r2cv) of 0.67 and a root mean square error of cross-validation (RMSEcv) of 0.131 MPa. This predictive model was employed to map the spatial variability of the vineyard water status and provided useful, practical information towards the implementation of appropriate irrigation strategies. The outcomes presented in this work show the great potential of this low-cost methodology to assess the vineyard stem water potential and its spatial variability in a commercial vineyard.