Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

Assessment of climate change impacts on water needs and growing cycle on grapevine in three DOs of NE Spain

This study assessed the suitability of grapevine growing in three DOs (Empordà, Pla de Bages and Penedès) of Catalonia (NE Spain) over the 21st century. For this purpose, an estimation of water needs and agroclimatic and phenological indicators was made. Climate change impacts were estimated at 1 km pixel resolution using temperature and precipitation projections from several general circulation models (GCM) and two climate change scenarios: RCP 4.5 (stabilization scenario) and RCP 8.5 (worst-case scenario). Potential crop evapotranspiration (following FAO procedure) and a daily water balance considering soil water holding capacity were used to estimate actual evapotranspiration of vines and, finally, water needs. Dynamics would be similar in the three DOs studied although the magnitude of impact differs. Water needs would be 2 and 3 times greater (ranging from 0 to more than 1500 m3/ha) than current water needs at both climate change scenarios. Moreover, blooming date would advance from 3 to 6 weeks, harvest date from 1 to 2.5 months, resulting in growing cycles from 10 to 80 days shorter. It should also be noted that frost risk would decrease from 6 to 76%, the number of days with temperatures above 30ºC during ripening would rise from 48 to 500% and tropical nights (minimum temperature >20ºC) at ripening would increase from 28 to 150%, depending on the scenario and the DOs. The impacts of climate change in the three DOs could result in significant limitations for grapevine cultivation and wine production if adaptive strategies are not applied. This result could serve as a basis for the design of specific and particular adaptation strategies to improve and maintain vineyards in the DOs studied and could be extrapolated to similar DOs and regions.

Phenological characterization of a wide range of Vitis Vinifera varieties

In order to study the impact of climate change on Bordeaux grape varieties and to assess the adaptation capacities of candidates to the grape varieties of this wine region to the new climatic conditions, an experimental block design composed of 52 grape varieties was set up in 2009 at the INRAE Bordeaux Aquitaine center. Among the many parameters studied, the three main phenological stages of the vine (budburst, flowering and veraison) have been closely monitored since 2012. Observations for each year, stage and variety were carried out on four independent replicates. Precocity indices have been calculated from the data obtained over the 2012-2021 period (Barbeau et al. 1998). This work allowed to group the phenological behaviour of the grapevine varieties, not only based on the timing of the subsequent developmental stages, but also on the overall precocity of the cycle and the total length of the cycle between budburst and veraison. Results regarding the variability observed among the different grape varieties for these phenological stages are presented as heat maps.

Extreme canopy management for vineyard adaptation to climate change: is it a good idea?

Climate change constitutes an enormous challenge for humankind and for all human activities, viticulture not being an exception. Long-term strategic changes are probably needed the most, but growers also need to deal with short-term changes: summers that are getting progressively warmer, earlier harvest dates and higher pH in musts and wines. In the last 10-15 years, a relevant corpus of research is being developed worldwide in order to evaluate to which extent extreme canopy management operations, aimed at reducing leaf area and, thus, limiting the source to sink ratio, could be useful to delay ripening. Although extreme canopy management can result in relevant delays in harvest dates, longer term studies, as well as detailed analysis of their implications on carbohydrate reserves, bud fertility and future yield are desirable before these practices can be recommended.

Green berries on Gewürztraminer (Vitis vinifera L.) in South Tyrol (Italy)

The grape variety Gewürztraminer is known to be affected by two physiological disorders namely berry shrivel and bunch stem necrosis. During the season 2014 we noticed a new symptomatology type of ripening disorder on the variety. The new symptom showed not all berries fallowing the normal maturation stages, but single berries remaining at a soft but green stage till harvest. The broad distribution of these so called “green berries” symptoms in different production sites of our region, caused huge damage due to the difficulty of eliminating single berries per bunch before harvesting. Therefore, the Research Centre Laimburg began to investigate the reasons and origins of this new symptom. This work shows the results of first attempts to find causes for the symptom as well as the resulting approach to mitigate symptoms. Applications of magnesium leaf fertilizer showed first promising results against this putative disorder. To study the causal effect of the green berries 30 symptomatic vineyards in 2014 have been selected for a monitoring during the season 2016. To evaluate the foliar nutrient treatment two vineyards have been selected for application of magnesium sulfate and magnesium chloride. Leaf and berry nutrient analysis, as well as the main quality parameters during ripening have been performed. As soon as “green berries” symptoms appeared, incidence and severity have been evaluated. Most of the symptomatic vineyards of the 2016 monitoring showed light to clear magnesium deficit symptoms on their foliage. Only during the seasons 2020 and 2021 “green berries” symptoms could be found in the leaf fertilizer treatment vineyards. Both seasons showed a significant effect of the magnesium treatments to reduce the incidence and severity of the symptom. It seems that the appearance of the “green berries” symptom on Gewürztraminer is correlated to a disturbed uptake of magnesium of the vines.

VINIoT – Precision viticulture service

The project VINIoT pursues the creation of a new technological vineyard monitoring service, which will allow companies in the wine sector in the SUDOE space to monitor plantations in real time and remotely at various levels of precision. The system is based on spectral images and an IoT architecture that allows assessing parameters of interest viticulture and the collection of data at a precise scale (level of grape, plant, plot or vineyard) will be designed. In France, three subjects were specifically developed: evaluation of maturity, of water stress, and detection of flavescence dorée. For the evaluation of maturity, it has been decided first to work at the berry scale in the laboratory, then at the bunch scale and finally in the vineyard. The acquisition of the spectral hyperstal image as well as the reference analyzes to measure the maturity, were carried out in the laboratory after harvesting the berries in a maturity monitoring context. This work focuses on a case study to predict sugar content of three different grape varieties: Syrah, Fer Servadou and Mauzac. A robust method called Roboost-PLSR, developed in the framework of this work (Courand et al., 2022), to improve prediction model performance was applied on spectra after the acquirement of hyperspectral images. Regarding the evaluation of water stress, to work with a significant variability in terms of water status, it has been worked first with potted plants under 2 different water regimes. The facilities have allowed the supervision of irrigation and micro-climatic conditions. The regression models on agronomic variables (stomatal conductance, water potential, …) are studied. To detect flavescence dorée, the experimental plan has consisted of work at leaf scale in the laboratory first, and then in the field. To detect the disease from hyper-spectral imaging, a combination of multivariate curve resolution-alternating least squares (MCR-ALS) and factorial discriminant analysis (FDA) was proposed. This strategy proved the potential towards the discrimination of healthy and infected leaves by flavescence dorée based on the use of hyperspectral images (Mas Garcia et al., 2021).