Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

Assessing the relationship between cordon strangulation, dieback, and fungal trunk disease symptom expression

Grapevine trunk diseases including Eutypa dieback are a major factor in the decline of vineyards and may lead to loss of productivity, reduced income, and premature reworking or replanting. Several studies have yielded results indicating that vines may be more likely to express symptoms of vascular disease if their health is already compromised by stress. In Australia and many other wine-growing regions it is a common practice for canes to be wrapped tightly around the cordon wire during the establishment of permanent cordon arms. It is likely that this practice may have a negative effect on health and longevity, as older cordons that have been trained in this manner often display signs of decay and dieback, with the wire often visibly embedded within the wood of the cordon. It is possible that adopting a training method which avoids constriction of the vasculature of the cordon may help to limit the onset of vascular disease symptom expression. A survey was conducted during the spring of two consecutive growing seasons on vineyards in South Australia displaying symptoms of Eutypa lata infection when symptomless shoots were 50–100 cm long. Vines were assessed as follows: (i) the proportion of cordon exhibiting dieback was rated using a 0–100% scale; (ii) the proportion of canopy exhibiting foliar symptoms of Eutypa dieback was rated using a 0–100% scale; (iii) the severity of strangulation was rated using a 0–4 point scale. Images were also taken of each vine for the purpose of measuring plant area index (PAI) using the VitiCanopy App. The goal of the survey was to determine if and to what extent any correlation exists between severity of strangulation and cordon dieback, in addition to Eutypa dieback foliar symptom expression.

Traditional agroforestry vineyards, sources of inspiration for the agroecological transition of viticulture

A unique “terroir” can be found in southern Bolivia, which combines the specific features of climate, topography and altitude of high valleys, with the management of grapevines staked on trees. It is one of the rare remnants of agroforestry viticulture. A survey was carried out among 29 grapegrowers in three valleys, to characterize the structure and management of these vineyards, and identify the services they expect from trees. Farms were small (2.2 ha on average) and 85% of vineyards were less than 1 ha. Viticulture was associated with vegetable, fruit and fodder production, sometimes in the same fields. Molle trees were found in all plots, together with one or two other native tree species. Traditional grapevine varieties such as Negra Criolla, Moscatel de Alejandría and Vicchoqueña were grown with a large range of densities from 1550 to 9500 vines ha-1. From 18 to 30% of them were staked on trees, with 1.2 to 4.9 vines per tree. The management of these vineyards (irrigation, fertilization and grapevine protection) was described, the most particular technical operation being the coordinated pruning of trees and grapevines. Three types of management could be identified in the three valleys. Grapegrowers had a clear idea of the ecosystem services they expected from trees in their vineyards. The main one was protection against climate hazards (hail, frost, flood). Then they expected benefits in terms of pest and disease control, improvement of soil fertility and resulting yield. At last, some producers claimed that tree-staking was quicker and cheaper than conventional trellising. It can be hypothesized then that agroforestry is a promising technique for the agroecological transition of viticulture. Its contribution to the “terroir” of the high valleys of southern Bolivia and its link with the specificities of the wines and spirits produced there remain to be explored.

Effect of multi-level and multi-scale spectral data source on vineyard state assessment

Currently, the main goal of agriculture is to promote the resilience of agricultural systems in a sustainable way through the improvement of use efficiency of farm resources, increasing crop yield and quality under climate change conditions. This last is expected to drastically modify plant growth, with possible negative effects, especially in arid and semi-arid regions of Europe on the viticultural sector. In this context, the monitoring of spatial behavior of grapevine during the growing season represents an opportunity to improve the plant management, winegrowers’ incomes, and to preserve the environmental health, but it has additional costs for the farmer. Nowadays, UAS equipped with a VIS-NIR multispectral camera (blue, green, red, red-edge, and NIR) represents a good and relatively cheap solution to assess plant status spatial information (by means of a limited set of spectral vegetation indices), representing important support in precision agriculture management during the growing season. While differences between UAS-based multispectral imagery and point-based spectroscopy are well discussed in the literature, their impact on plant status estimation by vegetation indices is not completely investigated in depth. The aim of this study was to assess the performance level of UAS-based multispectral (5 bands across 450-800nm spectral region with a spatial resolution of 5cm) imagery, reconstructed high-resolution satellite (Sentinel-2A) multispectral imagery (13 bands across 400-2500 nm with spatial resolution of <2 m) through Convolutional Neural Network (CNN) approach, and point-based field spectroscopy (collecting 600 wavelengths across 400-1000 nm spectral region with a surface footprint of 1-2 cm) in a plant status estimation application, and then, using Bayesian regularization artificial neural network for leaf chlorophyll content (LCC) and plant water status (LWP) prediction. The test site is a Greco vineyard of southern Italy, where detailed and precise records on soil and atmosphere systems, in-vivo plant monitoring of eco-physiological parameters have been conducted.

An analytical framework to site-specifically study climate influence on grapevine involving the functional and Bayesian exploration of farm data time series synchronized using an eGDD thermal index

Climate influence on grapevine physiology is prevalent and this influence is only expected to increase with climate change. Although governed by a general determinism, climate influence on grapevine physiology may present variations according to the terroir. In addition, these site-specific differences are likely to be enhanced when climate influence is studied using farm data. Indeed, farm data integrate additional sources of variation such as a varying representativity of the conditions actually experienced in the field. Nevertheless, there is a real challenge in valuing farm data to enable grape growers to understand their own terroir and consequently adapt their practices to the local conditions. In such a context, this article proposes a framework to site-specifically study climate influence on grapevine physiology using farm data. It focuses on improving the analysis of time series of weather data. The analytical framework includes the synchronization of time series using site-specific thermal indices computed with an original method called Extended Growing Degree Days (eGDD). Synchronized time series are then analyzed using a Bayesian functional Linear regression with Sparse Steps functions (BLiSS) in order to detect site-specific periods of strong climate influence on yield development. The article focuses on temperature and rain influence on grape yield development as a case study. It uses data from three commercial vineyards respectively situated in the Bordeaux region (France), California (USA) and Israel. For all vineyards, common periods of climate influence on yield development were found. They corresponded to already known periods, for example around veraison of the year before harvest. However, the periods differed in their precise timing (e.g. before, around or after veraison), duration and correlation direction with yield. Other periods were found for only one or two vineyards and/or were not referred to in literature, for example during the winter before harvest.

Effects of graft quality on growth and grapevine-water relations

Climate change is challenging viticulture worldwide compromising its sustainability due to warmer temperatures and the increased frequency of extreme events. Grafting Vitis vinifera L.