Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

What are the optimal ranges and thresholds for berry solar radiation for flavonoid biosynthesis?

In wine grape production, canopy management practices are applied to control the source-sink balance and improve the cluster microclimate to enhance berry composition. The aim of this study was to identify the optimal ranges of berry solar radiation exposure (exposure) for upregulation of flavonoid biosynthesis and thresholds for their degradation, to evaluate how canopy management practices such as leaf removal, shoot thinning, and a combination of both affect the grapevine (Vitis vinifera L. cv. Cabernet Sauvignon) yield components, berry composition, and flavonoid profile under context of climate change. First experiment assessed changes in the grape flavonoid content driven by four degrees of exposure. In the second experiment, individual grape berries subjected to different exposures were collected from two cultivars (Cabernet Sauvignon and Petit Verdot). The third experiment consisted of an experiment with three canopy management treatments (i) LR (removal of 5 to 6 basal leaves), (ii) ST (thinned to 24 shoots per vine), and (iii) LRST (a combination of LR and ST) and an untreated control (UNT). Berry composition, flavonoid content and profiles, and 3-isobutyl 2-methoxypyrazine were monitored during berry ripening. Although increasing canopy porosity through canopy management practices can be helpful for other purposes, this may not be the case of flavonoid compounds when a certain proportion of kaempferol was achieved. Our results revealed different sensitivities to degradation within the flavonoid groups, flavonols being the only monitored group that was upregulated by solar radiation. Within different canopy management practices, the main effects were due to the ST. Under environmental conditions given in this trial, ST and LRST hastened fruit maturity; however, a clear improvement of the flavonoid compounds (i.e., greater anthocyanin) was not observed at harvest. Methoxypyrazine berry content decreased with canopy management practices studied. Although some berry traits were improved (i.e. 2.5° Brix increase in berry total soluble solids) due to canopy management practices (ST), this resulted in a four-fold increase in labor operations cost, two-fold decrease in yield with a 10-fold increase in anthocyanin production cost per hectare that should be assessed together as the climate continues to get hot.

Better understand the soil wet bulb formation with subsurface or aerial drip irrigation in viticulture

The gradual change in rainfall patterns experienced in the south of France vineyards, especially around the Mediterranean sea, means that the vines are increasingly subject to summer drought. The winegrowers developped the use of irrigation techniques to ensure the maintenance of competitive yields in the production of wines under Protected Geographical Indication label. In practice, drip irrigation pipes can be installed above the ground or buried into the soil as well as at different distances from the vine row. The objective of this study was to examine the profiles of the wet bulbs of the soil obtained from two drip irrigation systems : aerial drip located under the vine row and subsurface drip placed in the middle of the inter-row. This experiment took place over two consecutive seasons (2020-2021) on a 3.4 ha Viognier plot in the Mediterranean region (PGI Oc, France) on sandy clay soil. The annual rainfalls were less than 400 mm. Soil water content probes were installed at different depths (20 – 40 – 60 – 80 cm) and at different lateralities from the vine row (30 – 60 – 90 – 120 cm) to control the formation of the soil wet bulb during irrigation. The mapping and the analysis of the data allowed a better understanding and differentiation of the water percolation when irrigating with subsurface or aerial drip. For the same amount of water and without differences of vine water status, it is shown that in a subsurface drip irrigation situation, the size of the wet bulb formed is larger than in aerial drip irrigation system.

Spatial determination of areas in the Western Balkans region favorable for organic production

In problematic conditions for production of grapes and wine caused by the COVID-19 pandemic and the resulting occurrence of wine surpluses, producers are increasingly turning to the innovative viticulture and winemaking of products that are more appealing to the market and the consumers. On the other hand, consumption of the food safety or organic products, and therefore of organic grapes and wine, is increasingly common in the world, in particular in Europe. The Regional Rural Development Standing Working Group (SWG RRD), as a regional intergovernmental organization gathers actors in the viticulture and winemaking sector from states and territories of the Western Balkans (South-East Europe) in the Expert Working Group for Wine, with the aim of improving viticulture and winemaking in this region through joint activities. In accordance with the aforementioned, the SWG RRD is working on advancing organic production of grapes and wine, and on recognition of specificities of the terroir of wine-growing areas in Western Balkans. In addition, as part of the project “Facilitation of Exchange and Advice on Wine Regulations in Western Balkan Countries” helmed by the German Federal Ministry of Food and Agriculture, in addition to harmonization of relevant legislation with EU regulations, efforts are being invested towards recognition of organic wines. Within activities and project implemented by this organization, expert analyses and scientific research of the terroir of Western Balkans were carried out, and some of the results are presented in this paper.

Co-design and evaluation of spatially explicit strategies of adaptation to climate change in a Mediterranean watershed

Climate change challenges differently wine growing systems, depending on their biophysical, sociological and economic features. Therefore, there is a need to locally design and evaluate adaptation strategies combining several technical options, and considering the local opportunities and constraints (e.g. water access, wine typicity). The case study took place in a typical and heterogeneous Mediterranean vineyard of 1,500 ha in the South of France. We developed a participatory modeling approach to (1) conceptualize local climate change issues and design spatially explicit adaptation strategies with stakeholders, (2) numerically evaluate their effects on phenology, yield and irrigation needs under the high-emissions climate change scenario RCP 8.5, and (3) collectively discuss simulation results. We organized five sets of workshops, with in-between modeling phases. A process-based model was developed that allowed to evaluate the effects of six technical options (late varieties, irrigation, water saving by reducing canopy size, adjusting cover cropping, reducing density, and shading) with various distributions in the watershed, as well as vineyard relocation. Overall, we co-designed three adaptation strategies. Delay harvest strategy with late varieties showed little effects on decreasing air temperature during ripening. Water constraint limitation strategy would compensate for production losses if disruptive adaptations (e.g. reduced density) were adopted, and more land got access to irrigation. Relocation strategy would foster high premium wine production in the constrained mountainous areas where grapevine is less impacted by climate change. This research shows that a spatial distribution of technical changes gives room for adaptation to climate change, and that the collaboration with local stakeholders is a key to the identification of relevant adaptation. Further research should explore the potential of adaptation strategies based on soil quality improvement and on water stress tolerant varieties.

VINIoT – Precision viticulture service

The project VINIoT pursues the creation of a new technological vineyard monitoring service, which will allow companies in the wine sector in the SUDOE space to monitor plantations in real time and remotely at various levels of precision. The system is based on spectral images and an IoT architecture that allows assessing parameters of interest viticulture and the collection of data at a precise scale (level of grape, plant, plot or vineyard) will be designed. In France, three subjects were specifically developed: evaluation of maturity, of water stress, and detection of flavescence dorée. For the evaluation of maturity, it has been decided first to work at the berry scale in the laboratory, then at the bunch scale and finally in the vineyard. The acquisition of the spectral hyperstal image as well as the reference analyzes to measure the maturity, were carried out in the laboratory after harvesting the berries in a maturity monitoring context. This work focuses on a case study to predict sugar content of three different grape varieties: Syrah, Fer Servadou and Mauzac. A robust method called Roboost-PLSR, developed in the framework of this work (Courand et al., 2022), to improve prediction model performance was applied on spectra after the acquirement of hyperspectral images. Regarding the evaluation of water stress, to work with a significant variability in terms of water status, it has been worked first with potted plants under 2 different water regimes. The facilities have allowed the supervision of irrigation and micro-climatic conditions. The regression models on agronomic variables (stomatal conductance, water potential, …) are studied. To detect flavescence dorée, the experimental plan has consisted of work at leaf scale in the laboratory first, and then in the field. To detect the disease from hyper-spectral imaging, a combination of multivariate curve resolution-alternating least squares (MCR-ALS) and factorial discriminant analysis (FDA) was proposed. This strategy proved the potential towards the discrimination of healthy and infected leaves by flavescence dorée based on the use of hyperspectral images (Mas Garcia et al., 2021).