Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

Analysis of some environmental factors and cultural practices that affect the production and quality of the Manto Negro, Callet and Prensal Blanc varieties

45 non irrigated vineyards distributed in the DO (Denomination) Pla i Llevant de Mallorca and the DO Binissalem Mallorca were used to investigate the characteristics of production and quality and their relationships certain environmental factors and cultural practices. The grape varieties investigated are autochthonous to the island of Mallorca, Manto Negro and Callet as red and Prensal Blanc as white. All plants were measured for four consecutive years in the main production and quality parameters. Among the environmental factors, the type of soil has been studied, more specifically its water retention capacity, the planting density, the age of the vineyard and the level of viral infection. The presence or absence of virus seems to have no effect on any component studied in the varieties studied. For the white variety Prensal Blanc age is negatively correlated with production and the number of bunches, nevertheless it does not cause any effect on the required quality parameters. However, for the red varieties Callet and Manto Negro, the age of the plantation is the variable that best correlates with the quality parameters, therefore the old vines should be the object of preservation by the viticulturists and winemakers in order to guarantee its contribution to the quality of the wines made with these varieties.

Rapid damage assessment and grapevine recovery after fire

There is increasing scientific consensus that climate changeis the underlying cause of the prolonged dry and hot conditions that have increased the risk of extreme fire weather in many countries around the world. In December 2019, a bushfire event occurred in the Adelaide Hills, South Australia where 25,000 hectares were burnt and in vineyards and surrounding areas various degrees of scorching and infrastructure damage occurred. The ability to coordinate and plan recovery after a fire event relies on robust and timely data. The current practice for measuring the scale and distribution of fire damage is to walk or drive the vineyard and score individual vines based on visual observation. The process is time consuming, subjective, or semi-quantitative at best. After the December 2019 fires, it took many months to access properties and estimate the area of vineyard damaged. This study compares the rapid assessment and mapping of fire damage using high-resolution satellite imagery with more traditional ground based measures. Satellite imagery tracking vineyard recovery in the season following the bushfire is being correlated to field assessments of vineyard productivity such as canopy health and development, fertility and carbohydrate storage. Canopy health in the seasons following the fires correlated to the severity of the initial fire damage. Severely damaged vines had reduced canopy growth, were infertile or had very low fertility as well as lower carbohydrate levels in buds and canes during dormancy, which reduced productivity in the seasons following the bushfire event. In contrast, vines that received minor damage were able to recover within 1-2 years. Tools that rapidly and affordably capture the extent and severity of damage over large vineyard area will allow producers, government and industry bodies to manage decisions in relation to fire recovery planning, coordination and delivery, improving the efficiency and effectiveness of their response.

The potential of multispectral/hyperspectral technologies for early detection of “flavescence dorée” in a Portuguese vineyard

“Flavescence dorée” (FD) is a grapevine quarantine disease associated with phytoplasmas and transmitted to healthy plants by insect vectors, mainly Scaphoideus titanus. Infected plants usually develop symptoms of stunted growth, unripe cane wood, leaf rolling, leaf yellowing or reddening, and shrivelled berries. Since plants can remain symptomless up to four years, they may act as reservoirs of FD contributing to the spread of the disease. So far, conventional management strategies rely mainly on the insecticide treatments, uprooting of infected plants and use of phytoplasma-free propagation material. However, these strategies are costly and could have undesirable environmental impacts. Thus, the development of sustainable and noninvasive approaches for early detection of FD and its management are of great importance to reduce disease spread and select the best cultural practices and treatments. The present study aimed to evaluate if multispectral/hyperspectral technologies can be used to detect FD before the appearance of the first symptoms and if infected grapevines display a spectral imaging fingerprint. To that end, physiological parameters (leaf area, chlorophyll content and photosynthetic rate) were collected in concomitance to the measurements of plant reflectance (using both a portable apparatus and a remote sensing drone). Measurements were performed in two leaves of 8 healthy and 8 FD-infected grapevines, at four timepoints: before the development of disease symptoms (21st June); and after symptoms appearance (ii) at veraison (2nd August); at post-veraison (11th September); and at harvest (25th September). At all timepoints, FD infected plants revealed a significant decrease in the studied physiological parameters, with a positive correlation with drone imaging data and portable apparatus analyses. Moreover, spectra of either drone imaging and portable apparatus showed clear differences between healthy and FD-infected grapevines, validating multispectral/ hyperspectral technology as a potential tool for the early detection of FD or other grapevine-associated diseases.

Soil, vine, climate change – what is observed – what is expected

To evaluate the current and future impact of climate change on Viticulture requires an integrated view on a complex interacting system within the soil-plant-atmospheric continuum under continuous change. Aside of the globally observed increase in temperature in basically all viticulture regions for at least four decades, we observe several clear trends at the regional level in the ratio of precipitation to potential evapotranspiration. Additionally the recently published 6th assessment report of the IPCC (The physical science basis) shows case-dependent further expected shifts in climate patterns which will have substantial impacts on the way we will conduct viticulture in the decades to come.
Looking beyond climate developments, we observe rising temperatures in the upper soil layers which will have an impact on the distribution of microbial populations, the decay rate of organic matter or the storage capacity for carbon, thus affecting the emission of greenhouse gases (GHGs) and the viscosity of water in the soil-plant pathway, altering the transport of water. If the upper soil layers dry out faster due to less rainfall and/or increased evapotranspiration driven by higher temperatures, the spectral reflection properties of bare soil change and the transport of latent heat into the fruiting zone is increased putting a higher temperature load on the fruit. Interactions between micro-organisms in the rhizosphere and the grapevine root system are poorly understood but respond to environmental factors (such as increased soil temperatures) and the plant material (rootstock for instance), respectively the cultivation system (for example bio-organic versus conventional). This adds to an extremely complex system to manage in terms of increased resilience, adaptation to and even mitigation of climate change. Nevertheless, taken as a whole, effects on the individual expressions of wines with a given origin, seem highly likely to become more apparent.

A multidisciplinary approach to evaluate the effects of the training system on the performance of “Aglianico del Vulture” vineyards

Vineyards are complex agro-ecosystems with high spatial and temporal variability. An efficient training system may counteract the adverse effects of this variability. Moreover, considering the climate change issues, choosing an efficient training system that enhances water use and protects the vines from radiative thermal stress has become a priority for the farmers. A multidisciplinary approach that assesses the soil-crop-yield-wine relationships of vineyards in a distributed and holistic way could bring added knowledge on the behavior of the different training systems. This ongoing research aimed to implement a multidisciplinary approach to study the behavior of “Aglianico del Vulture” grapevines trained with two different systems: a spurred cordon (SC) and an “Alberello in parete” (AL), grown in a high-quality wine production area of Basilicata region (Italy). The approach merged several methods and scales of soil, ecophysiology, must/wine quality, and spectral data collection to assess the influence of the training system. Homogeneous zones (HZs) in both training systems were defined through a procedure based on geomorphological classification, unmanned aerial vehicles (UAV) images analysis, and a traditional soil survey supported by geophysical scanning. During the 2021 season, TDR probes monitored soil water content, while grapevine health status was assessed using eco-physiological measurements (LWP, chlorophyll content, PSII photosynthetic efficiency, LAI, and point-based field spectroscopy). These grapevine in-vivo measurements validated the spectral vegetation indexes (NDVI, RENDVI, CVI, and TVI) derived from the UAV multispectral imagery, which monitored the grapevine status in a distributed and non-invasive way. Grape yield, quality of berries, must and wine were measured to assess the effects of the training systems. The first experimental year results showed the variability of the vineyards and revealed relationships among soil parameters, crop characteristics, and vegetation indices of the SC and AL training systems. This multidisciplinary study could bring new insights into the vineyard training system’s effects on grape yield and wine quality.