Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

Green berries on Gewürztraminer (Vitis vinifera L.) in South Tyrol (Italy)

The grape variety Gewürztraminer is known to be affected by two physiological disorders namely berry shrivel and bunch stem necrosis. During the season 2014 we noticed a new symptomatology type of ripening disorder on the variety. The new symptom showed not all berries fallowing the normal maturation stages, but single berries remaining at a soft but green stage till harvest. The broad distribution of these so called “green berries” symptoms in different production sites of our region, caused huge damage due to the difficulty of eliminating single berries per bunch before harvesting. Therefore, the Research Centre Laimburg began to investigate the reasons and origins of this new symptom. This work shows the results of first attempts to find causes for the symptom as well as the resulting approach to mitigate symptoms. Applications of magnesium leaf fertilizer showed first promising results against this putative disorder. To study the causal effect of the green berries 30 symptomatic vineyards in 2014 have been selected for a monitoring during the season 2016. To evaluate the foliar nutrient treatment two vineyards have been selected for application of magnesium sulfate and magnesium chloride. Leaf and berry nutrient analysis, as well as the main quality parameters during ripening have been performed. As soon as “green berries” symptoms appeared, incidence and severity have been evaluated. Most of the symptomatic vineyards of the 2016 monitoring showed light to clear magnesium deficit symptoms on their foliage. Only during the seasons 2020 and 2021 “green berries” symptoms could be found in the leaf fertilizer treatment vineyards. Both seasons showed a significant effect of the magnesium treatments to reduce the incidence and severity of the symptom. It seems that the appearance of the “green berries” symptom on Gewürztraminer is correlated to a disturbed uptake of magnesium of the vines.

Underpinning terroir with data: rethinking the zoning paradigm

Agriculture, natural resource management and the production and sale of products such as wine are increasingly data-driven activities. Thus, the use of remote and proximal crop and soil sensors to aid management decisions is becoming commonplace and ‘Agtech’ is proliferating commercially; mapping, underpinned by geographical information systems and complex methods of spatial analysis, is widely used. Likewise, the chemical and sensory analysis of wines draws on multivariate statistics; the efficient winery intake of grapes, subsequent production of wines and their delivery to markets relies on logistics; whilst the sales and marketing of wines is increasingly driven by artificial intelligence linked to the recorded purchasing behaviour of consumers. In brief, there is data everywhere!

Opinions will vary on whether these developments are a good thing. Those concerned with the ‘mystique’ of wine, or the historical aspects of terroir and its preservation, may find them confronting. In contrast, they offer an opportunity to those interested in the biophysical elements of terroir, and efforts aimed at better understanding how these impact on vineyard performance and the sensory attributes of resultant wines. At the previous Terroir Congress, we demonstrated the potential of analytical methods used at the within-vineyard scale in the development of Precision Viticulture, in contributing to a quantitative understanding of regional terroir. For this conference, we take this approach forward with examples from contrasting locations in both the northern and southern hemispheres. We show how, by focussing on the vineyards within winegrowing regions, as opposed to all of the land within those regions, we might move towards a more robust terroir zoning than one derived from a mixture of history, thematic mapping, heuristics and the whims of marketers. Aside from providing improved understanding by underpinning terroir with data, such methods should also promote improved management of the entire wine value chain.

δ13C : A still underused indicator in precision viticulture  

The first demonstration of the interest of carbon isotope composition of sugars in grapevine, as an integrated indicator of vineyard water status, dates back to 2000 (Gaudillère et al., 1999; Van Leeuwen et al., 2001). Thanks to the isotopic discrimination of Carbon that takes place during plant photosynthesis, under hydric stress conditions, it is possible to accurately estimate the photosynthetic activity. Ever since, δ13C has been widely applied with success to zonation, terroir studies and vine physiology research, but is still not widely used by viticulturists. This is quite astonishing by considering the impact of global warming on viticulture and the need to improve water management, that would justify a widespread use of δ13C.
The lack of private laboratories proposing the analysis, the cost of the technology, as well as the long analytical delays, have been detrimental to its development. Some laboratories tried to overcome the analytical difficulties of isotopic analysis by using fourier transformed infrared spectroscopy, as a fast and cheap alternative to the official OIV method (IRMS). These claimed FTIR models have never been published or peer reviewed and cannot be considered robust. In this work, thanks to the recent acquisition of IRMS technology, new modern and robust applications of δ13C for viticulture are proposed. This includes the use of the analysis to make parcel separations at harvesting, the possibility to increase the precision of hydric stress cartography and the potential cost reduction when compared with Scholander pressure bomb analysis.

20-Year-Old data set: scion x rootstock x climate, relationships. Effects on phenology and sugar dynamics

Global warming is one of the biggest environmental, social, and economic threats. In the Douro Valley, change to the climate are expected in the coming years, namely an increase in average temperature and a decrease in annual precipitation. Since vine cultivation is extremely vulnerable and influenced by the climate, these changes are likely to have negative effects on the production and quality of wine.
Adaptation is a major challenge facing the viticulture sector where the choice of plant material plays an important role, particularly the rootstock as it is a driver for adaptation with a wide range of effects, the most important being phylloxera, nematode and salt, tolerance to drought and a complex set of interactions in the grafted plant.
In an experimental vineyard, established in the Douro Region in 1997, with four randomized blocs, with five varieties, Touriga Nacional, Tinta Barroca, Touriga Franca and Tinta Roriz, grafted in four rootstocks, Rupestris du Lot, R110, 196-17C, R99 and 1103P, data was collected consecutively over 20 years (2001-2020). Phenological observations were made two to three times a week, following established criteria, to determine the average dates of budbreak, flowering and veraison. During maturation, weekly berry samples were taken to study the dynamics of sugar accumulation, amongst other parameters. Climate data was collected from a weather station located near the vineyard parcel, with data classified through several climatic indices.
The results achieved show a very low coefficient of variations in the average date of the phenophases and an important contribution from the rootstock in the dynamic of the phenology, allowing a delay in the cycle of up to10-12 days for the different combinations. The Principal Component Analysis performed, evaluating trends in the physical-chemical parameters, highlighted the effect of the climate and rootstock on fruit quality by grape varieties.

Making sense of available information for climate change adaptation and building resilience into wine production systems across the world

Effects of climate change on viticulture systems and winemaking processes are being felt across the world. The IPCC 6thAssessment Report concluded widespread and rapid changes have occurred, the scale of recent changes being unprecedented over many centuries to many thousands of years. These changes will continue under all emission scenarios considered, including increases in frequency and intensity of hot extremes, heatwaves, heavy precipitation and droughts. Wine companies need tools and models allowing to peer into the future and identify the moment for intervention and measures for mitigation and/or avoidance. Previously, we presented conceptual guidelines for a 5-stage framework for defining adaptation strategies for wine businesses. That framework allows for direct comparison of different solutions to mitigate perceived climate change risks. Recent global climatic evolution and multiple reports of severe events since then (smoke taint, heatwave and droughts, frost, hail and floods, rising sea levels) imply urgency in providing effective tools to tackle the multiple perceived risks. A coordinated drive towards a higher level of resilience is therefore required. Recent publications such as the Australian Wine Future Climate Atlas and results from projects such as H2020 MED-GOLD inform on expected climate change impacts to the wine sector, foreseeing the climate to expect at regional and vineyard scale in coming decades. We present examples of practical application of the Climate Change Adaptation Framework (CCAF) to impacts affecting wine production in two wine regions: Barossa (Australia) and Douro (Portugal). We demonstrate feasibility of the framework for climate adaptation from available data and tools to estimate historical climate-induced profitability loss, to project it in the future and to identify critical moments when disruptions may occur if timely measures are not implemented. Finally, we discuss adaptation measures and respective timeframes for successful mitigation of disruptive risk while enhancing resilience of wine systems.