Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

VINIoT: Precision viticulture service for SMEs based on IoT sensors network

The main innovation in the VINIoT service is the joint use of two technologies that are currently used separately: vineyard monitoring using multispectral imaging and deployed terrain sensors. One part of the system is based on the development of artificial intelligence algorithms that are feed on the images of the multispectral camera and IoT sensors, high-level information on water stress, grape ripening status and the presence of diseases. In order to obtain algorithms to determine the state of ripening of the grapes and avoid losing information due to the diversity of the grape berries, it was decided to work along the first year 2020 at berry scale in the laboratory, during the second year at the cluster scale and on the last year at plot scale. Different varieties of white and red grapes were used; in the case of Galicia we worked with the white grape variety Treixadura and the red variety Mencía. During the 2020 and 2021 campaigns, multispectral images were taken in the visible and infrared range of: 1) sets of 100 grapes classifying them by means of densimetric baths, 2) individual bunches. The images taken with the laboratory analysis of the ripening stage were correlated. Technological maturity, pH, probable degree, malic acid content, tartaric acid content and parameters for assessing phenolic maturity, IPT, anthocyanin content were determined. It has been calculated for each single image the mean value of each spectral band (only taking into account the pixels of interest) and a correlation study of these values with laboratory data has been carried out. These studies are still provisional and it will be necessary to continue with them, jointly with the training of the machine learning algorithms. Processed data will allow to determine the sensitivity of the multispectral images and select bands of interest in maturation.

Modelling vine water stress during a critical period and potential yield reduction rate in European wine regions: a retrospective analysis

Most European vineyards are managed under rainfed conditions, where seasonal water deficit has become increasingly important. The flowering-veraison phenophase represents an important period for vine response to water stress, which is seldomly thoroughly evaluated. Therefore, we aim to quantify the flowering-veraison water stress levels using Crop Water Stress Indicator (CWSI) over 1986–2015 for important European wine regions, and to assess the respective potential Yield Lose Rate (YLR). Additionally, we also investigate whether an advanced flowering-veraison phase may help alleviating the water stress with improved yield. A process-based grapevine model STICS is employed, which has been extensively calibrated for flowering and veraison stages using observed data at 38 locations with 10 different grapevine varieties. Subsequently, the model is being implemented at the regional level, considering site-specific calibration results and gridded climate and soil datasets. The findings suggest wine regions with stronger flowering-veraison CWSI tend to have higher potential YLR. However, contrasting patterns are found between wine regions in France-Germany-Luxembourg and Italy-Portugal-Spain. The former tends to have slight-to-moderate drought conditions (CWSI<0.5) and a negligible-to-moderate YLR (<30%), whereas the latter possesses severe-to-extreme CWSI (>0.5) and substantial YLR (>40%). Wine regions prone to a high drought risk (CWSI>0.75) are also identified, which are concentrated in southern Mediterranean Europe. An advanced flowering-veraison phase may have benefited from cooler temperatures and a higher fraction of spring precipitation in wine regions of Italy-Portugal-Spain, resulting in alleviated CWSI and moderate reductions of YLR. For those of France-Germany-Luxembourg, this can have reduced flowering-veraison precipitation, but prevalent alleviations of YLR are also found, possibly because of shifted phase towards a cooler growing season with reduced evaporative demands. Overall, such a retrospective analysis might provide new insights towards better management of seasonal water deficit for conventionally vulnerable Mediterranean wine regions, but also for relatively cooler and wetter Central European regions.

Simulating climate change impact on viticultural systems in historical and emergent vineyards

Global climate change affects regional climates and hold implications for wine growing regions worldwide. Although winegrowers are constantly adapting to internal and external factors, it seems relevant to develop tools, which will allow them to better define actual and future agro-climatic potentials. Within this context, we develop a modelling approach, able to simulate the impact of environmental conditions and constraints on vine behaviour and to highlight potential adaptation strategies according to different climate change scenarios. Our modeling approach, named SEVE (Simulating Environmental impacts on Viticultural Ecosystems), provides a generic modeling framework for simulating grapevine growth and berry ripening under different conditions and constraints (slope, aspect, soil type, climate variability…) as well as production strategies and adaptation rules according to climate change scenarios. Each activity is represented by an autonomous agent able to react and adapt its reaction to the variability of environmental constraints. Using this model, we have recently analyzed the evolution of vineyards’ exposure to climatic risks (frost, pathogen risk, heat wave) and the adaptation strategies potentially implemented by the winegrowers. This approach, implemented for two climate change scenarios, has been initiated in France on traditional (Loire Valley) and emerging (Brittany) vineyards. The objective is to identify the time horizons of adaptations and new opportunities in these two regions. Carried out in collaboration with wine growers, this approach aims to better understand the variability of climate change impacts at local scale in the medium and long term.

Second pruning as a strategy to delay maturation in cv. ‘Touriga nacional’ in the Portuguese Douro region

The advance in maturation of wine grapes is an important climate change risk related effect that could affect warm regions like Portuguese Douro Wine Region. Indeed, the climate analysis over the past years registered a decrease in the precipitation, significant higher average temperatures, and a more frequent occurrence of extreme weather events, including heat waves. In these conditions the length from anthesis until maturation is shortened and the uncoupling of technical and phenolic maturity results in berries with higher sugar concentration (and lower acidity), but lower anthocyanins, tannins, and total phenolic concentration, which produce unbalanced wines.
In this work, an innovative strategy of crop forcing, based on forcing vine regrowth after a second pruning of green shoots, was tested, aimed at delaying ripening until the temperature becomes lower and, therefore, preventing acidity loss and increasing anthocyanin-to-sugar ratio. The experiments were conducted in 2019 and 2020 in a commercial vineyard of ‘Touriga Nacional’ located in the Douro Region. Crop forcing was conducted 15 (CF1) to 30 (CF2) days after fruit set. Vines pruned with conventional methods were used as control (CF0). Results confirmed that fruit ripening was shifted from the hot season (August/September), until a cooler period (October through early-November). At harvest, grapevine berries from CF1 and CF2 presented lower pH and higher acidity, than control, with no significant differences in colour intensity and phenolic levels composition. Sugar content was lower in CF2-treated vines in both seasons. However, in CF-treated vines the number and size of clusters were significantly lower (up to 88% reduction) than in control plants. A metabolomics analysis of mature berries from CF-treated vines and control is underway. Crop forcing was indeed effective in producing a more balance berry composition but severely reduced grapevine yield,

Deconstructing the soil component of terroir: from controversy to consensus

Wine terroir describes the collectively recognized relation between a geographical area and the distinctive organoleptic characteristics of the wines produced in it. The overriding objective in terroir studies is therefore to provide scientific proof relating the properties of terroir components to wine quality and typicity. In scientific circles, the role of climate (macro-, meso- and micro-) on grape and wine characteristics is well documented and accepted as the most critical. Moreover, there has been increasing interest in recent years about new elements with possible importance in shaping wine terroir like berry/leaf/soil microbiology or even aromatic plants in proximity to the vineyard conferring flavors to the grapes. However, the actual effect of these factors is also dependent on complex interactions with plant material (variety/clone, rootstock, vine age) and with human factors.
The contribution of soil, although a fundamental component of terroir and extremely popular among wine enthusiasts, remains a much-debated issue among researchers. The role of geology is probably the one mostly associated by consumers with the notion of terroir with different parent rocks considered to give birth to different wine styles. However, the relationship between wine properties and the underlying parent material raises a lot of controversy especially regarding the actual existence of rock-derived flavors in the wine (e.g. minerality). As far as the actual soil properties are concerned, the effect of soil physical properties is generally regarded as the most significant (e.g sandy soils being associated with lighter wines while those on clay with colored and tannic ones) mostly through control of water availability which ultimately modifies berry ripening conditions either directly by triggering biosynthetic pathways, or indirectly by altering vigor and yield components. The role of soil chemistry seems to be weakly associated to wine sensory characteristic, although N, K, S and Ca, but also soil pH, are often considered important in the overall soil effect.
Recently, in the light of evidence provided by precision agriculture studies reporting a high variability of vineyard soils, the spatial scale should also be taken into consideration in the evaluation of the soil effects on wines. While it is accepted that soil effects become more significant than climate on a local level, it is not clear whether these micro-variations of vineyard soils are determining in the terroir effect. Moreover, as terroir is not a set of only natural factors, the magnitude of the contribution of human-related factors (irrigation, fertilization, soil management) to the soil effect still remains ambiguous. Lastly, a major shortcoming of the majority of works about soil effects on wine characteristics is the absence of connection with actual vine physiological processes since all soil effects on grape and wine chemistry and sensorial properties are ultimately mediated through vine responses.
This article attempts to breakdown the main soil attributes involved in the terroir effect to suggest an improved understanding about soil’s true contribution to wine sensory characteristics. It is proposed that soil parameters per se are not as significant determining factors in the terroir effect but rather their mutual interactions as well as with other natural and human factors included in the terroir concept. Consequently, similarly to bioclimatic indices, composite soil indices (i.e. soil depth, water holding capacity, fertility, temperature etc), incorporating multiple soil parameters, might provide a more accurate and quantifiable means to assess the relative weight of the soil component in the terroir effect.