Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

Terroir analysis and its complexity

Terroir is not only a geographical site, but it is a more complex concept able to express the “collective knowledge of the interactions” between the environment and the vines mediated through human action and “providing distinctive characteristics” to the final product (OIV 2010). It is often treated and accepted as a “black box”, in which the relationships between wine and its origin have not been clearly explained. Nevertheless, it is well known that terroir expression is strongly dependent on the physical environment, and in particular on the interaction between soil-plant and atmosphere system, which influences the grapevine responses, grapes composition and wine quality. The Terroir studying and mapping are based on viticultural zoning procedures, obtained with different levels of know-how, at different spatial and temporal scales, empiricism and complexity in the description of involved bio-physical processes, and integrating or not the multidisciplinary nature of the terroir. The scientific understanding of the mechanisms ruling both the vineyard variability and the quality of grapes is one of the most important scientific focuses of terroir research. In fact, this know-how is crucial for supporting the analysis of climate change impacts on terroir resilience, identifying new promised lands for viticulture, and driving vineyard management toward a target oenological goal. In this contribution, an overview of the last findings in terroir studies and approaches will be shown with special attention to the terroir resilience analysis to climate change, facing the use and abuse of terroir concept and new technology able to support it and identifying the terroir zones.

Copper contamination in vineyard soils of Bordeaux: spatial risk assessment for the replanting of vines and crops

Copper (Cu) is widely and historically used in viticulture as a fungicide against mildew. Cu has a strong affinity for soil organic matter and accumulates in topsoil horizons. Thus, Cu may negatively affect soil organisms and plants, consequently reducing soil fertility and productivity. The Bordeaux vineyards have the largest vineyard surfaces (26%) within French controlled appellation and a great proportion of French wine production (around 5 million hl per year). Considering the local context of vineyard surfaces decreasing (vine uprooting) and possible new crop plantation, the issue of Cu potential toxicity rises. Therefore, the aims of this work are firstly to evaluate the Cu contamination in vineyard soils of Bordeaux, secondly to produce a risk assessment map for new vine or crop plantation. We used soil analyses from several local studies to build a database with 4496 soil horizon samples. The database was enhanced by means of pedotransfer functions in order to estimate the bioaccessible (EDTA-extractable) Cu in soils of samples without measurements. From this database, 1797 georeferenced samples with CuEDTA concentrations in the topsoil (0-50 cm depth) were used for kriging interpolation in order to produce the spatial distribution map of CuEDTA in vineyard soils. Then, the spatial distribution of Cu was crossed with vine uprooting surfaces and municipality boundaries. CuEDTAconcentrations ranged from 0.52 to 459 mg/kg and showed clear anomalies. Our results from spatial analysis showed that almost 50% of vineyard soil surfaces have CuEDTA concentrations higher than 30 mg/kg (moderate risk for new plantation) and 20% with concentrations higher than 50 mg/kg (high risk for new plantation). A decision-support map based on municipalities was realised to provide a simple tool to stakeholders concerned by land use management.

The impact of leaf canopy management on eco-physiology, wood chemical properties and microbial communities in root, trunk and cordon of Riesling grapevines (Vitis vinifera L.)

In the last decades, climate change required already adaptation of vineyard management. Increase in temperature and unexpected weather events cause changes in all phenological stages requiring new management tools. For example, defoliation can be a useful tool to reduce the sugar content in the berries creating differences in the wine profiles. In a ten-year field experiment using Riesling (Vitis vinifera L, planted 1986, Geisenheim, Germany), various mechanical defoliation strategies and different intensities were trialed until 2016 before the vineyard was uprooted. Wood was sampled from the plant compartments root, trunk, cordon and shoot for analyses of physicochemical properties (e.g. lignin and element content, pH, diameter), nonstructural carbohydrates and the microbial communities. The aim of the study was to investigate the influence of reduced canopy leaf area on the sink-source allocation into different compartments and potential changes of the fungal and prokaryotic wood-inhabiting community using a metabarcoding approach. Severe summer pruning (SSP) of the canopy and mechanical defoliation (MDC) above the bunch zone decreased the leaf area by 50% compared to control (C). SSP reduced the photosynthetic capacity, which resulted in an altered source-sink allocation and carbohydrate storage. With lower leaf area, less carbohydrates are allocated. This for example resulted in a decreased trunk diameter. Further, it affected the composition of the grapevine wood microbiota. SSP and MDC management changed significantly the prokaryotic community composition in wood of the root samples, but had no effect in other compartments. In general, this study found strong compartment and less management effects of the microbial community composition and associated physicochemical properties. The highest microbial diversities were identified in the wood of the trunk, and several species were recorded the first time in grapevine.

Mapping and tracking canopy size with VitiCanopy

Understanding vineyard variability to target management strategies, apply inputs efficiently and deliver consistent grape quality to the winery is essential. However, despite inherent vineyard variability, the majority are managed as if they are uniform. VitiCanopy is a simple, grower-friendly tool for precision/digital viticulture that allows users to collect and interpret objective spatial information about vineyard performance. After four years of field and market research, an upgraded VitiCanopy has been created to achieve a more streamlined, technology-assisted vine monitoring tool that provides users with a set of superior new features, which could significantly improve the way users monitor their grapevines. These new features include:
• New user interface
• User authentication
• Batch analysis of multiple images
• Ease the learning curve through enhanced help features
• Reporting via the creation of colour maps that will allow users to assess the spatial differences in canopies within a vineyard.
Use-case examples are presented to demonstrate the quantification and mapping of vineyard variability through objective canopy measurements, ground-truthing of remotely sensed measurements, monitoring of crop conditions, implementation of disease and water management decisions as well as creating a history of each site to forecast quality. This intelligent tool allows users to manage grapevines and make informed management choices to achieve the desired production targets and remain profitable.

Mobile device to induce heat-stress on grapevine berries

Studying heat stress response of grapevine berries in the field often relies on weather conditions during the growing season. We constructed a mobile heating device, able to induce controlled heat stress on grapes in vineyards. The heater consisted of six 150 W infrared lamps mounted in a profile frame. Heating power of the lamps could be controlled individually by a control unit consisting of a single board computer and six temperature sensors to reach a pre-set temperature. The heat energy applied to individual berries within a cluster decreases by the squared distance to the heat source, enabling the establishment of temperature profiles within individual clusters. These profiles can be measured by infrared thermography once a steady state has been reached. Radiant flux density received by a berry depending on the distance was calculated based on a view factor and measured lamp surface temperature and resulted to 665 Wm-2 at 7cm. Infrared thermography of the fruit surface was in good agreement with measurements conducted with a thermocouple inserted at epidermis level. In combination with infrared thermography, the presented device offers possibilities for a wide range of applications like phenotyping for heat tolerance in the field to proceed in the understanding of the complex response of plants to heat stress. Sunburn necrosis symptoms were artificially induced with the aid of the device for cv. Bacchus and cv. Sylvaner in the 2020 and 2021 growing season. Threshold temperatures for sunburn induction (LT5030min) were derived from temperature data of single berries and visual sunburn assessment, applying logistic regression. A comparison of threshold temperatures for the occurrence of sunburn necrosis confirmed the higher susceptibility of cv. Bacchus. The lower susceptibility of cv. Sylvaner did not seem to be related to its phenolic composition, rendering a thermoprotective role of berry phenolic compounds unlikely.