Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

A better understanding of the climate effect on anthocyanin accumulation in grapes using a machine learning approach

The current climate changes are directly threatening the balance of the vineyard at harvest time. The maturation period of the grapes is shifted to the middle of the summer, at a time when radiation and air temperature are at their maximum. In this context, the implementation of corrective practices becomes problematic. Unfortunately, our knowledge of the climate effect on the quality of different grape varieties remains very incomplete to guide these choices. During the Innovine project, original experiments were carried out on Syrah to study the combined effects of normal or high air temperature and varying degrees of exposure of the berries to the sun. Berries subjected to these different conditions were sampled and analyzed throughout the maturation period. Several quality characteristics were determined, including anthocyanin content. The objective of the experiments was to investigate which climatic determinants were most important for anthocyanin accumulation in the berries. Temperature and irradiance data, observed over time with a very thin discretization step, are called functional data in statistics. We developed the procedure SpiceFP (Sparse and Structured Procedure to Identify Combined Effects of Functional Predictors) to explain the variations of a scalar response variable (a grape berry quality variable for example) by two or three functional predictors (as temperature and irradiance) in a context of joint influence of these predictors. Particular attention was paid to the interpretability of the results. Analysis of the data using SpiceFP identified a negative impact of morning combinations of low irradiance (lower than about 100 μmol m−2 s−1 or 45 μmol m−2 s−1 depending on the advanced-delayed state of the berries) and high temperature (higher than 25oC). A slight difference associated with overnight temperature occurred between these effects identified in the morning.

Climate modeling at local scale in the Waipara winegrowing region in the climate change context

In viticulture, a warming climate can have a very significant impact on grapevine development and therefore on the quality and characteristics of wines across different spatial scales, ranging from global to local. In order to adapt wine-growing to climate change, global climate models can be used to define future scenarios, but only at the scale of major wine regions. Despite the huge progress made over the last ten years in terms of the spatial resolution of climate models (now downscaled to a few square kilometres), they are not yet sufficiently precise to account for the local climate variability associated with such parameters as local topography, in spite of these parameters being decisive for vine and wine characteristics. This study describes a method to downscale future climate scenarios to vineyard scale. Networks of data loggers have been used to collect air temperature at canopy level in the Waipara winegrowing region (New Zealand) over five growing seasons. These measurements allow the creation of fine-scale geostatistical models and maps of temperature (at 100 m resolution) for the growing season. In order to model climate change at pilot site scale, these geostatistical models have been combined with regional climate change predictions for the periods 2031-2050 and 2081-2100 based on the RCP8.5 climate change scenario. The integration of local climate variability with regionalized climate change simulations allows assessment of the impacts of climate change at the vineyard scale. The improved knowledge gained using this methodology results from the increased horizontal resolution that better addresses the concerns of winegrowers. The results provide the local winegrowers with information necessary to understand current processes, as well as historical and future viticulture trends at the scale of their site, thereby facilitating decisions about future response strategies.

Underpinning terroir with data: rethinking the zoning paradigm

Agriculture, natural resource management and the production and sale of products such as wine are increasingly data-driven activities. Thus, the use of remote and proximal crop and soil sensors to aid management decisions is becoming commonplace and ‘Agtech’ is proliferating commercially; mapping, underpinned by geographical information systems and complex methods of spatial analysis, is widely used. Likewise, the chemical and sensory analysis of wines draws on multivariate statistics; the efficient winery intake of grapes, subsequent production of wines and their delivery to markets relies on logistics; whilst the sales and marketing of wines is increasingly driven by artificial intelligence linked to the recorded purchasing behaviour of consumers. In brief, there is data everywhere!

Opinions will vary on whether these developments are a good thing. Those concerned with the ‘mystique’ of wine, or the historical aspects of terroir and its preservation, may find them confronting. In contrast, they offer an opportunity to those interested in the biophysical elements of terroir, and efforts aimed at better understanding how these impact on vineyard performance and the sensory attributes of resultant wines. At the previous Terroir Congress, we demonstrated the potential of analytical methods used at the within-vineyard scale in the development of Precision Viticulture, in contributing to a quantitative understanding of regional terroir. For this conference, we take this approach forward with examples from contrasting locations in both the northern and southern hemispheres. We show how, by focussing on the vineyards within winegrowing regions, as opposed to all of the land within those regions, we might move towards a more robust terroir zoning than one derived from a mixture of history, thematic mapping, heuristics and the whims of marketers. Aside from providing improved understanding by underpinning terroir with data, such methods should also promote improved management of the entire wine value chain.

Organic recycled mulches in sustainable viticulture: assessment of spontaneous plants communities and weed coverage

In recent years, developing more efficient and sustainable viticulture management has been essential due to the impact of climate change in semiarid regions. For this reason, the use of recycled organic mulching (ROM) in the vineyard has become an interesting strategy to cope with water stress, isolated soil from extreme temperatures and improving soil humidity, control the presence of weeds and therefore reduce the inputs of herbicides and improve soil fertility. This work aimed to analyse the effect of three different organic mulches [straw (S), grape pruning debris (GPD) and spent mushroom compost (SMC)] and two traditional soil management techniques [herbicide (H) and interrow (IN)] on weed coverage and the spontaneous plant communities’ presence. Data sampling was collected throughout the vine vegetative cycle of 2021 in La Rioja, Spain. The different soil management techniques had a clear effect on weed coverage and his development during the vine vegetative cycle. SMC and H were the treatments with the highest and the lowest coverage percentage, respectively. IN had a delayed weed emergence at the beginning of the vine vegetative cycle, but finally it reached maximum values nearby SMC. GPD and S had similar effects on weed emergence, reaching 25-30% of the maximum coverage values. A total of 29 herbaceous species were identified during the vegetative cycle, some of them very isolated and occasional. Principal component analysis (PCAs) showed a good association between spontaneous species and treatments, furthermore, specific species-treatment associations were found. Moreover, three clear groups of herbaceous communities were identified by cluster analysis. This study provides interesting information about the effect of different alternative soil management on herbaceous plant coverage and weed species communities which could contribute to making more sustainable viticulture.

Variations of soil attributes in vineyards influence their reflectance spectra

Knowledge on the reflectance spectrum of soil is potentially useful since it carries information on soil chemical composition that can be used to the planning of agricultural practices. If compared with analytical methods such as conventional chemical analysis, reflectance measurement provides non-destructive, economic, near real-time data. This paper reports results from reflectance measurements performed by spectroradiometry on soils from two vineyards in south Brazil. The vineyards are close to each other, are on different geological formations, but were subjected to the same management. The objective was to detect spectral differences between the two areas, correlating these differences to variations in their chemical composition, to assess the technique’s potential to predict soil attributes from reflectance data.To that end, soil samples were collected from ten selected vine parcels. Chemical analysis yield data on concentration of twenty-one soil attributes, and spectroradiometry was performed on samples. Chemical differences significant to a 95% confidence level between the two studied areas were found for six soil attributes, and the average reflectance spectra were separated by this same level along most of the observed spectral domain. Correlations between soil reflectance and concentrations of soil attributes were looked for, and for ten soil traits it was possible to define wavelength domains were reflectance and concentrations are correlated to confidence levels from 95% to 99%. Partial Least Squares Regression (PLSR) analyses were performed comparing measured and predicted concentrations, and for fifteen out of 21 soil traits we found Pearson correlation coefficients r > 0.8. These preliminary results, which have to be validated, suggest that variations of concentration in the investigated soil attributes induce differences in reflectance that can be detected by spectroradiometry. Applications of these observations include the assessment of the chemical content of soils by spectroradiometry as a fast, low-cost alternative to chemical analytical methods.