Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

Biodiversity in the vineyard agroecosystem: exploring systemic approaches

Biodiversity conservation and restoration are essential for guarantee the provision of ecosystem services associated to vineyard agroecosystem such as climate regulation trough carbon sequestration and control of pests and diseases. Most of published research dealing with the complexity of the vineyard agroecosystems emphasizes the necessity of innovative approaches, including the integration of information at different temporal and spatial scales and development of systemic analysis based on modelling. A biodiversity survey was conducted in the Franciacorta wine-growing area (Lombardy, Italy), one of the most important Italian wine-growing regions for sparkling wine production, considering a portion of the territory of 112 ha. The area was divided into several Environmental Units (EUs), defined as a whole vineyard or portion of vineyard homogenous in terms of four agronomic characteristics: planting year, planting density, cultivar, and training system. In each EU a set of compartments was identified and characterised by specific variables. The compartments are meteorology, morphology (altitude, slope, aspect, row orientation, and solar irradiance), ecological infrastructures and management. The landscape surrounding EU was also characterised in terms of land-use in a buffer zone of 500 m. For each component a specific methodology was identified and applied. Different statistical approaches were used to evaluate the method to integrate the information related to different compartments within the EU and related to the buffer zone. These approaches were also preliminarily evaluated for their ability to describe the contribution of biodiversity and landscape components to ecosystem services. This methodological exploration provides useful indication for the development of a fully systemic approach to structural and functional biodiversity in vineyard agroecosystems, contributing to promote a multifunctional perspective for the all wine-growing sector.

VINIoT: Precision viticulture service for SMEs based on IoT sensors network

The main innovation in the VINIoT service is the joint use of two technologies that are currently used separately: vineyard monitoring using multispectral imaging and deployed terrain sensors. One part of the system is based on the development of artificial intelligence algorithms that are feed on the images of the multispectral camera and IoT sensors, high-level information on water stress, grape ripening status and the presence of diseases. In order to obtain algorithms to determine the state of ripening of the grapes and avoid losing information due to the diversity of the grape berries, it was decided to work along the first year 2020 at berry scale in the laboratory, during the second year at the cluster scale and on the last year at plot scale. Different varieties of white and red grapes were used; in the case of Galicia we worked with the white grape variety Treixadura and the red variety Mencía. During the 2020 and 2021 campaigns, multispectral images were taken in the visible and infrared range of: 1) sets of 100 grapes classifying them by means of densimetric baths, 2) individual bunches. The images taken with the laboratory analysis of the ripening stage were correlated. Technological maturity, pH, probable degree, malic acid content, tartaric acid content and parameters for assessing phenolic maturity, IPT, anthocyanin content were determined. It has been calculated for each single image the mean value of each spectral band (only taking into account the pixels of interest) and a correlation study of these values with laboratory data has been carried out. These studies are still provisional and it will be necessary to continue with them, jointly with the training of the machine learning algorithms. Processed data will allow to determine the sensitivity of the multispectral images and select bands of interest in maturation.

Drought effect on aromatic and phenolic potential of seven recovered grapevine varieties in Castilla-La Mancha region (Spain)

The effects of climate change are seriously affecting the quality of wine grapes. High temperatures and drought cause imbalances in the chemical composition of grapes. The result is overripe grapes with low acidity and high sugar content, which produce wines with excessive alcohol content, lacking in freshness and not very aromatic. As a consequence, the search of varieties with capacity of produce quality grapes in adverse climate conditions is a good alternative to preserve the sustainability of vineyards. In this work, quality parameters of seven Vitis vinifera L. cultivars (five whites and two reds) recently recovered from extinction and grown under two different hydric regimes (rainfed and irrigated) were analyzed during the 2020 vintage. At harvest time, weight of 100 berries, must physicochemical parameters (brix degree, total acidity, malic acid, pH), and carbon and oxygen isotope ratios (δ13C, δ18O) were determined. Subsequently, varietal aroma potential index (IPAv) and total polyphenol index (TPI) were analyzed. Quality parameters, IPAv and TPI, showed significant differences between varieties and water regimes. Both red varieties, Moribel and Tinto Fragoso, stood out for their high aromatic and phenolic potential, which was higher under rainfed regime. Regarding to white varieties, Montonera del Casar and Jarrosuelto stood out in terms of varietal aroma potential. Montonera del Casar high acidity in its musts and Jarrosuelto showed the highest berry weights.

Effect of the commercial inoculum of arbuscular mycorrhiza in the establishment of a commercial vineyard of the cultivar “Manto negro

The favorable effect of symbiosis with arbuscular mycorrhizal fungi (AMF) has been known and studied since the 60s. Nowadays, many companies took the chance to start promoting and selling commercial inoculants of AMF, in order to be used as biofertilizers and encourage sustainable biological agriculture. However, the positive effect of these commercial biofertilizers on plant growth is not always demonstrated, especially under field conditions. In this study, we used a commercial inoculum on newly planted grapevines of a local cultivar grafted on a common rootstock R110. We followed the physiological status of vines, growth and productivity and functional biodiversity of soil bacteria during the first and second years of 20 inoculated with commercial inoculum bases on Rhizophagus irregularis and Funeliformis mosseaeAMF at field planting time and 20 non-inoculated control plants. All the parameters measured showed a neutral to negative effect on plant growth and production. The inoculated plants always presented lower values of photosynthesis, growth and grape production, although in some cases the differences did not reach statistical significance. On the contrary, the inoculation supposed an increase of the bacterial functional diversity, although the differences were not statistically significant either. Several studies show that the effect of inoculation with AMF is context-dependent. The non-favorable effects are probably due to inoculation ineffectiveness under complex field conditions and/or that, under certain conditions, AMF presence may be a parasitic association. This puts into question the effectiveness of its application in the field. Therefore, it is recommended to only resort to this type of biofertilizer when the cultivation conditions require it (e.g., very low previous microbial diversity, foreseeable stress due to drought, salinity, or lack of nutrients) and not as a general fertilization practice.

Adapting the vineyard to climate change in warm climate regions with cultural practices

Since the 1980s global regime shift, grape growers have been steadily adapting to a changing climate. These adaptations have preserved the region-climate-cultivar rapports that have established the global trade of wine with lucrative economic benefits since the middle of 17th century. The advent of using fractions of crop and actual evapotranspiration replacement in vineyards with the use of supplemental irrigation has furthered the adaptation of wine grape cultivation. The shift in trellis systems, as well as pruning methods from positioned shoot systems to sprawling canopies, as well as adapting the bearing surface from head-trained, cane-pruned to cordon-trained, spur-pruned systems have also aided in the adaptation of grapevine to warmer temperatures. In warm climates, the use of shade cloth or over-head shade films not only have aided in arresting the damage of heat waves, but also identified opportunities to reduce the evapotranspiration from vineyards, reducing environmental footprint of vineyard. Our increase in knowledge on how best to understand the response of grapevine to climate change was aided with the identification of solar radiation exposure biomarker that is now used for phenotyping cultivars in their adaptability to harsh environments. Using fruit-based metrics such as sugar-flavonoid relationships were shown to be better indicators of losses in berry integrity associated with a warming climate, rather than solely focusing on region-climate-cultivar rapports. The resilience of wine grape was further enhanced by exploitation of rootstock × scion combinations that can resist untoward droughts and warm temperatures by making more resilient grapevine combinations. Our understanding of soil-plant-atmosphere continuum in the vineyard has increased within the last 50 years in such a manner that growers are able to use no-till systems with the aid of arbuscular mycorrhiza fungi inoculation with permanent cover cropping making the vineyard more resilient to droughts and heat waves. In premium wine grape regions viticulture has successfully adapted to a rapidly changing climate thus far, but berry based metrics are raising a concern that we may be approaching a tipping point.