Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

A multidisciplinary approach to evaluate the effects of the training system on the performance of “Aglianico del Vulture” vineyards

Vineyards are complex agro-ecosystems with high spatial and temporal variability. An efficient training system may counteract the adverse effects of this variability. Moreover, considering the climate change issues, choosing an efficient training system that enhances water use and protects the vines from radiative thermal stress has become a priority for the farmers. A multidisciplinary approach that assesses the soil-crop-yield-wine relationships of vineyards in a distributed and holistic way could bring added knowledge on the behavior of the different training systems. This ongoing research aimed to implement a multidisciplinary approach to study the behavior of “Aglianico del Vulture” grapevines trained with two different systems: a spurred cordon (SC) and an “Alberello in parete” (AL), grown in a high-quality wine production area of Basilicata region (Italy). The approach merged several methods and scales of soil, ecophysiology, must/wine quality, and spectral data collection to assess the influence of the training system. Homogeneous zones (HZs) in both training systems were defined through a procedure based on geomorphological classification, unmanned aerial vehicles (UAV) images analysis, and a traditional soil survey supported by geophysical scanning. During the 2021 season, TDR probes monitored soil water content, while grapevine health status was assessed using eco-physiological measurements (LWP, chlorophyll content, PSII photosynthetic efficiency, LAI, and point-based field spectroscopy). These grapevine in-vivo measurements validated the spectral vegetation indexes (NDVI, RENDVI, CVI, and TVI) derived from the UAV multispectral imagery, which monitored the grapevine status in a distributed and non-invasive way. Grape yield, quality of berries, must and wine were measured to assess the effects of the training systems. The first experimental year results showed the variability of the vineyards and revealed relationships among soil parameters, crop characteristics, and vegetation indices of the SC and AL training systems. This multidisciplinary study could bring new insights into the vineyard training system’s effects on grape yield and wine quality.

Climate ethnography and wine environmental futures

Globalisation and climate change have radically transformed world wine production upsetting the established order of wine ecologies. Ecological risks and the future of traditional agricultural systems are widely debated in anthropology, but very little is understood of the particular challenges posed by climate change to viticulture which is seen by many as the canary in the coalmine of global agriculture. Moreover, wine as a globalised embedded commodity provides a particularly telling example for the study of climate change having already attracted early scientific attention. Studies of climate change in viticulture have focused primarily on the production of systematic models of adaptation and vulnerability, while the human and cultural factors, which are key to adaptation and sustainable futures, are largely missing. Climate experts have been unanimous in recognising the urgent need for a better understanding of the complex dynamics that shape how climate change is experienced and responded to by human systems. Yet this call has not yet been addressed. Climate ethnography, coined by the anthropologist Susan Crate (2011), aims to bridge this growing disjuncture between climate science and everyday life through the exploration of the social meaning of climate change. It seeks to investigate the confrontation of its social salience in different locations and under different environmental guises (Goodman 2018: 340). By understanding how wine producers make sense of the world (and the environment) and act in it, it proposes to focus on the co-production of interdisciplinary knowledge by identifying and foreshadowing problems (Goodman 2018: 342; Goodman & Marshall 2018). It seeks to offer an original, transformative and contrasted perspective to climate change scenarios by investigating human agency -individual or collective- in all its social, political and cultural diversity. An anthropological approach founded on detailed ethnographies of wine production is ideally placed to address economic, social and cultural disruptions caused by the emergence of these new environmental challenges. Indeed, the community of experts in environmental change have recently called for research that will encompass the human dimension and for more broad-based, integrated through interdisciplinarity, useful knowledge (Castree & al 2014). My paper seeks to engage with climate ethnography and discuss what it brings to the study of wine environmental futures while exploring the limitations of the anthropological environmental approach.

The plantation frame as a measure of adaptation to climate change

The mechanization of vineyard work originally led to a reduction in planting densities due to the lack of machinery adapted to the vineyard. The current availability of specific machinery makes it possible to establish higher planting densities. In this work, three planting densities (1.40×0.80 m, 1.80×1 m and 2.20×1.20 m, corresponding to 8928, 5555 and 3787 plants/ha respectively) were studied with four varieties autochthonous of Galicia (northwestern Spain): Albariño and Treixadura (white), Sousón and Mencía (red). The vines were trained in a vertical shoot positioning system using a single Royat cordon, and pruned to spurs with two buds each. Agronomic data (yield, pruning wood weight, Ravaz index) and oenological data in must were collected. The higher planting density (1.40×0.80 m) had no significant effect on grape yield per vine in white varieties, although production per hectare was much higher due to the greater number of plants. In red varieties, this planting density resulted in a significantly lower production per vine, compensated by the greater number of plants. In addition, it significantly reduced the Brix degree in the must of the Albariño, Treixadura and Sousón varieties, and increased the total acidity in the latter two and Mencía. It also caused an increase in extractable and total anthocyanins and IPT in red grapes. The effects of high planting density on grapes are of great interest for the adaptation of varieties in the context of climate change. In the future, it could be advisable to modify the limits imposed by the appellations of origin on the planting density of these varieties in order to obtain more balanced wines.

Effect of the commercial inoculum of arbuscular mycorrhiza in the establishment of a commercial vineyard of the cultivar “Manto negro

The favorable effect of symbiosis with arbuscular mycorrhizal fungi (AMF) has been known and studied since the 60s. Nowadays, many companies took the chance to start promoting and selling commercial inoculants of AMF, in order to be used as biofertilizers and encourage sustainable biological agriculture. However, the positive effect of these commercial biofertilizers on plant growth is not always demonstrated, especially under field conditions. In this study, we used a commercial inoculum on newly planted grapevines of a local cultivar grafted on a common rootstock R110. We followed the physiological status of vines, growth and productivity and functional biodiversity of soil bacteria during the first and second years of 20 inoculated with commercial inoculum bases on Rhizophagus irregularis and Funeliformis mosseaeAMF at field planting time and 20 non-inoculated control plants. All the parameters measured showed a neutral to negative effect on plant growth and production. The inoculated plants always presented lower values of photosynthesis, growth and grape production, although in some cases the differences did not reach statistical significance. On the contrary, the inoculation supposed an increase of the bacterial functional diversity, although the differences were not statistically significant either. Several studies show that the effect of inoculation with AMF is context-dependent. The non-favorable effects are probably due to inoculation ineffectiveness under complex field conditions and/or that, under certain conditions, AMF presence may be a parasitic association. This puts into question the effectiveness of its application in the field. Therefore, it is recommended to only resort to this type of biofertilizer when the cultivation conditions require it (e.g., very low previous microbial diversity, foreseeable stress due to drought, salinity, or lack of nutrients) and not as a general fertilization practice.

Mobile device to induce heat-stress on grapevine berries

Studying heat stress response of grapevine berries in the field often relies on weather conditions during the growing season. We constructed a mobile heating device, able to induce controlled heat stress on grapes in vineyards. The heater consisted of six 150 W infrared lamps mounted in a profile frame. Heating power of the lamps could be controlled individually by a control unit consisting of a single board computer and six temperature sensors to reach a pre-set temperature. The heat energy applied to individual berries within a cluster decreases by the squared distance to the heat source, enabling the establishment of temperature profiles within individual clusters. These profiles can be measured by infrared thermography once a steady state has been reached. Radiant flux density received by a berry depending on the distance was calculated based on a view factor and measured lamp surface temperature and resulted to 665 Wm-2 at 7cm. Infrared thermography of the fruit surface was in good agreement with measurements conducted with a thermocouple inserted at epidermis level. In combination with infrared thermography, the presented device offers possibilities for a wide range of applications like phenotyping for heat tolerance in the field to proceed in the understanding of the complex response of plants to heat stress. Sunburn necrosis symptoms were artificially induced with the aid of the device for cv. Bacchus and cv. Sylvaner in the 2020 and 2021 growing season. Threshold temperatures for sunburn induction (LT5030min) were derived from temperature data of single berries and visual sunburn assessment, applying logistic regression. A comparison of threshold temperatures for the occurrence of sunburn necrosis confirmed the higher susceptibility of cv. Bacchus. The lower susceptibility of cv. Sylvaner did not seem to be related to its phenolic composition, rendering a thermoprotective role of berry phenolic compounds unlikely.