Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

Organic recycled mulches in sustainable viticulture: assessment of spontaneous plants communities and weed coverage

In recent years, developing more efficient and sustainable viticulture management has been essential due to the impact of climate change in semiarid regions. For this reason, the use of recycled organic mulching (ROM) in the vineyard has become an interesting strategy to cope with water stress, isolated soil from extreme temperatures and improving soil humidity, control the presence of weeds and therefore reduce the inputs of herbicides and improve soil fertility. This work aimed to analyse the effect of three different organic mulches [straw (S), grape pruning debris (GPD) and spent mushroom compost (SMC)] and two traditional soil management techniques [herbicide (H) and interrow (IN)] on weed coverage and the spontaneous plant communities’ presence. Data sampling was collected throughout the vine vegetative cycle of 2021 in La Rioja, Spain. The different soil management techniques had a clear effect on weed coverage and his development during the vine vegetative cycle. SMC and H were the treatments with the highest and the lowest coverage percentage, respectively. IN had a delayed weed emergence at the beginning of the vine vegetative cycle, but finally it reached maximum values nearby SMC. GPD and S had similar effects on weed emergence, reaching 25-30% of the maximum coverage values. A total of 29 herbaceous species were identified during the vegetative cycle, some of them very isolated and occasional. Principal component analysis (PCAs) showed a good association between spontaneous species and treatments, furthermore, specific species-treatment associations were found. Moreover, three clear groups of herbaceous communities were identified by cluster analysis. This study provides interesting information about the effect of different alternative soil management on herbaceous plant coverage and weed species communities which could contribute to making more sustainable viticulture.

Elevational range shifts of mountain vineyards: Recent dynamics in response to a warming climate

Increasing temperatures worldwide are expected to cause a change in spatial distribution of plant species along elevational gradients and there are already observable shifts to higher elevations as a consequence of climate change for many species. Not only naturally growing plants, but also agricultural cultivations are subject to the effects of climate change, as the type of cultivation and the economic viability depends largely on the prevailing climatic conditions. A shift to higher elevations therefore represents a viable adaptation strategy to climate change, as higher elevations are characterized by lower temperatures. This is especially important in the case of viticulture because a certain wine-style can only be achieved under very specific climatic conditions. Although there are several studies investigating climatic suitability within winegrowing regions or longitudinal shifts of winegrowing areas, little is known about how fast vineyards move to higher elevations, which may represent a viable strategy for winegrowers to maintain growing conditions and thus wine-style, despite the effects of climate change. We therefore investigated the change in the spatial distribution of vineyards along an elevational gradient over the past 20 years in the mountainous wine-growing region of Alto Adige (Italy). A dataset containing information about location and planting year of more than 26000 vineyard parcels and 30 varieties was used to perform this analysis. Preliminary results suggest that there has been a shift to higher elevations for vineyards in general (from formerly 700m to currently 850 m a.s.l., with extreme sites reaching 1200 m a.s.l.), but also that this development has not been uniform across different varieties and products (i.e. vitis vinifera vs hybrid varieties and still vssparkling wines). This is important for climate change adaptation as well as for rural development. Mountain areas, especially at mid to high elevations, are often characterized by severe land abandonment which can be avoided to some degree if economically viable and sustainable land management strategies are available.

Extreme canopy management for vineyard adaptation to climate change: is it a good idea?

Climate change constitutes an enormous challenge for humankind and for all human activities, viticulture not being an exception. Long-term strategic changes are probably needed the most, but growers also need to deal with short-term changes: summers that are getting progressively warmer, earlier harvest dates and higher pH in musts and wines. In the last 10-15 years, a relevant corpus of research is being developed worldwide in order to evaluate to which extent extreme canopy management operations, aimed at reducing leaf area and, thus, limiting the source to sink ratio, could be useful to delay ripening. Although extreme canopy management can result in relevant delays in harvest dates, longer term studies, as well as detailed analysis of their implications on carbohydrate reserves, bud fertility and future yield are desirable before these practices can be recommended.

Evaluation of climate change impacts at the Portuguese Dão terroir over the last decades: observed effects on bioclimatic indices and grapevine phenology

In the last decades the growers of the Portuguese Dão winegrowing region (center of Portugal) are experiencing changes in climate that are influencing either grape phenology berry health and ripening. Aiming to study the relationships between climate indices (CI), seasonal weather and grapevine phenology, in this work long-term climate and phenological data collected at the experimental vineyard of the Portuguese Dão research centre between 1958 and 2019 (61 years) for the red variety Touriga Nacional, was analyzed. The trends over time for the classical temperature-based indices (Growing Season Temperature – GST -, Growing Degree Days – GDD, Huglin Index – HI and Cool Night Index – CI) presented a significantly positive slope while the Dryness Index (DI) showed a negative trend over the last 61 years. Regarding grapevine phenology, an average advance of 4.5 days per decade in the harvest day was observed throughout the last 61 years. Consequently, the weather conditions during the ripening period have changed, showing an increasing trend over time in the average temperature (higher magnitude in the maximum than in the minimum temperature) and a decrease in the accumulated rainfall. A regression analysis showed that ~50% of harvest date variability over years was explained by the temperature-based indices variability. These observed effects of climate change on bioclimatic indices and corresponding anticipation of harvest date can still be considered advantageous for the Dão terroir as it allows to achieve an optimal berry ripening before the common equinox rains and, therefore, avoid the potential negative impacts of the rainfall on berry health and composition.

Mobile device to induce heat-stress on grapevine berries

Studying heat stress response of grapevine berries in the field often relies on weather conditions during the growing season. We constructed a mobile heating device, able to induce controlled heat stress on grapes in vineyards. The heater consisted of six 150 W infrared lamps mounted in a profile frame. Heating power of the lamps could be controlled individually by a control unit consisting of a single board computer and six temperature sensors to reach a pre-set temperature. The heat energy applied to individual berries within a cluster decreases by the squared distance to the heat source, enabling the establishment of temperature profiles within individual clusters. These profiles can be measured by infrared thermography once a steady state has been reached. Radiant flux density received by a berry depending on the distance was calculated based on a view factor and measured lamp surface temperature and resulted to 665 Wm-2 at 7cm. Infrared thermography of the fruit surface was in good agreement with measurements conducted with a thermocouple inserted at epidermis level. In combination with infrared thermography, the presented device offers possibilities for a wide range of applications like phenotyping for heat tolerance in the field to proceed in the understanding of the complex response of plants to heat stress. Sunburn necrosis symptoms were artificially induced with the aid of the device for cv. Bacchus and cv. Sylvaner in the 2020 and 2021 growing season. Threshold temperatures for sunburn induction (LT5030min) were derived from temperature data of single berries and visual sunburn assessment, applying logistic regression. A comparison of threshold temperatures for the occurrence of sunburn necrosis confirmed the higher susceptibility of cv. Bacchus. The lower susceptibility of cv. Sylvaner did not seem to be related to its phenolic composition, rendering a thermoprotective role of berry phenolic compounds unlikely.