Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

VINIoT: Precision viticulture service for SMEs based on IoT sensors network

The main innovation in the VINIoT service is the joint use of two technologies that are currently used separately: vineyard monitoring using multispectral imaging and deployed terrain sensors. One part of the system is based on the development of artificial intelligence algorithms that are feed on the images of the multispectral camera and IoT sensors, high-level information on water stress, grape ripening status and the presence of diseases. In order to obtain algorithms to determine the state of ripening of the grapes and avoid losing information due to the diversity of the grape berries, it was decided to work along the first year 2020 at berry scale in the laboratory, during the second year at the cluster scale and on the last year at plot scale. Different varieties of white and red grapes were used; in the case of Galicia we worked with the white grape variety Treixadura and the red variety Mencía. During the 2020 and 2021 campaigns, multispectral images were taken in the visible and infrared range of: 1) sets of 100 grapes classifying them by means of densimetric baths, 2) individual bunches. The images taken with the laboratory analysis of the ripening stage were correlated. Technological maturity, pH, probable degree, malic acid content, tartaric acid content and parameters for assessing phenolic maturity, IPT, anthocyanin content were determined. It has been calculated for each single image the mean value of each spectral band (only taking into account the pixels of interest) and a correlation study of these values with laboratory data has been carried out. These studies are still provisional and it will be necessary to continue with them, jointly with the training of the machine learning algorithms. Processed data will allow to determine the sensitivity of the multispectral images and select bands of interest in maturation.

Local adaptation tools to ensure the viticultural sustainability in a changing climate

[lwp_divi_breadcrumbs home_text="IVES" use_before_icon="on" before_icon="||divi||400" module_id="publication-ariane" _builder_version="4.19.4" _module_preset="default" module_text_align="center" module_font_size="16px" text_orientation="center"...

Mobile device to induce heat-stress on grapevine berries

Studying heat stress response of grapevine berries in the field often relies on weather conditions during the growing season. We constructed a mobile heating device, able to induce controlled heat stress on grapes in vineyards. The heater consisted of six 150 W infrared lamps mounted in a profile frame. Heating power of the lamps could be controlled individually by a control unit consisting of a single board computer and six temperature sensors to reach a pre-set temperature. The heat energy applied to individual berries within a cluster decreases by the squared distance to the heat source, enabling the establishment of temperature profiles within individual clusters. These profiles can be measured by infrared thermography once a steady state has been reached. Radiant flux density received by a berry depending on the distance was calculated based on a view factor and measured lamp surface temperature and resulted to 665 Wm-2 at 7cm. Infrared thermography of the fruit surface was in good agreement with measurements conducted with a thermocouple inserted at epidermis level. In combination with infrared thermography, the presented device offers possibilities for a wide range of applications like phenotyping for heat tolerance in the field to proceed in the understanding of the complex response of plants to heat stress. Sunburn necrosis symptoms were artificially induced with the aid of the device for cv. Bacchus and cv. Sylvaner in the 2020 and 2021 growing season. Threshold temperatures for sunburn induction (LT5030min) were derived from temperature data of single berries and visual sunburn assessment, applying logistic regression. A comparison of threshold temperatures for the occurrence of sunburn necrosis confirmed the higher susceptibility of cv. Bacchus. The lower susceptibility of cv. Sylvaner did not seem to be related to its phenolic composition, rendering a thermoprotective role of berry phenolic compounds unlikely.

Copper contamination in vineyard soils of Bordeaux: spatial risk assessment for the replanting of vines and crops

Copper (Cu) is widely and historically used in viticulture as a fungicide against mildew. Cu has a strong affinity for soil organic matter and accumulates in topsoil horizons. Thus, Cu may negatively affect soil organisms and plants, consequently reducing soil fertility and productivity. The Bordeaux vineyards have the largest vineyard surfaces (26%) within French controlled appellation and a great proportion of French wine production (around 5 million hl per year). Considering the local context of vineyard surfaces decreasing (vine uprooting) and possible new crop plantation, the issue of Cu potential toxicity rises. Therefore, the aims of this work are firstly to evaluate the Cu contamination in vineyard soils of Bordeaux, secondly to produce a risk assessment map for new vine or crop plantation. We used soil analyses from several local studies to build a database with 4496 soil horizon samples. The database was enhanced by means of pedotransfer functions in order to estimate the bioaccessible (EDTA-extractable) Cu in soils of samples without measurements. From this database, 1797 georeferenced samples with CuEDTA concentrations in the topsoil (0-50 cm depth) were used for kriging interpolation in order to produce the spatial distribution map of CuEDTA in vineyard soils. Then, the spatial distribution of Cu was crossed with vine uprooting surfaces and municipality boundaries. CuEDTAconcentrations ranged from 0.52 to 459 mg/kg and showed clear anomalies. Our results from spatial analysis showed that almost 50% of vineyard soil surfaces have CuEDTA concentrations higher than 30 mg/kg (moderate risk for new plantation) and 20% with concentrations higher than 50 mg/kg (high risk for new plantation). A decision-support map based on municipalities was realised to provide a simple tool to stakeholders concerned by land use management.

Soil, vine, climate change – what is observed – what is expected

To evaluate the current and future impact of climate change on Viticulture requires an integrated view on a complex interacting system within the soil-plant-atmospheric continuum under continuous change. Aside of the globally observed increase in temperature in basically all viticulture regions for at least four decades, we observe several clear trends at the regional level in the ratio of precipitation to potential evapotranspiration. Additionally the recently published 6th assessment report of the IPCC (The physical science basis) shows case-dependent further expected shifts in climate patterns which will have substantial impacts on the way we will conduct viticulture in the decades to come.
Looking beyond climate developments, we observe rising temperatures in the upper soil layers which will have an impact on the distribution of microbial populations, the decay rate of organic matter or the storage capacity for carbon, thus affecting the emission of greenhouse gases (GHGs) and the viscosity of water in the soil-plant pathway, altering the transport of water. If the upper soil layers dry out faster due to less rainfall and/or increased evapotranspiration driven by higher temperatures, the spectral reflection properties of bare soil change and the transport of latent heat into the fruiting zone is increased putting a higher temperature load on the fruit. Interactions between micro-organisms in the rhizosphere and the grapevine root system are poorly understood but respond to environmental factors (such as increased soil temperatures) and the plant material (rootstock for instance), respectively the cultivation system (for example bio-organic versus conventional). This adds to an extremely complex system to manage in terms of increased resilience, adaptation to and even mitigation of climate change. Nevertheless, taken as a whole, effects on the individual expressions of wines with a given origin, seem highly likely to become more apparent.