Terroir 2020 banner
IVES 9 IVES Conference Series 9 International Terroir Conferences 9 Terroir 2020 9 History and innovation of terroir 9 Detection of spider mite using artificial intelligence in digital viticulture

Detection of spider mite using artificial intelligence in digital viticulture

Abstract

Aim: Pests have a high impact on yield and grape quality in viticulture. An objective and rapid detection of pests under field conditions is needed. New sensing technologies and artificial intelligence could be used for pests detection in digital viticulture. The aim of this work was to apply computer vision and deep learning techniques for automatic detection of spider mite symptoms in grapevine under field conditions. 

Methods and Results: RGB images of grapevine canopy attacked by the spider mite (Eotetranychus carpini Oud) were manually taken in commercial vineyard (Etxano, Basque Country, Spain) under natural day light conditions. Leaf segmentation in images was performed based on computer vision techniques, isolating target leaves with spider mite visual symptoms from the vineyard canopy. HSV colour space was used to consider colour variations representing symptoms on the leaves, separating these values from those of saturation and brightness of the image. Spider mite detection was done using Convolutional Neural Networks (CNN) models with an artificially augmented dataset for the classification of leaves with this pest symptoms. An accuracy surpassing 75% was obtained using a hold-out validation.

Conclusions: 

High accuracy proves the effectiveness of the trained model in the classification of grapevine leaves. Computer vision techniques were useful to image classification on the relevant pixels. Additionally, deep learning techniques provided a robust model to find complex features of spider mite visual symptoms.

Significance and Impact of the Study: Non-invasive technology and artificial intelligence shown promising results in the automatic detection of pests in commercial vineyards.

DOI:

Publication date: March 23, 2021

Issue: Terroir 2020

Type: Video

Authors

Inés Hernández1, Salvador Gutiérrez2, Sara Ceballos1, Ignacio Barrio1, Fernando Palacios1, Ana M. Diez-Navajas3, Javier Tardáguila1*

1Televitis Research Group. University of La Rioja, 26007 Logroño, Spain 
2Department of Computer Science and Engineering, University of Cádiz, 11519 Puerto Real, Spain 
3Department of Plant Production and Protection, NEIKER-Basque Institute for Agricultural Research and Development, Basque Research and Technology Alliance (BRTA), 01192 Arkaute, Spain

Contact the author

Keywords

Deep learning, computer vision, pests, grapevine, crop protection

Tags

IVES Conference Series | Terroir 2020

Citation

Related articles…

Soil, vine, climate change – what is observed – what is expected

To evaluate the current and future impact of climate change on Viticulture requires an integrated view on a complex interacting system within the soil-plant-atmospheric continuum under continuous change. Aside of the globally observed increase in temperature in basically all viticulture regions for at least four decades, we observe several clear trends at the regional level in the ratio of precipitation to potential evapotranspiration. Additionally the recently published 6th assessment report of the IPCC (The physical science basis) shows case-dependent further expected shifts in climate patterns which will have substantial impacts on the way we will conduct viticulture in the decades to come.
Looking beyond climate developments, we observe rising temperatures in the upper soil layers which will have an impact on the distribution of microbial populations, the decay rate of organic matter or the storage capacity for carbon, thus affecting the emission of greenhouse gases (GHGs) and the viscosity of water in the soil-plant pathway, altering the transport of water. If the upper soil layers dry out faster due to less rainfall and/or increased evapotranspiration driven by higher temperatures, the spectral reflection properties of bare soil change and the transport of latent heat into the fruiting zone is increased putting a higher temperature load on the fruit. Interactions between micro-organisms in the rhizosphere and the grapevine root system are poorly understood but respond to environmental factors (such as increased soil temperatures) and the plant material (rootstock for instance), respectively the cultivation system (for example bio-organic versus conventional). This adds to an extremely complex system to manage in terms of increased resilience, adaptation to and even mitigation of climate change. Nevertheless, taken as a whole, effects on the individual expressions of wines with a given origin, seem highly likely to become more apparent.

Estimating bulk stomatal conductance of grapevine canopies

In response to changes in their environment, grapevines regulate transpiration using various physiological mechanisms that alter conductance of water through the soil-plant-atmosphere continuum. Expressed as bulk stomatal conductance at the canopy scale, it varies diurnally in response to changes in vapor pressure deficit and net radiation, and over the season to changes in soil water deficits and hydraulic conductivity of both soil and plant. It is necessary to characterize the response of conductance to these variables to better model how vine transpiration also responds to these variables. Furthermore, to be relevant for vineyard-scale modeling, conductance is best characterized using data collected in a vineyard setting. Applying a crop canopy energy flux model developed by Shuttleworth and Wallace, bulk stomatal conductance was estimated using measurements of individual vine sap flow, temperature and humidity within the vine canopy, and estimates of net radiation absorbed by the vine canopy. These measurements were taken on several vines in a non-irrigated vineyard in Bordeaux France, using equipment that did not interfere with ongoing vineyard operations. An inverted Penman-Monteith equation was then used to calculate bulk stomatal conductance on 15-minute intervals from July to mid-September 2020. Time-series plots show significant diurnal variation and seasonal decreases in conductance, with overall values similar to those in the literature. Global sensitivity analysis using non-parametric regression found transpiration flux and vapor pressure deficit to be the most important input variables to the calculation of bulk stomatal conductance, with absorbed net radiation and bulk boundary layer conductance being much less important. Conversely, bulk stomatal conductance was one of the most important inputs when calculating vine transpiration, further emphasizing the need for characterizing its response to environmental changes for use in vineyard water use modeling.

Comparison of imputation methods in long and varied phenological series. Application to the Conegliano dataset, including observations from 1964 over 400 grape varieties

A large varietal collection including over 1700 varieties was maintained in Conegliano, ITA, since the 1950s. Phenological data on a subset of 400 grape varieties including wine grapes, table grapes, and raisins were acquired at bud break, flowering, veraison, and ripening since 1964. Despite the efforts in maintaining and acquiring data over such an extensive collection, the data set has varying degrees of missing cases depending on the variety and the year. This is ubiquitous in phenology datasets with significant size and length. In this work, we evaluated four state-of-the-art methods to estimate missing values in this phenological series: k-Nearest Neighbour (kNN), Multivariate Imputation by Chained Equations (mice), MissForest, and Bidirectional Recurrent Imputation for Time Series (BRITS). For each phenological stage, we evaluated the performance of the methods in two ways. 1) On the full dataset, we randomly hold-out 10% of the true values for use as a test set and repeated the process 1000 times (Monte Carlo cross-validation). 2) On a reduced and almost complete subset of varieties, we varied the percentage of missing values from 10% to 70% by random deletion. In all cases, we evaluated the performance on the original values using normalized root mean squared error. For the full dataset we also obtained performance statistics by variety and by year. MissForest provided average errors of 17% (3 days) at budbreak, 14% (4 days) at flowering, 14.5% (7 days) at veraison, and 17% (3 days) at maturity. We completed the imputations of the Conegliano dataset, one of the world’s most extensive and varied phenological time series and a steppingstone for future climate change studies in grapes. The dataset is now ready for further analysis, and a rigorous evaluation of imputation errors is included.

Assessment of climate change impacts on water needs and growing cycle on grapevine in three DOs of NE Spain

This study assessed the suitability of grapevine growing in three DOs (Empordà, Pla de Bages and Penedès) of Catalonia (NE Spain) over the 21st century. For this purpose, an estimation of water needs and agroclimatic and phenological indicators was made. Climate change impacts were estimated at 1 km pixel resolution using temperature and precipitation projections from several general circulation models (GCM) and two climate change scenarios: RCP 4.5 (stabilization scenario) and RCP 8.5 (worst-case scenario). Potential crop evapotranspiration (following FAO procedure) and a daily water balance considering soil water holding capacity were used to estimate actual evapotranspiration of vines and, finally, water needs. Dynamics would be similar in the three DOs studied although the magnitude of impact differs. Water needs would be 2 and 3 times greater (ranging from 0 to more than 1500 m3/ha) than current water needs at both climate change scenarios. Moreover, blooming date would advance from 3 to 6 weeks, harvest date from 1 to 2.5 months, resulting in growing cycles from 10 to 80 days shorter. It should also be noted that frost risk would decrease from 6 to 76%, the number of days with temperatures above 30ºC during ripening would rise from 48 to 500% and tropical nights (minimum temperature >20ºC) at ripening would increase from 28 to 150%, depending on the scenario and the DOs. The impacts of climate change in the three DOs could result in significant limitations for grapevine cultivation and wine production if adaptive strategies are not applied. This result could serve as a basis for the design of specific and particular adaptation strategies to improve and maintain vineyards in the DOs studied and could be extrapolated to similar DOs and regions.

Ecophysiological performance of Vitis rootstocks under water stress

The use of rootstocks tolerant to soil water deficit is an interesting strategy to cope with limited water availability. Currently, several nurseries are breeding new genotypes, but the physiological basis of its responses under water stress are largely unknown. To this end, an ecophysiological assessment of the conventional 110-Richter (110R) and SO4, and the new M1 and M4 rootstocks was carried out in potted ungrafted plants. During one season, these Vitis genotypes were grown under greenhouse conditions and subjected to two water regimes, well-watered and water deficit. Water potentials of plants under water deficit down to < -1.4 MPa, and net photosynthesis (AN) <5 μmol m-2 s-1 did not cause leaf oxidative stress damage compared to well-watered conditions in any of the genotypes. The antioxidant capacity was sufficient to neutralize the mild oxidative stress suffered. Under both treatments, gravimetric differences in daily water use were observed among genotypes, leading to differences in the biomass of root, shoot and leaf. Under well-watered conditions, SO4 and 110R were the most vigorous and M1 and M4 the least. However, under water stress, SO4 exhibited the greatest reduction in biomass while M4 showed the lowest. Remarkably, under these conditions, SO4 reached the least negative stem water potential (Ψstem), while M1 reduced stomatal conductance (gs) and AN the most. In addition, SO4 and M1 genotypes also showed the highest and lowest hydraulic conductance values, respectively. Our results suggest that there are differences in water use regulation among genotypes, not only attributed to differences in stomatal regulation or intrinsic water use efficiency at the leaf level. Therefore, because no differences in canopy-to-root ratio were achieved, it is hypothesized that xylem vessel anatomical differences may be driving the reported differences among rootstocks performance. Results demonstrate that each Vitis rootstock differs in its ecophysiological responses under water stress.