From Detection to Protection: The Role of Optical Sensors, Robots, and Artificial Intelligence in Modern Plant Disease Management
- Anne-Katrin Mahlein1 †
- Jayme G. Arnal Barbedo2
- Kuo-Szu Chiang3
- Emerson M. Del Ponte4
- Clive H. Bock5
- 1Institute of Sugar Beet Research (IfZ), Holtenser Landstrasse 77 37079 Göttingen, Germany
- 2Embrapa Agricultural Digital, Campinas, SP 13083-886, Brazil
- 3Division of Biometrics, Department of Agronomy, National Chung Hsing University, Taichung, Taiwan
- 4Departamento de Fitopatologia, Universidade Federal de Viçosa, Viçosa, MG 36570-000, Brazil
- 5U.S. Department of Agriculture-Agricultural Research Service Southeastern Fruit and Tree Nut Research Station, Byron, GA 31008, U.S.A.
Abstract
In the past decade, there has been a recognized need for innovative methods to monitor and manage plant diseases, aiming to meet the precision demands of modern agriculture. Over the last 15 years, significant advances in the detection, monitoring, and management of plant diseases have been made, largely propelled by cutting-edge technologies. Recent advances in precision agriculture have been driven by sophisticated tools such as optical sensors, artificial intelligence, microsensor networks, and autonomous driving vehicles. These technologies have enabled the development of novel cropping systems, allowing for targeted management of crops, contrasting with the traditional, homogeneous treatment of large crop areas. The research in this field is usually a highly collaborative and interdisciplinary endeavor. It brings together experts from diverse fields such as plant pathology, computer science, statistics, engineering, and agronomy to forge comprehensive solutions. Despite the progress, translating the advancements in the precision of decision-making or automation into agricultural practice remains a challenge. The knowledge transfer to agricultural practice and extension has been particularly challenging. Enhancing the accuracy and timeliness of disease detection continues to be a priority, with data-driven artificial intelligence systems poised to play a pivotal role. This perspective article addresses critical questions and challenges faced in the implementation of digital technologies for plant disease management. It underscores the urgency of integrating innovative technological advances with traditional integrated pest management. It highlights unresolved issues regarding the establishment of control thresholds for site-specific treatments and the necessary alignment of digital technology use with regulatory frameworks. Importantly, the paper calls for intensified research efforts, widespread knowledge dissemination, and education to optimize the application of digital tools for plant disease management, recognizing the intersection of technology's potential with its current practical limitations.
Literature Cited
- 2022. Swarm robots in mechanized agricultural operations: A review about challenges for research. Comput. Electron. Agric. 193:106608. https://doi.org/10.1016/j.compag.2021.106608 CrossrefWeb of ScienceGoogle Scholar
- 2017. iPathology: Robotic applications and management of plants and plant diseases. Sustainability 9:1010. https://doi.org/10.3390/su9061010 CrossrefWeb of ScienceGoogle Scholar
- 2022. Potential of laboratory hyperspectral data for in-field detection of Phytophthora infestans on potato. Precis. Agric. 23:876-893. https://doi.org/10.1007/s11119-021-09865-0 CrossrefWeb of ScienceGoogle Scholar
- 2019. Helios: A scalable 3D plant and environmental biophysical modeling framework. Front. Plant Sci. 10:1185. https://doi.org/10.3389/fpls.2019.01185 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2019. A review on the use of unmanned aerial vehicles and imaging sensors for monitoring and assessing plant stresses. Drones 3:40. https://doi.org/10.3390/drones3020040 CrossrefGoogle Scholar
- 2022a. Deep learning applied to plant pathology: The problem of data representativeness. Trop. Plant Pathol. 47:85-94. https://doi.org/10.1007/s40858-021-00459-9 CrossrefWeb of ScienceGoogle Scholar
- 2022b. Data fusion in agriculture: Resolving ambiguities and closing data gaps. Sensors 22:2285. https://doi.org/10.3390/s22062285 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2023a. Disease incidence and severity of Cercospora leaf spot in sugar beet assessed by multispectral unmanned aerial images and machine learning. Plant Dis. 107:188-200. https://doi.org/10.1094/PDIS-12-21-2734-RE LinkWeb of ScienceGoogle Scholar
- 2023b. Data augmentation for mask-based leaf segmentation of UAV-images as a basis to extract leaf-based phenotyping parameters. Künstl. Intell. 37:143-156. https://doi.org/10.1007/s13218-023-00815-8 CrossrefWeb of ScienceGoogle Scholar
- 2020. Overview of citrus huanglongbing spread and management strategies in Brazil. Trop. Plant Pathol. 45:251-264. https://doi.org/10.1007/s40858-020-00343-y CrossrefWeb of ScienceGoogle Scholar
- 2020. Digital agriculture to design sustainable agricultural systems. Nat. Sustain. 3:254-256. https://doi.org/10.1038/s41893-020-0510-0 CrossrefWeb of ScienceGoogle Scholar
- 2015. A review of advanced machine learning methods for the detection of biotic stress in precision crop protection. Precis. Agric. 16:239-260. https://doi.org/10.1007/s11119-014-9372-7 CrossrefWeb of ScienceGoogle Scholar
- 2021. Ecosystem services and biodiversity of agricultural system at the landscape scale. Environ. Monit. Assess. 193:275. https://doi.org/10.1007/s10661-021-08857-x CrossrefMedlineWeb of ScienceGoogle Scholar
- 2020. From visual estimates to fully automated sensor-based measurements of plant disease severity: Status and challenges for improving accuracy. Phytopathol. Res. 2:9. https://doi.org/10.1186/s42483-020-00049-8 CrossrefWeb of ScienceGoogle Scholar
- 2022. A phytopathometry glossary for the twenty-first century: Towards consistency and precision in intra- and inter-disciplinary dialogues. Trop. Plant Pathol. 47:14-24. https://doi.org/10.1007/s40858-021-00454-0 CrossrefWeb of ScienceGoogle Scholar
- 2010. Plant disease severity estimated visually, by digital photography and image analysis, and by hyperspectral imaging. Crit. Rev. Plant Sci. 29:59-107. https://doi.org/10.1080/07352681003617285 CrossrefWeb of ScienceGoogle Scholar
- 2016. Robots poised to revolutionise agriculture. Ind. Robot 43:450-456. https://doi.org/10.1108/IR-05-2016-0142 CrossrefGoogle Scholar
- 2019. In-field detection of yellow rust in wheat on the ground canopy and UAV scale. Remote Sens. 11:2495. https://doi.org/10.3390/rs11212495 CrossrefWeb of ScienceGoogle Scholar
- 2021. A hyperspectral library of foliar diseases of wheat. Phytopathology 111:1583-1593. https://doi.org/10.1094/PHYTO-09-19-0335-R LinkWeb of ScienceGoogle Scholar
- 2022. A public decision support system for the assessment of plant disease infection risk shared by Italian regions. J. Environ. Manage. 317:115365. https://doi.org/10.1016/j.jenvman.2022.115365 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2021. Detection of Xylella fastidiosa in almond orchards by synergic use of an epidemic spread model and remotely sensed plant traits. Remote Sens. Environ. 260:112420. https://doi.org/10.1016/j.rse.2021.112420 CrossrefMedlineWeb of ScienceGoogle Scholar
- 1972. Economics of pest control. Pages 79-99 in: Pest Control Strategies for the Future. Robert L. Metcalf (Chairman), Agricultural Board, Division of Biology and Agriculture, National Research Council, National Academy of Sciences, Washington, DC. Google Scholar
- 2009. Multi-sensor plant imaging: Towards the development of a stress-catalogue. Biotechnol. J. 4:1152-1167. https://doi.org/10.1002/biot.200800242 CrossrefMedlineGoogle Scholar
- 2024. Towards a general-purpose foundation model for computational pathology. Nat. Med. 30:850-862. https://doi.org/10.1038/s41591-024-02857-3 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2014. What interval characteristics make a good categorical disease assessment scale? Phytopathology 104:575-585. https://doi.org/10.1094/PHYTO-10-13-0279-R LinkWeb of ScienceGoogle Scholar
- 2023. Farmers’ perception of the barriers that hinder the implementation of agriculture 4.0. Agric. Syst. 208:103656. https://doi.org/10.1016/j.agsy.2023.103656 CrossrefWeb of ScienceGoogle Scholar
- 2021. Integrated pest management: Good intentions, hard realities. A review. Agron. Sustain. Dev. 41:38. https://doi.org/10.1007/s13593-021-00689-w CrossrefWeb of ScienceGoogle Scholar
- 2016. Will digital technologies transform agriculture in developing countries? Agric. Econ. 47:21-33. https://doi.org/10.1111/agec.12300 CrossrefGoogle Scholar
- 2022. Data-centric annotation analysis for plant disease detection: Strategy, consistency, and performance. Front. Plant Sci. 13:1037655. https://doi.org/10.3389/fpls.2022.1037655 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2020. Automatic system for crop pest and disease dynamic monitoring and early forecasting. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 13:4410-4418. https://doi.org/10.1109/JSTARS.2020.3013340 CrossrefWeb of ScienceGoogle Scholar
- 2014. Understanding the impact of mobile phones on livelihoods in developing countries. Dev. Policy Rev. 32:567-588. https://doi.org/10.1111/dpr.12073 CrossrefWeb of ScienceGoogle Scholar
- 2015. Lights, camera, action: High-throughput plant phenotyping is ready for a close-up. Curr. Opin. Plant Biol. 24:93-99. https://doi.org/10.1016/j.pbi.2015.02.006 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2022. Smart farming technologies adoption: Which factors play a role in the digital transition? Technol. Soc. 68:101869. https://doi.org/10.1016/j.techsoc.2022.101869 CrossrefGoogle Scholar
- 2020. Contact reflectance spectroscopy for rapid, accurate, and nondestructive Phytophthora infestans clonal lineage discrimination. Phytopathology 110:851-862. https://doi.org/10.1094/PHYTO-08-19-0294-R LinkWeb of ScienceGoogle Scholar
- 2021. UAV-based classification of Cercospora leaf spot using RGB images. Drones 5:34. https://doi.org/10.3390/drones5020034 CrossrefGoogle Scholar
- 2022. Agricultural plant cataloging and establishment of a data framework from UAV-based crop images by computer vision. GigaScience 11:giac054. https://doi.org/10.1093/gigascience/giac054 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2018. Automated identification of sugar beet diseases using smartphones. Plant Pathol. 67:399-410. https://doi.org/10.1111/ppa.12741 CrossrefWeb of ScienceGoogle Scholar
- 2024. Foundation model for advancing healthcare: Challenges, opportunities, and future directions. arXiv 2404.03264. https://doi.org/10.48550/arXiv.2404.03264 Google Scholar
- 2018. Detecting myrtle rust (Austropuccinia psidii) on lemon myrtle trees using spectral signatures and machine learning. Plant Pathol. 67:1114-1121. https://doi.org/10.1111/ppa.12830 CrossrefWeb of ScienceGoogle Scholar
- 2017. The evidential basis of decision making in plant disease management. Annu. Rev. Phytopathol. 55:41-59. https://doi.org/10.1146/annurev-phyto-080516-035342 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2024. Automatic scoring of Rhizoctonia crown and root rot affected sugar beet fields from orthorectified UAV images using machine learning. Plant Dis. 108:711-724. https://doi.org/10.1094/PDIS-04-23-0779-RE LinkWeb of ScienceGoogle Scholar
- 2019. An improved crop scouting technique incorporating unmanned aerial vehicle-assisted multispectral crop imaging into conventional scouting practice for gummy stem blight in watermelon. Plant Dis. 103:1642-1650. https://doi.org/10.1094/PDIS-08-18-1373-RE LinkWeb of ScienceGoogle Scholar
- 2021. A web-based system for fungus disease risk assessment in greenhouses: System development. Comput. Electron. Agric. 188:106326. https://doi.org/10.1016/j.compag.2021.106326 CrossrefWeb of ScienceGoogle Scholar
- 2019. A review of social science on digital agriculture, smart farming and agriculture 4.0: New contributions and a future research agenda. NJAS Wagen. J. Life Sci. 90-91:1-16. https://doi.org/10.1016/j.njas.2019.100315 Google Scholar
- 2015. Hyperspectral phenotyping on the microscopic scale: Towards automated characterization of plant-pathogen interactions. Plant Methods 11:28. https://doi.org/10.1186/s13007-015-0073-7 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2020. The future(s) of digital agriculture and sustainable food systems: An analysis of high-level policy documents. Ecosyst. Serv. 45:101183. https://doi.org/10.1016/j.ecoser.2020.101183 CrossrefWeb of ScienceGoogle Scholar
- 2021. Toward sustainability: Trade-off between data quality and quantity in crop pest recognition. Front. Plant Sci. 12:811241. https://doi.org/10.3389/fpls.2021.811241 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2023. A hierarchical optimization strategy in the intelligent ecological control of the greenhouse downy mildew. Comput. Electron. Agric. 214:108337. https://doi.org/10.1016/j.compag.2023.108337 CrossrefWeb of ScienceGoogle Scholar
- 2023. Identification of symptoms related to potato Verticillium wilt from UAV-based multispectral imagery using an ensemble of gradient boosting machines. Smart Agric. Technol. 3:100138. https://doi.org/10.1016/j.atech.2022.100138 CrossrefGoogle Scholar
- 1995. Plant disease incidence: Distributions, heterogeneity, and temporal analysis. Annu. Rev. Phytopathol. 33:529-564. https://doi.org/10.1146/annurev.py.33.090195.002525 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2023. Catching spores: Linking epidemiology, pathogen biology, and physics to ground-based airborne inoculum monitoring. Plant Dis. 107:13-33. https://doi.org/10.1094/PDIS-11-21-2570-FE LinkWeb of ScienceGoogle Scholar
- 2016. Plant disease detection by imaging sensors - Parallels and specific demands for precision agriculture and plant phenotyping. Plant Dis. 100:241-251. https://doi.org/10.1094/PDIS-03-15-0340-FE LinkWeb of ScienceGoogle Scholar
- 2018. Hyperspectral sensors and imaging technologies in phytopathology: State of the art. Annu. Rev. Phytopathol. 56:535-558. https://doi.org/10.1146/annurev-phyto-080417-050100 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2019. Quantitative and qualitative phenotyping of disease resistance of crops by hyperspectral sensors: Seamless interlocking of phytopathology, sensors, and machine learning is needed! Curr. Opin. Plant Biol. 50:156-162. https://doi.org/10.1016/j.pbi.2019.06.007 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2013. Development of spectral indices for detecting and identifying plant diseases. Remote Sens. Environ. 128:21-30. https://doi.org/10.1016/j.rse.2012.09.019 CrossrefWeb of ScienceGoogle Scholar
- 2006. Disease assessment concepts and the advancements made in improving the accuracy and precision of plant disease data. Eur. J. Plant Pathol. 115:95-103. https://doi.org/10.1007/s10658-005-1230-z CrossrefWeb of ScienceGoogle Scholar
- 2020. Remote sensing of diseases. Annu. Rev. Phytopathol. 58:225-252. https://doi.org/10.1146/annurev-phyto-010820-012832 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2017. Epidemiology: Past, present, and future impacts on understanding disease dynamics and improving plant disease management—A summary of focus issue articles. Phytopathology 107:1092-1094. https://doi.org/10.1094/PHYTO-07-17-0248-FI LinkWeb of ScienceGoogle Scholar
- 2019. Measuring crops in 3D: Using geometry for plant phenotyping. Plant Methods 15:103. https://doi.org/10.1186/s13007-019-0490-0 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2018. Estimate, a new iPad application for assessment of plant disease severity using photographic standard area diagrams. Plant Dis. 102:276-281. https://doi.org/10.1094/PDIS-07-17-1094-SR LinkWeb of ScienceGoogle Scholar
- 2020. Agriculture 4.0 and the role of education. J. Agric. Inform. 11:45-51. https://doi.org/10.17700/jai.2020.11.1.571 Google Scholar
- 2023. Digital twins in agriculture: Challenges and opportunities for environmental sustainability. Curr. Opin. Environ. Sustain. 61:101252. https://doi.org/10.1016/j.cosust.2022.101252 CrossrefWeb of ScienceGoogle Scholar
- 2021. Europe's Farm to Fork strategy and its commitment to biotechnology and organic farming: Conflicting or complementary goals? Trends Plant Sci. 26:600-606. https://doi.org/10.1016/j.tplants.2021.03.012 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2022. Economic potential of site-specific pesticide application scenarios with direct injection and automatic application assistant in northern Germany. Precis. Agric. 23:2063-2088. https://doi.org/10.1007/s11119-022-09888-1 CrossrefWeb of ScienceGoogle Scholar
- 2021. The persistent threat of emerging plant disease pandemics to global food security. Proc. Natl. Acad. Sci. U.S.A. 118:e2022239118. https://doi.org/10.1073/pnas.2022239118 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2010. Modelling plant diseases for decision making in crop protection. Pages 241-258 in: Precision Crop Protection - The Challenge and Use of Heterogeneity. E.-C. Oerke, R. Gerhards, G. Menz, and R. A. Sikora, eds. Springer, Dordrecht, the Netherlands. CrossrefGoogle Scholar
- 2019. Critical success factors for the adoption of decision tools in IPM. Agronomy 9:710. https://doi.org/10.3390/agronomy9110710 CrossrefWeb of ScienceGoogle Scholar
- 2010. Early detection and classification of plant diseases with Support Vector Machines based on hyperspectral reflectance. Comput. Electron. Agric. 74:91-99. https://doi.org/10.1016/j.compag.2010.06.009 CrossrefWeb of ScienceGoogle Scholar
- 2022. Sensing and imaging of plant disease through the lens of science mapping. Trop. Plant Pathol. 47:74-84. https://doi.org/10.1007/s40858-021-00478-6 CrossrefWeb of ScienceGoogle Scholar
- 2013. Huanglongbing (citrus greening) detection using visible, near infrared and thermal imaging techniques. Sensors 13:2117-2130. https://doi.org/10.3390/s130202117 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2010. A review of advanced techniques for detecting plant diseases. Comput. Electron. Agric. 72:1-13. https://doi.org/10.1016/j.compag.2010.02.007 CrossrefWeb of ScienceGoogle Scholar
- 2017. Development of a robotic detection system for greenhouse pepper plant diseases. Precis. Agric. 18:394-409. https://doi.org/10.1007/s11119-017-9503-z CrossrefWeb of ScienceGoogle Scholar
- 2020. Making deep neural networks right for the right scientific reasons by interacting with their explanations. Nat. Mach. Intell. 2:476-486. https://doi.org/10.1038/s42256-020-0212-3 CrossrefGoogle Scholar
- 2020. Swarm robotic behaviors and current applications. Front. Robot. AI 7:36. https://doi.org/10.3389/frobt.2020.00036 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2020. Detection of banana plants and their major diseases through aerial images and machine learning methods: A case study in DR Congo and Republic of Benin. ISPRS J. Photogramm. Remote Sens. 169:110-124. https://doi.org/10.1016/j.isprsjprs.2020.08.025 CrossrefWeb of ScienceGoogle Scholar
- 2020. Development of models and methods for creating a digital twin of plant within the cyber-physical system for precision farming management. J. Phys. Conf. Ser. 1703:012022. https://doi.org/10.1088/1742-6596/1703/1/012022 CrossrefGoogle Scholar
- 1967. What is integrated pest management? Pages 295-340 in: Pest Control. Academic Press, New York. Google Scholar
- 1966. Principles, definitions and scope of integrated pest control. Proc. FAO Symp. Integrated Pest Control 1:11-17. Google Scholar
- 2021. Tapping the full potential of the digital revolution for agricultural extension: An emerging innovation agenda. Int. J. Agric. Sustain. 19:549-565. https://doi.org/10.1080/14735903.2020.1738754 CrossrefWeb of ScienceGoogle Scholar
- 2021. What is an ecological threshold in crop protection? Gesunde Pflanz. 73:135-147. https://doi.org/10.1007/s10343-021-00551-9 CrossrefGoogle Scholar
- 2024. Research priorities to leverage smart digital technologies for sustainable crop production. Eur. J. Agron. 156:127178. https://doi.org/10.1016/j.eja.2024.127178 CrossrefWeb of ScienceGoogle Scholar
- 2020. Sensor data quality: A systematic review. J. Big Data 7:11. https://doi.org/10.1186/s40537-020-0285-1 CrossrefGoogle Scholar
- 2018. Benefits of hyperspectral imaging for plant disease detection and plant protection: A technical perspective. J. Plant Dis. Prot. 125:5-20. https://doi.org/10.1007/s41348-017-0124-6 CrossrefGoogle Scholar
- 2022. Cultivating FAIR principles for agri-food data. Comput. Electron. Agric. 196:106909. https://doi.org/10.1016/j.compag.2022.106909 CrossrefWeb of ScienceGoogle Scholar
- 2022. Responsible artificial intelligence in agriculture requires systemic understanding of risks and externalities. Nat. Mach. Intell. 4:104-109. https://doi.org/10.1038/s42256-022-00440-4 CrossrefGoogle Scholar
- 2019. On defining artificial intelligence. J. Artif. Gen. Intell. 10:1-37. https://doi.org/10.2478/jagi-2019-0002 CrossrefGoogle Scholar
- 2019. Spot farming – An alternative for future plant production. J. Kult. 71:70-89. https://doi.org/10.5073/JfK.2019.04.02 Google Scholar
- 2003. The potential of optical canopy measurement for targeted control of field crop disease. Annu. Rev. Phytopathol. 41:593-614. https://doi.org/10.1146/annurev.phyto.41.121702.103726 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2016. Creating prescription maps from historical imagery for site-specific management of cotton root rot. Proceedings of the Annual Precision Ag Conference. https://www.ispag.org/session_detail?sid=37 Google Scholar
- 2018. Previsual symptoms of Xylella fastidiosa infection revealed in spectral plant-trait alterations. Nat. Plants 4:432-439. https://doi.org/10.1038/s41477-018-0189-7 CrossrefMedlineWeb of ScienceGoogle Scholar
- 2014. Integrating remotely sensed and meteorological observations to forecast wheat powdery mildew at a regional scale. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 7:4328-4339. https://doi.org/10.1109/JSTARS.2014.2315875 CrossrefWeb of ScienceGoogle Scholar