Hostname: page-component-848d4c4894-xm8r8 Total loading time: 0 Render date: 2024-06-22T00:32:17.812Z Has data issue: false hasContentIssue false
  • English
  • Français

Characterization and classification of urban weed species in northeast China using terrestrial hyperspectral images

Published online by Cambridge University Press:  01 August 2023

Jinfeng Wang Open the ORCID record for Jinfeng Wang [Opens in a new window] ,
Guoqing Chen ,
Jinyan Ju ,
Tenghui Lin ,
Ruidong Wang  and
Zhentao Wang
Jinfeng Wang*
Affiliation:
Professor, Vice President, College of Engineering, Northeast Agricultural University, Harbin, China
Guoqing Chen
Affiliation:
Graduate Student, College of Engineering, Northeast Agricultural University, Harbin, China
Jinyan Ju
Affiliation:
Research Agronomist, Mechanical Engineering College, Heilongjiang University of Science and Technology, Harbin, China
Tenghui Lin
Affiliation:
Graduate Student, College of Engineering, Northeast Agricultural University, Harbin, China
Ruidong Wang
Affiliation:
Graduate Student, College of Engineering, Northeast Agricultural University, Harbin, China
Zhentao Wang*
Affiliation:
Associate Agronomist, College of Engineering, Northeast Agricultural University, Harbin, China
*
Corresponding author: Jinfeng Wang; Email: jinfeng_w@126.com; Zhentao Wang; Email: 15770085650@163.com.
Corresponding author: Jinfeng Wang; Email: jinfeng_w@126.com; Zhentao Wang; Email: 15770085650@163.com.
Get access Rights & Permissions [Opens in a new window]

Abstract

Weeds contribute to biodiversity and a wide range of ecosystem functions. It is crucial to map different weed species and analyze their physiological activities. Remote sensing techniques for plant identification, especially hyperspectral imaging, are being developed using spectral response patterns to vegetation for detection and species identification. A library of hyperspectral images of 40 urban weed species in northeast China was established in this study. A terrestrial hyperspectral camera was used to acquire 435 hyperspectral images. The hyperspectral information for each weed species was extracted and analyzed. The spectral characteristics and vegetation indices of different weeds revealed the differences between weed species in the cities of northeast China and indirectly characterized the growth and physiological activity levels of different species, but could not effectively distinguish different species. Five methods—first derivative spectrum (FDS), second derivative spectrum (SDS), standard normal variate (SNV), moving averages (MA), and Savitzky-Golay (SG) smoothing—were used to pretreat the spectral curves to maximize the retention of spectral characteristics while removing the influence of noise. We investigated the application of a convolutional neural network (CNN) with terrestrial hyperspectral remote sensing to identify urban weeds in northeast China. A CNN classification model was established to distinguish weeds from the hyperspectral images and demonstrated a test accuracy of 95.32% to 98.15%. The accuracy of the original spectrum was 97.45%; SNV had the best accuracy (98.15%) and SG was the least accurate (95.32%). This provides a baseline for understanding the hyperspectral characteristics of urban weed species and monitoring their growth. It also contributes to the development of a hyperspectral imaging database with global applicability.

Keywords

Convolutional neural networkhyperspectral libraryphysiological activity
Type
Research Article
Information
Weed Science , Volume 71 , Issue 4 , July 2023 , pp. 353 - 368
Check for updates
Copyright
© The Author(s), 2023. Published by Cambridge University Press on behalf of the Weed Science Society of America

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

*

These authors contributed equally to this work.

Associate Editor: Ramon G. Leon, North Carolina State University

References

Abbas, S, Peng, Q, Wong, MS, Li, Z, Wang, J, Ng, KTK, Kwok, CYT, Hui, KKW (2021) Characterizing and classifying urban tree species using bi-monthly terrestrial hyperspectral images in Hong Kong. ISPRS J Photogramm Remote Sens 177:204–216 CrossRefGoogle Scholar
Adegbenjo, AO, Liu, L, Ngadi, MO (2020) Non-destructive assessment of chicken egg fertility. Sensors 20:5546 CrossRefGoogle ScholarPubMed
Bai, Y, Gao, J, Zhang, B (2019) Monitoring of crops growth based on NDVI and EVI. Trans Chin Soc Agric Mach 50:153–161. ChineseGoogle Scholar
Becker, BL, Lusch, DP, Qi, JG (2005) Identifying optimal spectral bands from in situ measurements of great lakes coastal wetlands using second-derivative analysis. Remote Sens Environ 97:238–248 CrossRefGoogle Scholar
Behmann, J, Acebron, K, Emin, D, Bennertz, S, Matsubara, S, Thomas, S, Bohnenkamp, D, Kuska, MT, Jussila, J, Salo, H, Mahlein, AK, Rascher, U (2018) Specim IQ: evaluation of a new, miniaturized handheld hyperspectral camera and its application for plant phenotyping and disease detection. Sensors 18:441 CrossRefGoogle ScholarPubMed
Bretagnolle, V, Gaba, S (2015) Weeds for bees? A review. Agron Sustain Dev 35:891–909 CrossRefGoogle Scholar
Bro, R, Smilde, AK (2014) Principal component analysis. Anal Methods 6:2812–2831 CrossRefGoogle Scholar
Brunzel, S, Fischer, SF, Schneider, J, Jetzkowitz, J, Brandl, R (2009) Neo- and archaeophytes respond more strongly than natives to socio-economic mobility and disturbance patterns along an urban-rural gradient. J Biogeogr 36:835–844 CrossRefGoogle Scholar
Cao, J, Liu, K, Liu, L, Zhu, Y, Li, J, He, Z (2019) Identifying mangrove species using field close-range snapshot hyperspectral imaging and machine-learning techniques. Remote Sens 10:2047 CrossRefGoogle Scholar
Carlesi, S, Bocci, G, Moonen, AC, Frumento, P, Barberi, P (2013) Urban sprawl and land abandonment affect the functional response traits of maize weed communities in a heterogeneous landscape. Agric Ecosyst Environ 166:76–85 CrossRefGoogle Scholar
Chen, H, Pan, T, Chen, J, Lu, Q (2011) Waveband selection for NIR spectroscopy analysis of soil organic matter based on SG smoothing and MWPLS methods. Chemometr Intell Lab Syst 107:139–146 CrossRefGoogle Scholar
Chen, X, Zhang, L, Zhang, X, Liu, B (2012) Comparison of the sensor dependence of vegetation indices based on hyperion and CHRIS hyperspectral data. Int J Remote Sens 34:2200–2215 CrossRefGoogle Scholar
Cheoi, K, Choi, H, Ko, J (2020) Empirical remarks on the translational equivariance of convolutional layers. Appl Sci 10:3161 CrossRefGoogle Scholar
Che’Ya, NN, Dunwoody, E, Gupta, M (2021) Assessment of weed classification using hyperspectral reflectance and optimal multispectral UAV imagery. Agronomy 11:1435 CrossRefGoogle Scholar
Cho, H, Lee, KS (2014) Comparison between hyperspectral and multispectral images for the classification of coniferous species. Korean J Remote Sens 30:25–36 CrossRefGoogle Scholar
Cho, MA, Debba, P, Mathieu, R, Naidoo, L, Van Aardt, J, Asner, GP (2010) Improving discrimination of savanna tree species through a multiple-endmember spectral angle mapper approach: canopy-level analysis. IEEE Trans Geosci Remote Sens 48:4133–4142 Google Scholar
Eddy, PR, Smith, AM, Hill, BD, Peddle, DR, Coburn, CA, Blackshaw, RE (2014) Weed and crop discrimination using hyperspectral image data and reduced bandsets. Can J Remote Sens 39:481–490.CrossRefGoogle Scholar
Farooq, A, Jia, X, Hu, J, Zhou, J (2019) Multi-resolution weed classification via convolutional neural network and superpixel based local binary pattern using remote sensing images. Remote Sens 11:1692 CrossRefGoogle Scholar
Farquhar, GD, Von Caemmerer, S, Berry, JA (1980) A biochemical model of photosynthetic CO2 assimilation in leaves of C3 species. Planta 149:78–90 CrossRefGoogle Scholar
Fassnacht, FE, Neumann, C, Forster, M, Buddenbaum, H, Ghosh, A, Clasen, A, Joshi, PK, Koch, B (2014) Comparison of feature reduction algorithms for classifying tree species with hyperspectral data on three central European test sites. IEEE J Sel Top Appl Earth Obs Remote Sens 7:2547–2561 CrossRefGoogle Scholar
Ferreira, GL, Souza, MD, de Queiroz, GP, Ferreira, LR, Ferreira, EA, Neto, SND, de Souza, WM, Silva, DV (2016) Physiological characteristics of eucalypts in association with signal grass. Aust For 79:203–207 CrossRefGoogle Scholar
Ferreira, MP, Zortea, M, Zanotta, DC, Shimabukuro, YE, De Souza Filho, CR (2016) Mapping tree species in tropical seasonal semi-deciduous forests with hyperspectral and multispectral data. Remote Sens Environ 179:66–78 CrossRefGoogle Scholar
Frechette, E, Chang, CYY, Ensminger, I (2016) Photoperiod and temperature constraints on the relationship between the photochemical reflectance index and the light use efficiency of photosynthesis in Pinus strobus . Tree Physiol 36:311–324 CrossRefGoogle ScholarPubMed
Gage, KL, Schwartz-Lazaro, LM (2019) Shifting the paradigm: an ecological systems approach to weed management. Agriculture 9:179 CrossRefGoogle Scholar
Gamon, JA, Peñuelas, J, Field, CB (1992) A narrow-waveband spectral index that tracks diurnal changes in photosynthetic efficiency. Remote Sens Environ 41:35–44 CrossRefGoogle Scholar
Giovos, R, Tassopoulos, D, Kalivas, D, Lougkos, N, Priovolou, A (2021) Remote sensing vegetation indices in viticulture: a critical review. Agriculture 11:457 CrossRefGoogle Scholar
Guo, J, Xu, X, Zhao, Q, Liu, J (2016) Precise orbit determination for quad-constellation satellites at Wuhan University: strategy, result validation, and comparison. J Geod 90:143–159 CrossRefGoogle Scholar
Guo, L, Qiu, J, Li, L, Lu, B, Olsen, K, Fan, L (2018) Genomic clues for crop–weed interactions and evolution. Trends Plant Sci 23:1102–1115 CrossRefGoogle ScholarPubMed
Hahn, DS, Roosjen, P, Morales, A, Nijp, J, Beck, L, Cruz, CV, Leinauer, B (2021) Detection and quantification of broadleaf weeds in turfgrass using close-range multispectral imagery with pixel- and object-based classification. Int J Remote Sens 42:8035–8055 CrossRefGoogle Scholar
Hamel, S, Garel, M, Festa-Bianchet, M, Gaillard, JM, Cote, SD (2009) Spring normalized difference vegetation index (NDVI) predicts annual variation in timing of peak faecal crude protein in mountain ungulates. J Appl Ecol 46:582–589 CrossRefGoogle Scholar
Han, F, Zhu, J, Liu, B, Zhang, B, Xie, F (2020) Fish shoals behavior detection based on convolutional neural network and spatiotemporal information. IEEE Access 8:126907–126926 CrossRefGoogle Scholar
Hu, Y, Zhang, J, Ma, J, An, J, Ren, G, Li, X (2019) Hyperspectral coastal wetland classification based on a multiobject convolutional neural network model and decision fusion. IEEE Geosci Remote Sens 16:1110–1114 CrossRefGoogle Scholar
Huber-Lerner, M, Hadar, O, Rotman, SR, Huber-Shalem, R (2016) Hyperspectral band selection for anomaly detection: the role of data Gaussianity. IEEE J Sel Top Appl Earth Obs Remote Sens 9:732–743 CrossRefGoogle Scholar
Jabran, K, Doğan, MN (2020) Elevated CO2, temperature and nitrogen levels impact growth and development of invasive weeds in the Mediterranean region. J Sci Food Agric 100:4893–4900 CrossRefGoogle ScholarPubMed
Ji, L, Zhang, L, Rover, J, Wylie, BK, Chen, X (2014) Geostatistical estimation of signal-to-noise ratios for spectral vegetation indices. ISPRS J Photogramm Remote Sens 96:20–27 CrossRefGoogle Scholar
Kachrimanis, K, Braun, DE, Griesser, UJ (2007) Quantitative analysis of paracetamol polymorphs in powder mixtures by FT-Raman spectroscopy and PLS regression. J Pharm Biomed Anal 43:407–412 CrossRefGoogle ScholarPubMed
Katkovsky, LV, Martinov, AO, Siliuk, VA, Ivanov, DA, Kokhanovsky, AA (2018) Fast atmospheric correction method for hyperspectral data. Remote Sens 10:1698 CrossRefGoogle Scholar
Khaliq, A, Comba, L, Biglia, A, Aimonino, DR, Chiaberge, M, Gay, P (2019) Comparison of satellite and UAV-Based multispectral imagery for vineyard variability assessment. Remote Sens 11:436 CrossRefGoogle Scholar
Khdery, G, Yones, M (2021) Innovative spectral library for identification common wild plants using hyperspectral technology in Northwestern Coast, Egypt. Egypt J Remote Sens 24:485–491 Google Scholar
Korres, NE, Norsworthy, JK, Tehranchian, P, Gitsopoulos, TK, Loka, DA, Oosterhuis, DM, Gealy, DR, Moss, SR, Burgos, NR, Miller, MR, Palhano, M (2016) Cultivars to face climate change effects on crops and weeds: a review. Agron Sustain Dev 36:12 CrossRefGoogle Scholar
Krause, GH, Weis, E (1991) Chlorophyll fluorescence and photosynthesis: the basics. Annu Rev Plant Physiol Plant Mol Biol 42:313–349 CrossRefGoogle Scholar
Lauwers, M, De Cauwer, B, Nuyttens, D, Cool, SR, Pieters, JG (2020) Hyperspectral classification of cyperus esculentus clones and morphologically similar weeds. Sensors 20:2504 CrossRefGoogle ScholarPubMed
Li, Q, Gao, M, Li, Z (2022) Ground hyper-spectral remote-sensing monitoring of wheat water stress during different growing stages. Agronomy 12:2267 CrossRefGoogle Scholar
Li, Y, Al-Sarayreh, M, Irie, K, Hackell, D, Bourdot, G, Reis, MM, Ghamkhar, K (2021) Identification of weeds based on hyperspectral imaging and machine learning. Front Plant Sci 11:611622 CrossRefGoogle ScholarPubMed
Lou, Z, Quan, L, Sun, D, Li, H, Xia, F (2022) Hyperspectral remote sensing to assess weed competitiveness in maize farmland ecosystems. Sci Total Environ 844:157071 CrossRefGoogle ScholarPubMed
Maes, WH, Steppe, K (2019) Perspectives for remote sensing with unmanned aerial vehicles in precision agriculture. Trends Plant Sci 24:152–164 CrossRefGoogle ScholarPubMed
Manjunath, KR, Kumar, A, Meenakshi, M, Renu, R, Uniyal, SK, Singh, RD, Ahuja, PS, Ray, SS, Panigrahy, S (2014) Developing spectral library of major plant species of western Himalayas using ground observations. J Indian Soc Remote Sens 42:201–216 CrossRefGoogle Scholar
Mariotto, I, Thenkabail, PS, Huete, A, Slonecker, ET, Platonov, A (2014) Hyperspectral versus multispectral crop-productivity modeling and type discrimination for the HyspIRI mission. Remote Sens Environ 139:291–305 CrossRefGoogle Scholar
Mottus, M, Rautiainen, M (2013) Scaling PRI between coniferous canopy structures. IEEE J Sel Top Appl Earth Obs Remote Sens 6:708–714 CrossRefGoogle Scholar
Oerke, EC, Herzog, K, Toepfer, R (2016) Hyperspectral phenotyping of the reaction of grapevine genotypes to Plasmopara viticola . J Exp Bot 67:5529–5543 CrossRefGoogle ScholarPubMed
Pena-Barragan, JM, Lopez-Granados, F, Jurado-Expoosito, M, Garcia-Torres, L (2006) Spectral discrimination of Ridolfia segetum and sunflower as affected by phenological stage. Weed Res 46:10–21 CrossRefGoogle Scholar
Pettorelli, N, Vik, JO, Mysterud, A, Gaillard, JM, Tucker, CJ, Stenseth, NC (2005) Using the satellite-derived NDVI to assess ecological responses to environmental change. Trends Ecol Evol 20:503–510 CrossRefGoogle ScholarPubMed
Prati, A, Shan, C, Wang, KIK (2019) Sensors, vision and networks: from video surveillance to activity recognition and health monitoring. J Ambient Intel Smart Environ 11:5–22 Google Scholar
Qian, Y, Yu, J, Jia, Z, Yang, F, Palidan, T (2013) Extraction and analysis of hyperspectral data from typical desert grassland in Xinjiang. Acta Prataculturae Sin 22:157–166. ChineseGoogle Scholar
Qu, J, Sun, D, Cheng, J, Pu, H (2018) Mapping moisture contents in grass carp (Ctenopharyngodon idella) slices under different freeze drying periods by Vis-NIR hyperspectral imaging. LWT Food Sci Technol 75:529–536 CrossRefGoogle Scholar
Rossini, M, Nedbal, L, Guanter, L, Ac, A, Alonso, L, Burkart, A, Cogliati, S, Colombo, R, Damm, A, Drusch, M, Hanus, J, Janoutova, R, Julitta, T, Kokkalis, P, Moreno, J, et al. (2015) Red and far red sun-induced chlorophyll fluorescence as a measure of plant photosynthesis. Geophys Res Lett 42:1632–1639 CrossRefGoogle Scholar
Rozenberg, G, Kent, R, Blank, L (2021) Consumer-grade UAV utilized for detecting and analyzing late-season weed spatial distribution patterns in commercial onion fields. Precis Agric 22:1317–1332 CrossRefGoogle Scholar
Segarra, J, Buchaillot, ML, Araus, JL, Kefauver, SC (2020) Remote sensing for precision agriculture: Sentinel-2 improved features and applications. Agronomy 10:641 CrossRefGoogle Scholar
Steponaviciene, V, Marcinkeviciene, A, Butkeviciene, LM, Skinuliene, L, Boguzas, V (2021) The effect of different soil tillage systems and crop residues on the composition of weed communities. Agronomy 11:1276 CrossRefGoogle Scholar
Tang, J, Wang, D, Zhang, Z, He, L, Xin, J, Xu, Y (2017) Weed identification based on K-means feature learning combined with convolutional neural network. Comput Electron Agric 135:63–70 CrossRefGoogle Scholar
Tzamali, E, Akoumianakis, G, Argyros, A, Stephanedes, YJ (2006) Improved design for vision-based incident detection in transportation systems using real-time view transformations. J Transp Eng A Syst 132:837–844 CrossRefGoogle Scholar
Von der Lippe, M, Kowarik, I (2007) Do cities export biodiversity? Traffic as dispersal vector across urban-rural gradients. Divers Distrib 14:18–25 CrossRefGoogle Scholar
Waheed, T, Bonnell, RB, Prasher, SO, Paulet, E (2006) Measuring performance in precision agriculture: CART-A decision tree approach. Agric Water Manage 84:173–185 CrossRefGoogle Scholar
Wang, Z, Fu, Z, Weng, W, Yang, D, Wang, J (2023) An efficient method for the rapid detection of industrial paraffin contamination levels in rice based on hyperspectral imaging. LWT Food Sci Technol 171:114125 CrossRefGoogle Scholar
Wei, X, Bai, J, Zhang, J, Wu, S (2014) Weed identification from winter rape at seedling stage based on spectral variable selection. Sensor Lett 12:530–536 CrossRefGoogle Scholar
Xiao, Y, He, X, Ma, Q, Lu, Y, Bai, F, Bai, J, Wu, Q (2018) Photosynthetic accumulation of lutein in Auxenochlorella protothecoides after heterotrophic growth. Mar Drugs 16:283 CrossRefGoogle ScholarPubMed
Yang, W, Liu, W, Liu, J, Zhang, M (2020) Acoustic emission recognition based on a two-streams convolutional neural network. Comput Mater Contin 64:515–525 Google Scholar
Yang, Z, Tian, J, Feng, K, Gong, X, Liu, J (2021) Application of a hyperspectral imaging system to quantify leaf-scale chlorophyll, nitrogen and chlorophyll fluorescence parameters in grapevine. Plant Physiol Biochem 166:723–737 CrossRefGoogle ScholarPubMed
Yeow, YL, Leong, YK (2005) A general computational method for converting normal spectra into derivative spectra. Appl Spectrosc 59:584–592 CrossRefGoogle ScholarPubMed
Zahisham, Z, Lim, K, Koo, V, Chan, Y, Lee, C (2023) 2SRS: two-stream residual separable convolution neural network for hyperspectral image classification. IEEE Geosci Remote Sens 20:5501505 Google Scholar
Zhang, C, Zhou, L, Zhao, Y, Zhu, S, Liu, F, He, Y (2020) Noise reduction in the spectral domain of hyperspectral images using denoising autoencoder methods. Chemometr Intell Lab Syst 203:104063 CrossRefGoogle Scholar
Zhang, Q, Zhang, Y, Peng, S, Zobel, K (2014) Climate warming may facilitate invasion of the exotic shrub Lantana camara . PLoS ONE 9:e105500 CrossRefGoogle ScholarPubMed
Zhang, R, Zheng, Z, Liu, G, Du, C, Du, C, Lei, S, Xu, Y, Xu, J, Mu, M, Bi, S, Li, J (2021) Simulation and assessment of the capabilities of orbita hyperspectral (OHS) imagery for remotely monitoring chlorophyll-a in eutrophic plateau lakes. Remote Sens 13:2821 CrossRefGoogle Scholar
Zhang, X, Liu, F, He, Y, Li, X (2013) Application of hyperspectral imaging and chemometric calibrations for variety discrimination of maize seeds. Sensors 12:17234–17246 CrossRefGoogle Scholar
Zhang, X, Pu, P, Tang, Y, Zhang, L, Lv, J (2019a) C4 photosynthetic enzymes play a key role in wheat spike bracts primary carbon metabolism response under water deficit. Plant Physiol Biochem 142:163–172 CrossRefGoogle ScholarPubMed
Zhang, Y, Cao, K, Sack, L, Li, N, Wei, X, Goldstein, G (2015) Extending the generality of leaf economic design principles in the cycads, an ancient lineage. New Phytol 206:817–829 CrossRefGoogle ScholarPubMed
Zhang, Y, Gao, J, Cen, H, Lu, Y, Xu, X, He, Y, Pieters, JG (2019b) Automated spectral feature extraction from hyperspectral images to differentiate weedy rice and barnyard grass from a rice crop. Comput Electron Agric 159:42–49 CrossRefGoogle Scholar
Zhang, Y, Slaughter, DC (2011) Hyperspectral species mapping for automatic weed control in tomato under thermal environmental stress. Comput Electron Agric 77:95–104 CrossRefGoogle Scholar
Zhang, Y, Wu, J, Wang, A (2022) Comparison of various approaches for estimating leaf water content and stomatal conductance in different plant species using hyperspectral data. Ecol Indic 142:109278 CrossRefGoogle Scholar
Zhong, Y, Wang, X, Xu, Y, Wang, S, Jia, T, Hu, X, Zhao, J, Wei, L, Zhang, L (2019) Mini-UAV-Borne hyperspectral remote sensing: from observation and processing to applications. IEEE Geosc Remote Sens 6:46–62 CrossRefGoogle Scholar
Zomer, RJ, Trabucco, A, Ustin, SL (2009) Building spectral libraries for wetlands land cover classification and hyperspectral remote sensing. J Environ Manag 90:2170–2177 CrossRefGoogle ScholarPubMed
Supplementary material: File

Wang et al. supplementary material

Table S1 and Figure S1

Download Wang et al. supplementary material(File)
File 1.9 MB