Use of the weighted Kappa coefficient in classification error assessment of thematic maps
- 1 July 1996
- journal article
- research article
- Published by Taylor & Francis in International Journal of Geographical Information Science
- Vol. 10 (5), 591-603
- https://doi.org/10.1080/02693799608902099
Abstract
The weighted Kappa coefficient is applied to the comparison of thematic maps. Weighted Kappa is a useful measure of accuracy when the map classes are ordered, or when the relative seriousness of the different possible errors may vary. The calculation and interpretation of weighted Kappa are demonstrated by two examples from forest surveys. First, the accuracy of thematic site quality maps classified according to an ordinal scale is assessed. Error matrices are derived from map overlays, and two different sets of agreement weights are used for the calculation. Weighted Kappa ranges from 0.34 to 0.55, but it does not differ significantly between two separate areas. Secondly, weighted Kappa is calculated for a tree species cover classified according to a nominal scale. Weights reflecting the economic loss for the forest owner due to erroneous data are used for the computation. The value of weighted Kappa is 0.56.Keywords
This publication has 7 references indexed in Scilit:
- Use of the average mutual information index in evaluating classification error and consistencyInternational Journal of Geographical Information Science, 1993
- A review of assessing the accuracy of classifications of remotely sensed dataRemote Sensing of Environment, 1991
- Coefficient Kappa: Some Uses, Misuses, and AlternativesEducational and Psychological Measurement, 1981
- The Comparison of Means When Samples Consist of Spatially Autocorrelated ObservationsEnvironment and Planning A: Economy and Space, 1975
- A New Procedure for Assessing Reliability of Scoring EEG Sleep RecordingsAmerican Journal of Eeg Technology, 1971
- Large sample standard errors of kappa and weighted kappa.Psychological Bulletin, 1969
- Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.Psychological Bulletin, 1968