Hostname: page-component-8448b6f56d-dnltx Total loading time: 0 Render date: 2024-04-24T10:34:45.213Z Has data issue: false hasContentIssue false
  • English
  • Français

Overview of current practice and research initiatives for the verification and validation of KBS

Published online by Cambridge University Press:  07 July 2009

T. J. Lydiard
T. J. Lydiard
Affiliation:
Artificial Intelligence Applications Institute, University of Edinburgh, Edinburgh, UK
Get access Rights & Permissions [Opens in a new window]

Abstract

Based on a survey of recent literature, this report aims to highlight the issues associated with the verification and validation of knowledge based systems. The confusion arising from the lack of clear terminology is considered, along with some of the characteristics of knowledge based systems that cause particular difficulties for verification and validation. The various approaches that can be adopted to address these difficulties are discussed, followed by a survey of recent research initiatives.

The author concludes that many of the difficulties associated with the verification and validation of knowledge based systems are a feature of the complexity of the system being built and the manner of its development rather than of the specific technology chosen to implement it.

Type
Research Article
Information
The Knowledge Engineering Review , Volume 7 , Issue 2 , June 1992 , pp. 101 - 113
Copyright
Copyright © Cambridge University Press 1992

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Born, G, 1988, “Guidelines for quality assurance of expert systems” CSA Working Group on QA and Expert Systems (1.1), 11.Google Scholar
Cragun, BJ and Steudel, HJ, 1987, “A decision-table-based processor for checking completeness and consistency in rule-based expert systems” International Journal of Man-Machine Studies 26 633–648.Google Scholar
Enand, R, Kahn, GS and Mills, RA, 1990 “A methodology for validating large knowledge bases” International Journal of Man-Machine Studies 33 361–371.Google Scholar
Hoppe, T and Meseguer, P, 1991, “On the terminology of VVT” In: M. Grisoni, editor, Eurovav-91: Proceedings of the European Workshop on the Verification and Validation of Knowledge Based Systems pp 103–108.Google Scholar
Inder, R and Filby, I, 1991, Survey of Knowledge Engineering Methods and Supporting Tools. Technical Report AIAI-TR-99, AIAI, December. (Also presented at the BCS SGES workshop on Knowledge-Based Systems Methodologies, 12 1991.Google Scholar
Johnson, RG, Joly, GC and King, PJH, 1987, Survey of Techniques for the Checking of Rule-Based Expert Systems. Technical report, Department of Computer Science, Birkbeck College, London.Google Scholar
Kang, Y and Bahill, AT, 1990, “A tool for detecting expert system errors” AI Expert 02, 46–51.Google Scholar
Liu, NK and Dillon, T, 1991, “An approach towards the verification of expert systems using numerical Petri nets” International Journal of Intelligent Systems 6 255–276.Google Scholar
McGraw, KL and Harbison-Briggs, K, 1989, Knowledge Acquisition: Principles and Guidelines, pp 300–325, Prentice-Hall.Google Scholar
Mengshoel, OJ, 1991, “KVAT: a tool for incremental knowledge validation in a knowledge engineering workbench: In: M. Grisoni, editor, Eurovav-91: Proceedings of the European Workshop on the Verification and Validation of Knowledge Based Systems pp 133–146.Google Scholar
Nazareth, DL, 1989, “Issues in the verification of knowledge in rule-based systems” International Journal of Man-Machine Studies 30 255–271.Google Scholar
Nazareth, DL and Kennedy, MH, 1991, “Verification of knowledge based systems using directed graphs” Knowledge Acquisition 3 339–360.Google Scholar
Nguyen, TA, “CHECK applied to ART” In: Third Conference on AI ApplicationsWashington, DC.Google Scholar
Nguyen, TA, Perkins, WA, Laffey, TJ and Pecora, D, 1987, “Knowledge base verification” AI Magazine 8(2) 69–75, Summer.Google Scholar
O'Keefe, RM, Balci, O and Smith, EP, 1987, “Validating expert system performance” IEEE Expert, 81–89, Winter.Google Scholar
Partridge, D, 1986, Artificial Intelligence: Applications in the Future of Software Development Engineering Ellis Horwood.Google Scholar
Pearce, D, 1991, “A model based approach to validation” In: M. Grisoni, editor, Eurovav-91: Proceedings of the European Workshop on the Verification and Validation of Knowledge Based Systems pp 55–67.Google Scholar
Petitjean, S, Brunessaux, L and Vaudet, J-P, 1991, “Three pragmatic tools for the validation of knowledge based systems” In: M. Grisoni, editor, Eurovav-91: Proceedings of the European Workshop on the Verification and Validation of Knowledge Based Systems pp 111–123.Google Scholar
Ribar, G, Arcoleo, Fand, Hollo, D, 1991, “Loan probe: testing a big expert system” AI Expert 43–49, 05.Google Scholar
Stachowitz, RA, Chang, CL, Stock, TS and Combs, JB, 1987, “Building validation tools for knowledge based systems.” Proceedings of the SOAR Conference,Houston, TXNASA/JSC.Google Scholar
Stachowitz, RA, Combs, JB, 1987, “Validation of expert systems” In: Proceedings of the 20th Annual Hawaii International Conference on System Sciences.Google Scholar
van Someren, M, 1991, “Structural and formative validation of knowledge bases” In: M. Grisoni, editor, Eurovav-91: Proceedings of the European Workshop on the Verification and Validation of Knowledge Based Systems. pp 103–108Google Scholar