Hostname: page-component-78c5997874-4rdpn Total loading time: 0 Render date: 2024-11-15T06:36:22.177Z Has data issue: false hasContentIssue false
  • English
  • Français

Case research on knowledge acquisition: observations and lessons

Published online by Cambridge University Press:  07 July 2009

Christine Chan  and
Izak Benbasat
Christine Chan
Affiliation:
School of Computing Science, Simon Fraser University, Burnaby, BC, CanadaV5A 1S6
Izak Benbasat
Affiliation:
School of Computing Science, Simon Fraser University, Burnaby, BC, CanadaV5A 1S6
Get access Rights & Permissions [Opens in a new window]

Abstract

Expert systems are being built despite the widely acknowledged problem of acquiring knowledge from experts. This study attempts to understand how knowledge acquisition is conducted in practice by investigating three expert system development projects. A CASE research methodology is adopted, and data is collected through unobtrusive observation, from taped protocols of knowledge acquisition sessions, retrospective interviews with the participants involved, and deliverables produced. The variables examined include the problem domain, the domain expert, the knowledge engineer, the knowledge acquisition process, the expert system construction process, potential users, organizational setting, and the expert system itself. The knowledge acquisition processes for three expert systems in the domains of law of negligence, telephone line fault diagnosis, and wastewater treatment have been examined. By juxtaposing the observations drawn with findings from the relevant literature, the study makes prescriptive suggestions on considerations and techniques for future acquisition efforts, and provides data for hypothesis generation in further research.

Type
Research Article
Information
The Knowledge Engineering Review , Volume 6 , Issue 2 , June 1991 , pp. 97 - 120
Copyright
Copyright © Cambridge University Press 1991

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abrett, G and Burstein, MH, 1987, “The KREME knowledge editing environment” International Journal of Man-Machine Studies 27 (2) 103–126.Google Scholar
Alexander, JH, Freiling, MJ, Shulman, SJ, Rehfuss, S and Messich, SL, 1987, “Ontological analysis, an ongoing experiment” International Journal of Man-Machine Studies 26 (4) 473–485.CrossRefGoogle Scholar
Anjewierden, A, 1987, “The KADS system” Proceedings of the First Knowledge Acquisition Workshop Reading University, UK, (09).Google Scholar
Asner, M and King, A, 1987, “Prototyping: a low-risk approach to developing complex systems” unpublished paper from Gellman Hayward & Partners Ltd.Google Scholar
Bell, J and Hardiman, RJ, 1989, “The Third role—the naturalistic knowledge engineer” In: Diaper, D, ed., Knowledge Engineering: Principles, Techniques, and Applications Ellis Horwood Ltd.Google Scholar
Bonoma, TV, 1985, “Case research in Marketing: opportunities, problems, and a process” Journal of Marketing Research 22 (05) 199–208.Google Scholar
Boose, J, 1986, Expertise Transfer for Expert System Design Elsevier.Google Scholar
Boose, JH, 1989, “A survey of Knowledge acquisition techniques and tools”, Knowledge Acquisition 1 (1) 3–38.CrossRefGoogle Scholar
Breuker, J and Wielinga, B, 1987 a, “Knowledge acquisition as modelling expertise: the KADS methodology” Proceedings of the First European Workshop on Knowledge Acquisition for Knowledge-Based Systems Reading University, UK, (09).Google Scholar
Breuker, J and Wielinga, B, 1987 b, “Use of models in the interpretation of verbal data” In: Kidd, A, ed., Knowledge Acquisition for Expert Systems: a Practical Handbook Plenum Press.Google Scholar
Breuker, J and Wielinga, B, 1989, “Models of expertise in knowledge acquisition In: Guida, G and Tasso, C, eds., Topics in Expert System Design: Methodologies and Tools 265–295. Elsevier Science Publishing Co.CrossRefGoogle Scholar
Buchanan, BG, Barstow, D, Bechtel, R, Bennett, J, Clancy, W, Kulikowski, C, Mitchell, T and Waterman, DA, 1983, “Constructing an expert system” In: Hayes-Roth, F, Waterman, DA, and Lenat, DB, eds., Building Expert Systems Addison-Wesley.Google Scholar
Burton, AM and Shadbolt, NR, 1987, “Knowledge engineering”, Technical Report 87–2–1, Artificial Intelligence Group, Department of Technology, University of Nottingham.Google Scholar
Chilibeck, BM, 1988, “Operation and diagnostics of wastewater treatment facilities using an expert system”, unpublished Master's thesis, Department of Civil Engineering, University of British Columbia, Canada.Google Scholar
Cordingly, ES, 1989, “Knowledge elicitation techniques for knowledge based systems” In: Diaper, D, ed., Knowledge Elicitation: Principles, Techniques and Applications Ellis Horwood Ltd.Google Scholar
DeJong, K, 1986, “Knowledge acquisition for fault isolation expert systems” Proceedings of the First Knowledge Acquisition for Knowledge-Based Systems Workshop, 20.0–20.8, Banff, Canada, (11).Google Scholar
Dhaliwal, JS and Benbasat, I, 1990, “A framework for the comparative evaluation of knowledge acquisition tools and techniques” Knowledge Acquisition 2 (2) 145–66.CrossRefGoogle Scholar
Diaper, D, 1989, “Designing expert systems: from Dan to Beersheba” In: Diaper, D, ed., Knowledge Elicitation: Principles, Techniques, and Applications. Ellis Horwood Ltd.Google Scholar
Fellers, JW, 1987, “Key factors in knowledge acquisition” Computer Personnel 11 (1) 10–21.Google Scholar
Gaines, BR, 1987 a, “Rapid prototyping for expert systems” In: Oliff, M, ed., Intelligent Manufacturing: Proceedings of the First International Conference on Expert Systems and the Leading Edge in Production Planning and Control45–73 Benjamin Cummins.Google Scholar
Gaines, BR, 1987 b, “Advanced expert system support environments” Proceedings of the Second Knowledge Acquisition for Knowledge-Based Systems Workshop Banff, Canada, (11).Google Scholar
Gale, WA, 1987, “Knowledge-based knowledge acquisition for statistical consulting system” International Journal of Man-Machine Studies 26 55–64.CrossRefGoogle Scholar
Greenwell, M, 1988, Knowledge Engineering for Expert Systems Ellis Horwood Ltd.Google Scholar
Grover, MD, 1983, “A pragmatic knowledge acquisition methodology” Proceedings of the Eighth International Joint Conference on Artificial IntelligenceMorgan Kaufmann Publishers, Inc.Google Scholar
Guida, G and Tasso, C, 1989, “Building expert systems: from life cycle to development methodology” In: Guida, G and Tasso, C, eds., Topics in Expert System Design: Methodologies and Tools North Holland.Google Scholar
Hart, A, 1986, Knowledge Acquisition for Expert Systems Kogan Page.Google Scholar
Hayes-Roth, F, Waterman, DA and Lenat, DB, 1983, Building Expert Systems Addison-Wesley.Google Scholar
Henderson, HC, 1987, “Finding synergy between decision support systems and expert systems research” Decision Sciences 18 (3) 333–349.Google Scholar
Jenkins, AM, 1980, “The prototype model as a management information systems design technique” Discussion Paper #1663, School of Business, Indiana University.Google Scholar
Jenkins, AM, 1983, “Prototyping: a methodology for the design and development of application systems” Discussion paper #227, School of Business, Indiana University.Google Scholar
Johnson, PE, 1983, “What kind of expert should a system be?” The Journal of Medicine and Philosophy 8 77–97.CrossRefGoogle ScholarPubMed
Jorgensen, AH, 1984, “On the psychology of prototyping” In: Budde, R, Kuhlenkamp, K and Mathiassen, L, eds., Approaches to Prototyping Springer-Verlag.Google Scholar
Kitto, CM, 1988, “Progress in automated knowledge acquisition tools: how close are we to replacing the knowledge engineer?” Proceedings of the 3rd AAAI Knowledge Acquisition for Knowledge-Based Systems Workshop Banff, Canada (11).Google Scholar
Kulikowski, CA, 1989, “Knowledge base design and construction: from prototyping to refinement” In: Guida, G and Tasso, C, eds., Topics in Expert System Design: Methodologies and Tools North Holland.Google Scholar
Littman, DC, 1987, “Modelling human expertise in knowledge engineering: some preliminary observations” International Journal of Man-Machine Studies 26 81–92.CrossRefGoogle Scholar
Naumann, JD and Jenkins, AM, 1982, “Prototyping: the new paradigm for systems development” Management Information Systems Quarterly 6 (3) 29–44.Google Scholar
Neale, IM, 1988, “First generation expert systems: a review of knowledge acquisition methodologies” Knowledge Engineering Review 3 (2) 105–145.Google Scholar
Nunamaker, JF et al. , 1988, “Knowledge-based systems support for information centers” Journal of Management Information Systems 5 (1) 4–24.Google Scholar
Olson, JR and Reuter, HH, 1987, “Extracting expertise from experts: methods for knowledge acquisition” Expert Systems 4 (3) 152–168.Google Scholar
Prerau, DS, 1989, “Choosing an expert system domain” In: Guida, G and Tasso, C, eds., Topics in Expert System Design: Methodologies and Tools North Holland.Google Scholar
Shaw, MLG and Gaines, BR, 1987, “Techniques for knowledge acquisition and transfer” International Journal of Man-Machine Studies 27 251–280.CrossRefGoogle Scholar
Smith, JC, 1984, Liability and Negligence Carswell Legal Publications.Google Scholar
Smith, JC, 1988, Professor J C Smith emphasized this point in personal communications with the first author and C Deedman on 08 19 1988.Google Scholar
Stefik, M, Foster, G, Bobrow, DG, Kahn, K, Lanning, S and Suchman, L, 1987, “Beyond the chalkboard: computer support for collaboration and problem solving meetings” Communications of the ACM 30 (1) 32–47.CrossRefGoogle Scholar
Sviokla, JJ, 1986, “Planpower, Xcon, and Mudman: An in-depth analysis into three commercial expert systems in use” unpublished doctoral thesis, Graduate School of Business, Harvard University, Cambridge, USA.Google Scholar
Watkins, P and O'Leary, DE, 1987, “Knowledge acquisition for small scale expert systems from consulting experts: a field study approach” Proceedings of the First European Workshop on Knowledge Acquisition for Knowledge-Based Systems Reading University, UK (09).Google Scholar
Webb, EJ, Campbell, DT, Schwartz, RD and Sechrest, L, 1966, Unobtrusive Measure: Nonreactive Research in the Social Sciences Rand McNally.Google Scholar
Weick, KE, 1968, “Systematic observational methods” In: Lindzen, G and Aronson, E, eds., The Handbook of Social Psychology Volume 2 Addison-Wesley.Google Scholar
Weitzel, JR and Kerschberg, L, 1989, “Developing knowledge-based systems: reorganising the system development life cycle” Communications of the ACM 32 (4). 04.Google Scholar
Welbank, M, 1987, “Knowledge acquisition: a survey and British Telecom experience” Proceedings of the First European Workshop on Knowledge Acquisition for Knowledge-Based Systems Reading University, UK (09).Google Scholar
Witten, IH and MacDonald, B, 1988, “Using concept learning for knowledge acquisition” International Journal of Man-Machine Studies 29 (2) 171–196.CrossRefGoogle Scholar
Yin, RK, 1984 Case Study Research, Design, and Methods Sage Publications.Google Scholar