Development of the CODER System: A Test-bed for Artificial Intelligence Methods in Information Retrieval

Fox, Edward A. (1986) Development of the CODER System: A Test-bed for Artificial Intelligence Methods in Information Retrieval. Technical Report TR-86-40, Computer Science, Virginia Polytechnic Institute and State University.

Abstract

The CODER (COmposite Document Expert/Extended/Effective Retrieval) system is a test-bed for investigating the application of artificial intelligence methods to increase the effectiveness of information retrieval systems. Particular attention is being given to analysis and representation of heterogeneous documents, such as electronic mail digests or messages, which vary widely in style, length, topic, and structure. Since handling passages of various types in these collections is difficult even for experimental systems like SMART, it is necessary to turn to other techniques being explored by information retrieval and artificial intelligence researchers. The CODER system architecture involves communities of experts around active blackboards, accessing knowledge bases that describe users, documents, or lexical items of various types. Most of the lexical knowledge base construction work is now complete, and experts for search and temporal reasoning can perform a variety of processing tasks. User information and queries are being gathered, and the first prototype is nearly complete. It appears that a number of artificial intelligence techniques are needed to best handle such common, but complex, document analysis and retrieval tasks.