5604: INFORMATION STORAGE AND RETRIEVAL


Analyzing, indexing, representing, storing, searching, retrieving, processing and presenting information and documents using fully automatic systems. The information may be in the form of text, hypertext, multimedia, or hypermedia. The systems are based on various models, e.g., Boolean logic, fuzzy logic, probability theory, etc., and they are implemented using inverted files, relational thesauri, special hardware, and other approaches. Evaluation of the systems' efficiency and effectiveness. Pre: Graduate standing; (3H,3C). I.


Textbook
“Information Storage and Retrieval” by Robert R. Korfhage, John Wiley & Sons, Inc. 1997[Korf97]


Topic

Reading
Additional Resources
Overview
Data Compression

[Korf97]1
[Korf97]2.6

http://www.faqs.org/faqs/compression-faq/part2/section-1.html
http://www.compressconsult.com/huffman/

Document Analysis and File Structures
Lexical Analysis
Inverted File         Structures

[Korf97]2
[Korf97]B
“Self-Indexing Inverted Files for Fast Text Retrieval” Moffat A., et.al.

http://www.python.org/doc/ref/lexical.html
Models and Query Structures
Boolean
Vector
Probabilistic

[Korf97]3
“Automatic Text Browsing Using Vector Space Model” Singhal A., et.al.


Matching Process
Relevance and Similarity
Matching Types (Proximity, Fuzzy, etc.)

[Korf97]4
http://citeseer.nj.nec.com/weber97approximationbased.html
Text Analysis
Stemming
Thesauri

[Korf97]5

User Profiles
Document Clusters
IR Systems

[Korf97]6
[Korf97]7


http://searchpdf.adobe.com/proxies/1/97/85/46.html
Retrieval Effectiveness Measures
Effectiveness Improvement Techniques
TREC

[Korf97]8
[Korf97]9

http://trec.nist.gov
Alternative Retrieval Techniques
[Korf97]10

Output Presentation
Graphical User Interfaces
Visualization

[Korf97]11
http://www.geog.le.ac.uk/jwo/research/poplandscape/index.html
Web
Search Engines
Metadata

[Korf97]12
http://purl.org/metadata/dublin_core

Project

Sample lecture presentation Slides in Powerpoint; copies of the course lecture slides are distributed the day of the lecture