Number of found records: 18
|
VAUGHAN, Liwen |
|
New measurements for search engine evaluation proposed and tested. |
|
Information Processing and Management, 2004, vol. 40, n. 4, pp.677-691. |
|
On line (13/05/2005) |
|
A set of measurements is proposed for evaluating Web search engine performance. Some measurements are adapted from the concepts of recall and precision, which are commonly used in evaluating traditional information retrieval systems. Others are newly developed to evaluate search engine stability, an issue unique to Web information retrieval systems. An experiment was conducted to test these new measurements by applying them to a performance comparison of three commercial search engines: Google, AltaVista, and Teoma. Twenty-four subjects ranked four sets of Web pages and their rankings were used as benchmarks against which to compare search engine performance. Results show that the proposed measurements are able to distinguish search engine performance very well. (AU) |
|
Searching; Search engines; Evaluation |
Assessment |
|
|
|
|
XI, Wensi; XU-RONG, Richard; KHOO, Christopher S.G. |
|
Incorporating Window-Based Passage-Level Evidence in Document Retrieval |
|
Center for Advanced Information Systems. School of Applied Science Nanyang Technological University. Singapore; Journal of Information Science, 27(2001) 2,pp. 73-80 |
|
PDF |
|
This study investigated whether information retrieval can be improved if documents are divided into smaller subdocuments or passages, and the retrieval score for these passages are incorporated in the final retrieval score for the whole document. The documents were segmented by sliding a window of a certain size across the document. Each time the window stopped, it displayed/extracted a certain number of contiguous words. A retrieval score was calculated for each of the passages extracted, and the highest score obtained by a passage of that size was taken as the document's "window score" for that window size. A range of window sizes were tried. The experimental results indicated that using a fixed window size of 50 gave better results than other window sizes for the TREC test collection. This window size yielded a significant retrieval improvement of 24% compared to using the whole document retrieval score. However, combining this window score and the whole document retrieval score did not yield a retrieval improvement. Identifying the highest window score for each document (using window sizes varying from 50 to 400 words), and adopting it as the document retrieval score yielded a retrieval improvement of about 5% over taking the size-50 window score. Different window sizes were found to work best for different queries. If we could predict accurately the best window size to use for each query, a maximum retrieval improvement of 42% could be obtained. However, an effective way has not been found for predicting which window size would give the best results for each query. (AU) |
|
passage retrieval; text segmentation; merging search results/information synthesis |
Assessment |
|
|
|
|
BONZI, Susan; LIDDY, Elizabeth DuRoss |
|
The use of anaphoric resolution for document description in information retrieval. |
|
Information Processing and Management, 1989, vol. 25, n. 4, pp.429-441. |
|
On line (12/05/2005) |
|
Investigates 2 hypotheses concerning the use of anaphors in information retrieval. The 1st hypothesis, that anaphors tend to refer to integral concepts rather than to peripheral concepts, was well supported. 2 samples of documents, 1 in psychology and the other in computer science, were examined by subject experts who judged the centrality of phrases that were referred to anaphorically. The 2nd hypothesis, that various term weighting schemes are affected differently by anaphoric resolution, was also well supported. It was found that schemes that incorporate document length into the calculations produce much smaller increases in term weights for terms occurring in anaphoric resolutions than those that do not consider document length. (AU) |
|
Technical services; Information storage and retrieval; Information work; Subject indexing; Searching; Relevance; Anaphors |
Assessment |
|
|
|
|
CUGINI, John; PIATKO, Christine; LASKOWSKI, Sharon |
|
Interactive 3D Visualization for Document Retrieval. |
|
On line (12/05/2005) |
|
The availability of large collections of documents coupled with powerful search and retrieval algorithms provides the opportunity for people to access large sets of relevant documents in electronic form. However, often a user query can result in hundreds of potentially useful documents returned by the system. Our hypothesis is that interactive 3D graphics techniques can be used to help the user comprehend and filter such result sets. We describe some prototypes developed at NIST in pursuit of these goals and discuss associated design issues, such as icon appearance, layout within 3D space, and interaction mechanisms. (AU) |
|
Document retrieval; information retrieval; visualization; interactive 3D graphics techniques |
Assessment |
|
|
|
|
