Number of found records: 59
|
FROEHLICH, Thomas J. |
|
Relevance reconsidered: towards an agenda for the 21st century: introduction to special topic issue on relevance research |
|
Journal of the American Society for Information Science, 1994, vol. 45, n. 3, pp. 124-134 |
|
On line (13/05/2005) |
|
The publication of this issue marks a special event for the Journal of the American Society for Information Science: the introduction of special topics issues. It seems appropriate that the first issue is devoted to the topic of relevance, acknowledged as the most fundamental and much debated concern for information science, it being the tacit or explicit judgment of end-users about the output of information retrieval systems. Early on, information scientists recognized that the concept of relevance was integral to information system design, development, and evaluation. However, there was little agreement as to the exact nature of relevance and even less that it could be operationalized in systems or for the evaluation of systems. While this lack of agreement continues to an extent at the present, some common understandings have developed, and these are reflected in the papers in this issue. (AU) |
|
Subject indexing; Relevance |
Assessment |
|
|
|
|
HARRIS, Robert |
|
Evaluating Internet Research Sources |
|
On line ( 15/06/2004) |
|
Presentation of different criteria for evaluating the quality of information on the Internet |
|
Quality; evaluation; Internet; information |
Assessment |
|
|
|
|
HONG, Traci |
|
The influence of structural and message features on web site credibility |
|
Journal of the American Society for Information Science and Technology; 57 (1) Jan 2006, pp.114-127 ISSN 1532-2882 |
|
On line ( 05/2006) (Only UGR) |
|
This article explores the associations that message features and Web structural features have with perceptions of Web site credibility. In a within-subjects experiment, 84 participants actively located health-related Web sites on the basis of two tasks that differed in task specificity and complexity. Web sites that were deemed most credible were content analyzed for message features and structural features that have been found to be associated with perceptions of source credibility. Regression analyses indicated that message features predicted perceived Web site credibility for both searches when controlling for Internet experience and issue involvement. Advertisements and structural features had no significant effects on perceived Web site credibility. Institution-affiliated domain names (.gov, .org, .edu) predicted Web site credibility, but only in the general search, which was more difficult. Implications of results are discussed in terms of online credibility research and Web site design. (Original abstract) |
|
World Wide Web; Web sites; Credibility; Evaluation; Performance measures |
Assessment |
|
|
|
|
HOVY, Eduard; LIN, Chin-Yew |
|
Manual and Automatic Evaluation of Summaries. |
|
In HAHN, Udo; HARMAN, Donna, (Eds), Proceedings of the Workshop on Text Summarization at the 4Oth Meeting of the Association for Computational Linguistics, July 11{12 2002. |
|
PDF |
|
In this paper we discuss manual and automatic evaluations of summaries using data from the Document Understanding Conference 2001 (DUC-2001). We first show the instability of the manual evaluation. Specifically, the low interhuman agreement indicates that more reference summaries are needed. To investigate the feasibility of automated summary evaluation based on the recent BLEU method from machine translation, we use accumulative n-gram overlap scores between system and human summaries. The initial results provide encouraging correlations with human judgments, based on the Spearman rank-order correlation coefficient. However, relative ranking of systems needs to take into account the instability. (AU) |
|
DUC; evaluation; summary; |
Assessment |
|
|
|
|
