By a News Reporter-Staff News Editor at Information Technology Newsweekly -- Investigators publish new report on Information Technology. According to news reporting from Melbourne, Australia, by VerticalNews journalists, research stated, "Evaluation is highly important for designing, developing and maintaining effective information retrieval or search systems as it allows the measurement of how successfully an information retrieval system meets its goal of helping users fulfil their information needs. But what does it mean to be successful? It might refer to whether an information retrieval system retrieves relevant (compared with non-relevant) documents; how quickly results are returned; how well the system supports users' interactions; whether users are satisfied with the results; how easily users can use the system; whether the system helps users carry out their tasks and fulfil their information needs; whether the system impacts on the wider environment; how reliable the system is etc."
The news correspondents obtained a quote from the research from the Royal Melbourne Institute of Technology University, "Evaluation of information retrieval systems has been actively researched for over 50 years and continues to be an area of discussion and controversy. Test collections. In this paper we discuss system-oriented evaluation that focuses on measuring system effectiveness: how well an information retrieval system can separate relevant from non-relevant documents for a given user query. We discuss the construction and use of standardised benchmarks - test collections - for evaluating information retrieval systems. Research directions. The paper also describes current and future research directions for test collection-based evaluation, including efficient gathering of relevance assessments, the relationship between system effectiveness and user utility, and evaluation across user sessions."
According to the news reporters, the research concluded: "This paper describes test collections which have been widely used in information retrieval evaluation and provide an approach for measuring system effectiveness."
For more information on this research see: Evaluating the performance of information retrieval systems using test collections. Information Research-An International Electronic Journal, 2013;18(2):124-133. Information Research-An International Electronic Journal can be contacted at: Univ Sheffield Dept Information Studies, Univ Sheffield, Western Bank, Sheffield S10 2TN, S Yorks, England.
Our news journalists report that additional information may be obtained by contacting P. Clough, RMIT Univ, Sch Comp Sci & Informat Technol, Melbourne, Vic 3001, Australia.
Keywords for this news article include: Melbourne, Information Technology, Australia and New Zealand
Our reports deliver fact-based news of research and discoveries from around the world. Copyright 2014, NewsRx LLC