Bringing undergraduate students closer to a real-world information retrieval setting: methodology and resources

@inproceedings{Urbano2011BringingUS,
  title={Bringing undergraduate students closer to a real-world information retrieval setting: methodology and resources},
  author={Juli{\'a}n Urbano and M{\'o}nica Marrero and Diego Mart{\'i}n and Jorge Luis Morato Lara},
  booktitle={ITiCSE '11},
  year={2011}
}
We describe a pilot experiment to update the program of an Information Retrieval course for Computer Science undergraduates. We have engaged the students in the development of a search engine from scratch, and they have been involved in the elaboration, also from scratch, of a complete test collection to evaluate their systems. With this methodology they get a whole vision of the Information Retrieval process as they would find it in a real-world setting, and their direct involvement in the… 
Overview of EIREX 2010: Computing
TLDR
This overview paper summarizes the results of the EIREX 2010 track, focusing on the creation of the test collection and the analysis to assess its reliability.
Overview of EIREX 2011: Crowdsourcing
TLDR
This overview paper summarizes the results of the EIREX 2011 track, focusing on the creation of the test collection and the analysis to assess its reliability.
Overview of EIREX 2012: Social Media
TLDR
This overview paper summarizes the results of the EIREX 2012 track, focusing on the creation of the test collection and the analysis to assess its reliability.
PREDICTORS OF INFORMATION RETRIEVAL EFFECTIVENESS AMONG LIBRARY AND INFORMATION SCIENCE UNDERGRADUATES IN KWARA STATE UNIVERSITIES
In this information age, it is observed that, as the quantity of information grows the ability of individuals to search and retrieve the needed information decreases in a dramatically manner, which

References

SHOWING 1-10 OF 19 REFERENCES
Teaching key topics in computer science and information systems through a web search engine project
TLDR
The tools and resources available to students in this project are reviewed and the experiences in having students to work on this project in a course at the University of Arizona are reported.
History places: A case study for relational database and information retrieval system design
TLDR
This article presents a project-based case study that was developed for students with diverse backgrounds and varied inclinations for engaging technical topics, requiring that student teams develop a vision for a kind of digital library, propose a conceptual model, and use the model to derive a logical model and information retrieval specification.
IR-BASE: An integrated framework for the research and teaching of information retrieval technologies
TLDR
IR-BASE is of interest not only to IR researchers and professionals, who want to rapidly develop prototypes to test new ideas, but also to teachers and students, who will have an easily configurable, modifiable and extendible set of components to act has a basis for learning, building and experimenting with current IR algorithms.
Combining Open-Source with Research to Re-engineer a Hands-on Introductory NLP Course
  • Nitin MadnaniB. Dorr
  • Computer Science
    Proceedings of the Third Workshop on Issues in Teaching Computational Linguistics - TeachCL '08
  • 2008
We describe our first attempts to re-engineer the curriculum of our introductory NLP course by using two important building blocks: (1) Access to an easy-to-learn programming language and framework
Cumulated gain-based evaluation of IR techniques
TLDR
This article proposes several novel measures that compute the cumulative gain the user obtains by examining the retrieval result up to a given ranked position, and test results indicate that the proposed measures credit IR methods for their ability to retrieve highly relevant documents and allow testing of statistical significance of effectiveness differences.
Evaluating the use of search engine development tools in IT education
TLDR
Evaluation results showed that SpidersRUs performed better than the two other tools in overall satisfaction and the level of knowledge gained in their learning experience when using the tools for a class project on Internet applications development.
How reliable are the results of large-scale information retrieval experiments?
TLDR
A detailed empirical investigation of the TREC results shows that the measured relative performance of systems appears to be reliable, but that recall is overestimated: it is likely that many relevant documents have not been found.
Crawling the web for structured documents
TLDR
This demo describes a distributed and focused web crawler for any kind of structured documents, and it is shown how to exploit general-purpose resources to gather large amounts of real-world structured documents off the Web.
Variations in relevance judgments and the measurement of retrieval effectiveness
TLDR
Very high correlations were found among the rankings of systems produced using diAerent relevance judgment sets, indicating that the comparative evaluation of retrieval performance is stable despite substantial diAerences in relevance judgments, and thus reaArm the use of the TREC collections as laboratory tools.
Teaching and learning in information retrieval
TLDR
The survey, and its bibliography, provides an overview of the pedagogical research carried out in the field of IR and provides a guide for educators on approaches that can be applied to improving the student learning experiences.
...
...