Teaching recommender systems at large scale: evaluation and lessons learned from a hybrid MOOC

@article{Konstan2014TeachingRS,
  title={Teaching recommender systems at large scale: evaluation and lessons learned from a hybrid MOOC},
  author={Joseph A. Konstan and J. D. Walker and D. Christopher Brooks and Keith Brown and Michael D. Ekstrand},
  journal={Proceedings of the first ACM conference on Learning @ scale conference},
  year={2014}
}
In Fall 2013 we offered an open online Introduction to Recommender Systems through Coursera, while simultaneously offering a for-credit version of the course on-campus using the Coursera platform and a flipped classroom instruction model. As the goal of offering this course was to experiment with this type of instruction, we performed extensive evaluation including surveys of demographics, self-assessed skills, and learning intent; we also designed a knowledge-assessment tool specifically for… 

Tables from this paper

Benefits of Massive Open Online Course Participation: Deductive Thematic Analysis
TLDR
A qualitative synthesis in the form of a deductive thematic analysis of a set of MOOC evaluation studies was conducted to explore outcomes for MOOC learners, that is, how the learners themselves benefit from participating in MOOCs.
Exploring Demographics and Students’ Motivation as Predictors of Completion of a Massive Open Online Course
This paper investigates the degree to which different variables affect the completion of a Massive Open Online Course (MOOC). Data on those variables, such as age, gender, English proficiency,
How Do We Model Learning at Scale? A Systematic Review of Research on MOOCs
Despite a surge of empirical work on student participation in online learning environments, the causal links between the learning-related factors and processes with the desired learning outcomes
How do we model learning at scale ?
Despite a surge of empirical work on student participation in online learning environments, the causal links between the learning-related factors and processes with the desired learning outcomes
Teaching Recommender Systems at Large Scale
TLDR
Based on the limited data the authors were able to gather, face-to-face students performed as well as the online-only students or better; they preferred this format to traditional lecture for reasons ranging from pure convenience to the desire to watch videos at a different pace.
The Challenges of Evolving Technical Courses at Scale: Four Case Studies of Updating Large Data Science Courses
TLDR
Four case studies from the authors' teaching experiences highlight major challenges in maintaining and updating technical courses and design ideas for instructor-oriented tools that can reduce the logistical complexities of teaching at scale, thus letting instructors focus on the substance of teaching rather than on mundane logistics.
The Challenges of Evolving Technical Courses at Scale: Four Case Studies of Updating Large Data Science Courses
TLDR
Four case studies from the authors' teaching experiences highlight major challenges in maintaining and updating technical courses and design ideas for instructor-oriented tools that can reduce the logistical complexities of teaching at scale, thus letting instructors focus on the substance of teaching rather than on mundane logistics.
E-Learning in a Postmodern Society
The relevance of the chosen direction of research is that e-learning at the present stage of development of society is one of the most popular forms of organization of the educational process. This
A Recommendation System for People Analytics
  • Nan Wang, E. Katsamakas
  • Business, Computer Science
    International Journal of Business Intelligence Research
  • 2021
TLDR
A recommendation system for personalized workload assignment in the context of people analytics that follows a novel two-level hybrid architecture is proposed, demonstrating how computational and machine learning approaches can complement humans in improving the performance of organizations.
...
...

References

SHOWING 1-10 OF 13 REFERENCES
How College Affects Students: A Third Decade of Research. Volume 2.
This is the long-awaited second volume of Pascarella and Terenzini's 1991 award-winning review of the research on the impacts of college on students. The authors review their earlier findings and
Long-term memory for knowledge learned in school.
Three experiments examined students' long-term retention of knowledge learned in college courses. In Experiment 1 retention was measured 4 and 11 months after the term ended. Students retained a
Predicting non-traditional student learning outcomes using data analytics - a pilot research study
TLDR
There are positive correlations between student activity in an LMS system and their final grade, and a proposed framework, which includes collecting and analyzing data from several courses, drawn from various disciplines to be used in further data analysis is discussed.
Correlating skill and improvement in 2 MOOCs with a student's time on tasks
TLDR
This quest starts by examining correlations between time spent on specific course resources and various measures of student performance: score on assessments, skill as defined by Item Response Theory, improvement in skill over the period of the course, and conceptual improvement as measured by a pre-post test.
Online education: MOOCs taken by educated few
TLDR
It is shown that when viral DNA can be detected by innate immune sensors, including cyclic GMP-AMP synthase, it depends on the recruitment to the HIV-1 capsid of specific cofactors that are involved in orchestrating nuclear entry and targeting.
Changing “Course”
In massive open online courses (MOOCs), low barriers to registration attract large numbers of students with diverse interests and backgrounds, and student use of course content is asynchronous and
How Students Think: Implications for Learning in Introductory Geoscience Courses
TLDR
While the exercises themselves are important in promoting the development of higher-order thinking skills, the group interaction also appears to be a significant contributor to the improvement of reasoning.
Student skill and goal achievement in the mapping with google MOOC
TLDR
It is shown that students who completed course activities were more likely to earn certificates of completion than peers who did not and how well prior skill in a subject predicts a student's course completion was assessed.
MOOCs and the funnel of participation
TLDR
The metaphor of a 'funnel of participation' is introduced to reconceptualise the steep drop-off in activity, and the pattern of steeply unequal participation, which appear to be characteristic of MOOCs and similar learning environments.
Rethinking the recommender research ecosystem: reproducibility, openness, and LensKit
TLDR
The utility of LensKit is demonstrated by replicating and extending a set of prior comparative studies of recommender algorithms, and a question recently raised by a leader in the recommender systems community on problems with error-based prediction evaluation is investigated.
...
...