Effect of tuned parameters on an LSA multiple choice questions answering model

@article{Lifchitz2009EffectOT,
  title={Effect of tuned parameters on an LSA multiple choice questions answering model},
  author={Alain Lifchitz and Sandra Jhean-Larose and Guy Denhi{\`e}re},
  journal={Behavior Research Methods},
  year={2009},
  volume={41},
  pages={1201-1209}
}
This article presents the current state of a work in progress, whose objective is to better understand the effects of factors that significantly influence the performance of latent semantic analysis (LSA). A difficult task, which consisted of answering (French) biology multiple choice questions, was used to test the semantic properties of the truncated singular space and to study the relative influence of the main parameters. A dedicated software was designed to fine-tune the LSA semantic space… Expand
Practical use of a latent semantic analysis (LSA) model for automatic evaluation of written answers
TLDR
It can be seen that the automatic evaluation technology shows that it is reaching a high level of efficiency, and to develop robustness, increase accuracy, and widen portability. Expand
Assessing the Effectiveness of Corpus-Based Methods in Solving SAT Sentence Completion Questions
TLDR
The results of this study demonstrate that local context is a fairly strong measure in determining how well a word fits in a sentence and that exploration of non-similarity based methods may be required to further increase the ability of computers to answer such questions. Expand
Algorithms for assessing the quality and difficulty of multiple choice exam questions
TLDR
The goal of this research is to create an automated method to both answer and assesses the difficulty of multiple choice inverse definition questions in the domain of introductory biology, and the results suggest that human-authored question banks provide useful data for building gold standard human performance models. Expand
Comparability of LSI and human judgment in text analysis tasks
TLDR
This paper presents an overview of 30 sets of studies in which the performance of LSI in text processing tasks can be compared directly to human performance on the same tasks, and argues that even this surprisingly high performance actually underestimates the potential performance ofLSI. Expand
Exploring lexical co-occurrence space using HiDEx
TLDR
This work took an empirical approach to understanding the influence of the parameters on the measures produced by the models, looking at how well matrices derived with different parameters could predict human reaction times in lexical decision and semantic decision tasks. Expand
Vocabulary development through reading: A comparison of approaches
TLDR
This thesis compares two approaches to extensive reading to determine the extent that they facilitate vocabulary development, a traditional reading-only approach and a task-based approach which supplements reading with post-reading meaning-focused discussions. Expand
etodo LSA na avaliac¸˜ ao autom´ atica de respostas discursivas
In order to attend the virtual learning environment needs, this paper presents the LSA (Latent Semantic Analysis) application to estimate scores au- tomatically in open ended questions, because stillExpand
Aplicação de um método LSA na avaliação automática de respostas discursivas
In order to attend the virtual learning environment needs, this paper presents the LSA (Latent Semantic Analysis) application to estimate scores au- tomatically in open ended questions, because stillExpand
HiDEx: The High Dimensional Explorer
TLDR
A new computer application called the High Dimensional Explorer (HiDEx) is described that makes it possible to systematically alter the values of the model's parameters and thereby to examine their effect on the co-occurrence matrix that instantiates the model. Expand
Knowledge evaluation based on LSA: MCQs and free answer questions
TLDR
An application using the SUMMA-LSA platform developed by Baier, Lehnard, Hoffmann & Schneider to evaluate biology knowledge of 7th and 8th grades students dealing with The human body energy requirements is presented. Expand
...
1
2
3
...

References

SHOWING 1-10 OF 60 REFERENCES
Parameters driving effectiveness of automated essay scoring with LSA
TLDR
It is shown that each of the identified factors significantly influences the quality of automated essay scor-ing and that the factors are not independent of each other. Expand
Stemming and its effects on TFIDF ranking.
TLDR
It is argued that stemming can help in certain contexts and that an empirical investigation of the relationship between stemming performance and retrieval performance can be valuable. Expand
An LSA Package for R
TLDR
The author describes the lsa package for the statistical language and environment R and illustrates its proper use through an example from the area of automated essay scoring and describes which entities and processes are involved when performing an LSA. Expand
SUMMA-A LSA Integrated Developpement System
TLDR
How SUMMA attaches the main phases in LSA development and test cycles and presents empirical results from applications is discussed, which confirms the viability of the LSA technology. Expand
Imperfect Answers in Multiple Choice Questionnaires
TLDR
Ev-MCQs (Evidential MCQs), an application of belief function theory for the management of the uncertainty and imprecision of MCQ answers is proposed, to obtain a richer student model closer to the real state of the student. Expand
Eigenvalue-based model selection during latent semantic indexing
  • M. Efron
  • Mathematics, Computer Science
  • J. Assoc. Inf. Sci. Technol.
  • 2005
TLDR
A novel method for model selection in unsupervised learning problems such as information retrieval (IR), a novel method that performs well, predicting the best values of k on 3 of 12 observations, with good predictions on several others, and never offering the worst estimate of optimal dimensionality. Expand
Knowledge evaluation based on LSA: MCQs and free answer questions
TLDR
An application using the SUMMA-LSA platform developed by Baier, Lehnard, Hoffmann & Schneider to evaluate biology knowledge of 7th and 8th grades students dealing with The human body energy requirements is presented. Expand
AutoTutor: A simulation of a human tutor
TLDR
This work has dissected the discourse and pedagogical strategies these unskilled tutors exhibit by analyzing approximately 100 hours of naturalistic tutoring sessions. Expand
Mathematical Foundations Behind Latent Semantic Analysis
TLDR
Latent semantic analysis (LSA) is an approach using linear algebra for effective yet automated information retrieval using vector space models to handle text retrieval from a large information database where the text is heterogeneous and the vocabulary varies. Expand
Handbook of latent semantic analysis
TLDR
This book discusses Latent Semantic Analysis as a Theory of Meaning, its application in Cognitive Theory, and its applications in Educational Applications. Expand
...
1
2
3
4
5
...