A framework for empirical evaluation of conceptual modeling techniques

@article{Gemino2004AFF,
  title={A framework for empirical evaluation of conceptual modeling techniques},
  author={Andrew C. Gemino and Yair Wand},
  journal={Requirements Engineering},
  year={2004},
  volume={9},
  pages={248-260}
}
The paper presents a framework for the empirical evaluation of conceptual modeling techniques used in requirements engineering. The framework is based on the notion that modeling techniques should be compared via their underlying grammars. The framework identifies two types of dimensions in empirical comparisons—affecting and affected dimensions. The affecting dimensions provide guidance for task definition, independent variables and controls, while the affected dimensions define the possible… Expand
Guidelines for Empirical Evaluations of Conceptual Modeling Grammars
TLDR
Past conceptual modeling research is reviewed and guidelines for addressing three issues, characteristics of grammars that can influence grammar performance, and factors that must be considered when testing the effect of grammar characteristics on grammar performance are provided. Expand
Improving the representation of roles in conceptual modeling: theory, method, and evidence
TLDR
This paper formally defines role as a conceptual modeling construct based on literature analysis, ontological concepts, and principles of classification, and derives guidelines for representing roles in conceptual models and suggests rules for modeling roles with the widely used extended entity-relationship grammar. Expand
Continued use of process modeling grammars: the impact of individual difference factors
  • J. Recker
  • Computer Science
  • Eur. J. Inf. Syst.
  • 2010
TLDR
A theoretical model is advanced that incorporates determinants of continued usage behavior as well as key antecedent individual difference factors of the grammar users, such as modeling experience, modeling background and perceived grammar familiarity, in the context of modeling grammar usage. Expand
Do Ontological Guidelines Improve Understandability of Conceptual Models? A Meta-analysis of Empirical Work
  • A. Saghafi, Y. Wand
  • Computer Science
  • 2014 47th Hawaii International Conference on System Sciences
  • 2014
TLDR
A meta-analysis of published empirical research about the impact of ontological guidance based on Bunge's model, and user understanding of conceptual models supports the proposition that ontological Guidance can improve model understandability. Expand
Empirical investigation of the usefulness of Gateway constructs in process models
  • J. Recker
  • Computer Science
  • Eur. J. Inf. Syst.
  • 2013
TLDR
Examination of perceptual discriminability effects of Gateway constructs on an individual's abilities to interpret process models reveals emerging implications for research and practice, in terms of revisions to grammar specifications, guideline development and design choices in process modeling. Expand
Theorizing the use of multiple conceptual models in combination
TLDR
A Theory of Combined Ontological Coverage is developed by extending an existing theory of ontological expressiveness of conceptual modelling grammars to posits that multiple conceptual models are used to increase the maximum coverage of the real-world domain being modelled, whilst trying to minimize the ontological overlap between the models. Expand
Ontological Modeling Rules for UML: An Empirical Assessment
TLDR
An empirical assessment of the benefits derived from using a set of modeling rules to provide the analyst or modeler with guidelines for using UML for conceptual modeling is provided. Expand
Performance effects of formal modeling language differences: a combined abstraction level and construct complexity analysis
Understanding data-modeling performance can provide valuable lessons for the selection, training, research, and development of data models. Data modeling is the process of transforming expressions inExpand
Performance effects of formal modeling language differences: a combined abstraction level and construct complexity analysis
TLDR
A set of model-specific construct complexity values are developed based on both theoretical and empirical support from complexity research in databases and other areas to find that abstraction levels and complexity values together are capable of providing a consistent explanation of laboratory experiment data. Expand
How do Individuals Interpret Multiple Conceptual Models? A Theory of Combined Ontological Completeness and Overlap
TLDR
New theory about interpreting multiple conceptual models that details propositions for evaluation of individuals’ selection, understanding, and perceived usefulness of several conceptual models is developed. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 47 REFERENCES
Research Commentary: Information Systems and Conceptual Modeling - A Research Agenda
Within the information systems field, the task of conceptual modeling involves building a representation of selected phenomena in some domain. High-quality conceptual modeling work is importantExpand
Empirical studies in information modeling : interpretation of the object relationship
TLDR
A two-stage research design, consisting of the exploratory and formalized phases, is employed in this dissertation, which indicates that the explicitness of relationship construct and the use of verb versus noun description for relationship have a profound impact on the accuracy of interpretation. Expand
Cognitive Fit in Requirements Modeling: A Study of Object and Process Methodologies
TLDR
This paper presents an empirical examination of object-oriented and process-oriented methodologies as applied to object- oriented andprocess-oriented tasks, and predicted by the theory of cognitive fit, superior performance was observed when the process- oriented tool was applied to the process -oriented task. Expand
Should Optional Properties Be Used in Conceptual Modelling? A Theory and Three Empirical Tests
TLDR
The theory that led to predict that optional attributes and relationships should be used in conceptual schema diagrams only when users of the diagrams require a surface-level understanding of the domain being represented by the diagrams is presented. Expand
The Meta Model Hierarchy: A Framework for Information Systems Concepts and Techniques
The numerous information systems design methods and specification techniques being proposed, can be compared on the basis of different criteria. In this paper a framework for ordering informationExpand
Comprehending Object and Process Models: An Empirical Study
TLDR
An empirical study comparing user comprehension of object oriented (OO) and process oriented (PO) models, which compares OO and PO models based on whether the comprehension activity involves: 1) only structural aspects, 2) only behavioral aspects, or 3) a combination of structural and behavioral aspects. Expand
An Experiment to Test User Validation of Requirements: Data-Flow Diagrams vs Task-Oriented Menus
TLDR
An experiment is conducted to determine whether a task-oriented, downward-cascading menu representation, which closely corresponds to Moran's idea of a user's conceptual model, permits better comprehension and therefore better validation than data-flow diagrams, which have been strongly advocated as facilitating user validation. Expand
How Do We Understand a System with (So) Many Diagrams? Cognitive Integration Processes in Diagrammatic Reasoning
TLDR
The results of the experiment revealed that understanding a system represented by multiple diagrams involves a process of searching for related information and of developing hypotheses about the target system, and showed that these perceptual and conceptual integration processes were facilitated by incorporating visual cues and contextual information in the multiple diagrams as representation aids. Expand
Data Analysis and Learning: An Experimental Study of Data Modeling Tools
TLDR
The results suggest that when given structured tasks, novices are able to learn rather quickly how to produce small, good quality models using either of the tools, and this has implications for data modeling training and for the development of data modeling tools. Expand
On the ontological expressiveness of information systems analysis and design grammars
TLDR
The notion of the ontological expressiveness of a grammar is formally examined and some of its implications for the design and use of ISAD methodologies are discussed. Expand
...
1
2
3
4
5
...