A framework for empirical evaluation of conceptual modeling techniques

@article{Gemino2004AFF,
  title={A framework for empirical evaluation of conceptual modeling techniques},
  author={Andrew C. Gemino and Yair Wand},
  journal={Requirements Engineering},
  year={2004},
  volume={9},
  pages={248-260}
}
The paper presents a framework for the empirical evaluation of conceptual modeling techniques used in requirements engineering. The framework is based on the notion that modeling techniques should be compared via their underlying grammars. The framework identifies two types of dimensions in empirical comparisons—affecting and affected dimensions. The affecting dimensions provide guidance for task definition, independent variables and controls, while the affected dimensions define the possible… 

Guidelines for Empirical Evaluations of Conceptual Modeling Grammars

Past conceptual modeling research is reviewed and guidelines for addressing three issues, characteristics of grammars that can influence grammar performance, and factors that must be considered when testing the effect of grammar characteristics on grammar performance are provided.

Improving the representation of roles in conceptual modeling: theory, method, and evidence

This paper formally defines role as a conceptual modeling construct based on literature analysis, ontological concepts, and principles of classification, and derives guidelines for representing roles in conceptual models and suggests rules for modeling roles with the widely used extended entity-relationship grammar.

Continued use of process modeling grammars: the impact of individual difference factors

A theoretical model is advanced that incorporates determinants of continued usage behavior as well as key antecedent individual difference factors of the grammar users, such as modeling experience, modeling background and perceived grammar familiarity, in the context of modeling grammar usage.

Designing Experiments to Test the Theory of Combined Ontological Coverage

This research in progress paper is to describe how experiments can be designed to examine the propositions of Recker's theory of combined ontological coverage to provide a grounding that will justify further research on conceptual modeling use as well as provide deep insights and foundations to understand how conceptual models are used in today's system analysis and development process.

Do Ontological Guidelines Improve Understandability of Conceptual Models? A Meta-analysis of Empirical Work

  • A. SaghafiY. Wand
  • Computer Science
    2014 47th Hawaii International Conference on System Sciences
  • 2014
A meta-analysis of published empirical research about the impact of ontological guidance based on Bunge's model, and user understanding of conceptual models supports the proposition that ontological Guidance can improve model understandability.

Empirical investigation of the usefulness of Gateway constructs in process models

  • J. Recker
  • Computer Science
    Eur. J. Inf. Syst.
  • 2013
Examination of perceptual discriminability effects of Gateway constructs on an individual's abilities to interpret process models reveals emerging implications for research and practice, in terms of revisions to grammar specifications, guideline development and design choices in process modeling.

Theorizing the use of multiple conceptual models in combination

A Theory of Combined Ontological Coverage is developed by extending an existing theory of ontological expressiveness of conceptual modelling grammars to posits that multiple conceptual models are used to increase the maximum coverage of the real-world domain being modelled, whilst trying to minimize the ontological overlap between the models.

Ontological Modeling Rules for UML: An Empirical Assessment

An empirical assessment of the benefits derived from using a set of modeling rules to provide the analyst or modeler with guidelines for using UML for conceptual modeling is provided.

Performance effects of formal modeling language differences: a combined abstraction level and construct complexity analysis

A set of model-specific construct complexity values are developed based on both theoretical and empirical support from complexity research in databases and other areas to find that abstraction levels and complexity values together are capable of providing a consistent explanation of laboratory experiment data.

Performance effects of formal modeling language differences: a combined abstraction level and construct complexity analysis

A set of model-specific construct complexity values are developed based on both theoretical and empirical support from complexity research in databases and other areas to find that abstraction levels and complexity values together are capable of providing a consistent explanation of laboratory experiment data.
...

References

SHOWING 1-10 OF 42 REFERENCES

Research Commentary: Information Systems and Conceptual Modeling - A Research Agenda

Within the information systems field, the task of conceptual modeling involves building a representation of selected phenomena in some domain. High-quality conceptual modeling work is important

Empirical studies in information modeling : interpretation of the object relationship

A two-stage research design, consisting of the exploratory and formalized phases, is employed in this dissertation, which indicates that the explicitness of relationship construct and the use of verb versus noun description for relationship have a profound impact on the accuracy of interpretation.

Cognitive Fit in Requirements Modeling: A Study of Object and Process Methodologies

This paper presents an empirical examination of object-oriented and process-oriented methodologies as applied to object- oriented andprocess-oriented tasks, and predicted by the theory of cognitive fit, superior performance was observed when the process- oriented tool was applied to the process -oriented task.

Should Optional Properties Be Used in Conceptual Modelling? A Theory and Three Empirical Tests

The theory that led to predict that optional attributes and relationships should be used in conceptual schema diagrams only when users of the diagrams require a surface-level understanding of the domain being represented by the diagrams is presented.

The Meta Model Hierarchy: A Framework for Information Systems Concepts and Techniques

A framework for ordering information systems modelling techniques based on meta models is proposed, called the Meta Model Hierarchy, which positions each technique according to an analysis of the distinctions between the basic concepts, and the set of constraints defined on these concepts.

Comprehending Object and Process Models: An Empirical Study

An empirical study comparing user comprehension of object oriented (OO) and process oriented (PO) models, which compares OO and PO models based on whether the comprehension activity involves: 1) only structural aspects, 2) only behavioral aspects, or 3) a combination of structural and behavioral aspects.

An Experiment to Test User Validation of Requirements: Data-Flow Diagrams vs Task-Oriented Menus

How Do We Understand a System with (So) Many Diagrams? Cognitive Integration Processes in Diagrammatic Reasoning

The results of the experiment revealed that understanding a system represented by multiple diagrams involves a process of searching for related information and of developing hypotheses about the target system, and showed that these perceptual and conceptual integration processes were facilitated by incorporating visual cues and contextual information in the multiple diagrams as representation aids.

Data Analysis and Learning: An Experimental Study of Data Modeling Tools

On the ontological expressiveness of information systems analysis and design grammars

The notion of the ontological expressiveness of a grammar is formally examined and some of its implications for the design and use of ISAD methodologies are discussed.