Understandability Measurement in an Early Usability Evaluation for Model-Driven Development: An Empirical Study

Author(s): Jose Ignacio Panach, Nelly Condori-Fernández, Francisco Valverde, Nathalie Aquino, Óscar Pastor
Venue: Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement
Date: October 9–10, 2008


DOI: http://doi.acm.org/10.1145/1414004.1414080
Type of Experiment: Empirical Study

The work proposes a method for evaluating internal understandability attributes during early stages of a software system's model-driven development process and presents an empirical study to provide verification of the relation between the method's measured values and the end user's perceived understandability value of the final product.

Study Details
The study compares the values obtained by two experts using Object Oriented Web Solution (OOWS) Conceptual Models with the perceived understandability values obtained from end-users using web applications built using OOWS Conceptual Models. There are several validity concerns about this experiment: random heterogeneity of subjects, selection, inadequate pre-operational explanation of constructs, representative material.

Hypothesis: "There is a significant difference between the understandability internal measures obtained with the early evaluation method and the external measures obtained from users’ perceptions."