Corpus ID: 18625019

A Strategy for Evaluating Web-Based Discretionary Decision Support Systems

  title={A Strategy for Evaluating Web-Based Discretionary Decision Support Systems},
  author={Maria Jean Johnstone Hall and Andrew Stranieri and John Zeleznikow},
  booktitle={ADBIS Research Communications},
The World Wide Web facilitates user access to knowledge-based decision support systems. Such web-enabled systems can provide users with advice about how decision-makers exercise discretion. GetAid, developed using the web-based shell environment WebShell, is an example of a web-based decision support system operating in a discretionary legal domain. This paper presents the Context, Criteria, Contingency evaluation framework for knowledge- based systems, general in design but geared… Expand
A process for evaluating legal knowledge-based systems based upon the context criteria contingency-guidelines framework
The ISO 14598 evaluation process is extended with a novel evaluation framework which satisfies three important requirements: elements of existing software engineering evaluation methodologies are integrated and subsumed, making them more readily accessible to the evaluator; requirements specific to the legal domain are included; and the intended users do not necessarily require extensive software engineering expertise. Expand
The evaluation of a web-based decision support system for healthcare project appraisal
A web-based decision support system for healthcare project appraisal was developed. Its main objective focuses on assisting decision-makers in examining different function programme alternatives andExpand
The Development and Rapid Evolution of the Knowledge Model of ADVOKATE: An Advisory System to Assess the Credibility of Eyewitness Testimony
ADVOKATE, a web-enabled knowledge base application operating in the forensic and legal domain, offers assistance to police and legal counsel in their task of assessing the credibility of potentialExpand
Building Intelligent Legal Decision Support Systems : Past Practice and Future Challenges
In [91] Susskind outlines the past use of Information Technology (IT), and indicates probable future uses of IT by the legal profession. He indicates that until recently, there was only limited useExpand
Reflections on my journey in using Information Technology to support Legal Decision Making—from Legal Positivism to Legal Realism
In this paper I discuss my transition from legal positivism to legal realism and how this has impacted upon my construction of legal decision support systems. As a child living with parents who wereExpand
Using Web-based Legal Decision Support Systems to Improve Access to Justice
Tools for building web-based legal decision support systems are discussed and examples from the domains of Family Law and eligibility for legal aid are given to help litigants negotiate their disputes. Expand
An ontology-based distributed whiteboard to determine legal responses to online cyber attacks
A decision support legal whiteboard that graphically constructs legal arguments as a decision tree that provides the user the capability to index and search legal documents using a complex international legal ontology that goes beyond the traditional LexisNexis‐like legal databases. Expand
Using Toulmin Argumentation to develop an Online Dispute Resolution Environment
Our goal is to model reasoning in discretionary legal domains. To do so, we use Knowledge Discovery from Database Techniques. However there are obstacles to this approach, including difficulties inExpand
Making Decisions about Legal Responses to Cyber Attacks
This work has developed a decision support tool that takes investigators and legal experts addressing the legal aspects of cyber incidents through a series of questions akin to those posed by an attorney to a client seeking legal guidance. Expand
Decision support systems for police: Lessons from the application of data mining techniques to “soft” forensic evidence
It is argued that computer science technologies which can support criminal investigations are wide ranging and include geographical information systems displays, clustering and link analysis algorithms and the more complex use of data mining technology for profiling crimes or offenders and matching and predicting crimes. Expand


Acknowledging insufficiency in the evaluation of legal knowledge-based systems: strategies towards a broadbased evaluation model
This paper foreshadows the development of an evaluation methodology tailored specifically for legal knowledge- based systems, both from the international ISO/IEC 14598 and 9126 standards and also from previous work on evaluation models for knowledge-based systems. Expand
The evaluation of legal knowledge based systems
An evaluation framework put forward by Reich is presented and how this motivated the evaluation of the authors' systems in Australian family law is described. Expand
The moving staircase - Problems of appraisal and evaluation in a turbulent environment
The problems of evaluating the benefits of an investment in information technology and systems against a background of institutional change are considered and formative evaluation will be beneficial, but where the contingencies are uncertain, structural changes in the organisation may be more effective in achieving benefits. Expand
Rethinking the approaches to information systems investment evaluation
This work focuses on the context, content and process of information systems evaluation as a source of organisational change and finds a noticeable gap between the recent theoretical work on IS evaluation and the practices within the case study organisations. Expand
Towards a practical method to validate decision support systems
A new method to validate DSS is presented that combines several validation methods developed to validate Operations Research/Management Science models and expert systems validation frameworks to define a practical guidance for the validation stage of the DSS development. Expand
A Software System Evaluation Framework
A software system evaluation framework is described and its levels of categorization are described, and examples of project classifications are analyzed to draw some conclusions and present ideas for further research. Expand
The problem of the dynamic organization and the static system: principles and techniques for achieving flexibility
The flexible system is defined here as an automated system that can be resynchronized with changes in the real world system through user-based data value modifications, without information restructuring or program code modification. Expand
Validating expert systems
A specific formal paradigm for prototype validation that is consistent with O'Leary's as well as O'Keefe's general guidelines for expert system development is presented and explicitly incorporates validation into the prototype development life cycle under constrained resources, primarily time and money. Expand
Evaluating software engineering methods and tool—part 2: selecting an appropriate evaluation method—technical criteria
In the previous article about the DESMET evaluation methodology, I identified nine different types of evaluation:1. Quantitative Experiments2. Quantitative Case Studies3. Quantitative Surveys4.Expand
Evaluation Methodologies: A System for Use
An analysis of the theoretical underpinnings of four types of evaluation formulates a system of evaluation methodologies showing in what circumstances each can be most appropriately used. Expand