The Future of Human-AI Collaboration: A Taxonomy of Design Knowledge for Hybrid Intelligence Systems

@article{Dellermann2019TheFO,
  title={The Future of Human-AI Collaboration: A Taxonomy of Design Knowledge for Hybrid Intelligence Systems},
  author={Dominik Dellermann and Adrian Calma and Nikolaus Lipusch and Thorsten Weber and Sascha Weigel and Philipp Alexander Ebel},
  journal={ArXiv},
  year={2019},
  volume={abs/2105.03354}
}
Recent technological advances, especially in the field of machine learning, provide astonishing progress on the road towards artificial general intelligence. However, tasks in current real-world business applications cannot yet be solved by machines alone. We, therefore, identify the need for developing socio-technological ensembles of humans and machines. Such systems possess the ability to accomplish complex goals by combining human and artificial intelligence to collectively achieve superior… 
Conceptualization and Framework of Hybrid Intelligence Systems
TLDR
It is argued that all AI systems are hybrid intelligence systems, so human factors need to be examined at every stage of such systems' lifecycle.
HACO: A Framework for Developing Human-AI Teaming
TLDR
A solution framework, Human-AI Collaboration (HACO), enables a model-driven development of human-AI teaming systems through graphical user interface and a user study performed to assess the usefulness of HACO, shows that HacO is a promising framework.
An alliance of humans and machines for machine learning: Hybrid intelligent systems and their design principles
TLDR
An application of human-in-the-loop computing to make operational processes more efficient and a set of principles to design machine-learning algorithms for hybrid intelligence are presented.
A Workflow-Based Methodological Framework for Hybrid Human-AI Enabled Scientometrics
TLDR
The contribution is a model for incorporating central principles of human-machine symbiosis (HMS) into scientometric workflows, demonstrating how hybrid intelligence systems can drive and encapsulate the future of research evaluation.
Hybrid Intelligence : to automate or not to automate, that is the question
TLDR
It is argued that process mining is a key technology to decide what to automate and what not and, using process mining, it is possible to systematically monitor and manage processes where work is distributed over human workers and software robots.
Towards Hybrid Crowd-AI Centered Systems: Developing an Integrated Framework from an Empirical Perspective
TLDR
This paper identifies some open challenges and design implications for future crowd-AI hybrid systems, and a framework is proposed based on the practical challenges of addressing human-centered AI methods and processes.
Socio-Technical Design of Hybrid Intelligence Systems - The Case of Predictive Maintenance
TLDR
The case study on Predictive Maintenance reveals a series of challenges that require keeping the organization and the human in the loop and appropriate design recommendations such as integrated support of communication and coordination, possibilities for intervention.
AI and Its Implications for Organisations
The nature of technologies that are recognised as Artificial Intelligence (AI) has continually changed over time to be something more advanced than other technologies. Despite the fluidity of
Human-AI Interactive and Continuous Sensemaking: A Case Study of Image Classification using Scribble Attention Maps
TLDR
A conceptual framework for supporting effective human-AI interaction, referred to as interactive and continuous sensemaking (HAICS), is implemented in an image classification application using deep Convolutional Neural Network classifiers as a browser-based tool that displays network attention maps to the human for explainability and collects human’s feedback in the form of scribble annotations overlaid onto the maps.
Can AI Teach Humans? Humans AI Collaboration for Lifelong Machine Learning
TLDR
The authors proposed a double-track approach to use expert systems to supplement the current machine learning paradigm to solve the problem of explainability of AI.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 83 REFERENCES
Finding the Unicorn: Predicting Early Stage Startup Success Through a Hybrid Intelligence Method
TLDR
To predict the success of startups, this work follows a design science research approach to develop a Hybrid Intelligence method that combines the strength of both machine and collective intelligence to demonstrate its utility for predictions under extreme uncertainty.
Power to the People: The Role of Humans in Interactive Machine Learning
TLDR
It is argued that the design process for interactive machine learning systems should involve users at all stages: explorations that reveal human interaction patterns and inspire novel interaction methods, as well as refinement stages to tune details of the interface and choose among alternatives.
Directions in Hybrid Intelligence: Complementing AI Systems with Human Intelligence
TLDR
This paper reviews recent research efforts towards developing hybrid systems focusing on reasoning methods for optimizing access to human intelligence and on gaining comprehensive understanding of humans as helpers of AI systems by discussing short and long term research directions.
Building machines that learn and think like people
TLDR
It is argued that truly human-like learning and thinking machines should build causal models of the world that support explanation and understanding, rather than merely solving pattern recognition problems, and harness compositionality and learning-to-learn to rapidly acquire and generalize knowledge to new tasks and situations.
On Human Intellect and Machine Failures: Troubleshooting Integrative Machine Learning Systems
TLDR
This work proposes a human-in-the-loop methodology which leverages human intellect for troubleshooting system failures and demonstrates the effectiveness of the approach on an automated image captioning system that has been pressed into real-world use.
Alloy: Clustering with Crowds and Computation
TLDR
Alloy, a hybrid approach that combines the richness of human judgments with the power of machine algorithms, is introduced, a modular "cast and gather" approach which leverages a machine learning backbone to stitch together different types of judgment tasks.
Artificial Intelligence: A Modern Approach
The long-anticipated revision of this #1 selling book offers the most comprehensive, state of the art introduction to the theory and practice of artificial intelligence for modern applications.
Building Watson: An Overview of the DeepQA Project
TLDR
The results strongly suggest that DeepQA is an effective and extensible architecture that may be used as a foundation for combining, deploying, evaluating and advancing a wide range of algorithmic techniques to rapidly advance the field of QA.
Machine Teaching: A New Paradigm for Building Machine Learning Systems
TLDR
This paper presents the position regarding the discipline of machine teaching and articulate fundamental machine teaching principles and describes how, by decoupling knowledge about machine learning algorithms from the process of teaching, this can accelerate innovation and empower millions of new uses for machine learning models.
Toward a Learning Science for Complex Crowdsourcing Tasks
TLDR
This work explores how crowdworkers can be trained to tackle complex crowdsourcing tasks and shows that having workers validate the work of their peer workers can be even more effective than having them review expert examples if the authors only present solutions filtered by a threshold length.
...
1
2
3
4
5
...