Adaptive and Dynamic Service Composition Using Q-Learning

  title={Adaptive and Dynamic Service Composition Using Q-Learning},
  author={Hongbing Wang and Xuan Zhou and Xiang Zhou and Weihong Liu and Wenya Li},
  journal={2010 22nd IEEE International Conference on Tools with Artificial Intelligence},
In a dynamic environment, some services may become unavailable, some new services may be published and the various properties of the services, such as their prices and performance, may change. Thus, to ensure user satisfaction in the long run, it is desirable that a service composition can automatically adapt to these changes. To this end, we leverage the technology of reinforcement learning and propose a mechanism for adaptive service composition. The mechanism requires no prior knowledge… CONTINUE READING
Highly Cited
This paper has 18 citations. REVIEW CITATIONS

From This Paper

Figures, tables, and topics from this paper.


Publications citing this paper.
Showing 1-10 of 12 extracted citations

Automatically Learning User Preferences for Personalized Service Composition

2017 IEEE International Conference on Web Services (ICWS) • 2017
View 5 Excerpts
Highly Influenced

Dynamic Web Service Composition Based on State Space Searching

2015 IEEE 21st International Conference on Parallel and Distributed Systems (ICPADS) • 2015
View 1 Excerpt

A Utility Model for Volunteered Service Composition

2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing • 2014
View 1 Excerpt

Towards Self-Aware Service Composition

2014 IEEE Intl Conf on High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security, 2014 IEEE 11th Intl Conf on Embedded Software and Syst (HPCC,CSS,ICESS) • 2014
View 2 Excerpts

Adaptive Web Services Composition Using Q-Learning in Cloud

2013 IEEE Ninth World Congress on Services • 2013
View 2 Excerpts


Publications referenced by this paper.
Showing 1-10 of 20 references

Markov-HTN Planning Approach to Enhance Flexibility of Automatic Web Service Composition

2009 IEEE International Conference on Web Services • 2009
View 2 Excerpts
Highly Influenced

Formalization and Verification of Automatic Composition Based on Pi-Calculus for Semantic Web Service

2009 Second International Symposium on Knowledge Acquisition and Modeling • 2009
View 1 Excerpt

An Adaptive Service Selection Approach to Service Composition

2008 IEEE International Conference on Web Services • 2008
View 1 Excerpt

An Efficient Approach for QoS-Aware Service Selection Based on a Tree-Based Algorithm

Seventh IEEE/ACIS International Conference on Computer and Information Science (icis 2008) • 2008
View 1 Excerpt

Similar Papers

Loading similar papers…