Sequential Learning-based IaaS Composition

We propose a novel Infrastructure-as-a-Service composition framework that selects an optimal set of consumer requests according to the provider’s qualitative preferences on long-term service provisions. Decision variables are included in the temporal conditional preference networks to represent qualitative preferences for both short-term and long-term consumers. The global preference ranking of a set of requests is computed using a k -d tree indexing-based temporal similarity measure approach. We propose an extended three-dimensional Q-learning approach to maximize the global preference ranking. We design the on-policy-based sequential selection learning approach that applies the length of request to accept or reject requests in a composition. The proposed on-policy-based learning method reuses historical experiences or policies of sequential optimization using an agglomerative clustering approach. Experimental results prove the feasibility of the proposed framework.

Modeling and Reasoning with Preferences and Ethical Priorities in AI Systems

As AI systems make decisions that affect our lives, we must ensure that these systems operate according to the same constraints, guidelines, and ethical principles that a human would follow. Humans make many complex decisions that rely on their subjective preferences, but their decisions are usually also constrained by these ethical priorities. Hence it is essential to equip AI systems with the tools to evaluate whether or not preferences are compatible with these other priorities. In computer science, the Conditional Preference networks (CP-nets), which graphically represent conditional and qualitative preference relations, can be used to model, combine, and compare subjective preferences and ethical priorities. This chapter proposes that one can use CP-nets to measure the distance between an agent’s subjective preference and the ethical principles of the agent’s community in order to ensure that the decisions of an AI system are aligned with a given set of ethical priorities.

On the Integration of CP-nets in ASPRIN

Conditional preference networks (CP-nets) express qualitative preferences over features of interest.A Boolean CP-net can express that a feature is preferable under some conditions, as long as all other features have the same value.This is often a convenient representation, but sometimes one would also like to express a preference for maximizing a set of features, or some other objective function on the features of interest.ASPRIN is a flexible framework for preferences in ASP, where one can mix heterogeneous preference relations, and this paper reports on the integration of Boolean CP-nets.In general, we extend ASPRIN with a preference program for CP-nets in order to compute most preferred answer sets via an iterative algorithm.For the specific case of acyclic CP-nets, we provide an approximation by partially ordered set preferences, which are in turn normalized by ASPRIN to take advantage of several highly optimized algorithms implemented by ASP solvers for computing optimal solutions.Finally, we take advantage of a linear-time computable function to address dominance testing for tree-shaped CP-nets.

Rank Pruning for Dominance Queries in CP-Nets

Conditional preference networks (CP-nets) are a graphical representation of a person’s (conditional) preferences over a set of discrete features. In this paper, we introduce a novel method of quantifying preference for any given outcome based on a CP-net representation of a user’s preferences. We demonstrate that these values are useful for reasoning about user preferences. In particular, they allow us to order (any subset of) the possible outcomes in accordance with the user’s preferences. Further, these values can be used to improve the efficiency of outcome dominance testing. That is, given a pair of outcomes, we can determine which the user prefers more efficiently. Through experimental results, we show that this method is more effective than existing techniques for improving dominance testing efficiency. We show that the above results also hold for CP-nets that express indifference between variable values.