Quantifying uncertainty in multicriteria concept selection methods

2006 ◽  
Vol 17 (4) ◽  
pp. 175-187 ◽  
Author(s):  
Michael J. Scott
Author(s):  
K. N. Otto ◽  
Kristin L. Wood

Abstract Numerical concept selection methods are used throughout industry to determine which among several design alternatives should be further developed. The results, however, are rarely believed at face value. Uncertainties (or errors) in subjective choices, modeling assumptions, and measurement are fundamental causes of this disbelief. This paper describes a methodology developed to predict overall error ranges, in addition to estimating a confidence measure in the numerical evaluation results. Each numerical assignment is given an associated error tolerance, and then treated as a probability error to create a simple means to propagate the uncertainties. A degree of confidence is also derived, similar to a statistical t-test, to indicate an induced confidence level in the final decision. Two preliminary concept selections are shown, to illustrate the methodology. Results from these concept selections indicate that (1) uncertainties can be suitably captured and quantified; (2) critical design questions are addressed during the process of numerical concept selection with error propagation; and (3) designers can make more informed and confident decisions through error estimation.


Author(s):  
Mikko Salonen ◽  
Matti Perttula

Concept selection is an area of design research that has been under considerable interest over the years. There is, however, only little information on how the methods that have been presented in design research for this task have been adopted by industry. Thus, a survey was carried out in the Finnish industry. The results revealed that the degree of industrial utilization of formal concept selection methods was relatively low. Less than one out of four companies responded to use one or several of the formal methods included in the study: Pugh’s evaluation matrix, Rating matrices, or Analytic Hierarchy Process (AHP). Concept review meeting were reported as the most common approach for concept selection. However, a majority of the companies that did not utilize any formal method reported lacking effective and suitable methods for concept selection. The companies using formal methods were more satisfied. The first conclusion from the study is that there is a basis for a higher degree of utilization of formal concept selection methods in industry. Our second conclusion is that the existing formal concept selection methods do not entirely fulfill the needs of concept selection in an industry context. We propose that numerical concept selection methods should be further developed and extended to better support the decision-making practices of concept selection in industry. This type of concept selection is characterized by the participation of multiple decision makers through concept design reviews.


2010 ◽  
Vol 22 (1) ◽  
pp. 7-27 ◽  
Author(s):  
Belinda López-Mesa ◽  
Nicklas Bylund

Author(s):  
Xuan Zheng ◽  
Scarlett R. Miller

While research has been conducted to study the use of concept selection methods in design education, few studies have focused on the influence of these methods on individual students’ and teams’ thought processes in grade-dependent class projects. In order to fill this research gap, the current study was designed to compare the influence of two concept selection methods, the Concept Selection Matrix (CSM) and a new adjective assessment method called the Tool for Assessing Semantic Creativity (TASC), through an experimental study in two sections of a first year engineering design class. The results of the study show that while students were equally confident in the concept ratings from the CSM and TASC methods, they reported that they were more likely to select ideas ranked highly in the CSM method. However, subsequent analysis revealed no difference between the common elements in the ideas rated highly by the two methods and the final design ideas produced.


2009 ◽  
Author(s):  
Dan Ispas ◽  
Alexandra Ilie ◽  
Dragos Iliescu
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document