The fulfillment of affective customers needs may award the producer extra premium in gaining a competitive edge. This entails a number of technical challenges to be addressed, such as, the elicitation, evaluation, and fulfillment of affective needs, as well as the evaluation of capability of producers to launch the planned products. To tackle these issues, this research proposes an affective human factor design framework to facilitate decision-making in designing product ecosystems. In particular, ambient intelligence techniques are applied to elicit affective customer needs. An analytical model is proposed to support affective design analysis. Utility measure and conjoint analysis are employed to quantify users’ affective satisfaction, while the producers’ capability to fulfill the respective customer needs is evaluated using a capacity index. Association rule mining techniques are applied to model the mapping of affective needs to design elements. Configuration design of product ecosystems is optimized with a heuristic genetic algorithm. A case study of designing the living room ecosystem is reported with dual considerations of customers’ satisfaction and producer’s capacities. It is demonstrated that the affective human factors design framework can effectively manage the elicitation, analysis, and fulfillment of affective customer needs.