VSumVis: Interactive Visual Understanding and Diagnosis of Video Summarization Model

2021 ◽  
Vol 12 (4) ◽  
pp. 1-28
Author(s):  
Guodao Sun ◽  
Hao Wu ◽  
Lin Zhu ◽  
Chaoqing Xu ◽  
Haoran Liang ◽  
...  
Keyword(s):  
User Study ◽  
Visual Analysis ◽  
Rapid Development ◽  
Video Summarization ◽  
Mobile Internet ◽  
User Centered Design ◽  
User Interactions ◽  
Multi Level ◽  
The Difference ◽  
Analysis System

With the rapid development of mobile Internet, the popularity of video capture devices has brought a surge in multimedia video resources. Utilizing machine learning methods combined with well-designed features, we could automatically obtain video summarization to relax video resource consumption and retrieval issues. However, there always exists a gap between the summarization obtained by the model and the ones annotated by users. How to help users understand the difference, provide insights in improving the model, and enhance the trust in the model remains challenging in the current study. To address these challenges, we propose VSumVis under a user-centered design methodology, a visual analysis system with multi-feature examination and multi-level exploration, which could help users explore and analyze video content, as well as the intrinsic relationship that existed in our video summarization model. The system contains multiple coordinated views, i.e., video view, projection view, detail view, and sequential frames view. A multi-level analysis process to integrate video events and frames are presented with clusters and nodes visualization in our system. Temporal patterns concerning the difference between the manual annotation score and the saliency score produced by our model are further investigated and distinguished with sequential frames view. Moreover, we propose a set of rich user interactions that enable an in-depth, multi-faceted analysis of the features in our video summarization model. We conduct case studies and interviews with domain experts to provide anecdotal evidence about the effectiveness of our approach. Quantitative feedback from a user study confirms the usefulness of our visual system for exploring the video summarization model.

scholarly journals Investigating the Temporal Effect of User Preferences with Application in Movie Recommendation

2017 ◽  
Vol 2017 ◽  
pp. 1-10 ◽  
Author(s):  
Wen-Jun Li ◽  
Qiang Dong ◽  
Yan Fu
Keyword(s):  
Rapid Development ◽  
User Preferences ◽  
Mobile Internet ◽  
Smart Devices ◽  
Data Sets ◽  
Rating Data ◽  
Temporal Effect ◽  
Proposed Model ◽  
Target User ◽  
The Difference

As the rapid development of mobile Internet and smart devices, more and more online content providers begin to collect the preferences of their customers through various apps on mobile devices. These preferences could be largely reflected by the ratings on the online items with explicit scores. Both of positive and negative ratings are helpful for recommender systems to provide relevant items to a target user. Based on the empirical analysis of three real-world movie-rating data sets, we observe that users’ rating criterions change over time, and past positive and negative ratings have different influences on users’ future preferences. Given this, we propose a recommendation model on a session-based temporal graph, considering the difference of long- and short-term preferences, and the different temporal effect of positive and negative ratings. The extensive experiment results validate the significant accuracy improvement of our proposed model compared with the state-of-the-art methods.

Design and Implementation of Fire Multi-Level Menu for Office Automation Platform Based on Communication Technology

2015 ◽  
Vol 733 ◽  
pp. 825-829
Author(s):  
Bin Ni
Keyword(s):  
Rapid Development ◽  
Office Automation ◽  
Mobile Internet ◽  
Internet Technology ◽  
Management Platform ◽  
Software Configuration ◽  
The Social ◽  
Finite State ◽  
Small Footprint ◽  
Multi Level

With the social development and progress, fire institutions, including colleges and universities, including office automation platform, which the functions needed to support the business more and more, need to use multilevel menu for management platform. In addition, with the rapid development of mobile Internet technology, people access to office automation platform approach is also increasingly diverse, due to the hardware and software configuration of various access devices larger difference, which requires multi-level menu office automation platform consumes fewer resources simple operation, good scalability. Now, we use the idea of finite state machines to achieve a small footprint, scalability, simple switching office automation platform colleges Fire multi-level menu management system.

scholarly journals Visual Analysis of Multimodal Movie Network Data Based on the Double-Layered View

2015 ◽  
Vol 2015 ◽  
pp. 1-16 ◽  
Author(s):  
Ying Tang ◽  
Jia Yu ◽  
Chen Li ◽  
Jing Fan
Keyword(s):  
User Study ◽  
Visual Analysis ◽  
New Method ◽  
Network Visualization ◽  
Network Data ◽  
Visualization Method ◽  
User Interactions ◽  
Graph Data ◽  
Different Types ◽  
Density Map

Multimodal visualization of network data is a method considering various types of nodes and visualizing them based on their types, or modes. Compared to traditional network visualization of nodes of the same mode, the new method treats different modes of entities in corresponding ways and presents the relations between them more clearly. In this paper, we apply the new method to visualize movie network data, a typical multimodal graph data that contains nodes of different types and connections between them. We use an improved force-directed layout algorithm to present the movie persons as the foreground and a density map to present films as the background. By combining the foreground and background, the movie network data are presented in one picture properly. User interactions are provided including detailed pie charts visible/invisible, zooming, and panning. We apply our visualization method to the Chinese movie data from Douban website. In order to testify the effectiveness of our method, we design and perform the user study of which the statistics are analyzed.

Comparative Effects of High-Tech Visual Scene Displays and Low-Tech Isolated Picture Symbols on Engagement From Students With Multiple Disabilities

2019 ◽  
Vol 50 (4) ◽  
pp. 693-702 ◽  
Author(s):  
Christine Holyfield ◽  
Sydney Brooks ◽  
Allison Schluterman
Keyword(s):  
Language Learning ◽  
Augmentative And Alternative Communication ◽  
Visual Analysis ◽  
Multiple Disabilities ◽  
Visual Scene ◽  
Future Research ◽  
High Tech ◽  
Single Subject ◽  
Wide Range ◽  
The Difference

Purpose Augmentative and alternative communication (AAC) is an intervention approach that can promote communication and language in children with multiple disabilities who are beginning communicators. While a wide range of AAC technologies are available, little is known about the comparative effects of specific technology options. Given that engagement can be low for beginning communicators with multiple disabilities, the current study provides initial information about the comparative effects of 2 AAC technology options—high-tech visual scene displays (VSDs) and low-tech isolated picture symbols—on engagement. Method Three elementary-age beginning communicators with multiple disabilities participated. The study used a single-subject, alternating treatment design with each technology serving as a condition. Participants interacted with their school speech-language pathologists using each of the 2 technologies across 5 sessions in a block randomized order. Results According to visual analysis and nonoverlap of all pairs calculations, all 3 participants demonstrated more engagement with the high-tech VSDs than the low-tech isolated picture symbols as measured by their seconds of gaze toward each technology option. Despite the difference in engagement observed, there was no clear difference across the 2 conditions in engagement toward the communication partner or use of the AAC. Conclusions Clinicians can consider measuring engagement when evaluating AAC technology options for children with multiple disabilities and should consider evaluating high-tech VSDs as 1 technology option for them. Future research must explore the extent to which differences in engagement to particular AAC technologies result in differences in communication and language learning over time as might be expected.

scholarly journals Mapping the Sharing Economy in China

2020 ◽  
Vol 12 (16) ◽  
pp. 6333
Author(s):  
Chan Liu ◽  
Raymond K. H. Chan ◽  
Maofu Wang ◽  
Zhe Yang
Keyword(s):  
Global Economy ◽  
Rapid Development ◽  
Sharing Economy ◽  
Essential Elements ◽  
Mobile Internet ◽  
Internet Technology ◽  
Short Term ◽  
Bona Fide ◽  
The Government ◽  
Idle Capacity

Harnessing the rapid development of mobile internet technology, the sharing economy has experienced unprecedented growth in the global economy, especially in China. Likely due to its increasing popularity, more and more businesses have adopted this label in China. There is a concern as to the essential meaning of the sharing economy. As it is difficult to have a universally accepted definition, we aim to map the sharing economy and demystify the use of it in China in this paper. We propose seven organizing essential elements of the sharing economy: access use rights instead of ownership, idle capacity, short term, peer-to-peer, Internet platforms mediated, for monetary profit, and shared value orientation. By satisfying all or only parts of these elements, we propose one typology of sharing economy, and to differentiate bona fide sharing economy from quasi- and pseudo-sharing economy. Finally, there are still many problems that need to be solved urgently in the real sharing economy from the perspective of the government, companies and individuals.

scholarly journals Systematic Development of Patient Decision Aids: An Update from the IPDAS Collaboration

2021 ◽  
pp. 0272989X2110141
Author(s):  
Holly O. Witteman ◽  
Kristin G. Maki ◽  
Gratianne Vaisson ◽  
Jeanette Finderup ◽  
Krystina B. Lewis ◽  
...  
Keyword(s):  
Decision Aid ◽  
Decision Aids ◽  
Rapid Development ◽  
User Involvement ◽  
User Centered Design ◽  
Patient Decision Aid ◽  
Patient Decision Aids ◽  
Patient Decision ◽  
Development Processes ◽  
Systematic Development

Background The 2013 update of the evidence informing the quality dimensions behind the International Patient Decision Aid Standards (IPDAS) offered a model process for developers of patient decision aids. Objective To summarize and update the evidence used to inform the systematic development of patient decision aids from the IPDAS Collaboration. Methods To provide further details about design and development methods, we summarized findings from a subgroup ( n = 283 patient decision aid projects) in a recent systematic review of user involvement by Vaisson et al. Using a new measure of user-centeredness (UCD-11), we then rated the degree of user-centeredness reported in 66 articles describing patient decision aid development and citing the 2013 IPDAS update on systematic development. We contacted the 66 articles’ authors to request their self-reports of UCD-11 items. Results The 283 development processes varied substantially from minimal iteration cycles to more complex processes, with multiple iterations, needs assessments, and extensive involvement of end users. We summarized minimal, medium, and maximal processes from the data. Authors of 54 of 66 articles (82%) provided self-reported UCD-11 ratings. Self-reported scores were significantly higher than reviewer ratings (reviewers: mean [SD] = 6.45 [3.10]; authors: mean [SD] = 9.62 [1.16], P < 0.001). Conclusions Decision aid developers have embraced principles of user-centered design in the development of patient decision aids while also underreporting aspects of user involvement in publications about their tools. Templates may reduce the need for extensive development, and new approaches for rapid development of aids have been proposed when a more detailed approach is not feasible. We provide empirically derived benchmark processes and a reporting checklist to support developers in more fully describing their development processes. [Box: see text]

Dynamic network intelligent hybrid recommendation algorithm and its application in online shopping platform

2021 ◽  
pp. 1-13
Author(s):  
Yuxuan Gao ◽  
Haiming Liang ◽  
Bingzhen Sun
Keyword(s):  
Online Shopping ◽  
Rapid Development ◽  
Dynamic Network ◽  
Topsis Method ◽  
Recommendation Algorithm ◽  
Time Periods ◽  
The Difference ◽  
Relationship Of ◽  
Hybrid Recommendation ◽  
Novel Model

With the rapid development of e-commerce, whether network intelligent recommendation can attract customers has become a measure of customer retention on online shopping platforms. In the literature about network intelligent recommendation, there are few studies that consider the difference preference of customers in different time periods. This paper proposes the dynamic network intelligent hybrid recommendation algorithm distinguishing time periods (DIHR), it is a integrated novel model combined with the DEMATEL and TOPSIS method to solved the problem of network intelligent recommendation considering time periods. The proposed method makes use of the DEMATEL method for evaluating the preference relationship of customers for indexes of merchandises, and adopt the TOPSIS method combined with intuitionistic fuzzy number (IFN) for assessing and ranking the merchandises according to the indexes. We specifically introduce the calculation steps of the proposed method, and then calculate its application in the online shopping platform.

Event detection of different English data sources based on transfer learning

2021 ◽  
pp. 1-11
Author(s):  
Yanan Huang ◽  
Yuji Miao ◽  
Zhenjing Da
Keyword(s):  
Transfer Learning ◽  
Event Detection ◽  
Visual Analysis ◽  
Learning Algorithm ◽  
Data Sources ◽  
Data Set ◽  
Data Source ◽  
Single Data Source ◽  
The Difference ◽  
Single Data

The methods of multi-modal English event detection under a single data source and isomorphic event detection of different English data sources based on transfer learning still need to be improved. In order to improve the efficiency of English and data source time detection, based on the transfer learning algorithm, this paper proposes multi-modal event detection under a single data source and isomorphic event detection based on transfer learning for different data sources. Moreover, by stacking multiple classification models, this paper makes each feature merge with each other, and conducts confrontation training through the difference between the two classifiers to further make the distribution of different source data similar. In addition, in order to verify the algorithm proposed in this paper, a multi-source English event detection data set is collected through a data collection method. Finally, this paper uses the data set to verify the method proposed in this paper and compare it with the current most mainstream transfer learning methods. Through experimental analysis, convergence analysis, visual analysis and parameter evaluation, the effectiveness of the algorithm proposed in this paper is demonstrated.

scholarly journals The Optimization of Alternating Current Electrospun PA 6 Solutions Using a Visual Analysis System

Polymers ◽  
2021 ◽  
Vol 13 (13) ◽  
pp. 2098
Author(s):  
Tomas Kalous ◽  
Pavel Holec ◽  
Jakub Erben ◽  
Martin Bilek ◽  
Ondrej Batka ◽  
...  
Keyword(s):  
High Voltage ◽  
High Speed ◽  
Visual Analysis ◽  
Polyamide 6 ◽  
Alternating Current ◽  
Sine Wave ◽  
Electrospinning Process ◽  
Camera System ◽  
Polymeric Solutions ◽  
Analysis System

The electrospinning process that produces fine nanofibrous materials have a major disadvantage in the area of productivity. However, alternating current (AC) electrospinning might help to solve the problem via the modification of high voltage signal. The aforementioned productivity aspect can be observed via a camera system that focuses on the jet creation area and that measures the average lifespan. The paper describes the optimization of polyamide 6 (PA 6) solutions and demonstrates the change in the behavior of the process following the addition of a minor dose of oxoacid. This addition served to convert the previously unspinnable (using AC) solution to a high-quality electrospinning solution. The visual analysis of the AC electrospinning of polymeric solutions using a high-speed camera and a programmable power source was chosen as the method for the evaluation of the quality of the process. The solutions were exposed to high voltage applying two types of AC signal, i.e., the sine wave and the step change. All the recordings presented in the paper contained two sets of data: firstly, camera recordings that showed the visual expression of electrospinning and, secondly, signal recordings that provided information on the data position in the signal function.

Sign in / Sign up

Export Citation Format

Share Document