Bibliographic References to Publications from Online Resources. Normalization Requirements

The article discusses the rules for compiling bibliographic references to cited or mentioned electronic documents placed in information and telecommunications networks of the following categories: all types of electronic documents placed in information and telecommunications networks, regardless of the primary source of their publication (including republications, integrated and multimedia electronic documents, software and databases), groups of homogeneous and heterogeneous electronic documents, components of an electronic document (the fragment of a text, part of a work or a publication, a block of information in an integrated or multimedia document). The authors specify the bibliographic record for making a reference to electronic documents that have analogies in the system of traditional scholarly communications (books, articles, conference materials, etc.). Alternative requirements for making a bibliographic record when referring to documents that are not included in other bibliographic standards are proposed: research data; an integrated electronic document and its component part (messages and responses to them in social networks, chats and forums, on news feeds and on information resources; a fragment of a document, including a multimedia one; an information resource (website, portal); computer programs.

An architecture for non-linear discovery of aggregated multimedia document web search results

The recent proliferation of multimedia information on the web enhances user information need from simple textual lookup to multi-modal exploration activities. The current search engines act as major gateways to access the immense amount of multimedia data. However, access to the multimedia content is provided by aggregating disjoint multimedia search verticals. The aggregation of the multimedia search results cannot consider relationships in them and are partially blended. Additionally, the search results’ presentation is via linear lists, which cannot support the users’ non-linear navigation patterns to explore the multimedia search results. Contrarily, users’ are demanding more services from search engines. It includes adequate access to navigate, explore, and discover multimedia information. Our discovery approach allow users to explore and discover multimedia information by semantically aggregating disjoint verticals using sentence embeddings and transforming snippets into conceptually similar multimedia document groups. The proposed aggregation approach retains the relationship in the retrieved multimedia search results. A non-linear graph is instantiated to augment the users’ non-linear information navigation and exploration patterns, which leads to discovering new and interesting search results at various aggregated granularity levels. Our method’s empirical evaluation results achieve 99% accuracy in the aggregation of disjoint search results at different aggregated search granularity levels. Our approach provides a standard baseline for the exploration of multimedia aggregation search results.

An Ontology Representation Language for Multimedia Event Applications

This paper presents formalization of a new Multimedia Web Ontology Language (E-MOWL) to handle events with media depictions. The temporal, spatial and entity aspects that are implicitly linked to an event are represented through this language to model the context of events. The already existing Multimedia Web Ontology Language (MOWL) can be leveraged for perceptual modelling of a domain, where the concepts manifest into media patterns in the multimedia document and helps in semantic processing of the contents. The language E-MOWL provides a rich method for representing knowledge corresponding to a specific domain wherein the context specifies the intended meaning of each element of the domain of discourse; an element in different context may correspond to different functional role. The context information associated with an event ties the audiovisual data with event related aspects. All these aspects when considered altogether provide the evidence and contribute towards recognizing an event from multimedia documents. The language also enables reasoning with the uncertainty associated with the events and is organized in the form of Bayesian Network (BN). The media items that are semantically relevant can be assimilated together on the basis of their association with events. We have demonstrated the efficacy of our approach by utilizing an ontology for the entertainment category in news domain to offer an application \textit{news aggregation} and event-based book recommendations.

A Knowledge-Driven Multimedia Retrieval System Based on Semantics and Deep Features

In recent years the information user needs have been changed due to the heterogeneity of web contents which increasingly involve in multimedia contents. Although modern search engines provide visual queries, it is not easy to find systems that allow searching from a particular domain of interest and that perform such search by combining text and visual queries. Different approaches have been proposed during years and in the semantic research field many authors proposed techniques based on ontologies. On the other hand, in the context of image retrieval systems techniques based on deep learning have obtained excellent results. In this paper we presented novel approaches for image semantic retrieval and a possible combination for multimedia document analysis. Several results have been presented to show the performance of our approach compared with literature baselines.

Automatic Transformation of a Video Using Multimodal Information for an Engaging Exploration Experience

Exploring the content of a video is typically inefficient due to the linear streamed nature of its media and the lack of interactivity. While different approaches have been proposed for enhancing the exploration experience of video content, the general view of video content has remained basically the same, that is, a continuous stream of images. It is our contention that such a conservative view on video limits its potential value as a content source. This paper presents An Alternative Representation of Video via feature Extraction (RAAVE), a novel approach to transform videos from a linear stream of content into an adaptive interactive multimedia document and thereby enhance the exploration potential of video content by providing a more engaging user experience. We explore the idea of viewing video as a diverse multimedia content source, opening new opportunities and applications to explore and consume video content. A modular framework and algorithm for the representation engine and template collection is described. The representation engine based approach is evaluated through development of a prototype system grounded on the design of the proposed approach, allowing users to perform multiple content exploration tasks within a video. The evaluation demonstrated RAAVE’s ability to provide users with a more engaging, efficient and effective experience than a typical multimedia player while performing video exploration tasks.

A mechanism for automatic preparation of media objects in Ginga-NCL

This contribution proposes a mechanism for automatic preparation of media objects incorporated in Ginga-NCL. In the automatic preparation, the middleware Ginga-NCL builds a preparation plan based on the network conditions and the presentation behaviour gathered from the multimedia document that defines the application. The automatic preparation of media objects aims to reduce or avoid synchronization faults during the presentation of distributed multimedia applications.