Real-Time Face Tracking System for Augmented Reality

2009 ◽  
Author(s):  
Yi-Ting Tu ◽  
Shana Smith
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Tracking System ◽  
Direct Interaction ◽  
Principal Component ◽  
Face Tracking ◽  
Computer Interface ◽  
Human Computer Interface ◽  
Training Time ◽  
Augmented Reality Technology

In this paper, we apply augmented reality technology to make human computer interface more technically advanced and interesting. We present a real-time face tracking system for augmented reality, which will be used in electronic commerce, to help shoppers acquire a more direct interaction with the products they purchase. A real-time face tracking mechanism can enhance the realism of online shopping. In order to emphasize the convenience and practicability of our system, we used plug-in functions and Principal Component Analysis (PCA) to conduct real-time face tracking and Neural Networks (NN) to reduce training time and achieve valid recognition. Convenience and uniqueness are the other main parts of this system.

scholarly journals PENERAPAN TEKNOLOGI AUGMENTED REALITY PADA MEDIA PROMOSI FASILITAS SMP BHAKTI MULIA JAKARTA TIMUR

2021 ◽  
Vol 5 (2) ◽  
pp. 196
Author(s):  
Shilki Dini Abadiya ◽  
Intan Dwi Fatmaningtyas
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Junior High School ◽  
3D Visualization ◽  
Tracking System ◽  
Complete Information ◽  
Unity 3D ◽  
Adobe Illustrator ◽  
New Students ◽  
Augmented Reality Technology

Abstrak: Media promosi SMP Bhakti Mulya merupakan alat atau bentuk perantara yang dipakai untuk menyebarkan informasi. Biasanya media promosi SMP Bhakti Mulya yang paling banyak digunakan adalah media konvensional, seperti spanduk dan brosur. Akibatnya, daya tarik untuk para peminat disekolah SMP Bhakti Mulya menjadi berkurang dikarenakan informasi mengenai beberapa fasilitas yang terdapat di SMP Bhakti Mulya kurang tergambarkan dengan jelas untuk para calon siswa baru. Maka dibutuhkan suatu media promosi sekolah bagi calon siswa baru yang lebih kreatif dan menarik yang dapat memberikan gambaran visualisasi 3D dengan menggunakan teknologi augmented reality. Augmented Reality (AR) adalah suatu lingkungan yang memasukkan objek virtual 3D kedalam lingkungan nyata secara real-time karena dalam hal ini dikarenakan perpaduan dari script pemrograman serta seni 3 Dimensi yang diwujudkan kedalam sebuah aplikasi secara bersamaan. Aplikasi augmented reality yang dibangun berjalan pada platform mobile, dimana kamera bekerja sebagai sumber input dengan cara membaca dan melacak marker (penanda) dengan sistem tracking. Untuk penggunaan perancangan aplikasi, maka digunakan perangkat lunak seperti Unity 3D, Vuforia, Adobe Illustrator, Visual Studio. Dengan hal ini menggunakan model pengembangan yaitu metode Prototyping dengan tipe requirement prototype karena dalam impelementasi akan menjadi mudah dan untuk pengguna sistem sudah mempunyai gambaran tentang sistem. Dengan adanya, media promosi fasilitas dengan menggunakan teknologi augmented reality ini diharapkan para calon siswa baru akan mendapatkan informasi yang lengkap mengenai sarana dan prasarana yang tersedia di SMP Bhakti Mulya.   Kata kunci: Media Promosi, Augmented Reality, Prototyping, Unity 3D, Vuforia.   Abstract: Promotional media for SMP Bhakti Mulya is a tool or form of intermediary used to disseminate information. Usually the promotional media for SMP Bhakti Mulya that are most widely used are conventional media, such as banners and brochures. As a result, the attraction for enthusiasts at the Bhakti Mulya Middle School is reduced because information about some of the facilities available at Bhakti Mulya Junior High School is not clearly described for prospective new students. So we need a school promotion media for prospective new students who are more creative and interesting who can provide a 3D visualization picture using augmented reality technology. Augmented Reality (AR) is an environment that inserts 3D virtual objects into a real environment in real-time because in this case it is due to a combination of programming scripts and 3D art that are realized into an application simultaneously. The augmented reality application that is built runs on a mobile platform, where the camera works as an input source by reading and tracking markers with a tracking system. For application design use, software such as Unity 3D, Vuforia, Adobe Illustrator, Visual Studio are used. In this case, using a development model, namely the Prototyping method with the requirement prototype type because the implementation will be easy and for system users already have an overview of the system. With the existence of this media promotion of facilities using augmented reality technology, it is hoped that prospective new students will get complete information about the facilities and infrastructure available at SMP Bhakti Mulya.   Keywords: Promotional Media, Augmented Reality, Prototyping, Unity 3D, Vuforia.

Real time vision-based hand gesture estimation for a human-computer interface

1997 ◽  
Vol 28 (7) ◽  
pp. 76-88 ◽  
Author(s):  
Koichi Ishibuchi ◽  
Keisuke Iwasaki ◽  
Haruo Takemura ◽  
Fumio Kishino
Keyword(s):  
Real Time ◽  
Computer Interface ◽  
Hand Gesture ◽  
Human Computer Interface

Augmented Reality Berbasis Android Sebagai Media Pembelajaran Sistem Tata Surya

2021 ◽  
Vol 2 (1) ◽  
pp. 53-59
Author(s):  
Yulia Fatma ◽  
Armen Salim ◽  
Regiolina Hayami
Keyword(s):  
Augmented Reality ◽  
Solar System ◽  
Real Time ◽  
Real World ◽  
Virtual World ◽  
The Real ◽  
Virtual Objects ◽  
Augmented Reality Technology ◽  
The Revolution

Along with the development, the application can be used as a medium for learning. Augmented Reality is a technology that combines two-dimensional’s virtual objects and three-dimensional’s virtual objects into a real three-dimensional’s  then projecting the virtual objects in real time and simultaneously. The introduction of Solar System’s material, students are invited to get to know the planets which are directly encourage students to imagine circumtances in the Solar System. Explenational of planets form and how the planets make the revolution and rotation in books are considered less material’s explanation because its only display objects in 2D. In addition, students can not practice directly in preparing the layout of the planets in the Solar System. By applying Augmented Reality Technology, information’s learning delivery can be clarified, because in these applications are combined the real world and the virtual world. Not only display the material, the application also display images of planets in 3D animation’s objects with audio.

A ROBUST AND FRIENDLY HUMAN–ROBOT INTERFACE SYSTEM BASED ON NATURAL HUMAN GESTURES

2010 ◽  
Vol 24 (06) ◽  
pp. 847-866 ◽  
Author(s):  
MING-SHAUNG CHANG ◽  
JUNG-HUA CHOU
Keyword(s):  
Real Time ◽  
Face Detection ◽  
Fuzzy Logic Controller ◽  
Tracking System ◽  
Back Propagation ◽  
Principal Component ◽  
Working Environment ◽  
Expression Recognition ◽  
Linear Discriminant ◽  
Human Gestures

In this paper, we design a robust and friendly human–robot interface (HRI) system for our intelligent mobile robot based only on natural human gestures. It consists of a triple-face detection method and a fuzzy logic controller (FLC)-Kalman filter tracking system to check the users and predict their current position in a dynamic and cluttered working environment. In addition, through the combined classifier of the principal component analysis (PCA) and back-propagation artificial neural network (BPANN), single and successive commands defined by facial positions and hand gestures are identified for real-time command recognition after dynamic programming (DP). Therefore, the users can instruct this HRI system to make member recognition or expression recognition corresponding to their gesture commands, respectively based on the linear discriminant analysis (LDA) and BPANN. The experimental results prove that the proposed HRI system perform accurately in real-time face detection and tracking, and robustly react to the corresponding gesture commands at eight frames per second (fps).

scholarly journals Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology

2018 ◽  
Vol 142 (5) ◽  
pp. 638-644 ◽  
Author(s):  
Matthew G. Hanna ◽  
Ishtiaque Ahmed ◽  
Jeffrey Nine ◽  
Shyam Prajapati ◽  
Liron Pantanowitz
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Mixed Reality ◽  
Digital Pathology ◽  
Remote Supervision ◽  
Augmented Reality Technology ◽  
Microsoft Hololens ◽  
Microscopic Pathology ◽  
Areas Of Interest ◽  
Whole Slide Images

Context Augmented reality (AR) devices such as the Microsoft HoloLens have not been well used in the medical field. Objective To test the HoloLens for clinical and nonclinical applications in pathology. Design A Microsoft HoloLens was tested for virtual annotation during autopsy, viewing 3D gross and microscopic pathology specimens, navigating whole slide images, telepathology, as well as real-time pathology-radiology correlation. Results Pathology residents performing an autopsy wearing the HoloLens were remotely instructed with real-time diagrams, annotations, and voice instruction. 3D-scanned gross pathology specimens could be viewed as holograms and easily manipulated. Telepathology was supported during gross examination and at the time of intraoperative consultation, allowing users to remotely access a pathologist for guidance and to virtually annotate areas of interest on specimens in real-time. The HoloLens permitted radiographs to be coregistered on gross specimens and thereby enhanced locating important pathologic findings. The HoloLens also allowed easy viewing and navigation of whole slide images, using an AR workstation, including multiple coregistered tissue sections facilitating volumetric pathology evaluation. Conclusions The HoloLens is a novel AR tool with multiple clinical and nonclinical applications in pathology. The device was comfortable to wear, easy to use, provided sufficient computing power, and supported high-resolution imaging. It was useful for autopsy, gross and microscopic examination, and ideally suited for digital pathology. Unique applications include remote supervision and annotation, 3D image viewing and manipulation, telepathology in a mixed-reality environment, and real-time pathology-radiology correlation.

AN S-PI VISION-BASED TRACKING SYSTEM FOR OBJECT MANIPULATION IN AUGMENTED REALITY

2015 ◽  
Vol 75 (4) ◽  
Author(s):  
Ajune Wanis Ismail ◽  
Mark Bilinghust ◽  
Mohd Shahrizal Sunar
Keyword(s):  
Augmented Reality ◽  
Real Time ◽  
Tracking System ◽  
Object Manipulation ◽  
3D Graphics ◽  
Virtual Objects ◽  
3D Objects ◽  
Time Calibration ◽  
Detection Stage ◽  
Vision Algorithm

In this paper, we describe a new tracking approach for object handling in Augmented Reality (AR). Our approach improves the standard vision-based tracking system during marker extraction and its detection stage. It transforms a unique tracking pattern into set of vertices which are able to perform interaction such as translate, rotate, and copy. This is based on arobust real-time computer vision algorithm that tracks a paddle that a person uses for input. A paddle pose pattern is constructed in a one-time calibration process and through vertex-based calculation of the camera pose relative to the paddle we can show 3D graphics on top of it. This allows the user to look at virtual objects from different viewing angles in the AR interface and perform 3D object manipulation. This approach was implemented using marker-based tracking to improve the tracking in term of the accuracy and robustness in manipulating 3D objects in real-time. We demonstrate our improved tracking system with a sample Tangible AR application, and describe how the system could be improved in the future.

Sign in / Sign up

Export Citation Format

Share Document