Integrated High-Performance Platform for Fast Query Response in Big Data with Hive, Impala, and SparkSQL: A Performance Evaluation

This paper first integrates big data tools—Hive, Impala, and SparkSQL—which support SQL-like queries for rapid data retrieval in big data. The three introduced tools are not only suitable for operating in business intelligence to serve high-performance data retrieval, but they are also an open-source software solution with low cost for small-to-medium enterprise use. In practice, the proposed approach provides an in-memory cache and an in-disk cache to achieve a very fast response to a query if a cache hit occurs. Moreover, this paper develops so-called platform selection that is able to select the appropriate tool dealing with input query with effectiveness and efficiency. As a result, the speed of job execution of proposed approach using platform selection is 2.63 times faster than Hive in the Case 1 experiment, and 4.57 times faster in the Case 2 experiment.

Download Full-text

Novel ionic bioartificial muscles based on ionically crosslinked multi-walled carbon nanotubes-mediated bacterial cellulose membranes and PEDOT:PSS electrodes

Smart Materials and Structures ◽

10.1088/1361-665x/ac4576 ◽

2021 ◽

Author(s):

Yaofeng Wang ◽

Fan Wang ◽

Yang Kong ◽

Lei Wang ◽

Qinchuan Li

Keyword(s):

Carbon Nanotubes ◽

Bacterial Cellulose ◽

Specific Capacitance ◽

High Performance ◽

Low Cost ◽

Actuation Voltage ◽

Fast Response ◽

Bending Deformation ◽

Multi Walled Carbon Nanotubes ◽

Walled Carbon Nanotubes

Abstract High-performance bioartificial muscles with low-cost, large bending deformation, low actuation voltage, and fast response time have drawn extensive attention as the development of human-friendly electronics in recent years. Here, we report a high-performance ionic bioartificial muscle based on the bacterial cellulose (BC)/ionic liquid (IL)/multi-walled carbon nanotubes (MWCNT) nanocomposite membrane and PEDOT:PSS electrode. The developed ionic actuator exhibits excellent electro-chemo-mechanical properties, which are ascribed to its high ionic conductivity, large specific capacitance, and ionically crosslinked structure resulting from the strong ionic interaction and physical crosslinking among BC, IL, and MWCNT. In particular, the proposed BC-IL-MWCNT (0.10 wt%) nanocomposite exhibited significant increments of Young's modulus up to 75% and specific capacitance up to 77%, leading to 2.5 times larger bending deformation than that of the BC-IL actuator. More interestingly, bioinspired applications containing artificial soft robotic finger and grapple robot were successfully demonstrated based on high-performance BC-IL-MWCNT actuator with excellent sensitivity and controllability. Thus, the newly proposed BC-IL-MWCNT bioartificial muscle will offer a viable pathway for developing next-generation artificial muscles, soft robotics, wearable electronic products, flexible tactile devices, and biomedical instruments.

Download Full-text

Joule Heating-Induced Carbon Fibers for Flexible Fiber Supercapacitor Electrodes

Materials ◽

10.3390/ma13225255 ◽

2020 ◽

Vol 13 (22) ◽

pp. 5255

Author(s):

Jin Gu Kang ◽

Gang Wang ◽

Sung-Kon Kim

Keyword(s):

Carbon Nanotubes ◽

Joule Heating ◽

High Performance ◽

Electrochemical Impedance ◽

High Current Density ◽

Low Cost ◽

Fast Response ◽

Extrusion Process ◽

Composite Fiber ◽

Flexible Fiber

Microscale fiber-based supercapacitors have become increasingly important for the needs of flexible, wearable, and lightweight portable electronics. Fiber electrodes without pre-existing cores enable a wider selection of materials and geometries than is possible through core-containing electrodes. The carbonization of fibrous precursors using an electrically driven route, different from a conventional high-temperature process, is particularly promising for achieving this structure. Here, we present a facile and low-cost process for producing high-performance microfiber supercapacitor electrodes based on carbonaceous materials without cores. Fibrous carbon nanotubes-agarose composite hydrogels, formed by an extrusion process, are converted to a composite fiber consisting of carbon nanotubes (CNTs) surrounded by an amorphous carbon (aC) matrix via Joule heating. When assembled into symmetrical two-electrode cells, the composite fiber (aC-CNTs) supercapacitor electrodes deliver a volumetric capacitance of 5.1 F cm−3 even at a high current density of 118 mA cm−3. Based on electrochemical impedance spectroscopy analysis, it is revealed that high electrochemical properties are attributed to fast response kinetics with a characteristic time constant of 2.5 s. The aC-CNTs fiber electrodes exhibit a 94% capacitance retention at 14 mA cm−3 for at least 10,000 charge-discharge cycles even when deformed (90° bend), which is essentially the same as that (96%) when not deformed. The aC-CNTs fiber electrodes also demonstrate excellent storage performance under mechanical deformation—for example, 1000 bending-straightening cycles.

Download Full-text

Development of Multiple Big Data Analytics Platforms with Rapid Response

Scientific Programming ◽

10.1155/2017/6972461 ◽

2017 ◽

Vol 2017 ◽

pp. 1-13 ◽

Cited By ~ 3

Author(s):

Bao Rong Chang ◽

Yun-Da Lee ◽

Po-Hao Liao

Keyword(s):

Big Data ◽

Business Intelligence ◽

Data Analytics ◽

High Performance ◽

Job Scheduling ◽

Big Data Analytics ◽

Data Retrieval ◽

System Throughput ◽

Data Platform ◽

R Programming

The crucial problem of the integration of multiple platforms is how to adapt for their own computing features so as to execute the assignments most efficiently and gain the best outcome. This paper introduced the new approaches to big data platform, RHhadoop and SparkR, and integrated them to form a high-performance big data analytics with multiple platforms as part of business intelligence (BI) to carry out rapid data retrieval and analytics with R programming. This paper aims to develop the optimization for job scheduling using MSHEFT algorithm and implement the optimized platform selection based on computing features for improving the system throughput significantly. In addition, users would simply give R commands rather than run Java or Scala program to perform the data retrieval and analytics in the proposed platforms. As a result, according to performance index calculated for various methods, although the optimized platform selection can reduce the execution time for the data retrieval and analytics significantly, furthermore scheduling optimization definitely increases the system efficiency a lot.

Download Full-text

Parallel Architectures for MEDLINE Search

Encyclopedia of Healthcare Information Systems ◽

10.4018/978-1-59904-889-5.ch130 ◽

2008 ◽

pp. 1048-1055

Author(s):

Rajendra V. Boppana ◽

Suresh Chalasani ◽

Bob Badgett ◽

Jacqueline A. Pugh

Keyword(s):

High Performance Computing ◽

High Performance ◽

Response Times ◽

Low Cost ◽

Parallel Architecture ◽

Fast Response ◽

Parallel Architectures ◽

Medline Search ◽

Medline Database ◽

Performance Computing

In this article, we describe a parallel architecture for MEDLINE database integrated with search refinement tools to facilitate accurate and fast response to search requests by users. The proposed architecture, to be developed by the authors, will use low-cost, high-performance computing clusters consisting of Linux based personal computers and workstations (i) to provide subsecond response times for individual searches and (ii) to support several concurrent queries from search refinement programs such as SUMSearch.

Download Full-text

Development of a Highly Miniaturized PQT-Sensor for Monitoring and Diagnosing of Pneumatic Systems

ASME 2007 International Manufacturing Science and Engineering Conference ◽

10.1115/msec2007-31017 ◽

2007 ◽

Author(s):

Christoph Sosna ◽

Rainer Buchner ◽

Walter Lang ◽

Wolfgang Benecke ◽

Christian Boehm ◽

...

Keyword(s):

High Resolution ◽

First Principles ◽

High Performance ◽

Low Cost ◽

Fast Response ◽

High Accuracy ◽

Measuring Range ◽

Micro Electro Mechanical Systems ◽

Diagnostic Applications ◽

Design Proposal

In this paper a feasibility study of a micromachined PQT-sensor for measurement of pressure (P), flow rate (Q), and temperature (T) for diagnostic applications in pneumatic systems is presented. As a low cost device this innovative PQT-sensor has to fulfill different kinds of criteria such as wide measuring range, fast response time, high resolution and high accuracy for diagnosing the health status of a pneumatic system. By using micro electro mechanical systems (MEMS) technologies small high-performance sensors were fabricated which fulfill all these criteria. At first, principles will be described that have been chosen for measurement of pressure, flow and temperature that will be used for the PQT-sensor. A design proposal for the sensor will be presented and verified with analytical calculations to show its applicability.

Download Full-text

Bandgap-Tuned 2D Boron Nitride/Tungsten Nitride Nanocomposites for Development of High-Performance Deep Ultraviolet Selective Photodetectors

Nanomaterials ◽

10.3390/nano10081433 ◽

2020 ◽

Vol 10 (8) ◽

pp. 1433

Author(s):

Ali Aldalbahi ◽

Rafael Velázquez ◽

Andrew F. Zhou ◽

Mostafizur Rahaman ◽

Peter X. Feng

Keyword(s):

Boron Nitride ◽

High Performance ◽

Operating Temperature ◽

Low Cost ◽

Fast Response ◽

Tungsten Nitride ◽

Applied Bias Voltage ◽

New Device ◽

Tunable Bandgap ◽

Deep Ultraviolet

This study presents a fast and effective method to synthesize 2D boron nitride/tungsten nitride (BN–WN) nanocomposites for tunable bandgap structures and devices. A few minutes of synthesis yielded a large quantity of high-quality 2D nanocomposites, with which a simple, low-cost deep UV photo-detector (DUV-PD) was fabricated and tested. The new device was demonstrated to have very good performance. High responsivity up to 1.17 A/W, fast response-time of lower than two milliseconds and highly stable repeatability were obtained. Furthermore, the influences of operating temperature and applied bias voltage on the properties of DUV-PD as well as its band structure shift were investigated.

Download Full-text

Comparison of Software Licensing and Development Models Using Val IT

ACMIT Proceedings ◽

10.33555/acmit.v3i1.46 ◽

2019 ◽

Vol 3 (1) ◽

pp. 208-212

Author(s):

Arief Abdul Hamid

Keyword(s):

Open Source ◽

Open Source Software ◽

Low Cost ◽

Development Models ◽

Advantages And Disadvantages ◽

Medium Enterprise ◽

Software Licensing ◽

It Application

Today Small Medium Enterprise (SME) in Indonesia increasingly growing, along with the growth of business done, of course must be offset by existing IT in the company, due to support the performance of the company. Who originally used it daily jobs done manually will be diverted to use software to help the work. But sometimes to develop the IT application, the obstacle typically encountered is about the budget for the investment of IT itself, therefore in this paper the authors compare the advantages and disadvantages between open source software and software Proprietary using VAL IT as a framework. For the result of the Open Source Software is low cost because the the code it is free but company should spend budget for the training and for the report the company need to learn to create the reporting. While for software Proprietary is high cost but support is conducted regularly for operational and for just ask the vendor to create report.

Download Full-text

Advancing HIV Vaccine Research With Low-Cost High-Performance Computing Infrastructure: An Alternative Approach for Resource-Limited Settings

Bioinformatics and Biology Insights ◽

10.1177/1177932219882347 ◽

2019 ◽

Vol 13 ◽

pp. 117793221988234

Author(s):

Batsirai M Mabvakure ◽

Raymond Rott ◽

Leslie Dobrowsky ◽

Peter Van Heusden ◽

Lynn Morris ◽

...

Keyword(s):

Open Source ◽

High Performance Computing ◽

Open Source Software ◽

High Performance ◽

Low Cost ◽

Resource Limited Settings ◽

Resource Limited ◽

Desktop Computers ◽

Performance Computing ◽

Generation Sequencing

Next-generation sequencing (NGS) technologies have revolutionized biological research by generating genomic data that were once unaffordable by traditional first-generation sequencing technologies. These sequencing methodologies provide an opportunity for in-depth analyses of host and pathogen genomes as they are able to sequence millions of templates at a time. However, these large datasets can only be efficiently explored using bioinformatics analyses requiring huge data storage and computational resources adapted for high-performance processing. High-performance computing allows for efficient handling of large data and tasks that may require multi-threading and prolonged computational times, which is not feasible with ordinary computers. However, high-performance computing resources are costly and therefore not always readily available in low-income settings. We describe the establishment of an affordable high-performance computing bioinformatics cluster consisting of 3 nodes, constructed using ordinary desktop computers and open-source software including Linux Fedora, SLURM Workload Manager, and the Conda package manager. For the analysis of large antibody sequence datasets and for complex viral phylodynamic analyses, the cluster out-performed desktop computers. This has demonstrated that it is possible to construct high-performance computing capacity capable of analyzing large NGS data from relatively low-cost hardware and entirely free (open-source) software, even in resource-limited settings. Such a cluster design has broad utility beyond bioinformatics to other studies that require high-performance computing.

Download Full-text

A self-powered, flexible ultra-thin Si/ZnO nanowire photodetector as full-spectrum optical sensor and pyroelectric nanogenerator

Beilstein Journal of Nanotechnology ◽

10.3762/bjnano.11.145 ◽

2020 ◽

Vol 11 ◽

pp. 1623-1630

Author(s):

Liang Chen ◽

Jianqi Dong ◽

Miao He ◽

Xingfu Wang

Keyword(s):

Optical Sensor ◽

High Performance ◽

Near Infrared ◽

Low Cost ◽

Short Circuit ◽

Fast Response ◽

Zno Nanowire ◽

Working Mechanism ◽

Full Spectrum ◽

Self Powered

In this work, a new type of self-powered, high-performance ultra-thin p-Si/n-ZnO nanowire (NW) flexible photodetector (PD) and its application as full-spectrum optical sensor and pyroelectric nanogenerator (PENG) are demonstrated. The working mechanism of PDs for PENGs is carefully investigated and systematically analyzed. The self-powered PDs exhibit high responsivity (1200 mA/W), high detectivity (1013 Jones) and fast response (τr = 18 μs, τf = 25 μs) under UV illumination. High and stable short-circuit output currents at each wavelength from ultraviolet (UV) to near-infrared (NIR) demonstrates that the device can realize full-spectrum optical communication. An experiment in which the PENG powers other devices is designed to further demonstrate the proposed working mechanism. This work provides an effective approach to realize self-powered, high-performance PDs for full-spectrum communication. Also, the fabrication of the PENG utilizing a simple and low-cost method shows its potential applications in self-powered flexible electronic devices.

Download Full-text

An Ultrahigh Sensitive Paper-Based Pressure Sensor with Intelligent Thermotherapy for Skin-Integrated Electronics

Nanomaterials ◽

10.3390/nano10122536 ◽

2020 ◽

Vol 10 (12) ◽

pp. 2536

Author(s):

Lin Gao ◽

Junsheng Yu ◽

Ying Li ◽

Peiwen Wang ◽

Jun Shu ◽

...

Keyword(s):

Pressure Sensor ◽

High Performance ◽

Low Cost ◽

Pressure Sensors ◽

Fast Response ◽

Integrated Electronics ◽

Piezoresistive Pressure Sensor ◽

Biomedical Diagnostics ◽

Porous Microstructure ◽

Ultrahigh Sensitivity

Porous microstructure pressure sensors that are highly sensitive, reliable, low-cost, and environment-friendly have aroused wide attention in intelligent biomedical diagnostics, human–machine interactions, and soft robots. Here, an all-tissue-based piezoresistive pressure sensor with ultrahigh sensitivity and reliability based on the bottom interdigitated tissue electrode and the top bridge of a microporous tissue/carbon nanotube composite was proposed. Such pressure sensors exhibited ultrahigh sensitivity (≈1911.4 kPa−1), fast response time (<5 ms), low fatigue of over 2000 loading/unloading cycles, and robust environmental degradability. These enabled sensors can not only monitor the critical physiological signals of the human body but also realize electrothermal conversion at a specific voltage, which enhances the possibility of creating wearable thermotherapy electronics for protecting against rheumatoid arthritis and cervical spondylosis. Furthermore, the sensor successfully transmitted wireless signals to smartphones via Bluetooth, indicating its potential as reliable skin-integrated electronics. This work provides a highly feasible strategy for promoting high-performance wearable thermotherapy electronics for the next-generation artificial skin.

Download Full-text