scholarly journals Redundancy Reduction in Twitter Event Streams

Author(s):  
Nane Kratzke

The data from social networks like Twitter is a valuable source for research but full of redundancy, making it hard to provide large-scale, self-contained, and small datasets. The data recording is a common problem in social media-based studies and could be standardized. Sadly, this is hardly done. This paper reports on lessons learned from a long-term evaluation study recording the complete public sample of the German and English Twitter stream. It presents a recording solution proposal that merely chunks a linear stream of events to reduce redundancy. If events are observed multiple times within the time-span of a chunk, only the latest observation is written to the chunk. A 10 Gigabyte Twitter raw dataset covering 1,2 Million Tweets of 120.000 users recorded between June and September 2017 was used to analyze expectable compression rates. It turned out that resulting datasets need only between 10\% and 20\% of the original data size without losing any event, metadata or the relationships between single events. This kind of redundancy reduction recording makes it possible to curate large-scale (even nation-wide), self-contained, and small datasets of social networks for research in a standardized and reproducible manner.

2019 ◽  
Vol 130 (4) ◽  
pp. 1166-1179 ◽  
Author(s):  
Pantaleo Romanelli ◽  
Marco Piangerelli ◽  
David Ratel ◽  
Christophe Gaude ◽  
Thomas Costecalde ◽  
...  

OBJECTIVEWireless technology is a novel tool for the transmission of cortical signals. Wireless electrocorticography (ECoG) aims to improve the safety and diagnostic gain of procedures requiring invasive localization of seizure foci and also to provide long-term recording of brain activity for brain-computer interfaces (BCIs). However, no wireless devices aimed at these clinical applications are currently available. The authors present the application of a fully implantable and externally rechargeable neural prosthesis providing wireless ECoG recording and direct cortical stimulation (DCS). Prolonged wireless ECoG monitoring was tested in nonhuman primates by using a custom-made device (the ECoG implantable wireless 16-electrode [ECOGIW-16E] device) containing a 16-contact subdural grid. This is a preliminary step toward large-scale, long-term wireless ECoG recording in humans.METHODSThe authors implanted the ECOGIW-16E device over the left sensorimotor cortex of a nonhuman primate (Macaca fascicularis), recording ECoG signals over a time span of 6 months. Daily electrode impedances were measured, aiming to maintain the impedance values below a threshold of 100 KΩ. Brain mapping was obtained through wireless cortical stimulation at fixed intervals (1, 3, and 6 months). After 6 months, the device was removed. The authors analyzed cortical tissues by using conventional histological and immunohistological investigation to assess whether there was evidence of damage after the long-term implantation of the grid.RESULTSThe implant was well tolerated; no neurological or behavioral consequences were reported in the monkey, which resumed his normal activities within a few hours of the procedure. The signal quality of wireless ECoG remained excellent over the 6-month observation period. Impedance values remained well below the threshold value; the average impedance per contact remains approximately 40 KΩ. Wireless cortical stimulation induced movements of the upper and lower limbs, and elicited fine movements of the digits as well. After the monkey was euthanized, the grid was found to be encapsulated by a newly formed dural sheet. The grid removal was performed easily, and no direct adhesions of the grid to the cortex were found. Conventional histological studies showed no cortical damage in the brain region covered by the grid, except for a single microscopic spot of cortical necrosis (not visible to the naked eye) in a region that had undergone repeated procedures of electrical stimulation. Immunohistological studies of the cortex underlying the grid showed a mild inflammatory process.CONCLUSIONSThis preliminary experience in a nonhuman primate shows that a wireless neuroprosthesis, with related long-term ECoG recording (up to 6 months) and multiple DCSs, was tolerated without sequelae. The authors predict that epilepsy surgery could realize great benefit from this novel prosthesis, providing an extended time span for ECoG recording.


2009 ◽  
Vol 35 (4) ◽  
pp. 431-436 ◽  
Author(s):  
Hyun Kyong Lim ◽  
Jeong Yeon Cho ◽  
Seung Hyup Kim

2006 ◽  
Vol 1 (1) ◽  
pp. 46-71 ◽  
Author(s):  
Itsuki Nakabayashi ◽  

This treatise outlines developments in disaster management focusing on earthquake disaster measures taken by the Japanese and Tokyo Metropolitan Governments since the 1980s. The 1978 Large-Scale Earthquake Measures Special Act on conditions for predicting the Tokai Earthquake significantly changed the direction of earthquake disaster measures in Japan. The Tokyo Metropolitan Government undertook its own earthquake disaster measures based on lessons learned from the 1964 Niigata Earthquake. In the 1980s, it began planning urban development disaster management programs for upgrading areas with high wooden houses concentration - still a big problem in many urban areas of Japan - which are most vulnerable to earthquake disasters. The 1995 Great Hanshin-Awaji Earthquake in Kobe brought meaningful insight into both to earthquake disaster measures by the Japanese Government and by the Tokyo Metropolitan Government and other local governments nationwide. Long-term predictions concerning possible earthquake occurrence have been conducted throughout Japan and new earthquake disaster measures have been adopted based on this long-term prediction. The Tokyo Government has further completely revised its own earthquake disaster measures. As a review of measures against foreseeable earthquake disasters based on developments in disaster management measures, this treatise provides invaluable insights emphasizing urban earthquake disaster prevention developed in Japan over the last 30 years that readers are sure to find both interesting and informative in their own work.


2019 ◽  
Vol 16 (12) ◽  
pp. 5026-5031
Author(s):  
Kethavath Narender ◽  
C. Puttamadappa

Symmetrical Frequency Division Multiple Access (OFDMA) is utilized in the higher rate Wireless Communication Systems (WCSs). In the correspondence framework, a fem to cell is a little cell in building Base Station (BS), which devours less power, short range, and works in a minimal effort. The fem to cell has little separation among sender and recipient that give higher flag quality. In spite of the favorable position in fem to cell systems, there win critical difficulties in Interference Management. Specifically, impedance between the macro cell and fem to cell turns into the fundamental issue in OFDMA-Long Term Evaluation (OFDMA-LTE) framework. In this paper, the Neural Network and Hybrid Bee Colony and Cuckoo Search based Resource Allocation (NN-HBCCS-RA) in OFDMA-LTE framework is presented. The ideal power esteems are refreshed to dispense every one of the clients in the fem to cell and large scale cell. The NN-HBCCS strategy accomplished low Signal to Interference Noise Ratio (SINR), otherworldly proficiency and high throughput contrasted with customary techniques.


2010 ◽  
Vol 26 (1) ◽  
pp. 1-3 ◽  
Author(s):  
William F. Schillinger

AbstractMany lessons in long-term cropping systems experiments are learned from practical experience. I have conducted large-scale, long-term, multidisciplinary dryland and irrigated cropping systems experiments with numerous colleagues at university and government research stations and in farmers' fields in the USA and in developing countries for 25 years. Several practical lessons learned through the years are outlined in this short commentary. While some of these lessons learned may be intrinsically obvious, results of many cropping systems experiments have not been published in scientific journals due to fatal flaws in experimental design, improper transitioning between phases of the experiment and many other reasons. Ongoing active support by stakeholders is critical to maintain funding for long-term cropping systems studies. Problems and unexpected challenges will occur, but scientists can often parlay these into opportunities for discovery and testing of new hypotheses. Better understanding and advancement of stable, profitable and sustainable cropping systems will be critical for feeding the world's projected 10 billion people by the mid-21st century.


2015 ◽  
Vol 3 (1) ◽  
Author(s):  
Jessie Lissenden ◽  
Siri Maley ◽  
Khanjan Mehta

As we develop practical, innovative and sustainable technology solutions for resource-constrained settings, what can we learn from the Appropriate Technology (AT) movement? Based on a review of academic literature over the past 35 years, this article identifies, and chronologically maps, the defining tenets and metrics of success advocated by scholars. The literature has gradually evolved from general musings into concrete lessons learned, while the definitions of “success” have transitioned from laboratory success into practical application and long-term usefulness. Nonetheless, juxtaposing this scholastic history with actual projects reveals three major gaps in AT philosophy related to a lack of 1) bilateral knowledge exchange, 2) emphasis on venture scalability, and 3) integration of implementation strategy through the project lifecycle. This article argues that rethinking and repositioning AT with a human-centric narrative emphasizing sustainability and scalability is imperative in order to revitalize and accelerate the AT movement and to achieve the large-scale impact it was expected to deliver.


Sign in / Sign up

Export Citation Format

Share Document