scholarly journals What will the future of cloud-based astronomical data processing look like?

2016 ◽  
Vol 12 (S325) ◽  
pp. 27-31
Author(s):  
Andrew W. Green ◽  
Elizabeth Mannering ◽  
Lloyd Harischandra ◽  
Minh Vuong ◽  
Simon O’Toole ◽  
...  
Keyword(s):  
Parallel Processing ◽  
Data Processing ◽  
Large Datasets ◽  
Data Archive ◽  
Astronomical Data ◽  
Processing Times ◽  
The Future ◽  
Very Large Datasets ◽  
User Friendly

AbstractAstronomy is rapidly approaching an impasse: very large datasets require remote or cloud-based parallel processing, yet many astronomers still try to download the data and develop serial code locally. Astronomers understand the need for change, but the hurdles remain high. We are developing a data archive designed from the ground up to simplify and encourage cloud-based parallel processing. While the volume of data we host remains modest by some standards, it is still large enough that download and processing times are measured in days and even weeks. We plan to implement a python based, notebook-like interface that automatically parallelises execution. Our goal is to provide an interface sufficiently familiar and user-friendly that it encourages the astronomer to run their analysis on our system in the cloud—astroinformatics as a service. We describe how our system addresses the approaching impasse in astronomy using the SAMI Galaxy Survey as an example.

Artistic Challenges within Control Societies: Big Data and Democratic Resistance

MedienJournal ◽  
2017 ◽  
Vol 38 (4) ◽  
pp. 50-61 ◽  
Author(s):  
Jan Jagodzinski
Keyword(s):  
Big Data ◽  
Gilles Deleuze ◽  
Data Archive ◽  
Current State ◽  
The Future ◽  
The Way

This paper will first briefly map out the shift from disciplinary to control societies (what I call designer capitalism, the idea of control comes from Gilles Deleuze) in relation to surveillance and mediation of life through screen cultures. The paper then shifts to the issues of digitalization in relation to big data that have the danger of continuing to close off life as zoë, that is life that is creative rather than captured via attention technologies through marketing techniques and surveillance. The last part of this paper then develops the way artists are able to resist the big data archive by turning the data in on itself to offer viewers and participants a glimpse of the current state of manipulating desire and maintaining copy right in order to keep the future closed rather than being potentially open.

Unsupervised dimensionality reduction for very large datasets: Are we going to the right direction?

2020 ◽  
Vol 196 ◽  
pp. 105777
Author(s):  
Jadson Jose Monteiro Oliveira ◽  
Robson Leonardo Ferreira Cordeiro
Keyword(s):  
Dimensionality Reduction ◽  
Large Datasets ◽  
Very Large Datasets ◽  
The Right

scholarly journals The data archive as factory: Alienation and resistance of data processors

2021 ◽  
Vol 8 (1) ◽  
pp. 205395172110075
Author(s):  
Jean-Christophe Plantin
Keyword(s):  
Data Processing ◽  
Assembly Line ◽  
Synthetic Approach ◽  
Data Archive ◽  
Factory Workers ◽  
Meaningful Involvement ◽  
The Social ◽  
Fast Pace ◽  
Ethnographic Data ◽  
The Moment

Archival data processing consists of cleaning and formatting data between the moment a dataset is deposited and its publication on the archive’s website. In this article, I approach data processing by combining scholarship on invisible labor in knowledge infrastructures with a Marxian framework and show the relevance of considering data processing as factory labor. Using this perspective to analyze ethnographic data collected during a six-month participatory observation at a U.S. data archive, I generate a taxonomy of the forms of alienation that data processing generates, but also the types of resistance that processors develop, across four categories: routine, speed, skill, and meaning. This synthetic approach demonstrates, first, that data processing reproduces typical forms of factory worker’s alienation: processors are asked to work along a strict standardized pipeline, at a fast pace, without acquiring substantive skills or having a meaningful involvement in their work. It reveals, second, how data processors resist the alienating nature of this workflow by developing multiple tactics along the same four categories. Seen through this dual lens, data processors are therefore not only invisible workers, but also factory workers who follow and subvert a workflow organized as an assembly line. I conclude by proposing a four-step framework to better value the social contribution of data workers beyond the archive.

ELIV 2021

2021 ◽  
Keyword(s):  
Automotive Industry ◽  
Digital Ecosystems ◽  
Start Up ◽  
The Future ◽  
User Friendly ◽  
Full Swing ◽  
Level 2 ◽  
The Way

Foreword Start-up future It has felt like Covid-19 had a stranglehold on us. But we haven‘t allowed ourselves to be defeated. On the contrary, we are taking advantage of the opportunities that arise as a result. Not only the long-overdue push towards digitalization, for example, but also the time gained by making fewer journeys. Those who show strength now and position themselves for the future will win. And that is exactly the reason why we have been preparing ELIV 2021 with such a lot of enthusiasm. As usual, we have prepared an up-to-date program with the familiar mixture of technically demanding and strategic papers and are sure that the ELIV platform will once again be a trendsetter for the automotive industry. The CASE megatrends (Connected, Autonomous, Shared, Electric) continue to disrupt the industry. In the Connect environment, there is still a struggle for user-friendly services and competition amongst digital ecosystems is in full swing. The entry of powerful central computers into electronic architectures poses major challenges for all parties involved. On the way from Level 2 to Levels 3, 4 and 5 all manufacturers are cur...

Peculiarities of Maser Data Correlation / Postcorrelation in Radioastron Mission

2017 ◽  
Vol 13 (S336) ◽  
pp. 443-444
Author(s):  
I. D. Litovchenko ◽  
S. F. Likhachev ◽  
V. I. Kostenko ◽  
I. A. Girin ◽  
V. A. Ladygin ◽  
...  
Keyword(s):  
Spectral Line ◽  
Data Processing ◽  
Detection Rate ◽  
Angular Size ◽  
Data Archive ◽  
Data Correlation ◽  
Raw Data ◽  
Unique Data ◽  
Technical Requirements ◽  
Upper Limits

AbstractWe discuss specific aspects of space-ground VLBI (SVLBI) data processing of spectral line experiments (H2O & OH masers) in Radioastron project. In order to meet all technical requirements of the Radioastron mission a new software FX correlator (ASCFX) and the unique data archive which stores raw data from all VLBI stations for all experiments of the project were developed in Astro Space Center. Currently all maser observations conducted in Radioastron project were correlated using the ASCFX correlator. Positive detections on the space-ground baselines were found in 38 sessions out of 144 (detection rate of about 27%). Finally, we presented upper limits on the angular size of the most compact spots observed in two galactic H2O masers, W3OH(H2O) and OH043.8-0.1.

scholarly journals Dictionnaire de la nomenclature des objets celestes

1982 ◽  
Vol 64 ◽  
pp. 203-205
Author(s):  
A. Fernandez ◽  
M.C. Lortet ◽  
F. Spite
Keyword(s):  
Data Centers ◽  
Astronomical Data ◽  
The Future ◽  
Future Publication ◽  
Γ Ray ◽  
Made In

AbstractThe confusing situation of the nomenclature of the astronomical objects led us to build, as a first step, a dictionary of the designations presently used. The future publication of this work is supported by Commission 5 of IAU. A brief description of this dictionary, as well as a sample of it, is given here. The designations (acronyms) will be given, together with the format, the total number of objects, the type of objects, the code for the complete bibliographical reference, the signification of acronym… Nomenclature for X and γ-ray sources, designations by constellations and descriptive designations will be dealt with as well. Good compilations are a considerable help in nomenclature problems; every effort should be made in order of : 1) urging specialists to build compilations 2) announce compilations in progress to Astronomical Data Centers and to the present authors.

Sign in / Sign up

Export Citation Format

Share Document