Open data for official statistics: History, principles, and implementation

For data that are collected and managed by national statistical offices to reach their full potential and benefit to society, they must be made available to the public as open data. In the simplest terms, open data are data that can be freely used, modified, and shared by anyone for any purpose. This paper reviews the development of standards for the production and dissemination of open data. It discusses the implementation of these standards in national statistical systems and reviews tool kits, readiness assessments, and maturity models that are available to guide national statistical offices in the adoption of open data. The demand for open data has created challenges for official statistics, but it has also raised the profile of the statistical office and points to a new and expanded role as data brokers and data stewards. The paper concludes with a discussion of how open data in official statistics can be used to improve data governance.

Download Full-text

TYPES OF PUBLIC INFORMATION IN THE FORM OF OPEN DATA AND THEIR CLASSIFICATION

Bulletin of Taras Shevchenko National University of Kyiv. Legal Studies ◽

10.17721/1728-2195/2020/3.114-8 ◽

2020 ◽

pp. 33-37

Author(s):

D. Nesterova

Keyword(s):

Public Sector ◽

Public Awareness ◽

Open Data ◽

Public Information ◽

Economic Benefits ◽

Full Potential ◽

Data Discovery ◽

The Public ◽

Public Data

The concept of public information in the form of open data and its main features are studied. It is determined that due to the possible wide application of open data, the definition of the main grounds for the classification of open data is an insufficiently covered issue. The purpose of this study is to determine the types and criteria for the classification of public information in the form of open data. This is necessary for their widespread use in order to solve socially important tasks and to use their full potential in unusual directions. The author has analyzed international reports on open data and identified the problems of the quality of such data and the possibility of using them to solve socially important tasks. The classification of open data is formed on the following grounds: 1. by data type; 2. by data format; 3. by subject. The article determines the value of open data to society and the possibility of its wide use in the example of other countries. The problems that complicate the implementation of the government data discovery initiative in Ukraine include the underdeveloped culture of open government; insufficient level of training of public authorities to work with open data; insufficient funding for the public data discovery initiative; low level of public awareness and interest in public data and the benefits of using it. Unfortunately, most citizens are still satisfying their curiosity by using open data. The author notes that using data that describes the patterns we live in can help us solve problems in ways we may not have anticipated. As a rule, public sector systems do not respond too quickly on changes. With open data, they could track, predict and respond to real-time changes. This would allow the public sector to streamline its processes and services and it would be possible to clearly identify areas for improving and increasing productivity, to develop specialized solutions based on various demographic indicators and other factors. This would be a huge transformational leap in attracting open data to the public sector, as it opens up a number of areas for innovation. The author substantiates the importance of open data for public sector transformation, economic benefits and their use as an instrument for creating an information society.

Download Full-text

Automated Annotations for AI Data and Model Transparency

Journal of Data and Information Quality ◽

10.1145/3460000 ◽

2022 ◽

Vol 14 (1) ◽

pp. 1-9

Author(s):

Saravanan Thirumuruganathan ◽

Mayuresh Kunjir ◽

Mourad Ouzzani ◽

Sanjay Chawla

Keyword(s):

Open Data ◽

Ease Of Use ◽

Quality Data ◽

Key Factors ◽

Data Governance ◽

Policy Compliance ◽

The Public ◽

Use Of Data ◽

Challenges And Opportunities ◽

Data Transparency

The data and Artificial Intelligence revolution has had a massive impact on enterprises, governments, and society alike. It is fueled by two key factors. First, data have become increasingly abundant and are often available openly. Enterprises have more data than they can process. Governments are spearheading open data initiatives by setting up data portals such as data.gov and releasing large amounts of data to the public. Second, AI engineering development is becoming increasingly democratized. Open source frameworks have enabled even an individual developer to engineer sophisticated AI systems. But with such ease of use comes the potential for irresponsible use of data. Ensuring that AI systems adhere to a set of ethical principles is one of the major problems of our age. We believe that data and model transparency has a key role to play in mitigating the deleterious effects of AI systems. In this article, we describe a framework to synthesize ideas from various domains such as data transparency, data quality, data governance among others to tackle this problem. Specifically, we advocate an approach based on automated annotations (of both data and the AI model), which has a number of appealing properties. The annotations could be used by enterprises to get visibility of potential issues, prepare data transparency reports, create and ensure policy compliance, and evaluate the readiness of data for diverse downstream AI applications. We propose a model architecture and enumerate its key components that could achieve these requirements. Finally, we describe a number of interesting challenges and opportunities.

Download Full-text

Mapping CRISPR-Cas9 public and commercial innovation using The Lens institutional toolkit

Transgenic Research ◽

10.1007/s11248-021-00237-y ◽

2021 ◽

Author(s):

Osmat Azzam Jefferson ◽

Simon Lang ◽

Kenny Williams ◽

Deniz Koellhofer ◽

Aaron Ballagh ◽

...

Keyword(s):

Public Investment ◽

Open Data ◽

Regulatory Elements ◽

Policy Makers ◽

Base Editing ◽

The Public ◽

Homology Directed Repair ◽

A Genome ◽

Institutional Capability ◽

Cellular Dna

AbstractCRISPR-Cas9 is a revolutionary technology because it is precise, fast and easy to implement, cheap and components are readily accessible. This versatility means that the technology can deliver a timely end product and can be used by many stakeholders. In plant cells, the technology can be applied to knockout genes by using CRISPR–Cas nucleases that can alter coding gene regions or regulatory elements, alter precisely a genome by base editing to delete or regulate gene expression, edit precisely a genome by homology-directed repair mechanism (cellular DNA), or regulate transcriptional machinery by using dead Cas proteins to recruit regulators to the promoter region of a gene. All these applications can be for: 1) Research use (Non commercial), 2) Uses related product components for the technology itself (reagents, equipment, toolkits, vectors etc), and 3) Uses related to the development and sale of derived end products based on this technology. In this contribution, we present a prototype report that can engage the community in open, inclusive and collaborative innovation mapping. Using the open data at the Lens.org platform and other relevant sources, we tracked, analyzed, organized, and assembled contextual and bridged patent and scholarly knowledge about CRISPR-Cas9 and with the assistance of a new Lens institutional capability, The Lens Report Builder, currently in beta release, mapped the public and commercial innovation pathways of the technology. When scaled, this capability will also enable coordinated editing and curation by credentialed experts to inform policy makers, businesses and private or public investment.

Download Full-text

Mapping the United Nations Fundamental Principles of Official Statistics against new and big data sources

Statistical Journal of the IAOS ◽

10.3233/sji-210789 ◽

2021 ◽

Vol 37 (1) ◽

pp. 161-169

Author(s):

Dominik Rozkrut ◽

Olga Świerkot-Strużewska ◽

Gemma Van Halderen

Keyword(s):

Big Data ◽

Public Information ◽

Fundamental Principle ◽

Data Sources ◽

Official Statistics ◽

Development Agenda ◽

Data Gaps ◽

Data Source ◽

Exciting Time ◽

Statistical Systems

Never has there been a more exciting time to be an official statistician. The data revolution is responding to the demands of the CoVID-19 pandemic and a complex sustainable development agenda to improve how data is produced and used, to close data gaps to prevent discrimination, to build capacity and data literacy, to modernize data collection systems and to liberate data to promote transparency and accountability. But can all data be liberated in the production and communication of official statistics? This paper explores the UN Fundamental Principles of Official Statistics in the context of eight new and big data sources. The paper concludes each data source can be used for the production of official statistics in adherence with the Fundamental Principles and argues these data sources should be used if National Statistical Systems are to adhere to the first Fundamental Principle of compiling and making available official statistics that honor citizen’s entitlement to public information.

Download Full-text

Big Data in the philippines: How do we actually use them?

Statistical Journal of the IAOS ◽

10.3233/sji-210826 ◽

2021 ◽

pp. 1-30

Author(s):

Lisa Grace S. Bersales ◽

Josefina V. Almeda ◽

Sabrina O. Romasoc ◽

Marie Nadeen R. Martinez ◽

Dannela Jann B. Galias

Keyword(s):

Big Data ◽

High Speed ◽

The Philippines ◽

Complex Data ◽

Official Statistics ◽

Group Discussions ◽

The Public ◽

The Government ◽

The Many ◽

Current Utilization

With the advancement of technology, digitalization, and the internet of things, large amounts of complex data are being produced daily. This vast quantity of various data produced at high speed is referred to as Big Data. The utilization of Big Data is being implemented with success in the private sector, yet the public sector seems to be falling behind despite the many potentials Big Data has already presented. In this regard, this paper explores ways in which the government can recognize the use of Big Data for official statistics. It begins by gathering and presenting Big Data-related initiatives and projects across the globe for various types and sources of Big Data implemented. Further, this paper discusses the opportunities, challenges, and risks associated with using Big Data, particularly in official statistics. This paper also aims to assess the current utilization of Big Data in the country through focus group discussions and key informant interviews. Based on desk review, discussions, and interviews, the paper then concludes with a proposed framework that provides ways in which Big Data may be utilized by the government to augment official statistics.

Download Full-text

Data ideologies of an interested public: A study of grassroots open government data intermediaries

Big Data & Society ◽

10.1177/2053951717690750 ◽

2017 ◽

Vol 4 (1) ◽

pp. 205395171769075 ◽

Cited By ~ 21

Author(s):

Andrew Schrock ◽

Gwen Shaffer

Keyword(s):

Open Data ◽

Government Officials ◽

Software Developers ◽

The Public ◽

Political Landscape ◽

Socially Constructed ◽

Open Government Data ◽

Government Data ◽

A Site ◽

Institutional Actors

Government officials claim open data can improve internal and external communication and collaboration. These promises hinge on “data intermediaries”: extra-institutional actors that obtain, use, and translate data for the public. However, we know little about why these individuals might regard open data as a site of civic participation. In response, we draw on Ilana Gershon to conceptualize culturally situated and socially constructed perspectives on data, or “data ideologies.” This study employs mixed methodologies to examine why members of the public hold particular data ideologies and how they vary. In late 2015 the authors engaged the public through a commission in a diverse city of approximately 500,000. Qualitative data was collected from three public focus groups with residents. Simultaneously, we obtained quantitative data from surveys. Participants’ data ideologies varied based on how they perceived data to be useful for collaboration, tasks, and translations. Bucking the “geek” stereotype, only a minority of those surveyed (20%) were professional software developers or engineers. Although only a nascent movement, we argue open data intermediaries have important roles to play in a new political landscape.

Download Full-text

Will Routine Annual Influenza Prevention and Control Systems Serve the United States Well in a Pandemic?

Disaster Medicine and Public Health Preparedness ◽

10.1097/dmp.0b013e3181ad1833 ◽

2009 ◽

Vol 3 (S2) ◽

pp. S160-S165 ◽

Cited By ~ 6

Author(s):

Jeanne S. Ringel ◽

Melinda Moore ◽

John Zambrano ◽

Nicole Lurie

Keyword(s):

Public Health ◽

United States ◽

Prevention And Control ◽

The United States ◽

Qualitative Assessment ◽

Full Potential ◽

Pandemic Preparedness ◽

The Public ◽

Influenza Prevention ◽

And Control

ABSTRACTObjective: To assess the extent to which the systems in place for prevention and control of routine annual influenza could provide the information and experience needed to manage a pandemic.Methods: The authors conducted a qualitative assessment based on key informant interviews and the review of relevant documents.Results: Although there are a number of systems in place that would likely serve the United States well in a pandemic, much of the information and experience needed to manage a pandemic optimally is not available.Conclusions: Systems in place for routine annual influenza prevention and control are necessary but not sufficient for managing a pandemic, nor are they used to their full potential for pandemic preparedness. Pandemic preparedness can be strengthened by building more explicitly upon routine influenza activities and the public health system’s response to the unique challenges that arise each influenza season (eg, vaccine supply issues, higher than normal rates of influenza-related deaths). (Disaster Med Public Health Preparedness. 2009;3(Suppl 2):S160–S165)

Download Full-text

Improving the Public Acceptance of WTE: Session 8

15th Annual North American Waste-to-Energy Conference ◽

10.1115/nawtec15-002 ◽

2007 ◽

Author(s):

Peter A. Napoli ◽

Lindsey Sampson ◽

Robin Davidov ◽

Bettina Kamuk

Keyword(s):

Natural Gas ◽

Low Cost ◽

Waste To Energy ◽

Public Acceptance ◽

Full Potential ◽

The Public ◽

Public Consumption ◽

Energy Plant ◽

Consumption Demand

This topic is important because of the growing need for us to produce and supply low cost energy for public consumption. Demand has increased exponentially, and in order to reduce dependence on foreign oil, coal, and natural gas we need to utilize waste to its full potential. Three major waste to energy plant expansions are happening now at Olmstead WTE, Minnesota and at Lee and Hillsborough Counties, in Florida. New “Greenfield” construction is planned at Harford, Carroll, and Fredrick Counties, in Maryland.

Download Full-text

Public Interest, Health Research and Data Protection Law: Establishing a Legitimate Trade-Off between Individual Control and Research Access to Health Data

Laws ◽

10.3390/laws9010006 ◽

2020 ◽

Vol 9 (1) ◽

pp. 6 ◽

Cited By ~ 3

Author(s):

Mark J. Taylor ◽

Tess Whitton

Keyword(s):

Public Interest ◽

Data Protection ◽

Health Research ◽

Health Data ◽

Personal Health ◽

Positive Contribution ◽

Data Governance ◽

The Public ◽

Individual Control ◽

Data Protection Law

The United Kingdom’s Data Protection Act 2018 introduces a new public interest test applicable to the research processing of personal health data. The need for interpretation and application of this new safeguard creates a further opportunity to craft a health data governance landscape deserving of public trust and confidence. At the minimum, to constitute a positive contribution, the new test must be capable of distinguishing between instances of health research that are in the public interest, from those that are not, in a meaningful, predictable and reproducible manner. In this article, we derive from the literature on theories of public interest a concept of public interest capable of supporting such a test. Its application can defend the position under data protection law that allows a legal route through to processing personal health data for research purposes that does not require individual consent. However, its adoption would also entail that the public interest test in the 2018 Act could only be met if all practicable steps are taken to maximise preservation of individual control over the use of personal health data for research purposes. This would require that consent is sought where practicable and objection respected in almost all circumstances. Importantly, we suggest that an advantage of relying upon this concept of the public interest, to ground the test introduced by the 2018 Act, is that it may work to promote the social legitimacy of data protection legislation and the research processing that it authorises without individual consent (and occasionally in the face of explicit objection).

Download Full-text