Web scraping for food price research

2019 ◽  
Vol 121 (12) ◽  
pp. 3350-3361 ◽  
Author(s):  
Judith Hillen
Keyword(s):  
Data Collection ◽  
Food Price ◽  
Content Type ◽  
Price Data ◽  
Technical Procedure ◽  
Web Scraping ◽  
Consumer Prices ◽  
Legal Challenges ◽  
Data Collection Technique ◽  
Price Analysis

Purpose The purpose of this paper is to discuss web scraping as a method for extracting large amounts of data from online sources. The author wants to raise awareness of the method’s potential in the field of food price research, hoping to enable fellow researchers to apply this method. Design/methodology/approach The author explains the technical procedure of web scraping, reviews the existing literature, and identifies areas of application and limitations for food price research. Findings The author finds that web scraping is a promising method to collect customised, high-frequency data in real time, overcoming several limitations of currently used food price data sources. With today’s applications mostly focussing on (online) consumer prices, the scope of applications for web scraping broadens as more and more price data are published online. Research limitations/implications To better deal with the technical and legal challenges of web scraping and to exploit its scalability, joint data collection projects in the field of agricultural and food economics should be considered. Originality/value In agricultural and food economics, web scraping as a data collection technique has received little attention. This is one of the first articles to address this topic with particular focus on food price analysis.

scholarly journals Measuring food inflation during the COVID-19 pandemic in real time using online data: a case study of Poland

2021 ◽  
Vol 123 (13) ◽  
pp. 260-280
Author(s):  
Krystian Jaworski
Keyword(s):  
Real Time ◽  
Alcoholic Beverage ◽  
Food Prices ◽  
Food Price ◽  
Online Data ◽  
Price Inflation ◽  
Content Type ◽  
Price Data ◽  
Online Stores ◽  
Food Inflation

PurposeThe purpose of this study paper is to focus on developing novel ways to monitor an economy in real time during the COVID-19 pandemic. A fully automated framework is proposed for collecting and analyzing online food prices in Poland. This is important, as the COVID-19 outbreak in Europe in 2020 has led many governments to impose lockdowns that have prevented manual price data collection from food outlets. The study primarily addresses whether food price inflation can be accurately measured during the pandemic using only a laptop and Internet connection, without needing to rely on official statistics.Design/methodology/approachThe big data approach was adopted to track food price inflation in Poland. Using the web-scraping technique, daily price information about individual food and non-alcoholic beverage products sold in online stores was gathered.FindingsBased on raw online data, reliable estimates of monthly and annual food inflation were provided about 30 days before final official indexes were published.Originality/valueThis is the first paper to focus on measuring inflation in real time during the COVID-19 pandemic. Monthly and annual food price inflation are estimated in real time and updated daily, thereby improving previous forecasting solutions with weekly or monthly indicators. Using daily frequency price data deepens understanding of price developments and enables more timely detection of inflation trends, both of which are useful for policymakers and market participants. This study also provides a review of crucial issues regarding inflation that emerged during the COVID-19 pandemic.

scholarly journals PENGEMBANGAN SISTEM APLIKASI WEB SCRAPER HARGA KOMODITAS MENGGUNAKAN METODE DESIGN ORIENTED RESEARCH

2020 ◽  
Vol 2 (1) ◽  
Author(s):  
Muhammad Irsad Arief ◽  
Robert Kurniawan
Keyword(s):  
Information Technology ◽  
Data Collection ◽  
Real Time ◽  
Online Data ◽  
Application System ◽  
Price Data ◽  
Web Scraping ◽  
System Usability Scale ◽  
System Usability ◽  
Oriented Research

Information technology develops in line with human civilization development. One type of information technology implementation in business is electronic commerce (e-commerce), which resulted in the availability of online price data. It raises new opportunities for more efficient and effective price data collection. One method of online data collection that is more efficient, cheaper, and more accessible is web scraping. This research develops an application system which can do web scraping of price easily, database system to accommodate web scraping result and a dashboard system that can give price information accurately and real-time. In addition to pricing information, the resulting application system also provides price forecasting. This research uses the Design Oriented Research method with the expected results in the form of a web scraper application system for commodity price data, by identifying problems that occur as well as efforts in their resolution. Also, testing is done by black-box testing, white-box testing, and system usability scale (SUS). The results of the application show that the use is acceptable with 75.5 scores and goes as expected result. Teknologi informasi turut berkembang sejalan dengan perkembangan peradaban manusia Salah satu jenis implementasi teknologi informasi dalam hal bisnis adalah perdagangan elektronik (e-commerce) yang mengakibatkan tersedianya data harga produk secara online. Hal ini menimbulkan peluang baru untuk proses pengumpulan data harga yang lebih efisien dan efektif. Salah satu metode pungumpulan data secara online yang lebih efisien, murah dan mudah adalah web scraping. Penelitian ini bertujuan mengembangkan sistem aplikasi yang mampu melakukan web scraping harga dengan mudah, membuat sistem basis data untuk menampung hasil web scraping serta membangun sistem yang dapat memberikan informasi harga dengan akurat dan real time. Selain informasi tentang harga, sistem aplikasi yang dihasilkan juga menyediakan informasi peramalan harga di masa yang akan datang. Penelitian ini menggunakan metode Design Oriented Research dengan hasil yang diharapkan berupa artefak sistem aplikasi web scraper data harga komoditas, dengan mengidentifikasi masalah yang terjadi serta usaha dalam penyelesaiannya. Selain itu, juga dilakukan pengujian dengan menggunakan pengujian blackbox testing, whitebox testing, dan system usability scale (SUS). Hasil dari pengujian aplikasi menunjukkan bahwa aplikasi berjalan sesuai dengan hasil yang diharapkan dan dapat diterima dengan baik dengan skor SUS 75,5.

scholarly journals Commodity Price Data Analysis Using Web Scraping

2015 ◽  
Vol 4 (4) ◽  
pp. 146
Author(s):  
M. Kameswara Rao ◽  
Rohit Lagisetty ◽  
M.S.V.K. Maniraj ◽  
K.N.S. Dattu ◽  
B. Sneha Ganga
Keyword(s):  
Data Analysis ◽  
Price Index ◽  
Inflation Rate ◽  
Commodity Price ◽  
Entire Process ◽  
Price Data ◽  
Web Scraping ◽  
Visualization Of Data ◽  
Price Analysis ◽  
The Web

<p>Today, analysis of data which is available on the web has become more popular, by using such data we are capable to solve many issues. Our project deals with the analysis of commodity price data available on the web. In general, commodity price data analysis is performed to know inflation rate prevailing in the country and also to know cost price index (CPI). Presently in some countries this analysis is done manually by collecting data from different cities, then calculate inflation and CPI using some predefined formulae. To make this entire process automatic we are developing this project. Now a day’s most of the customers are depending on online websites for their day to day purchases. This is the reason we are implementing a system to collect the data available in various e-commerce sites for commodity price analysis. Here, we are going to introduce a data scraping technique which enables us to collect data of various products available online and then store it in a database there after we perform analysis on them. By this process we can reduce the burden of collecting data manually by reaching various cities. The system consists of web module which perform analysis and visualization of data available in the database.</p>

Persepsi Dan Partisipasi Pengunjung Terhadap Permasalahan Sampah Laut (Marine Debris) Di Pantai Temberan Kabupaten Bangka Dan Pantai Pasir Padi Pangkalpinang

2020 ◽  
Vol 3 (1) ◽  
pp. 11-20
Author(s):  
Siska Oktavia ◽  
Wahyu Adi ◽  
Aditya Pamungkas
Keyword(s):  
Data Collection ◽  
Random Sampling ◽  
Sampling Technique ◽  
Marine Debris ◽  
Reliability Test ◽  
Validity Test ◽  
Data Collection Technique ◽  
Mixed Approach ◽  
Relationship Of ◽  
The Relationship

This study aims to analyze the value of the density of marine debris, perceptions and participation in Temberan beach and Pasir Padi beach, as well as determine the relationship of perception and participation to the density of marine debris. This research is a type of research that is descriptive with a mixed approach (quantitative and qualitative). The study was conducted at Temberan beach in Bangka Regency and Pasir Pasir Beach Pangkal Pinang in October 2019. The sampling technique used was random sampling and purposive sampling. The data collection technique was carried out using observation technique namely sampling and questionnaire. The validity test uses the Pearson Product Moment formula and the reliability test uses the Cronbach’s Alpha formula. The results showed that the density of debris in the Temberan beach was more dominant at 10.92 pieces/meter2, while at Temberan beach 3 pieces/meter2. The results of perception and participation are different, with the Temberan beach occupying more complex waste problems. The relationship of perception and participation in the density of marine debris have a relationship that affects each other.

MANAJEMEN PEMBELAJARAN TEMATIK INTEGRATIF SESUAI KURIKULUM 2013 PADA KELAS 4 SD KHADIJAH SURABAYA

2017 ◽  
Vol 2 (1) ◽  
Author(s):  
Nafiah Nafiah
Keyword(s):  
Data Collection ◽  
Primary School ◽  
Research Method ◽  
Lesson Plan ◽  
Portfolio Assessment ◽  
Authentic Assessment ◽  
Project Assessment ◽  
Written Assessment ◽  
Data Collection Technique ◽  
Thematic Learning

The purpose of this study is to describe the implementation of management of integrative thematic learning based on curriculum 2013 at grade 4 khadijah primary school Surabaya. The focus of this study are 1. The lesson plan for integrative thematic class based on curriculum 2013 at grade 4 khadijah primary school . the research method of this study is descriptive kualitatif, the data collection technique are interview, observation and documentation. The result of this study are 1) the lesson plan of integrative thematic based on curriculum 2013 at grade 4 khadijah primary school Surabaya conducted by several steps are : a) set thema, b) doing analisys SKL, KI, and basic competence, c) arrage syllabus, d) arrage the lesson plan, 2) doing integrative thematic learning based on curriculum 2013 at grade 4 Khadijah primary school used scientific approch by observing, questioning, reasoning, trying, processing, displaying, verivicaying, and communicating, 3) the assessment of integrative thematic learning based on curriculum 2013 at grade 4 khadijah primary school used authentic assessment that include written assessment, project assessment and portfolio assessment.

Analisis Pengembalian Kredit Terhadap Profitabilitas Pada PT Bank Sumut Cabang Gunungsitoli

Owner ◽  
2019 ◽  
Vol 3 (2) ◽  
pp. 160
Author(s):  
Victorinus Laoli
Keyword(s):  
Data Collection ◽  
Positive Influence ◽  
Business Continuity ◽  
Working Capital ◽  
The People ◽  
Data Collection Technique

One manifestation of the important role of banking in a region, as implemented by PT Bank Sumut, Gunungsitoli Branch, is to distribute loans for investment, consumption and working capital for the people in the area. The purpose of providing credit for banks is the return of credit that earns interest and can increase income to finance activities and business continuity. From the results of research conducted with this data collection technique, it shows that PT Bank Sumut has a number of loans from 2009 to 2014 which each year rises. From this study, it is also known that the rate of credit repayment has a positive influence on the level of profitability.

PENINGKATAN KEMAMPUAN MENYIMAK CERITA MELALUI PENERAPAN MODEL PEMBELAJARAN TIM PENDENGAR PADA MATA PELAJARAN BAHASA INDONESIA SISWA KELAS V SD NEGERI 007 PAGARAN TAPAH DARUSSALAM KABUPATEN ROKAN HULU

2017 ◽  
Vol 6 (1) ◽  
pp. 24
Author(s):  
Gusliarni Gusliarni
Keyword(s):  
Data Collection ◽  
Learning Model ◽  
Listening Skills ◽  
Class V ◽  
Average Ability ◽  
Average Value ◽  
The Subject ◽  
Data Collection Technique ◽  
Academic Year ◽  
Bahasa Indonesia

This research is motivated by the lack of listening skills obtained by the students, it is seen from the results of an assessment of the listening skills of students still achieved an average grade 56.32 or reach under the KKM predetermined value is 70. This study aims to determine whether the Team Learning model Listener can improve listening skills of students in the subject of Indonesian student Class V SD Negeri 007 Pagaran Tapah Darussalam Rokan Hulu. The subjects were 38 students in the academic year 2014-2015. Form of research is classroom action research. The data collection technique used is the technique of test and non test. Based on the results, it can be concluded that the ability to listen to the story class V students of SD Negeri 007 Pagaran Tapah Darussalam Rokan Hulu can be improved by applying the learning model listener team. On average ability to listen to stories of students in the early test is average with the average value of 56.32 by the medium category, and in the first cycle rose to 69.47 in the medium category, while in the second cycle listening skills of students categorized as high with the percentage of the average value of 76, 58 with a high category. Therefore, the success rate has exceeded 70 of the total number of students, which means that most students have achieved success predetermined value (minimum 75%).

Perkembangan Bahasa dan Seni Siswa Kelas Tinggi Madrasah Ibtidaiyah Negeri I Yogyakarta

2019 ◽  
Vol 2 (2) ◽  
pp. 32-44
Author(s):  
Muhamad Rofi Fauzi ◽  
Salmadina Saktiani
Keyword(s):  
Data Collection ◽  
Language Development ◽  
Qualitative Approach ◽  
Early Age ◽  
Data Collection Technique ◽  
Children’S Work ◽  
Power Of God

The development experienced by humans when explored deeply will make people more confident in the power of God. Simple things such as the process of developing the language and art of children, in fact there is something extraordinary in it, which if disturbed will have an impact on further developments or other aspects.Writing this journal uses a qualitative approach, through observation, interviews, and documentation as a data collection technique. Based on the results of the research conducted, there are some results, namely the indicator of language development of VA class children basically has been achieved in accordance with the task of development at his age. But there are some things that have not been maximized in achieving this, such as the use of synonyms from several words, and metaphorical sentences that do not fully understand. The development of VA class art is in the phase of the Early Realism and the Early Age of Pseudo Naturalism which in the early realism phase In the period of Early Realism, children's work more closely resembled reality. Perspective awareness begins to emerge, but based on one's own vision. Keywords: Language Development, Art, Madrasah

Hidden Curriculum Pembelajaran di SMA Ehipassiko BSD City Tangerang Selatan

2019 ◽  
Author(s):  
Suntoro
Keyword(s):  
High School ◽  
Data Collection ◽  
Education System ◽  
Student Attitudes ◽  
Research Method ◽  
Hidden Curriculum ◽  
Learning Activities ◽  
Data Collection Technique ◽  
Positive Character

Hidden curriculum is an integral part of the implementation of the education system. The existence of a hidden curriculum is absolutely necessary as a means of transfering positive character values to students. This study aims to determine the shape and implementation of hidden curriculum at Ehipassiko High School as one of the schools characterized by Buddhism. The research method used is descriptive qualitative. The data collection technique of this study uses observation, interviews, and documentation. The result of the study show that the hidden curriculum that appears in actual curriculum practice is reflected in learning activities such as: (a) the initial, core, and final activities of learning, (b) attached to all subjects; (c) student attitudes and comliance, and (d) exemplary teacher. Hidden curriculum in the learning process has a function as a tool and methid to increase the repertoire of students knowledge as well as a melting atmosphere of learning, resenting a respected and interesting teahing educator mode, so as to arouse students interest in learning. This research is expected to be an input for Ehipassiko Hidh School n particular and Buddhist schools in general to improve the quality of good Buddhist education.

Risk perception and awareness of earthquake: the case of Dhaka

2019 ◽  
Vol 10 (1) ◽  
pp. 65-82 ◽  
Author(s):  
Mohammad Lutfur Rahman
Keyword(s):  
Risk Perception ◽  
Data Collection ◽  
Seismic Risk ◽  
Public Awareness ◽  
Content Type ◽  
Earthquake Preparedness ◽  
Level Of Knowledge ◽  
Seismic Risk Perception ◽  
The Many ◽  
And Behavior

Purpose Among the many studies about risk perception, only a few deal with Bangladesh. Paul and Bhuiyan’s (2010) study has shown the earthquake-preparedness level of residents of Dhaka, but there are some biases in the data collection. This paper aims to examine the seismic-risk perception and the level of knowledge on earthquake and preparedness among the residents of Dhaka. Design/methodology/approach A questionnaire was developed, and data collection was undertaken through home and sidewalk surveys. This paper investigates how attitude, perception and behavior differ depending on gender, age, education and casualty awareness. This research tries to examine and make a comparison of the risk perception and preparedness level between different groups of gender, age and level of education. Findings This research shows that female respondents have a much better risk perception of and are better prepared for earthquakes than male respondents; younger people have a higher knowledge about earthquake preparedness than older people and less-educated people are at a higher risk of unpreparedness than more-educated people. Research limitations/implications This research is only limited to the Dhaka Division. Originality/value This paper concludes by noting that public awareness on seismic-risk perception and mitigation is poor, and their knowledge on basic theory and emergency response must be improved.

Sign in / Sign up

Export Citation Format

Share Document