scholarly journals Image Information Collection System Based on Python Web Crawler Technology

CONVERTER ◽  
2021 ◽  
pp. 606-612
Author(s):  
Dong Jin
Keyword(s):  
Data Acquisition ◽  
Data Acquisition System ◽  
Exception Handling ◽  
System Model ◽  
Information Collection ◽  
Collection System ◽  
Web Crawler ◽  
Model Framework ◽  
Image Information ◽  
Data Acquisition Process

Collecting data from the Internet is the key to solve the problem of data sources. This paper studies the image information collection system based on Python web crawler technology.This paper studies and develops a data acquisition system based on Python web crawler technology, which realizes the automatic collection of subject data. In this paper, we use urllib, beautiful soup, threading library to design and develop a system model framework including data crawling, exception handling, robots protocol management and multithreading management modules. Through the application of specific cases, this paper introduces the data acquisition process. Experimental data show that compared with the traditional manual data acquisition, the proposed method greatly improves the work efficiency.

Based on ARM Embedded Remote Data Acquisition System

2012 ◽  
Vol 614-615 ◽  
pp. 1566-1569
Author(s):  
Qiang Liu ◽  
Guo Hua Fu ◽  
Xin Ge Lian ◽  
Jun Wang
Keyword(s):  
Data Collection ◽  
Data Acquisition ◽  
Data Acquisition System ◽  
Video Data ◽  
Acquisition System ◽  
Price Ratio ◽  
Collection System ◽  
Application Range ◽  
Sd Card ◽  
Remote Data

Because of the data acquisition system is more and more wide application range, involved the signal source and the type of more and more of the requirement of measurement, more and more is also high, the domestic now has quite a few data collection system and measurement, but many systems are simple function, and acquisition channel, the sampling rate is low, less complex operation, and higher requirements for test environment. People need a wide application range, high performance/price ratio of data acquisition system. In this paper, the main content is the use of ARM9 processor C2440A primarily controller series 3, design an embedded data acquisition system. Using ARM9 chip do microprocessor design remote data acquisition system, through the embedded Linux system video data collection USB cameras, the JPEG compression coding, ARM9 chip control data acquisition by most industrial environmental restrictions for collection system that has a large capacity of the storage and wireless forwarding function. This paper to S3C2440A as the core, with A piece of FPGA and A piece of Ethernet CS8900A controller for auxiliary to realize the digital parts of the system hardware, analog part two way by the A/D acquisition, variable gain amplifier and basic amplifying circuit component. The system also realize the SD card memory function and various interface such as serial ports and JTAG mouth. In the software of realized in development platform on Linux system of transplantation, separately from the Bootloader transplantation, Linux kernel transplantation and root file system, the establishment of the three are expounded. And completion of the A/D converter, SD card and CS8900A in the drive design under Linux, and finally the data acquisition, storage design and forwarding program.

Data Acquisition System Based on VC++

2011 ◽  
Vol 109 ◽  
pp. 720-724
Author(s):  
Jing Bing Wu ◽  
Xie Wang ◽  
Lun Shu
Keyword(s):  
Data Collection ◽  
Data Acquisition ◽  
Real Time ◽  
Data Acquisition System ◽  
Acquisition System ◽  
Pci Bus ◽  
Collection System ◽  
Timing Data ◽  
Data Acquisition Card ◽  
Time Acquisition

In this paper, we introduced features of data acquisition card based on PCI bus, and combined with researching on timing data collection system in the reducer test, built data acquisition system aiming at parameters of the reducer, and by using VC+ + to program, we achieved display on timing and real-time acquisition curve of data of torque and speed of the reducer, and have got good results.

Design of a Data Collection System in Manufacturing Informationization

2012 ◽  
Vol 236-237 ◽  
pp. 283-288
Author(s):  
H.H. Jian ◽  
C.R. Xiong ◽  
G.B. Huang
Keyword(s):  
Data Collection ◽  
Data Acquisition ◽  
Software Design ◽  
Data Acquisition System ◽  
Acquisition System ◽  
Collection System ◽  
Enterprise Information System ◽  
Hardware Platform ◽  
Enterprise Information ◽  
Data Collection System

This paper is based on the background of manufacturing enterprise information system. Under this case, this paper introduces a design of a data collection system that is transparent and controlled by the host computer. It uses a data acquisition system software design model which will help in speeding up the development of the system, reducing maintenance costs as well as improving data collect velocity. This paper describes the data acquisition system based on ARM hardware platform, its software framework and design process.

Rancang Bangun Piranti Lunak Pengelola Parameter Akuisisi Data Terowongan Angin Kecepatan Rendah Indonesia

2015 ◽  
Vol 7 (1) ◽  
Author(s):  
Ivransa Zuhdi Pane
Keyword(s):  
Wind Tunnel ◽  
Data Acquisition ◽  
Wind Tunnel Test ◽  
Data Acquisition System ◽  
Aerodynamic Characteristics ◽  
Design And Implementation ◽  
Implementation Stages ◽  
Analysis Design ◽  
Data Acquisition Process ◽  
Existing Data

Data acquisition is an important part of a series of activities in a wind tunnel test and determine the validity of aerodynamic characteristics information of the test object. One of the factors which affect the success of the data acquisition process is the control of the data acquisition parameters prior to the execution of the wind tunnel test. A large number of data acquisition parameters, and the configuration complexities of the data acquisition parameters, which are still managed manually, urged the development of a software which is expected to facilitate the management of these parameters in a way that is friendly to use and integratable into the existing data acquisition system. Engineering of data acquisition parameters management software was then carried out through the analysis, design and implementation stages in an iterated manner, starting with a simple prototype toward the establisment of operational product.

Data acquisition system for induction motors with arduino

2019 ◽  
pp. 256-262
Author(s):  
Ali Sinan Cabuk
Keyword(s):  
Data Acquisition ◽  
Induction Motor ◽  
Induction Motors ◽  
Low Cost ◽  
Data Acquisition System ◽  
Electrical Machines ◽  
Acquisition System ◽  
Efficiency Measure ◽  
Collection System ◽  
Measurement Devices

Data acquisition systems have been used for many years in order to conduct analyses to increase efficiency, measure performance and detect failures in electrical motors.High costs and not being of modular use have prevented these systems from being commonly used. Various methods were developed for data acquisition from electrical machines. This paper presents data acquisition analysing and monitoring system using Arduino platform. Vibration, temperature and current values of a 3 phase induction motor are obtained by this data acquisition system via USB port. A system compatiable with all sorts of settings and of low cost was obtained as a result of using Arduino where data processing is conducted on a computer. Values obtained from the data collection system used in this study were found to be supportive to the values shown by the measurement devices from 3 phase induction motor.

scholarly journals DESIGN OF RICE REGIONAL TEST INFORMATION COLLECTION SYSTEM BASED ON CLOUD COMPUTING

2021 ◽  
pp. 497-506
Author(s):  
Xin Zha
Keyword(s):  
Cloud Computing ◽  
Data Acquisition ◽  
Information Collection ◽  
Test Results ◽  
Computing Technology ◽  
Collection System ◽  
Network Function ◽  
Crop Varieties ◽  
Significant Difference ◽  
Main Basis

This paper combines the image processing and analysis technology of artificial intelligence to realize the function of farmland data acquisition and analysis. The data acquisition function is completed by different types of sensors. The collected information can be divided into two categories: meteorological information and image and GPS information. Based on cloud computing technology, an information collection system for rice regional experiment was established. The information collected by the sensor was analysed by cloud computing technology, which provided a basis for agronomic operation and result evaluation of regional experiment. The test results show that there is no significant difference between the rice data collected by cloud computing and the manually collected rice data. It can replace the manually collected rice information, reduce labour costs and improve experimental quality. Regional test of crop varieties is an intermediate link in the breeding and popularization of new varieties, and the results of regional test are the main basis for the approval of crop varieties. With the popularization and application of network, it brings opportunities for the networking of regional test management, statistics and variety evaluation. At the same time, with the help of network function, it can realize the online transmission of data, solve the delay problem of regional test results, and query the statistical analysis and evaluation results of regional test at any time.

The Hardware Design and Implement of an Image Information Collection System

2013 ◽  
Vol 804 ◽  
pp. 211-215
Author(s):  
Feng Ying Guo
Keyword(s):  
Magnetic Particle ◽  
Detection System ◽  
Hardware Design ◽  
Information Collection ◽  
Head Model ◽  
Collection System ◽  
Nondestructive Detection ◽  
Image Information ◽  
Card Model

It introduces the hardware design and implement of the image information collection system which is one part of Fluorescent magnetic particle nondestructive detection system of Cannonball. The image information collection system includes Open collecting card model Initialize collection card modelApply for EMS memory modelCollecting image modelWrite bitmap information head model Show pictures modeClose collection card model. Through collecting image information to the EMS memory and then processing the image information, the magnetic images on the cannonball are showed clearly on computer, and cracks on the cannonball can easily to be judged. The software of the image information collection system is developed by Visual C++.

Zigbee-Based Data Acquisition System for Manufacturing

2011 ◽  
Vol 323 ◽  
pp. 65-69
Author(s):  
Gang Hong ◽  
Xiao Qin Pan
Keyword(s):  
Data Acquisition ◽  
Software Design ◽  
Distribution System ◽  
Data Acquisition System ◽  
Reliable Data ◽  
Low Power Consumption ◽  
Information Collection ◽  
Network Nodes ◽  
Network Information ◽  
Zigbee Protocol

Data acquisition for manufacturing, designed and implemented based on ZigBee protocol wireless network information collection. The CC2430 chip as the master controller node, introduced the system of hardware and software design process to achieve a remote data acquisition. Distribution system, convenient, economical, low power consumption terminal nodes, network nodes, and more features. The results show that the system is stable and reliable data acquisition can be achieved.

The Design of Artificial Climate Chamber Environment Based on CAN Bus Data Acquisition System

2013 ◽  
Vol 765-767 ◽  
pp. 1693-1696
Author(s):  
Guo Zhuang Liang ◽  
Bo Zheng ◽  
Ying Zhang ◽  
Tao Ma
Keyword(s):  
Data Acquisition ◽  
Can Bus ◽  
Data Acquisition System ◽  
Acquisition System ◽  
Information Collection ◽  
Climate Chamber ◽  
Growth Environment ◽  
Time Performance ◽  
Running Cost ◽  
Interface Devices

Introduced a kind of based on CAN bus, to realization of artificial climate chamber environment data acquisition system. System adopts SJA1000, PCA82C520 as interface devices, the host through the CAN bus runs around in the culture room of all CAN nodes, each node through the installation of various sensors on plant growth environment factor for information collection and transmission. System has a good real-time performance, low running cost, easy to build, has broad application prospects.

The Equipment Maintenance Technology Research Based on Information

2014 ◽  
Vol 568-570 ◽  
pp. 278-283
Author(s):  
Yan Bin Zhang ◽  
Jiu He Ma ◽  
De Qing Guo
Keyword(s):  
Data Acquisition ◽  
Data Acquisition System ◽  
Acquisition System ◽  
Information Collection ◽  
Technology Research ◽  
Technical Maintenance ◽  
Technical Status ◽  
New Type ◽  
Status Information ◽  
Maintenance Characteristic

For the composing and the technical maintenance characteristic of new-type weapon, the BIT information collection technology is developed, and the multi-channel inlayed data acquisition system is established. The implement for equipment technical maintenance can be guided and helped by obtaining equipment technical status information from system, which achieves the science character and pertinence of equipment technical maintenance.

Sign in / Sign up

Export Citation Format

Share Document