Analyzing Data Streams in Scientific Applications

2009 ◽  
pp. 431-462
Author(s):  
LAKSHMI PRANEETHA

Now-a-days data streams or information streams are gigantic and quick changing. The usage of information streams can fluctuate from basic logical, scientific applications to vital business and money related ones. The useful information is abstracted from the stream and represented in the form of micro-clusters in the online phase. In offline phase micro-clusters are merged to form the macro clusters. DBSTREAM technique captures the density between micro-clusters by means of a shared density graph in the online phase. The density data in this graph is then used in reclustering for improving the formation of clusters but DBSTREAM takes more time in handling the corrupted data points In this paper an early pruning algorithm is used before pre-processing of information and a bloom filter is used for recognizing the corrupted information. Our experiments on real time datasets shows that using this approach improves the efficiency of macro-clusters by 90% and increases the generation of more number of micro-clusters within in a short time.


Author(s):  
Tore Risch ◽  
Samuel Madden ◽  
Hari Balakrishan ◽  
Lewis Girod ◽  
Ryan Newton ◽  
...  

2021 ◽  
Vol 13 (19) ◽  
pp. 3930
Author(s):  
Amy E. Frazier ◽  
Benjamin L. Hemingway

With the ability to capture daily imagery of Earth at very high spatial resolutions, commercial smallsats are emerging as a key resource for the remote sensing community. Planet (Planet Labs, Inc., San Francisco, CA, USA) operates the largest constellation of Earth imaging smallsats, which have been capturing multispectral imagery for consumer use since 2016. Use of these images is growing in the remote sensing community, but the variation in radiometric and geometric quality compared to traditional platforms (i.e., Landsat, MODIS, etc.) means the images are not always ‘analysis ready’ upon download. Neglecting these variations can impact derived products and analyses. Users also must contend with constantly evolving technology, which improves products but can create discrepancies across sensor generations. This communication provides a technical review of Planet’s PlanetScope smallsat data streams and extant literature to provide practical considerations to the remote sensing community for utilizing these images in remote sensing research. Radiometric and geometric issues for researchers to consider are highlighted alongside a review of processing completed by Planet and innovations being developed by the user community to foster the adoption and use of these images for scientific applications.


Sign in / Sign up

Export Citation Format

Share Document