Maintaining data consistency using timestamp ordering in real-time broadcast environments

Author(s):  
V.C.S. Lee ◽  
Kwok-Wa Lam ◽  
S.H. Son
Author(s):  
Neng Huang ◽  
Junxing Zhu ◽  
Chaonian Guo ◽  
Shuhan Cheng ◽  
Xiaoyong Li

With the rapid development of mobile Internet, there is a higher demand for the real-time, reliability and availability of information systems and to prevent the possible systemic risks of information systems, various business consistency standards and regulatory guidelines have been published, such as Recovery Time Object (RTO) and Recovery Point Object (RPO). Some of the current related researches focus on the standards, methods, management tools and technical frameworks of business consistency, while others study the data consistency algorithms in the cases of large data, cloud computing and distributed storage. However, few researchers have studied on how to monitor the data consistency and RPO of production-disaster recovery, and what architecture and technology should be applied in the monitoring. Moreover, in some information systems, due to the complex structures and distributions of data, it is difficult for traditional methods to quickly detect and accurately locate the first error data. Besides, due to the separation of production data center (PDC) and disaster recovery data center (DRDC), it is difficult to calculate the data difference and RPO between the two centers. This paper first discusses the architecture of remote distributed DRDCs. The architecture can make the disaster recovery (DR) system always online and the data always readable, and support the real-time monitoring of data availability, consistency as well as other related indicators, in this way to make DRDC out-of-the-box in disasters. Second, inspired by blockchain, this paper proposes a method to realize real-time monitoring of data consistency and RTO by building hash chains for PDC and DRDC. Third, this paper evaluates the hash chain operations from the algorithm time complexity, the data consistency, and the validity of RPO monitoring algorithms and since DR system is actually a kind of distributed system, the proposed approach can also be applied to the data consistency detection and data difference monitoring in other distributed systems.


2019 ◽  
Vol 11 (1) ◽  
pp. 1
Author(s):  
Bagus Jati Santoso ◽  
F.X. Arunanto ◽  
Siti Rochimah ◽  
Dini Adni Navastara

For all real-time industrial processes in a company, the entire system must be well-controlled to ensure an effective, efficient and reliable operations. Therefore, several electronic instruments are needed to measure physical quantities, such as temperature, pressure and others. As in one of the largest liquefaction natural gas processing company in Indonesia which involves highly extensive production processes, the existence of electronic instruments is unquestionably essential to ensure the progression of the production process while avoiding risks.To increase the speed, accuracy and quality of data over the electrical instrument in the company, it is necessary to build an electronic instrument data processing application system, called the Electronic Instrument Database System (ELIDA), so that it can provide convenience for the users in managing and monitoring the data of electronic instrument. The built ELIDA system will be integrated with several existing Oracle-based systems, including EBS-SCM for supply chain management, EBS-EAM for Enterprise Asset Management, and Oracle HRMS for human resource management so that the data consistency and the operational smoothness of the company can be ensured.Keywords : electronic instrument, database, application  AbstrakUntuk semua proses yang berjalan real-time di perusahaan, keseluruhan sistem harus dikendalikan secara baik untuk menjamin operasional yang efektif, efisien, dan handal. Karenanya, beberapa perangkat instrumen elektronik diperlukan untuk mengukur kuantitas fisikal seperti temperatur, tekanan, dan lainnya. Tak terkecuali di salah satu perusahaan pengolahan gas alam cair terbesar di Indonesia dimana melibatkan proses produksi yang sangat panjang, keberadaan perangkat instrumen elektronik mutlak diperlukan untuk menjamin jalannya proses produksi sekaligus menghindarkan terjadinya resiko.Dalam upaya peningkatan kecepatan, keakurasian, dan kualitas data-data instrumen di perusahaan tersebut, perlu dibangun sistem aplikasi pengolahan data instrument elektronik, atau disebut Electronic Instrument Database System (ELIDA), sehingga dapat memberikan kemudahan bagi pengguna data-data instrumen elektronik untuk melakukan pengelolaan dan pemantauan. Sistem ELIDA yang dibangun akan menggunakan framework Spring Hibernate dan terintegrasi dengan beberapa sistem berbasis Oracle yang sudah berjalan sebelumnya, diantaranya EBS-SCM untuk manajemen rantai pasok, EBS-EAM untuk manajamen aset perlengkapan, dan Oracle HRMS untuk manajemen sumber daya manusia sehingga konsistensi data dan kelancaran operasional perusahaan dapat terjamin.Kata Kunci: instrumen elektronik, basis data, aplikasi


2019 ◽  
Vol 18 (4) ◽  
pp. 1-28
Author(s):  
Zaid Al-bayati ◽  
Youcheng Sun ◽  
Haibo Zeng ◽  
Marco Di Natale ◽  
Qi Zhu ◽  
...  

2012 ◽  
Vol 532-533 ◽  
pp. 1172-1176
Author(s):  
Wei Wang ◽  
Shi Qun Yin

In order to raise speed of reading data from disk array memory, scientific and technological personnel have introduced cache technology into disk array. Since this technique has been invented, although the efficiency of reading data have been solved, after writing operation of countless times in disk cache, data consistency problem has been prominent expression. Especially in this condition that false of electricity and machine abnormal failure, the consistency of the data is more difficult to guarantee. In this paper, we adopt Non-Volatile RAM (NVRAM) devices to realize that the data will not be lost in disk array cache after power failure. Here we design a kind of new cache organizational structure. We firstly introduce cache structure of two tables (real-time mapping table, backup mapping table) and a cache backup block. Then through these two tables, we can work to recover data through the copy between the two tables in the macroscopic, and in the microscopic through cache backup block can backup the cache data from writing failure. As power failure and system breakdown, we can ensure that data will not easily lose and the original data can recovery after system crash by this technology. Thus it ensures the consistency of the data cache.


Sign in / Sign up

Export Citation Format

Share Document