MapReduce and YARN API

Apache Hadoop includes Java APIs for different functions on a HDFS file system like creation of a file, renaming, deletion, and to set read-write permissions for directories. This can be done on a single and cluster of systems. In addition, REST (REpresentational State Transfer) APIs is a collection of web services to provide interoperability between a single system and an interconnected distributed network. REST is chosen for its speedy performance, scalability, simplicity, and reliability. YARN REST and MapReduce REST APIs are briefly discussed in this chapter. YARN web service REST API includes URI resources through which the cluster information, nodes, and application information can be accessed. YARN is comprised of Resource manager, node manager, and timeline REST APIs. The application has HTTP request as resource and the response can be in the form XML or JSON. The request URI, response status, header, and body are defined in actual format. Similarly, the REST API is used for MapReduce that comprises the details about the jobs running with the information such as number of tasks, counters, and attempts. Hence, the REST APIs on YARN and resource manager create small modules as a response when a resource is requested. An outline of the research and growth of REST APIs is included in this chapter.

Author(s):  
Dr. Manish L Jivtode

Web services are applications that allow for communication between devices over the internet and are independent of the technology. The devices are built and use standardized eXtensible Markup Language (XML) for information exchange. A client or user is able to invoke a web service by sending an XML message and then gets back and XML response message. There are a number of communication protocols for web services that use the XML format such as Web Services Flow Language (WSFL), Blocks Extensible Exchange Protocol(BEEP) etc. Simple Object Access Protocol (SOAP) and Representational State Transfer (REST) are used options for accessing web services. It is not directly comparable that SOAP is a communications protocol while REST is a set of architectural principles for data transmission. In this paper, the data size of 1KB, 2KB, 4KB, 8KB and 16KB were tested each for Audio, Video and result obtained for CRUD methods. The encryption and decryption timings in milliseconds/seconds were recorded by programming extensibility points of a WCF REST web service in the Azure cloud..


Author(s):  
Dr. Manish L Jivtode

The Broker Architecture became popular involving client and server. Representational State Transfer(REST) architecture is the architecture of World Wide Web. REST uses HTTP protocol based on Servlet and ASMX technology is replaced by WCF web service technology. SOAP and REST are two kinds of WCF web services. REST is lightweight compared to SOAP and hence emerged as the popular technology for building distributed applications in the cloud. In this paper, conducted by exposing a HTTP endpoint address, HTTP relay binding (webHttpRelayBinding) and CRUD contract through interface. The interface is decorated using WebGet and WebInvoke attributes. WCF configuration file created using XML tags for use with REST web service.


2019 ◽  
Vol 7 (2) ◽  
pp. 37-46
Author(s):  
Mr Syafrial ◽  
Imam Teguh

Dinas Kependudukan dan Pencatatan Sipil Kota Bogor atau lebih dikenal Disdukcapil Kota Bogor merupakan salah satu instansi pemerintahan yang berada di bidang pelayanan masyarakat yang khususnya dalam bentuk pelayanan Administrasi Kependudukan Kartu Keluarga (KK) dan Kartu Tanda Penduduk (KTP). Kondisi saat ini yang terjadi adalah belum sepenuhnya berjalan dengan baik dan masih ditemuinya hambatan. Proses pembuatan KK dan KTP saat ini dimulai dari masyarakat mengisi formulir biodata yang berada dikelurahan dan memenuhi persyaratan yang ditetapkan. Setelah semua data telah lengkap pemohon diharuskan datang ke Kantor Disdukcapil untuk memproses permohonan cetak KK dan KTP. Waktu proses pembuatan KK adalah 7 hari kerja dan untuk KTP adalah maksimal 14 hari kerja apabila tidak ada kendala dimulai dari tanggal pendaftaran. Setelah tanggal yang ditentukan pemohon datang kembali ke kantor Disdukcapil untuk mengambil produk yang mereka cetak kemarin. Pada penelitian ini memanfaatkan metode Representational State Transfer (RESTFULL) Web Service. RESTFULL web service adalah metode teknologi yang menerapkan konsep perpindahan antar state yang menggunakan browser atau disebut juga mekanisme HTTP untuk menghubungkan aplikasi dengan aplikasi lain. Dalam hal ini metode RESTFULL digunakan sebagai akses data ke Database SIAK yang bertujuan untuk mempermudah prosedur permohonan pendaftaran KK dan KTP dan memberikan informasi yang terbaharui. Berdasarkan hasil pengujian yang telah dilakukan maka dapat disimpulkan bahwa secara fungsional seluruh proses pada sistem registrasi online kependudukan dengan menggunakan metode RESTFULL Web Service telah berjalan sesuai dengan yang diharapkan dan dapat mengurangi masyarakat yang datang langsung ke kantor Disdukcapil untuk melakukan permohonan KK dan KTP serta memberikan informasi yang actual.


2011 ◽  
Vol 135-136 ◽  
pp. 806-808 ◽  
Author(s):  
Hong Jun Li

In order to make the Web services, web sites in Java more powerful and flexible, building unified web applications is vital important. By introducing a new style─Representational State Transfer (REST), this paper studied the Java RESTful frameworks and the ways to develop Restful Web Service in Java. The RESTful frameworks in Java can effectively simplify the web development in many ways.


Author(s):  
José Renato Villela Dantas ◽  
Pedro Porfirio Muniz Farias

In the internet environment, web services based on representational state transfer (REST) have become the de facto standard. The addition of semantics is intended to enhance the description of web services with information that enables automatic agents to understand their data. However, the existence of different languages to semantically describe services makes it difficult to discover and select the service that best meets a requirement. Furthermore, relatively few proposals have a RESTful service semantic description, making the discovery process for RESTful services more difficult. This work proposes a RESTful semantic web service discovery architecture based on semantic interfaces (SERIN). SERIN is an ontology with annotations that semantically describe RESTful web services. This architecture enables software agents to automatically discover and make service calls in order to execute a determined task.


Competitive ◽  
2021 ◽  
Vol 16 (2) ◽  
pp. 87-94
Author(s):  
Supono Syafiq ◽  
Sari Armiati

Saat ini data merupakan bagian yang penting di era transformasi teknologi informasi, proses komunikasi pun tidak dibatasi oleh perbedaan jenis perangkat yang digunakan membuat informasi dapat diakses degan mudah. Saat ini Lembaga Penelitian dan Pengabdian kepada Masyarakat (LPPM) Politeknik Pos Indonesia sudah memiliki pangkalan data dalam proses pengelolaan data penelitian, pengabdian, publikasi dan HaKI berbasis web. Saat ini akses data APTIMAS masih terpusat dan tidak bisa diakses dengan menggunakan aplikasi selain aplikasi APTIMAS, sehingga dibutuhkan sebuah media middle ware atau web service yang memberikan solusi bagaiman aplikasi lain dapat mengkases data APTIMAS seperti untuk pengembangan aplikasi Mobile, dashboard di aplikasi lain, kebutuhan data lainnya. Oleh karena itu dibangunlah sebuah Web Service dengan arsitektur Representational State Transfer (REST) Application Programming Interface (API) yang berfungsi jembatan dalam memberikan layanan untuk komunikasi data. Dengan dibangunnya aplikasi middleware web service ini, diharapkan APTIMAS sebagai penyedia data penelitian, pengabdian, publikasi dan HaKI di lingkungan internal perguruan tinggi Politeknik Pos Inodoneisa dapat digunakan sebagai rujukan pengambilan data untuk pengembangan aplikasi lain dan kebutuhan data di lingkungan kampus Politeknik Pos Indonesia, tanpa harus mengakses langsung ke database APTIMAS


2018 ◽  
Vol 12 (3) ◽  
pp. 175 ◽  
Author(s):  
Festim Halili ◽  
Erenis Ramadani

The interest on Web services has been growing rapidly in these couple of years since their start of use. A web service would be described as a method for exchanging/communicating information between devices over a network. Often, when deciding which service would fit on the architecture design to develop a product, then the question rises which service to use and when?SOAP (Simple Object Access Protocol) and REST (Representational State Transfer) are the two most used protocols to exchange messages, so choosing one over the other has its own advantages and disadvantages. In this paper we have addressed the differences and best practices when to use one over the other.


Web Services are combination of open protocols and standards to allow communication between client and server. It provides an interoperability between contrasting applications. Representational state Transfer (REST) and Simple Object Access Protocol (SOAP) are the two main popular used web services now-a-days. REST is an architectural style based, whereas SOAP is a underlying protocol. Both services are used to handle the communication on the world wide web (www). Both services have some advantages and drawbacks and it is the decision of web developer to decide which service is best to use according to its requirements. The aim of this research work is to design a REST API and SOAP API by JAX-RS and JAX-WS, respectively and gives a comparative analysis of Application Programming Interface (API) features (in terms of response time, memory usage, execution speed and so on) of these services by using API testing tool like Postman. This gives insight view of which service is better to use as per requirements. The result of experiments shows that the response time of SOAP is approximate takes 4ms to 7ms more than REST. It has been observed that as number of API increases, SOAP takes approximate 1MB to 2MB more memory usage than REST


2020 ◽  
Vol 9 (4) ◽  
pp. 394-402
Author(s):  
Helmy ◽  
Athadhia Febyana ◽  
Agung Al Rasyid ◽  
Arif Nursyahid ◽  
Thomas Agung Setyawan ◽  
...  

Akuaponik merupakan penggabungan antara akuakultur dengan hidroponik. Salah satu sistem hidroponik yaitu sistem drip (tetes). Parameter yang perlu diperhatikan dalam budidaya akuaponik antara lain keasaman larutan nutrisi yaitu pH, suhu air, dan larutan nutrisi yang ditunjukkan oleh kepekatan zat padat terlarut dalam air (Total Dissolved Solids, TDS). Nutrisi tanaman diperoleh dari kotoran ikan yang mengandung nitrogen. Oleh karena itu, diperlukan pemantauan pH, TDS, dan suhu secara realtime dan pengendalian kelembapan tanah pada tanaman akuaponik agar tanaman tidak kekurangan nutrisi. Proses pengendalian menggunakan Representational State Transfer Application Programming Interface (REST API) dalam menerima nilai batas ambang yang ditentukan petani akuaponik melalui situs web dan mengirimkan nilai kelembapan tanah dan parameter kolam ikan berupa pH, suhu dan TDS ke server. Pengujian data loss dan delay pada sistem pemantauan dan pengendalian ini diperlukan untuk mengetahui keandalan alat dalam pengiriman dan penerimaan data. Selain itu, diperlukan notifikasi berupa e-mail kepada petani apabila nilai kelembapan tanah kurang dari batas ambang. Hasil pengujian menunjukkan sistem dapat mengirimkan notifikasi berupa e-mail kepada petani apabila nilai kelembapan tanah kurang dari batas ambang, rerata delay pemantauan node-gateway sebesar 6,01 detik, sedangkan rerata delay pemantauan gateway–server sebesar 10,02 detik, dan rerata delay pengendalian server–gateway sebesar 92,55 detik.


2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Fuad Sameh Alshraiedeh ◽  
Norliza Katuk

Purpose Many REpresentational State Transfer (RESTful) Web services suffered from anti-patterns problem, which may diminish the sustainability of the services. The anti-patterns problem could happen in the code of the programme or the uniform resource identifiers (URIs) of RESTful Web services. This study aims to address the problem by proposing a technique and an algorithm for detecting anti-patterns in RESTful Web services. Specifically, the technique is designed based on URIs parsing process. Design/methodology/approach The study was conducted following the design science research process, which has six activities, namely, identifying problems, identifying solutions, design the solutions, demonstrate the solution, evaluation and communicate the solution. The proposed technique was embedded in an algorithm and evaluated in four phases covering the process of extracting the URIs, implementing the anti-pattern detection algorithm, detecting the anti-patterns and validating the results. Findings The results of the study suggested an acceptable level of accuracy for the anti-patterns detection with 82.30% of precision, 87.86% of recall and 84.93% of F-measure. Practical implications The technique and the algorithm can be used by developers of RESTful Web services to detect possible anti-pattern occurrences in the service-based systems. Originality/value The technique is personalised to detect amorphous URI and ambiguous name anti-patterns in which it scans the Web service URIs using specified rules and compares them with pre-determined syntax and corpus.


Sign in / Sign up

Export Citation Format

Share Document