Parallel Cleaning Algorithm for Similar Duplicate Chinese Data Based on BERT

Data is an important source of knowledge discovery, but the existence of similar duplicate data not only increases the redundancy of the database but also affects the subsequent data mining work. Cleaning similar duplicate data is helpful to improve work efficiency. Based on the complexity of the Chinese language and the bottleneck of the single machine system to large-scale data computing performance, this paper proposes a Chinese data cleaning method that combines the BERT model and a k-means clustering algorithm and gives a parallel implementation scheme of the algorithm. In the process of text to vector, the position vector is introduced to obtain the context features of words, and the vector is dynamically adjusted according to the semantics so that the polysemous words can obtain different vector representations in different contexts. At the same time, the parallel implementation of the process is designed based on Hadoop. After that, k-means clustering algorithm is used to cluster similar duplicate data to achieve the purpose of cleaning. Experimental results on a variety of data sets show that the parallel cleaning algorithm proposed in this paper not only has good speedup and scalability but also improves the precision and recall of similar duplicate data cleaning, which will be of great significance for subsequent data mining.

A Lagrangian Backward Air Parcel Trajectories Clustering Framework

Many studies concerning atmosphere moisture paths use Lagrangian backward air parcel trajectories to determine the humidity sources for specific locations. Automatically grouping trajectories according to their geographical position simplifies and speeds up their analysis. In this paper, we propose a framework for clustering Lagrangian backward air parcel trajectories, from trajectory generation to cluster accuracy evaluation. We employ a novel clustering algorithm, called DenLAC, to cluster troposphere air currents trajectories. Our main contribution is representing trajectories as a one-dimensional array consisting of each trajectory’s points position vector directions. We empirically test our pipeline by employing it on several Lagrangian backward trajectories initiated from Břeclav District, Czech Republic.

A Different View on Dynamics of Space Curves Geometry

In this study, we define the X-torque curves, $$X-$$ X - equilibrium curves, X-moment conservative curves, $$X-$$ X - gyroscopic curves as new curves derived from a regular space curve by using the Frenet vectors of a space curve and its position vector, where $$X\in \left\{ T\left( s\right) , N\left( s\right) , B\left( s\right) \right\} $$ X ∈ T s , N s , B s and we examine these curves and we give their properties.

Land Subsidence Study Using Geodetic GPS and GAMIT/GLOBK Software (Case Study : Banjarasri Village and Kedungbanteng Village, Tanggulangin District, Sidoarjo Regency)

Floods are one of the natural disasters that always occur in various regions in the Republic of Indonesia. Several flood points were recorded in Banjarasri Village and Kedungbanteng Village, Tanggulangin District, Sidoarjo Regency. There is an allegation that one of the factors causing the flooding in the two villages was caused by land subsidence. Therefore, it is necessary to conduct a study to monitor the magnitude of land subsidence in the area. In this study, the Global Positioning System (GPS) observation method was used. The research was carried out by collecting data from six points which were carried out over three periods of time, namely on 22 - 27 October 2020, 24 - 29 November 2020, and 24 - 29 March 2021. Based on the results of processing and analyzing GPS data, the observed values for shift and motion vectors are obtained. There were five points of land subsidence statistically, which included BM02, BM03, BM04, BM05, and BM06 with values of respectively 3.6 cm, 7.3 cm, 5.9 cm, 4.8 cm, and 5.2 cm. The horizontal position vector moves in various ways, where BM01 and BM04 move to the southwest as far as 2.5 cm and 1.9 cm, BM05 moves to the southeast with a shift of 3.3 cm, and BM06 moves to the northeast with a shift of 4.2 cmFloods are one of the natural disasters that always occur in various regions in the Republic of Indonesia. Several flood points were recorded in Banjarasri Village and Kedungbanteng Village, Tanggulangin District, Sidoarjo Regency. There is an allegation that one of the factors causing the flooding in the two villages was caused by land subsidence. Therefore, it is necessary to conduct a study to monitor the magnitude of land subsidence in the area. In this study, the Global Positioning System (GPS) observation method was used. The research was carried out by collecting data from six points which were carried out over three periods of time, namely on 22 - 27 October 2020, 24 - 29 November 2020, and 24 - 29 March 2021. Based on the results of processing and analyzing GPS data, the observed values for shift and motion vectors are obtained. There were five points of land subsidence statistically, which included BM02, BM03, BM04, BM05, and BM06 with values of respectively 3.6 cm, 7.3 cm, 5.9 cm, 4.8 cm, and 5.2 cm. The horizontal position vector moves in various ways, where BM01 and BM04 move to the southwest as far as 2.5 cm and 1.9 cm, BM05 moves to the southeast with a shift of 3.3 cm, and BM06 moves to the northeast with a shift of 4.2 cm.

Characterization of Rectifying Curves by Their Involutes and Evolutes

A rectifying curve is a twisted curve with the property that all of its rectifying planes pass through a fixed point. If this point is the origin of the Cartesian coordinate system, then the position vector of the rectifying curve always lies in the rectifying plane. A remarkable property of these curves is that the ratio between torsion and curvature is a nonconstant linear function of the arc-length parameter. In this paper, we give a new characterization of rectifying curves, namely, we prove that a curve is a rectifying curve if and only if it has a spherical involute. Consequently, rectifying curves can be constructed as evolutes of spherical twisted curves; we present an illustrative example of a rectifying curve obtained as the evolute of a spherical helix. We also express the curvature and the torsion of a rectifying spherical curve and give necessary and sufficient conditions for a curve and its involute to be both rectifying curves.

On Backlund transformation and motion of null Cartan curves

The main scope of this paper is to examine null Cartan curves especially the ones with constant torsion. In accordance with this scope, the position vector of a null Cartan curve is stated by a linear combination of the vector fields of its pseudo-orthogonal frame with differentiable functions. However, the most important difference that distinguishes this study from the other studies is that the Bertrand curve couples (timelike, spacelike or null) of null Cartan curves are also examined. Consequently, it is seen that all kinds of Bertrand couples of a given null Cartan curve with constant curvature functions have also constant curvature functions. This result is the most valuable result of the study, but allows us to introduce a transformation on null Cartan curves. Then, it is proved that aforesaid transformation is a Backlund transformation which is well recognized in modern physics. Moreover, motion of an inextensible null Cartan curve is investigated. By considering time evolution of null Cartan curve, the angular momentum vector is examined. And three different situations are given depending on the character of the angular momentum vector [Formula: see text] In the case of [Formula: see text] we discuss the solution of the system which is obtained by compatibility conditions. Finally, we provide the relation between torsion of the curve and the velocity vector components of the moving curve [Formula: see text]

Hopf-type theorem for self-shrinkers

In this paper, we prove that a two-dimensional self-shrinker, homeomorphic to the sphere, immersed in the three-dimensional Euclidean space ℝ 3 {{\mathbb{R}}^{3}} is a round sphere, provided its mean curvature and the norm of the its position vector have an upper bound in terms of the norm of its traceless second fundamental form. The example constructed by Drugan justifies that the hypothesis on the second fundamental form is necessary. We can also prove the same kind of rigidity results for surfaces with parallel weighted mean curvature vector in ℝ n {{\mathbb{R}}^{n}} with radial weight. These results are applications of a new generalization of Cauchy’s Theorem in complex analysis which concludes that a complex function is identically zero or its zeroes are isolated if it satisfies some weak holomorphy.

Development a model of robot movement with five degrees of freedom for a warehouse

The object of research is a mathematical model describing the movement of a robot with five degrees of freedom for a warehouse. The work was aimed at analyzing the kinematic structure of the manipulator, on the basis of which the base and local coordinate systems were selected, as well as further formalized recording of the kinematic equations in matrix form. It is noted that one of the most problematic places is that the algorithms for controlling the robot most often contain local rules for the interaction of robots between themselves and the external environment, and emergent behavior is manifested as a result of the application of these rules, which does not have a formal description. Therefore, it is important to modernize the models describing the motion of a robot with five degrees of freedom for a warehouse. Using the matrix method, the sequence of constructing coordinate systems is described and its mathematical description is given, which will make it possible to eliminate this drawback in the future. The computer implementation of the developed algorithms was carried out using methods for processing matrix data structures. The principle of constructing a kinematic model of a robot is presented, with the help of which the main coordinate transformation matrices are obtained for robot with five degrees of freedom, and the possibility of taking into account the size of the gaps in the joints is shown. The resulting model is obtained, which is proposed for use in building control algorithms for a robot with an automatic gap selection, as well as in robot calibration. This is due to the fact that the proposed model has a number of features, in particular, the basic coordinate system and the coordinate system of each link of robot with five degrees of freedom are taken into account. This makes it possible to obtain the values of the indicators for the projection of the robot position vector in the initial state, in the rotation of the fourth link at a well-defined angle and in the case of a vertically straightened manipulator. Compared to similar known studies, this provides advantages such as minimizing errors in position, speed and motion accuracy. The object of research is a mathematical model describing the movement of a robot with five degrees of freedom for a warehouse. The work was aimed at analyzing the kinematic structure of the manipulator, on the basis of which the base and local coordinate systems were selected, as well as further formalized recording of the kinematic equations in matrix form. It is noted that one of the most problematic places is that the algorithms for controlling the robot most often contain local rules for the interaction of robots between themselves and the external environment, and emergent behavior is manifested as a result of the application of these rules, which does not have a formal description. Therefore, it is important to modernize the models describing the motion of a robot with five degrees of freedom for a warehouse. Using the matrix method, the sequence of constructing coordinate systems is described and its mathematical description is given, which will make it possible to eliminate this drawback in the future. The computer implementation of the developed algorithms was carried out using methods for processing matrix data structures. The principle of constructing a kinematic model of a robot is presented, with the help of which the main coordinate transformation matrices are obtained for robot with five degrees of freedom, and the possibility of taking into account the size of the gaps in the joints is shown. The resulting model is obtained, which is proposed for use in building control algorithms for a robot with an automatic gap selection, as well as in robot calibration. This is due to the fact that the proposed model has a number of features, in particular, the basic coordinate system and the coordinate system of each link of robot with five degrees of freedom are taken into account. This makes it possible to obtain the values of the indicators for the projection of the robot position vector in the initial state, in the rotation of the fourth link at a well-defined angle and in the case of a vertically straightened manipulator. Compared to similar known studies, this provides advantages such as minimizing errors in position, speed and motion accuracy.

A Cooperative Localization Method based on V2I Communication and Distance Information in Vehicular Networks

Relative positions are recent solutions to overcome the limited accuracy of GPS in urban environment. Vehicle positions obtained using V2I communication are more accurate because the known roadside unit (RSU) locations help predict errors in measurements over time. The accuracy of vehicle positions depends more on the number of RSUs; however, the high installation cost limits the use of this approach. It also depends on nonlinear localization nature. They were neglected in several research papers. In these studies, the accumulated errors increased with time due to the linearity localization problem. In the present study, a cooperative localization method based on V2I communication and distance information in vehicular networks is proposed for improving the estimates of vehicles’ initial positions. This method assumes that the virtual RSUs based on mobility measurements help reduce installation costs and facilitate in handling fault environments. The extended Kalman filter algorithm is a well-known estimator in nonlinear problem, but it requires well initial vehicle position vector and adaptive noise in measurements. Using the proposed method, vehicles’ initial positions can be estimated accurately. The experimental results confirm that the proposed method has superior accuracy than existing methods, giving a root mean square error of approximately 1 m. In addition, it is shown that virtual RSUs can assist in estimating initial positions in fault environments.

Path Recognition of the Regional Education Expansion Based on Improved Dragonfly Algorithm

To solve the problems of low recognition rate, high misrecognition rate, and long recognition time, the path recognition method of the regional education scale expansion based on the improved dragonfly algorithm is proposed. Through a variety of different behaviors utilized in the optimization process, the dragonfly algorithm model has been constructed. The step size and the position vector are introduced to update the dragonfly’s location. The dragonfly’s foraging behaviors are accurately simulated. Afterward, the dragonfly algorithm is combined with the flower authorization algorithm. The conversion probability is added, and the dragonfly’s global development ability is adjusted in real-time. Then, the dragonfly algorithm is improved. The improved dragonfly algorithm is employed to extract the features of the expansion path of the regional education scale. The improved support vector machine is utilized as a classifier to realize the recognition of the regional education scale expansion path. The experimental results denote that the proposed method has a high recognition rate of the regional education scale expansion path and can effectively reduce the misrecognition rate and shorten the recognition time.