scholarly journals Financial Volatility Forecasting: A Sparse Multi-Head Attention Neural Network

Information ◽  
2021 ◽  
Vol 12 (10) ◽  
pp. 419
Author(s):  
Hualing Lin ◽  
Qiubi Sun

Accurately predicting the volatility of financial asset prices and exploring its laws of movement have profound theoretical and practical guiding significance for financial market risk early warning, asset pricing, and investment portfolio design. The traditional methods are plagued by the problem of substandard prediction performance or gradient optimization. This paper proposes a novel volatility prediction method based on sparse multi-head attention (SP-M-Attention). This model discards the two-dimensional modeling strategy of time and space of the classic deep learning model. Instead, the solution is to embed a sparse multi-head attention calculation module in the network. The main advantages are that (i) it uses the inherent advantages of the multi-head attention mechanism to achieve parallel computing, (ii) it reduces the computational complexity through sparse measurements and feature compression of volatility, and (iii) it avoids the gradient problems caused by long-range propagation and therefore, is more suitable than traditional methods for the task of analysis of long time series. In the end, the article conducts an empirical study on the effectiveness of the proposed method through real datasets of major financial markets. Experimental results show that the prediction performance of the proposed model on all real datasets surpasses all benchmark models. This discovery will aid financial risk management and the optimization of investment strategies.

2019 ◽  
pp. 48-76 ◽  
Author(s):  
Alexander E. Abramov ◽  
Alexander D. Radygin ◽  
Maria I. Chernova

The article analyzes the problems of applying stock pricing models in the Russian stock market. The novelty of the study lies in the peculiarities of the methodology used and the substantive conclusions on the specifics of the influence of fundamental factors on the pricing of shares of Russian companies. The study was conducted using its own 5-factor basic pricing model based on a sample of the most complete number of issues of shares of Russian issuers and a long time horizon, from 1997 to 2017. The market portfolio was the widest for a set of issuers. We consider the factor model as a kind of universal indicator of the efficiency of the stock market performance of its functions. The article confirms the significance of factors of a broad market portfolio, size, liquidity and, in part, momentum (inertia). However, starting from 2011, the significance of factors began to decrease as the qualitative characteristics of the stock market deteriorated due to the outflow of foreign portfolio investment, combined with the low level of development of domestic institutional investors. Also identified is the cyclical nature of the actions of company size and liquidity factors. Their ability to generate additional income on shares rises mainly at the stage of the fall of the stock market. The results of the study suggest that as domestic institutional investors develop on the Russian stock market, factor investment strategies can be used as a tool to increase the return on investor portfolios.


2020 ◽  
Vol 15 ◽  
Author(s):  
Shulin Zhao ◽  
Ying Ju ◽  
Xiucai Ye ◽  
Jun Zhang ◽  
Shuguang Han

Background: Bioluminescence is a unique and significant phenomenon in nature. Bioluminescence is important for the lifecycle of some organisms and is valuable in biomedical research, including for gene expression analysis and bioluminescence imaging technology.In recent years, researchers have identified a number of methods for predicting bioluminescent proteins (BLPs), which have increased in accuracy, but could be further improved. Method: In this paper, we propose a new bioluminescent proteins prediction method based on a voting algorithm. We used four methods of feature extraction based on the amino acid sequence. We extracted 314 dimensional features in total from amino acid composition, physicochemical properties and k-spacer amino acid pair composition. In order to obtain the highest MCC value to establish the optimal prediction model, then used a voting algorithm to build the model.To create the best performing model, we discuss the selection of base classifiers and vote counting rules. Results: Our proposed model achieved 93.4% accuracy, 93.4% sensitivity and 91.7% specificity in the test set, which was better than any other method. We also improved a previous prediction of bioluminescent proteins in three lineages using our model building method, resulting in greatly improved accuracy.


2021 ◽  
Vol 11 (5) ◽  
pp. 2083
Author(s):  
Jia Xie ◽  
Zhu Wang ◽  
Zhiwen Yu ◽  
Bin Guo ◽  
Xingshe Zhou

Ischemic stroke is one of the typical chronic diseases caused by the degeneration of the neural system, which usually leads to great damages to human beings and reduces life quality significantly. Thereby, it is crucial to extract useful predictors from physiological signals, and further diagnose or predict ischemic stroke when there are no apparent symptoms. Specifically, in this study, we put forward a novel prediction method by exploring sleep related features. First, to characterize the pattern of ischemic stroke accurately, we extract a set of effective features from several aspects, including clinical features, fine-grained sleep structure-related features and electroencephalogram-related features. Second, a two-step prediction model is designed, which combines commonly used classifiers and a data filter model together to optimize the prediction result. We evaluate the framework using a real polysomnogram dataset that contains 20 stroke patients and 159 healthy individuals. Experimental results demonstrate that the proposed model can predict stroke events effectively, and the Precision, Recall, Precision Recall Curve and Area Under the Curve are 63%, 85%, 0.773 and 0.919, respectively.


2021 ◽  
Vol 3 (4) ◽  
Author(s):  
Jianlei Zhang ◽  
Yukun Zeng ◽  
Binil Starly

AbstractData-driven approaches for machine tool wear diagnosis and prognosis are gaining attention in the past few years. The goal of our study is to advance the adaptability, flexibility, prediction performance, and prediction horizon for online monitoring and prediction. This paper proposes the use of a recent deep learning method, based on Gated Recurrent Neural Network architecture, including Long Short Term Memory (LSTM), which try to captures long-term dependencies than regular Recurrent Neural Network method for modeling sequential data, and also the mechanism to realize the online diagnosis and prognosis and remaining useful life (RUL) prediction with indirect measurement collected during the manufacturing process. Existing models are usually tool-specific and can hardly be generalized to other scenarios such as for different tools or operating environments. Different from current methods, the proposed model requires no prior knowledge about the system and thus can be generalized to different scenarios and machine tools. With inherent memory units, the proposed model can also capture long-term dependencies while learning from sequential data such as those collected by condition monitoring sensors, which means it can be accommodated to machine tools with varying life and increase the prediction performance. To prove the validity of the proposed approach, we conducted multiple experiments on a milling machine cutting tool and applied the model for online diagnosis and RUL prediction. Without loss of generality, we incorporate a system transition function and system observation function into the neural net and trained it with signal data from a minimally intrusive vibration sensor. The experiment results showed that our LSTM-based model achieved the best overall accuracy among other methods, with a minimal Mean Square Error (MSE) for tool wear prediction and RUL prediction respectively.


2021 ◽  
Vol 11 (13) ◽  
pp. 6017
Author(s):  
Gerivan Santos Junior ◽  
Janderson Ferreira ◽  
Cristian Millán-Arias ◽  
Ramiro Daniel ◽  
Alberto Casado Junior ◽  
...  

Cracks are pathologies whose appearance in ceramic tiles can cause various damages due to the coating system losing water tightness and impermeability functions. Besides, the detachment of a ceramic plate, exposing the building structure, can still reach people who move around the building. Manual inspection is the most common method for addressing this problem. However, it depends on the knowledge and experience of those who perform the analysis and demands a long time and a high cost to map the entire area. This work focuses on automated optical inspection to find faults in ceramic tiles performing the segmentation of cracks in ceramic images using deep learning to segment these defects. We propose an architecture for segmenting cracks in facades with Deep Learning that includes an image pre-processing step. We also propose the Ceramic Crack Database, a set of images to segment defects in ceramic tiles. The proposed model can adequately identify the crack even when it is close to or within the grout.


Author(s):  
Zubair Ahmad Ahmad ◽  
Eisa Mahmoudi Mahmoudi ◽  
G. G. Hamedani

Actuaries are often in search of nding an adequate loss model in the scenario of actuarial and financial risk management problems. In this work, we propose a new approach to obtain a new class of loss distributions. A special sub-model of the proposed family, called the Weibull-loss model isconsidered in detail. Some mathematical properties are derived and maximum likelihood estimates of the model parameters are obtained. Certain characterizations of the proposed family are also provided. A simulation study is done to evaluate the performance of the maximum likelihood estimators. Finally, an application of the proposed model to the vehicle insurance loss data set is presented.


2020 ◽  
Vol 328 ◽  
pp. 01009
Author(s):  
František Világi ◽  
Branislav Knížat ◽  
Róbert Olšiak ◽  
Marek Mlkvik ◽  
Peter Mlynár ◽  
...  

The natural circulation helium loop is an experimental facility designed for the research of the possibility of utilizing natural convection cooling for the case of decay heat removal from a fast nuclear reactor. This concept would bring an improved automated safety system for future nuclear power plants operating a gas-cooled reactor. The article presents a new possibility of direct use of energy conservation laws in a 1D simulation of natural circulation loops. The calculation is performed by a triple iteration process, nested into each other. The results of the calculations showed good agreement with the measurements at steady state. A calculation with the proposed model at unsteady state is not yet possible, especially because of the exclusion of heat accumulation into the material.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Wen-ze Wu ◽  
Wanli Xie ◽  
Chong Liu ◽  
Tao Zhang

PurposeA new method for forecasting wind turbine capacity of China is proposed through grey modelling technique.Design/methodology/approachFirst of all, the concepts of discrete grey model are introduced into the NGBM(1,1) model to reduce the discretization error from the differential equation to its discrete forms. Then incorporating the conformable fractional accumulation into the discrete NGBM(1,1) model is carried out to further improve the predictive performance. Finally, in order to effectively seek the emerging coefficients, namely, fractional order and nonlinear coefficient, the whale optimization algorithm (WOA) is employed to determine the emerging coefficients.FindingsThe empirical results show that the newly proposed model has a better prediction performance compared to benchmark models; the wind turbine capacity from 2019 to 2021 is expected to reach 275954.42 Megawatts in 2021. According to the forecasts, policy suggestions are provided for policy-makers.Originality/valueBy combing the fractional accumulation and the concepts of discrete grey model, a new method to improve the prediction performance of the NGBM(1,1) model is proposed. The newly proposed model is firstly applied to predict wind turbine capacity of China.


Author(s):  
Eric S. Fung ◽  
Wai-Ki Ching ◽  
Tak-Kuen Siu

In financial forecasting, a long-standing challenging issue is to develop an appropriate model for forecasting long-term risk management of enterprises. In this chapter, using financial markets as an example, we introduce a mixture price trend model for long-term forecasts of financial asset prices with a view to applying it for long-term financial risk management. The key idea of the mixture price trend model is to provide a general and flexible way to incorporate various price trend behaviors and to extract information from price trends for long-term forecasting. Indeed, the mixture price trend model can incorporate model uncertainty in the price trend model, which is a key element for risk management and is overlooked in some of the current literatures. The mixture price trend model also allows the incorporation of users’ subjective views on long-term price trends. An efficient estimation method is introduced. Statistical analysis of the proposed model based on real data will be conducted to illustrate the performance of the model.


2019 ◽  
Vol 2019 ◽  
pp. 1-6 ◽  
Author(s):  
Wen-Ze Wu ◽  
Jianming Jiang ◽  
Qi Li

This paper aims to further increase the prediction accuracy of the grey model based on the existing discrete grey model, DGM(1,1). Herein, we begin by studying the connection between forecasts and the first entry of the original series. The results comprehensively show that the forecasts are independent of the first entry in the original series. On this basis, an effective method of inserting an arbitrary number in front of the first item of the original series to extract messages is applied to produce a novel grey model, which is abbreviated as FDGM(1,1) for simplicity. Incidentally, the proposed model can even forecast future data using only three historical data. To demonstrate the effectiveness of the proposed model, two classical examples of the tensile strength and life of the product are employed in this paper. The numerical results indicate that FDGM(1,1) has a better prediction performance than most commonly used grey models.


Sign in / Sign up

Export Citation Format

Share Document