Music Signal Recognition Based on the Mathematical and Physical Equation Inversion Method

Digitization and analysis processing technology of music signals is the core of digital music technology. The paper studies the music signal feature recognition technology based on the mathematical equation inversion method, which is aimed at designing a method that can help music learners in music learning and music composition. The paper firstly studies the modeling of music signal and its analysis and processing algorithm, combining the four elements of music sound, analyzing and extracting the characteristic parameters of notes, and establishing the mathematical model of single note signal and music score signal. The single note recognition algorithm is studied to extract the Mel frequency cepstrum coefficient of the signal and improve the DTW algorithm to achieve single note recognition. Based on the implementation of the single note algorithm, we combine the note temporal segmentation method based on the energy-entropy ratio to segment the music score into single note sequences to realize the music score recognition. The paper then goes on to study the music synthesis algorithm and perform simulations. The benchmark model demonstrates the positive correlation of pitch features on recognition through comparative experiments and explores the number of harmonics that should be attended to when recognizing different instruments. The attention network-based classification model draws on the properties of human auditory attention to improve the recognition scores of the main playing instruments and the overall recognition accuracy of all instruments. The two-stage classification model is divided into a first-stage classification model and a second-stage classification model, and the second-stage classification model consists of three residual networks, which are trained separately to specifically identify strings, winds, and percussions. This method has the highest recognition score and overall accuracy.

Optimization Research on Deep Learning and Temporal Segmentation Algorithm of Video Shot in Basketball Games

The analysis of the video shot in basketball games and the edge detection of the video shot are the most active and rapid development topics in the field of multimedia research in the world. Video shots’ temporal segmentation is based on video image frame extraction. It is the precondition for video application. Studying the temporal segmentation of basketball game video shots has great practical significance and application prospects. In view of the fact that the current algorithm has long segmentation time for the video shot of basketball games, the deep learning model and temporal segmentation algorithm based on the histogram for the video shot of the basketball game are proposed. The video data is converted from the RGB space to the HSV space by the boundary detection of the video shot of the basketball game using deep learning and processing of the image frames, in which the histogram statistics are used to reduce the dimension of the video image, and the three-color components in the video are combined into a one-dimensional feature vector to obtain the quantization level of the video. The one-dimensional vector is used as the variable to perform histogram statistics and analysis on the video shot and to calculate the continuous frame difference, the accumulated frame difference, the window frame difference, the adaptive window’s mean, and the superaverage ratio of the basketball game video. The calculation results are combined with the set dynamic threshold to optimize the temporal segmentation of the video shot in the basketball game. It can be seen from the comparison results that the effectiveness of the proposed algorithm is verified by the test of the missed detection rate of the video shots. According to the test result of the split time, the optimization algorithm for temporal segmentation of the video shot in the basketball game is efficiently implemented.

The Return of Nature to the Chernobyl Exclusion Zone: Increases in Forest Cover of 1.5 Times since the 1986 Disaster

For 34 years since the 1986 nuclear disaster, the Chernobyl Exclusion Zone (ChEZ) landscapes have been protected with very limited human interventions. Natural afforestation has largely occurred throughout the abandoned farmlands, while natural disturbance regimes, which dominantly include wildfires, have become more frequent and severe in the last years. Here, we utilize the dense time series of Landsat satellite imagery (1986–2020) processed by using the temporal segmentation algorithm LandTrendr in order to derive a robust land cover and forest mask product for the ChEZ. Additionally, we carried out an analysis of land cover transitions on the former farmlands. The Random Forest classification model developed here has achieved overall accuracies of 80% (using training data for 2017) and 89% on a binary “forest/non-forest” validation (using data from 1988). The total forest cover area within the ChEZ has increased from 41% (in 1986) to 59% (in 2020). This forest gain can be explained by the afforestation that has occurred in abandoned farmlands, which compensates for forest cover losses due to large fire events in 1992, 2015–2016, and 2020. Most transitions from open landscapes to dense forest cover occurred after the year 2000 and are possibly linked to past forest management practices. We conclude that a consistent forest strategy, with the aid of remote monitoring, is required to efficiently manage new forests in the ChEZ in order to retain their ecosystem functions and to ensure sustainable habitats.

Spatio-temporal feature learning with reservoir computing for T-cell segmentation in live-cell $$\hbox {Ca}^{2+}$$ fluorescence microscopy

Advances in high-resolution live-cell $$\hbox {Ca}^{2+}$$ Ca 2 + imaging enabled subcellular localization of early $$\hbox {Ca}^{2+}$$ Ca 2 + signaling events in T-cells and paved the way to investigate the interplay between receptors and potential target channels in $$\hbox {Ca}^{2+}$$ Ca 2 + release events. The huge amount of acquired data requires efficient, ideally automated image processing pipelines, with cell localization/segmentation as central tasks. Automated segmentation in live-cell cytosolic $$\hbox {Ca}^{2+}$$ Ca 2 + imaging data is, however, challenging due to temporal image intensity fluctuations, low signal-to-noise ratio, and photo-bleaching. Here, we propose a reservoir computing (RC) framework for efficient and temporally consistent segmentation. Experiments were conducted with Jurkat T-cells and anti-CD3 coated beads used for T-cell activation. We compared the RC performance with a standard U-Net and a convolutional long short-term memory (LSTM) model. The RC-based models (1) perform on par in terms of segmentation accuracy with the deep learning models for cell-only segmentation, but show improved temporal segmentation consistency compared to the U-Net; (2) outperform the U-Net for two-emission wavelengths image segmentation and differentiation of T-cells and beads; and (3) perform on par with the convolutional LSTM for single-emission wavelength T-cell/bead segmentation and differentiation. In turn, RC models contain only a fraction of the parameters of the baseline models and reduce the training time considerably.