scholarly journals PatchWarp: Corrections of non-uniform image distortions in two-photon calcium imaging data by patchwork affine transformations

2021 ◽  
Author(s):  
Ryoma Hattori ◽  
Takaki Komiyama
Keyword(s):  
Neural Activity ◽  
Calcium Imaging ◽  
Motion Correction ◽  
Extended Period ◽  
Affine Transformations ◽  
Imaging Data ◽  
Full Field ◽  
Two Photon ◽  
Automated Method ◽  
Wide Range

Two-photon microscopy has been widely used to record the activity of populations of individual neurons at high spatial resolution in behaving animals. The ability to perform imaging for an extended period of time allows the investigation of activity changes associated with behavioral states and learning. However, imaging often accompanies shifts of the imaging field, including rapid (~100ms) translation and slow, spatially non-uniform distortion. To combat this issue and obtain a stable time series of the target structures, motion correction algorithms are commonly applied. However, typical motion correction algorithms are limited to full field translation of images and are unable to correct non-uniform distortions. Here, we developed a novel algorithm, PatchWarp, to robustly correct slow image distortion for calcium imaging data. PatchWarp is a two-step algorithm with rigid and non-rigid image registrations. To correct non-uniform image distortions, it splits the imaging field and estimates the best affine transformation matrix for each of the subfields. The distortion-corrected subfields are stitched together like a patchwork to reconstruct the distortion-corrected imaging field. We show that PatchWarp robustly corrects image distortions of calcium imaging data collected from various cortical areas through glass window or GRIN lens with a higher accuracy than existing non-rigid algorithms. Furthermore, it provides a fully automated method of registering images from different imaging sessions for longitudinal neural activity analyses. PatchWarp improves the quality of neural activity analyses and would be useful as a general approach to correct image distortions in a wide range of disciplines.

scholarly journals Community-based benchmarking improves spike rate inference from two-photon calcium imaging data

2017 ◽  
Author(s):  
Philipp Berens ◽  
Jeremy Freeman ◽  
Thomas Deneux ◽  
Nicolay Chenkov ◽  
Thomas McColgan ◽  
...  
Keyword(s):  
Neural Activity ◽  
Calcium Imaging ◽  
Indirect Measurement ◽  
Generative Models ◽  
Imaging Data ◽  
Crowd Sourcing ◽  
Two Photon ◽  
Wide Range ◽  
Improved Performance ◽  
Highly Correlated

In recent years, two-photon calcium imaging has become a standard tool to probe the function of neural circuits and to study computations in neuronal populations. However, the acquired signal is only an indirect measurement of neural activity due to the comparatively slow dynamics of fluorescent calcium indicators. Different algorithms for estimating spike trains from noisy calcium measurements have been proposed in the past, but it is an open question how far performance can be improved. Here, we report the results of the spikefinder challenge, launched to catalyze the development of new spike inference algorithms through crowd-sourcing. We present ten of the submitted algorithms which show improved performance compared to previously evaluated methods. Interestingly, the top-performing algorithms are based on a wide range of principles from deep neural networks to generative models, yet provide highly correlated estimates of the neural activity. The competition shows that benchmark challenges can drive algorithmic developments in neuroscience.

scholarly journals NoRMCorre: An online algorithm for piecewise rigid motion correction of calcium imaging data

2017 ◽  
Author(s):  
Eftychios A. Pnevmatikakis ◽  
Andrea Giovannucci
Keyword(s):  
Calcium Imaging ◽  
Motion Correction ◽  
Rigid Motion ◽  
Motion Artifacts ◽  
Streaming Data ◽  
Field Of View ◽  
Large Field ◽  
Motion Field ◽  
Imaging Data ◽  
Two Photon

AbstractBackgroundMotion correction is a challenging pre-processing problem that arises early in the analysis pipeline of calcium imaging data sequences. The motion artifacts in two-photon microscopy recordings can be non-rigid, arising from the finite time of raster scanning and non-uniform deformations of the brain medium.New methodWe introduce an algorithm for fast Non-Rigid Motion Correction (NoRMCorre) based on template matching. NoRMCorre operates by splitting the field of view into overlapping spatial patches that are registered at a sub-pixel resolution for rigid translation against a continuously updated template. The estimated alignments are subsequently up-sampled to create a smooth motion field for each frame that can efficiently approximate non-rigid motion in a piecewise-rigid manner.Existing methodsExisting approaches either do not scale well in terms of computational performance or are targeted to motion artifacts arising from low speed scanning, whereas modern datasets with large field of view are more prone to non-rigid brain deformation issues.ResultsNoRMCorre can be run in an online mode resulting in comparable to or even faster than real time motion registration on streaming data. We evaluate the performance of the proposed method with simple yet intuitive metrics and compare against other non-rigid registration methods on two-photon calcium imaging datasets. Open source Matlab and Python code is also made available.ConclusionsThe proposed method and code provide valuable support to the community for solving large scale image registration problems in calcium imaging, especially when non-rigid deformations are present in the acquired data.

scholarly journals Community-based benchmarking improves spike rate inference from two-photon calcium imaging data

2018 ◽  
Vol 14 (5) ◽  
pp. e1006157 ◽  
Author(s):  
Philipp Berens ◽  
Jeremy Freeman ◽  
Thomas Deneux ◽  
Nikolay Chenkov ◽  
Thomas McColgan ◽  
...  
Keyword(s):  
Calcium Imaging ◽  
Spike Rate ◽  
Imaging Data ◽  
Community Based ◽  
Two Photon

scholarly journals Ultra-fast accurate reconstruction of spiking activity from calcium imaging data

2018 ◽  
Vol 119 (5) ◽  
pp. 1863-1878 ◽  
Author(s):  
Vahid Rahmati ◽  
Knut Kirmse ◽  
Knut Holthoff ◽  
Stefan J. Kiebel
Keyword(s):  
Calcium Imaging ◽  
Reconstruction Method ◽  
Imaging Data ◽  
Decay Kinetics ◽  
Experimental Conditions ◽  
Model Free ◽  
Reconstruction Methods ◽  
Wide Range ◽  
Fast Processing ◽  
Spiking Activity

Calcium imaging provides an indirect observation of the underlying neural dynamics and enables the functional analysis of neuronal populations. However, the recorded fluorescence traces are temporally smeared, thus making the reconstruction of exact spiking activity challenging. Most of the established methods to tackle this issue are limited in dealing with issues such as the variability in the kinetics of fluorescence transients, fast processing of long-term data, high firing rates, and measurement noise. We propose a novel, heuristic reconstruction method to overcome these limitations. By using both synthetic and experimental data, we demonstrate the four main features of this method: 1) it accurately reconstructs both isolated spikes and within-burst spikes, and the spike count per fluorescence transient, from a given noisy fluorescence trace; 2) it performs the reconstruction of a trace extracted from 1,000,000 frames in less than 2 s; 3) it adapts to transients with different rise and decay kinetics or amplitudes, both within and across single neurons; and 4) it has only one key parameter, which we will show can be set in a nearly automatic way to an approximately optimal value. Furthermore, we demonstrate the ability of the method to effectively correct for fast and rather complex, slowly varying drifts as frequently observed in in vivo data. NEW & NOTEWORTHY Reconstruction of spiking activities from calcium imaging data remains challenging. Most of the established reconstruction methods not only have limitations in adapting to systematic variations in the data and fast processing of large amounts of data, but their results also depend on the user’s experience. To overcome these limitations, we present a novel, heuristic model-free-type method that enables an ultra-fast, accurate, near-automatic reconstruction from data recorded under a wide range of experimental conditions.

scholarly journals CosMIC: A Consistent Metric for Spike Inference from Calcium Imaging

2017 ◽  
Author(s):  
Stephanie Reynolds ◽  
Therese Abrahamsson ◽  
P. Jesper Sjöström ◽  
Simon R. Schultz ◽  
Pier Luigi Dragotti
Keyword(s):  
Spike Train ◽  
Success Rate ◽  
Calcium Imaging ◽  
Ground Truth ◽  
Spike Trains ◽  
Imaging Data ◽  
Temporal Precision ◽  
Pulse Trains ◽  
Two Photon ◽  
Average Size

AbstractIn recent years, the development of algorithms to detect neuronal spiking activity from two-photon calcium imaging data has received much attention. Meanwhile, few researchers have examined the metrics used to assess the similarity of detected spike trains with the ground truth. We highlight the limitations of the two most commonly used metrics, the spike train correlation and success rate, and propose an alternative, which we refer to as CosMIC. Rather than operating on the true and estimated spike trains directly, the proposed metric assesses the similarity of the pulse trains obtained from convolution of the spike trains with a smoothing pulse. The pulse width, which is derived from the statistics of the imaging data, reflects the temporal tolerance of the metric. The final metric score is the size of the commonalities of the pulse trains as a fraction of their average size. Viewed through the lens of set theory, CosMIC resembles a continuous Sørensen-Dice coefficient — an index commonly used to assess the similarity of discrete, presence/absence data. We demonstrate the ability of the proposed metric to discriminate the precision and recall of spike train estimates. Unlike the spike train correlation, which appears to reward overestimation, the proposed metric score is maximised when the correct number of spikes have been detected. Furthermore, we show that CosMIC is more sensitive to the temporal precision of estimates than the success rate.

scholarly journals Interpreting wide-band neural activity using convolutional neural networks

eLife ◽  
2021 ◽  
Vol 10 ◽  
Author(s):  
Markus Frey ◽  
Sander Tanni ◽  
Catherine Perrodin ◽  
Alice O'Leary ◽  
Matthias Nau ◽  
...  
Keyword(s):  
Neural Activity ◽  
Calcium Imaging ◽  
Wide Band ◽  
Brain Regions ◽  
Imaging Data ◽  
User Input ◽  
Neural Recordings ◽  
Learning Framework ◽  
Behavioral Variables ◽  
Spatial Behaviors

Rapid progress in technologies such as calcium imaging and electrophysiology has seen a dramatic increase in the size and extent of neural recordings. Even so, interpretation of this data requires considerable knowledge about the nature of the representation and often depends on manual operations. Decoding provides a means to infer the information content of such recordings but typically requires highly processed data and prior knowledge of the encoding scheme. Here, we developed a deep-learning framework able to decode sensory and behavioral variables directly from wide-band neural data. The network requires little user input and generalizes across stimuli, behaviors, brain regions, and recording techniques. Once trained, it can be analyzed to determine elements of the neural code that are informative about a given variable. We validated this approach using electrophysiological and calcium-imaging data from rodent auditory cortex and hippocampus as well as human electrocorticography (ECoG) data. We show successful decoding of finger movement, auditory stimuli, and spatial behaviors – including a novel representation of head direction - from raw neural activity.

scholarly journals ABLE: An Activity-Based Level Set Segmentation Algorithm for Two-Photon Calcium Imaging Data

eNeuro ◽  
2017 ◽  
Vol 4 (5) ◽  
pp. ENEURO.0012-17.2017 ◽  
Author(s):  
Stephanie Reynolds ◽  
Therese Abrahamsson ◽  
Renaud Schuck ◽  
P. Jesper Sjöström ◽  
Simon R. Schultz ◽  
...  
Keyword(s):  
Level Set ◽  
Calcium Imaging ◽  
Segmentation Algorithm ◽  
Imaging Data ◽  
Two Photon ◽  
Level Set Segmentation

scholarly journals Denoising Two-Photon Calcium Imaging Data

PLoS ONE ◽  
2011 ◽  
Vol 6 (6) ◽  
pp. e20490 ◽  
Author(s):  
Wasim Q. Malik ◽  
James Schummers ◽  
Mriganka Sur ◽  
Emery N. Brown
Keyword(s):  
Calcium Imaging ◽  
Imaging Data ◽  
Two Photon

scholarly journals CosMIC: A Consistent Metric for Spike Inference from Calcium Imaging

2018 ◽  
Vol 30 (10) ◽  
pp. 2726-2756 ◽  
Author(s):  
Stephanie Reynolds ◽  
Therese Abrahamsson ◽  
Per Jesper Sjöström ◽  
Simon R. Schultz ◽  
Pier Luigi Dragotti
Keyword(s):  
Spike Train ◽  
Success Rate ◽  
Calcium Imaging ◽  
Ground Truth ◽  
Spike Trains ◽  
Imaging Data ◽  
Temporal Precision ◽  
Pulse Trains ◽  
Two Photon ◽  
Average Size

In recent years, the development of algorithms to detect neuronal spiking activity from two-photon calcium imaging data has received much attention, yet few researchers have examined the metrics used to assess the similarity of detected spike trains with the ground truth. We highlight the limitations of the two most commonly used metrics, the spike train correlation and success rate, and propose an alternative, which we refer to as CosMIC. Rather than operating on the true and estimated spike trains directly, the proposed metric assesses the similarity of the pulse trains obtained from convolution of the spike trains with a smoothing pulse. The pulse width, which is derived from the statistics of the imaging data, reflects the temporal tolerance of the metric. The final metric score is the size of the commonalities of the pulse trains as a fraction of their average size. Viewed through the lens of set theory, CosMIC resembles a continuous Sørensen-Dice coefficient—an index commonly used to assess the similarity of discrete, presence/absence data. We demonstrate the ability of the proposed metric to discriminate the precision and recall of spike train estimates. Unlike the spike train correlation, which appears to reward overestimation, the proposed metric score is maximized when the correct number of spikes have been detected. Furthermore, we show that CosMIC is more sensitive to the temporal precision of estimates than the success rate.

Sign in / Sign up

Export Citation Format

Share Document