scholarly journals Community-based benchmarking improves spike rate inference from two-photon calcium imaging data

2017 ◽  
Author(s):  
Philipp Berens ◽  
Jeremy Freeman ◽  
Thomas Deneux ◽  
Nicolay Chenkov ◽  
Thomas McColgan ◽  
...  
Keyword(s):  
Neural Activity ◽  
Calcium Imaging ◽  
Indirect Measurement ◽  
Generative Models ◽  
Imaging Data ◽  
Crowd Sourcing ◽  
Two Photon ◽  
Wide Range ◽  
Improved Performance ◽  
Highly Correlated

In recent years, two-photon calcium imaging has become a standard tool to probe the function of neural circuits and to study computations in neuronal populations. However, the acquired signal is only an indirect measurement of neural activity due to the comparatively slow dynamics of fluorescent calcium indicators. Different algorithms for estimating spike trains from noisy calcium measurements have been proposed in the past, but it is an open question how far performance can be improved. Here, we report the results of the spikefinder challenge, launched to catalyze the development of new spike inference algorithms through crowd-sourcing. We present ten of the submitted algorithms which show improved performance compared to previously evaluated methods. Interestingly, the top-performing algorithms are based on a wide range of principles from deep neural networks to generative models, yet provide highly correlated estimates of the neural activity. The competition shows that benchmark challenges can drive algorithmic developments in neuroscience.

scholarly journals PatchWarp: Corrections of non-uniform image distortions in two-photon calcium imaging data by patchwork affine transformations

2021 ◽  
Author(s):  
Ryoma Hattori ◽  
Takaki Komiyama
Keyword(s):  
Neural Activity ◽  
Calcium Imaging ◽  
Motion Correction ◽  
Extended Period ◽  
Affine Transformations ◽  
Imaging Data ◽  
Full Field ◽  
Two Photon ◽  
Automated Method ◽  
Wide Range

Two-photon microscopy has been widely used to record the activity of populations of individual neurons at high spatial resolution in behaving animals. The ability to perform imaging for an extended period of time allows the investigation of activity changes associated with behavioral states and learning. However, imaging often accompanies shifts of the imaging field, including rapid (~100ms) translation and slow, spatially non-uniform distortion. To combat this issue and obtain a stable time series of the target structures, motion correction algorithms are commonly applied. However, typical motion correction algorithms are limited to full field translation of images and are unable to correct non-uniform distortions. Here, we developed a novel algorithm, PatchWarp, to robustly correct slow image distortion for calcium imaging data. PatchWarp is a two-step algorithm with rigid and non-rigid image registrations. To correct non-uniform image distortions, it splits the imaging field and estimates the best affine transformation matrix for each of the subfields. The distortion-corrected subfields are stitched together like a patchwork to reconstruct the distortion-corrected imaging field. We show that PatchWarp robustly corrects image distortions of calcium imaging data collected from various cortical areas through glass window or GRIN lens with a higher accuracy than existing non-rigid algorithms. Furthermore, it provides a fully automated method of registering images from different imaging sessions for longitudinal neural activity analyses. PatchWarp improves the quality of neural activity analyses and would be useful as a general approach to correct image distortions in a wide range of disciplines.

scholarly journals Incorporating structural knowledge into unsupervised deep learning for two-photon imaging data

2021 ◽  
Author(s):  
Florian Eichin ◽  
Maren Hackenberg ◽  
Caroline Broichhagen ◽  
Antje Kilias ◽  
Jan Schmoranzer ◽  
...  
Keyword(s):  
Deep Learning ◽  
Live Imaging ◽  
Temporal Changes ◽  
Generative Models ◽  
Structural Knowledge ◽  
Imaging Data ◽  
Two Photon ◽  
Latent Space ◽  
Photon Imaging ◽  
Two Photon Imaging

Live imaging techniques, such as two-photon imaging, promise novel insights into cellular activity patterns at a high spatial and temporal resolution. While current deep learning approaches typically focus on specific supervised tasks in the analysis of such data, e.g., learning a segmentation mask as a basis for subsequent signal extraction steps, we investigate how unsupervised generative deep learning can be adapted to obtain interpretable models directly at the level of the video frames. Specifically, we consider variational autoencoders for models that infer a compressed representation of the data in a low-dimensional latent space, allowing for insight into what has been learned. Based on this approach, we illustrate how structural knowledge can be incorporated into the model architecture to improve model fitting and interpretability. Besides standard convolutional neural network components, we propose an architecture for separately encoding the foreground and background of live imaging data. We exemplify the proposed approach with two-photon imaging data from hippocampal CA1 neurons in mice, where we can disentangle the neural activity of interest from the neuropil background signal. Subsequently, we illustrate how to impose smoothness constraints onto the latent space for leveraging knowledge about gradual temporal changes. As a starting point for adaptation to similar live imaging applications, we provide a Jupyter notebook with code for exploration. Taken together, our results illustrate how architecture choices for deep generative models, such as for spatial structure, foreground vs. background, and gradual temporal changes, facilitate a modeling approach that combines the flexibility of deep learning with the benefits of incorporating domain knowledge. Such a strategy is seen to enable interpretable, purely image-based models of activity signals from live imaging, such as for two-photon data.

scholarly journals Community-based benchmarking improves spike rate inference from two-photon calcium imaging data

2018 ◽  
Vol 14 (5) ◽  
pp. e1006157 ◽  
Author(s):  
Philipp Berens ◽  
Jeremy Freeman ◽  
Thomas Deneux ◽  
Nikolay Chenkov ◽  
Thomas McColgan ◽  
...  
Keyword(s):  
Calcium Imaging ◽  
Spike Rate ◽  
Imaging Data ◽  
Community Based ◽  
Two Photon

scholarly journals Ultra-fast accurate reconstruction of spiking activity from calcium imaging data

2018 ◽  
Vol 119 (5) ◽  
pp. 1863-1878 ◽  
Author(s):  
Vahid Rahmati ◽  
Knut Kirmse ◽  
Knut Holthoff ◽  
Stefan J. Kiebel
Keyword(s):  
Calcium Imaging ◽  
Reconstruction Method ◽  
Imaging Data ◽  
Decay Kinetics ◽  
Experimental Conditions ◽  
Model Free ◽  
Reconstruction Methods ◽  
Wide Range ◽  
Fast Processing ◽  
Spiking Activity

Calcium imaging provides an indirect observation of the underlying neural dynamics and enables the functional analysis of neuronal populations. However, the recorded fluorescence traces are temporally smeared, thus making the reconstruction of exact spiking activity challenging. Most of the established methods to tackle this issue are limited in dealing with issues such as the variability in the kinetics of fluorescence transients, fast processing of long-term data, high firing rates, and measurement noise. We propose a novel, heuristic reconstruction method to overcome these limitations. By using both synthetic and experimental data, we demonstrate the four main features of this method: 1) it accurately reconstructs both isolated spikes and within-burst spikes, and the spike count per fluorescence transient, from a given noisy fluorescence trace; 2) it performs the reconstruction of a trace extracted from 1,000,000 frames in less than 2 s; 3) it adapts to transients with different rise and decay kinetics or amplitudes, both within and across single neurons; and 4) it has only one key parameter, which we will show can be set in a nearly automatic way to an approximately optimal value. Furthermore, we demonstrate the ability of the method to effectively correct for fast and rather complex, slowly varying drifts as frequently observed in in vivo data. NEW & NOTEWORTHY Reconstruction of spiking activities from calcium imaging data remains challenging. Most of the established reconstruction methods not only have limitations in adapting to systematic variations in the data and fast processing of large amounts of data, but their results also depend on the user’s experience. To overcome these limitations, we present a novel, heuristic model-free-type method that enables an ultra-fast, accurate, near-automatic reconstruction from data recorded under a wide range of experimental conditions.

scholarly journals CosMIC: A Consistent Metric for Spike Inference from Calcium Imaging

2017 ◽  
Author(s):  
Stephanie Reynolds ◽  
Therese Abrahamsson ◽  
P. Jesper Sjöström ◽  
Simon R. Schultz ◽  
Pier Luigi Dragotti
Keyword(s):  
Spike Train ◽  
Success Rate ◽  
Calcium Imaging ◽  
Ground Truth ◽  
Spike Trains ◽  
Imaging Data ◽  
Temporal Precision ◽  
Pulse Trains ◽  
Two Photon ◽  
Average Size

AbstractIn recent years, the development of algorithms to detect neuronal spiking activity from two-photon calcium imaging data has received much attention. Meanwhile, few researchers have examined the metrics used to assess the similarity of detected spike trains with the ground truth. We highlight the limitations of the two most commonly used metrics, the spike train correlation and success rate, and propose an alternative, which we refer to as CosMIC. Rather than operating on the true and estimated spike trains directly, the proposed metric assesses the similarity of the pulse trains obtained from convolution of the spike trains with a smoothing pulse. The pulse width, which is derived from the statistics of the imaging data, reflects the temporal tolerance of the metric. The final metric score is the size of the commonalities of the pulse trains as a fraction of their average size. Viewed through the lens of set theory, CosMIC resembles a continuous Sørensen-Dice coefficient — an index commonly used to assess the similarity of discrete, presence/absence data. We demonstrate the ability of the proposed metric to discriminate the precision and recall of spike train estimates. Unlike the spike train correlation, which appears to reward overestimation, the proposed metric score is maximised when the correct number of spikes have been detected. Furthermore, we show that CosMIC is more sensitive to the temporal precision of estimates than the success rate.

scholarly journals NoRMCorre: An online algorithm for piecewise rigid motion correction of calcium imaging data

2017 ◽  
Author(s):  
Eftychios A. Pnevmatikakis ◽  
Andrea Giovannucci
Keyword(s):  
Calcium Imaging ◽  
Motion Correction ◽  
Rigid Motion ◽  
Motion Artifacts ◽  
Streaming Data ◽  
Field Of View ◽  
Large Field ◽  
Motion Field ◽  
Imaging Data ◽  
Two Photon

AbstractBackgroundMotion correction is a challenging pre-processing problem that arises early in the analysis pipeline of calcium imaging data sequences. The motion artifacts in two-photon microscopy recordings can be non-rigid, arising from the finite time of raster scanning and non-uniform deformations of the brain medium.New methodWe introduce an algorithm for fast Non-Rigid Motion Correction (NoRMCorre) based on template matching. NoRMCorre operates by splitting the field of view into overlapping spatial patches that are registered at a sub-pixel resolution for rigid translation against a continuously updated template. The estimated alignments are subsequently up-sampled to create a smooth motion field for each frame that can efficiently approximate non-rigid motion in a piecewise-rigid manner.Existing methodsExisting approaches either do not scale well in terms of computational performance or are targeted to motion artifacts arising from low speed scanning, whereas modern datasets with large field of view are more prone to non-rigid brain deformation issues.ResultsNoRMCorre can be run in an online mode resulting in comparable to or even faster than real time motion registration on streaming data. We evaluate the performance of the proposed method with simple yet intuitive metrics and compare against other non-rigid registration methods on two-photon calcium imaging datasets. Open source Matlab and Python code is also made available.ConclusionsThe proposed method and code provide valuable support to the community for solving large scale image registration problems in calcium imaging, especially when non-rigid deformations are present in the acquired data.

scholarly journals Interpreting wide-band neural activity using convolutional neural networks

eLife ◽  
2021 ◽  
Vol 10 ◽  
Author(s):  
Markus Frey ◽  
Sander Tanni ◽  
Catherine Perrodin ◽  
Alice O'Leary ◽  
Matthias Nau ◽  
...  
Keyword(s):  
Neural Activity ◽  
Calcium Imaging ◽  
Wide Band ◽  
Brain Regions ◽  
Imaging Data ◽  
User Input ◽  
Neural Recordings ◽  
Learning Framework ◽  
Behavioral Variables ◽  
Spatial Behaviors

Rapid progress in technologies such as calcium imaging and electrophysiology has seen a dramatic increase in the size and extent of neural recordings. Even so, interpretation of this data requires considerable knowledge about the nature of the representation and often depends on manual operations. Decoding provides a means to infer the information content of such recordings but typically requires highly processed data and prior knowledge of the encoding scheme. Here, we developed a deep-learning framework able to decode sensory and behavioral variables directly from wide-band neural data. The network requires little user input and generalizes across stimuli, behaviors, brain regions, and recording techniques. Once trained, it can be analyzed to determine elements of the neural code that are informative about a given variable. We validated this approach using electrophysiological and calcium-imaging data from rodent auditory cortex and hippocampus as well as human electrocorticography (ECoG) data. We show successful decoding of finger movement, auditory stimuli, and spatial behaviors – including a novel representation of head direction - from raw neural activity.

scholarly journals ABLE: An Activity-Based Level Set Segmentation Algorithm for Two-Photon Calcium Imaging Data

eNeuro ◽  
2017 ◽  
Vol 4 (5) ◽  
pp. ENEURO.0012-17.2017 ◽  
Author(s):  
Stephanie Reynolds ◽  
Therese Abrahamsson ◽  
Renaud Schuck ◽  
P. Jesper Sjöström ◽  
Simon R. Schultz ◽  
...  
Keyword(s):  
Level Set ◽  
Calcium Imaging ◽  
Segmentation Algorithm ◽  
Imaging Data ◽  
Two Photon ◽  
Level Set Segmentation

scholarly journals Simultaneous Two-Photon Voltage or Calcium Imaging and Multi-Channel Local Field Potential Recordings in Barrel Cortex of Awake and Anesthetized Mice

2021 ◽  
Vol 15 ◽  
Author(s):  
Claudia Cecchetto ◽  
Stefano Vassanelli ◽  
Bernd Kuhn
Keyword(s):  
Local Field ◽  
Calcium Imaging ◽  
Local Field Potential ◽  
Barrel Cortex ◽  
Field Potential ◽  
Imaging Data ◽  
Spatiotemporal Resolution ◽  
Two Photon ◽  
Cranial Window ◽  
Sensory Evoked

Neuronal population activity, both spontaneous and sensory-evoked, generates propagating waves in cortex. However, high spatiotemporal-resolution mapping of these waves is difficult as calcium imaging, the work horse of current imaging, does not reveal subthreshold activity. Here, we present a platform combining voltage or calcium two-photon imaging with multi-channel local field potential (LFP) recordings in different layers of the barrel cortex from anesthetized and awake head-restrained mice. A chronic cranial window with access port allows injecting a viral vector expressing GCaMP6f or the voltage-sensitive dye (VSD) ANNINE-6plus, as well as entering the brain with a multi-channel neural probe. We present both average spontaneous activity and average evoked signals in response to multi-whisker air-puff stimulations. Time domain analysis shows the dependence of the evoked responses on the cortical layer and on the state of the animal, here separated into anesthetized, awake but resting, and running. The simultaneous data acquisition allows to compare the average membrane depolarization measured with ANNINE-6plus with the amplitude and shape of the LFP recordings. The calcium imaging data connects these data sets to the large existing database of this important second messenger. Interestingly, in the calcium imaging data, we found a few cells which showed a decrease in calcium concentration in response to vibrissa stimulation in awake mice. This system offers a multimodal technique to study the spatiotemporal dynamics of neuronal signals through a 3D architecture in vivo. It will provide novel insights on sensory coding, closing the gap between electrical and optical recordings.

scholarly journals Denoising Two-Photon Calcium Imaging Data

PLoS ONE ◽  
2011 ◽  
Vol 6 (6) ◽  
pp. e20490 ◽  
Author(s):  
Wasim Q. Malik ◽  
James Schummers ◽  
Mriganka Sur ◽  
Emery N. Brown
Keyword(s):  
Calcium Imaging ◽  
Imaging Data ◽  
Two Photon
Sign in / Sign up

Export Citation Format

Share Document