scholarly journals Bedshift: perturbation of genomic interval sets

2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Aaron Gu ◽  
Hyun Jae Cho ◽  
Nathan C. Sheffield

AbstractFunctional genomics experiments, like ChIP-Seq or ATAC-Seq, produce results that are summarized as a region set. There is no way to objectively evaluate the effectiveness of region set similarity metrics. We present Bedshift, a tool for perturbing BED files by randomly shifting, adding, and dropping regions from a reference file. The perturbed files can be used to benchmark similarity metrics, as well as for other applications. We highlight differences in behavior between metrics, such as that the Jaccard score is most sensitive to added or dropped regions, while coverage score is most sensitive to shifted regions.

2020 ◽  
Author(s):  
Aaron Gu ◽  
Hyun Jae Cho ◽  
Nathan C. Sheffield

Results of functional genomics experiments such as ChIP-Seq or ATAC-Seq produce data summarized as a region set. Many tools have been developed to analyze region sets, including computing similarity metrics to compare them. However, there is no way to objectively evaluate the effectiveness of region set similarity metrics. In this paper we present bedshift, a command-line tool and Python API to generate new BED files by making random perturbations to an original BED file. Perturbed files have known similarity to the original file and are therefore useful to benchmark similarity metrics. To demonstrate, we used bedshift to create an evaluation dataset of 3,600 perturbed files generated by shifting, adding, and dropping regions from a reference BED file. Then, we compared four similarity metrics: Jaccard score, coverage score, Euclidean distance, and cosine similarity. The results show that the Jaccard score is most sensitive to detecting adding and dropping regions, while the coverage score is more sensitive to shifted regions.AvailabilityBSD2-licensed source code and documentation can be found at https://bedshift.databio.org.


2019 ◽  
Vol 78 (14) ◽  
pp. 1249-1261
Author(s):  
O. Rubel ◽  
S. K. Abramov ◽  
V. V. Abramova ◽  
V. V. Lukin

Sign in / Sign up

Export Citation Format

Share Document