scholarly journals Concentration Bounds for High Sensitivity Functions Through Differential Privacy

2019 ◽  
Vol 9 (1) ◽  
Author(s):  
Uri Stemmer ◽  
Kobbi Nissim

A new line of work demonstrates how differential privacy can be used as a mathematical tool for guaranteeing generalization in adaptive data analysis. Specifically, if a differentially private analysis is applied on a sample S of i.i.d. examples to select a low-sensitivity function f, then w.h.p. f(S) is close to its expectation, even though f is being chosen adaptively, i.e., based on the data. Very recently, Steinke and Ullman observed that these generalization guarantees can be used for proving concentration bounds in the non-adaptive setting, where the low-sensitivity function is fixed beforehand. In particular, they obtain alternative proofs for classical concentration bounds for low-sensitivity functions, such as the Chernoff bound and McDiarmid's Inequality. In this work, we extend this connection between differential privacy and concentration bounds, and show that differential privacy can be used to prove concentration of high-sensitivity functions.


2021 ◽  
Vol 9 ◽  
pp. 891-908
Author(s):  
Michael Hahn ◽  
Dan Jurafsky ◽  
Richard Futrell

Abstract We introduce a theoretical framework for understanding and predicting the complexity of sequence classification tasks, using a novel extension of the theory of Boolean function sensitivity. The sensitivity of a function, given a distribution over input sequences, quantifies the number of disjoint subsets of the input sequence that can each be individually changed to change the output. We argue that standard sequence classification methods are biased towards learning low-sensitivity functions, so that tasks requiring high sensitivity are more difficult. To that end, we show analytically that simple lexical classifiers can only express functions of bounded sensitivity, and we show empirically that low-sensitivity functions are easier to learn for LSTMs. We then estimate sensitivity on 15 NLP tasks, finding that sensitivity is higher on challenging tasks collected in GLUE than on simple text classification tasks, and that sensitivity predicts the performance both of simple lexical classifiers and of vanilla BiLSTMs without pretrained contextualized embeddings. Within a task, sensitivity predicts which inputs are hard for such simple models. Our results suggest that the success of massively pretrained contextual representations stems in part because they provide representations from which information can be extracted by low-sensitivity decoders.



2016 ◽  
Vol 72 (7) ◽  
pp. 849-859
Author(s):  
Ximeng Y. Dow ◽  
Christopher M. Dettmar ◽  
Emma L. DeWalt ◽  
Justin A. Newman ◽  
Alexander R. Dow ◽  
...  

Second harmonic generation correlation spectroscopy (SHG-CS) is demonstrated as a new approach to protein nanocrystal characterization. A novel line-scanning approach was performed to enable autocorrelation analysis without sample damage from the intense incident beam. An analytical model for autocorrelation was developed, which includes a correction for the optical scattering forces arising when focusing intense, infrared beams. SHG-CS was applied to the analysis of BaTiO3nanoparticles ranging from 200 to ∼500 nm and of photosystem I nanocrystals. A size distribution was recovered for each sample and compared with the size histogram measured by scanning electron microscopy (SEM). Good agreement was observed between the two independent measurements. The intrinsic selectivity of the second-order nonlinear optical process provides SHG-CS with the ability to distinguish well ordered nanocrystals from conglomerates and amorphous aggregates. Combining the recovered distribution of particle diameters with the histogram of measured SHG intensities provides the inherent hyperpolarizability per unit volume of the SHG-active nanoparticles. Simulations suggest that the SHG activity per unit volume is likely to exhibit relatively low sensitivity to the subtle distortions within the lattice that contribute to resolution loss in X-ray diffraction, but high sensitivity to the presence of multi-domain crystals.



2020 ◽  
Vol 2020 ◽  
pp. 1-29 ◽  
Author(s):  
Xingxing Xiong ◽  
Shubo Liu ◽  
Dan Li ◽  
Zhaohui Cai ◽  
Xiaoguang Niu

With the advent of the era of big data, privacy issues have been becoming a hot topic in public. Local differential privacy (LDP) is a state-of-the-art privacy preservation technique that allows to perform big data analysis (e.g., statistical estimation, statistical learning, and data mining) while guaranteeing each individual participant’s privacy. In this paper, we present a comprehensive survey of LDP. We first give an overview on the fundamental knowledge of LDP and its frameworks. We then introduce the mainstream privatization mechanisms and methods in detail from the perspective of frequency oracle and give insights into recent studied on private basic statistical estimation (e.g., frequency estimation and mean estimation) and complex statistical estimation (e.g., multivariate distribution estimation and private estimation over complex data) under LDP. Furthermore, we present current research circumstances on LDP including the private statistical learning/inferencing, private statistical data analysis, privacy amplification techniques for LDP, and some application fields under LDP. Finally, we identify future research directions and open challenges for LDP. This survey can serve as a good reference source for the research of LDP to deal with various privacy-related scenarios to be encountered in practice.



2021 ◽  
pp. 143-165
Author(s):  
V.G. Maralov ◽  
◽  
V.A. Sitarov ◽  

The relevance of the problem is due to the importance of identifying factors that determine the propensity of students to coercion or nonviolence, creating psychological and pedagogical conditions for the formation of the socionomic sphere of nonviolent competencies for future specialists at universities. The theoretical basis of the study was the position of nonviolence as a daily practice of interaction, by which we understand the ability of a person to choose from a number of possible alternatives that carry the least charge of coercion. The aim of the work was to study the influence of irrational beliefs and sensitivity to a person (interest, empathy, understanding and assistance) on the students’ tendency to coercion, manipulation, non-violence and non-interference in the processes of interaction with people. The hypothesis was tested that the tendency of students to coercion, manipulation, and noninterference will be due to expressed irrational beliefs and low level of sensitivity to a person and the tendency to non-violence will be explained by the absence of irrational beliefs and a high level of sensitivity to a person. The study involved 125 students of pedagogical and psychological faculties of the Moscow Humanitarian and Cherepovets State universities. The authors used questionnaires to identify the positions of interaction among students and sensitivity to a person, as well as a list of irrational beliefs proposed by A. Beck and A. Freeman. It is established that the tendency to both coercion and manipulation are determined by the beliefs of anti-social type and low sensitivity to the person. The tendency to manipulate the narcissistic beliefs, high interest in people and understanding them, at the same time the tendency to non-violence and non-interference are determined by beliefs of avoidant and dependent types with a low level of understanding people. And a tendency to non-interference is determined by beliefs of dependent type with unexpressed orientation on helping. The tendency to nonviolence is determined by the high sensitivity to a person and the absence of irrational beliefs of antisocial, passive-aggressive and narcissistic types. As a result, the conclusion is made about the need to form purposefully the ability to nonviolent interaction among students, which should include the work on awareness and overcoming irrational beliefs and the development of sensitivity to a person. The obtained results can be used in practical work with students on the formation of their nonviolent competencies.



1996 ◽  
Vol 75 (1) ◽  
pp. 75-96 ◽  
Author(s):  
D. R. Irvine ◽  
R. Rajan ◽  
L. M. Aitkin

1. Interaural intensity differences (IIDs) provide the major cue to the azimuthal location of high-frequency narrowband sounds. In recent studies of the azimuthal sensitivity of high-frequency neurons in the primary auditory cortex (field AI) of the cat, a number of different types of azimuthal sensitivity have been described and the azimuthal sensitivity of many neurons was found to vary as a function of changes in stimulus intensity. The extent to which the shape and the intensity dependence of the azimuthal sensitivity of AI neurons reflects features of their IID sensitivity was investigated by obtaining data on IID sensitivity from a large sample of neurons with a characteristic frequency (CF) > 5.5 kHz in AI of anesthetized cats. IID sensitivity functions were classified in a manner that facilitated comparison with previously obtained data on azimuthal sensitivity, and the effects of changes in the base intensity at which IIDs were introduced were examined. 2. IID sensitivity functions for CF tonal stimuli were obtained at one or more intensities for a total of 294 neurons, in most cases by a method of generating IIDs that kept the average binaural intensity (ABI) of the stimuli at the two ears constant. In the standard ABI range at which a function was obtained for each unit, five types of IID sensitivity were distinguished. Contra-max neurons (50% of the sample) had maximum response (a peak or a plateau) at IIDs corresponding to contralateral azimuths, whereas ipsi-max neurons (17%) had the mirror-image form of sensitivity. Near-zero-max neurons (18%) had a clearly defined maximum response (peak) in the range of +/- 10 dB IID, whereas a small group of tough neurons (2%) had a restricted range of minimal responsiveness with near-maximal responses at IIDs on either side. A final 18% of AI neurons were classified as insensitive to IIDs. The proportions of neurons exhibiting the various types of sensitivity corresponded closely to the proportions found to exhibit corresponding types of azimuthal sensitivity in a previous study. 3. There was a strong correlation between a neuron's binaural interaction characteristics and the form of its IID sensitivity function. Thus, neurons excited by monaural stimulation of only one ear but with either inhibitory, facilitatory, or mixed facilitatory-inhibitory effects of stimulation of the other ear had predominantly contra-max IID sensitivity (if contralateral monaural stimulation was excitatory) or ipsi-max sensitivity (if ipsilateral monaural stimulation was excitatory). Neurons driven weakly or not at all by monaural stimulation but facilitated binaurally almost all exhibited near-zero-max IID sensitivity. The exception to this tight association between binaural input and IID sensitivity was provided by neurons excited by monaural stimulation of either ear (EE neurons). Although EE neurons have frequently been considered to be insensitive to IIDs, our data were in agreement with two recent reports indicating that they can exhibit various forms of IID sensitivity: only 23 of 75 EE neurons were classified as insensitive and the remainder exhibited diverse types of sensitivity. 4. IID sensitivity was examined at two or more intensities (3-5 in most cases) for 84 neurons. The form of the IID sensitivity function (defined in terms of both shape and position along the IID axis) was invariant with changes in ABI for only a small proportion of IID-sensitive neurons (approximately 15% if a strict criterion of invariance was employed), and for many of these neurons the spike counts associated with a given IID varied with ABI, particularly at near-threshold levels. When the patterns of variation in the form of IID sensitivity produced by changes in ABI were classified in a manner equivalent to that used previously to classify the effects of intensity on azimuthal sensitivity, there was a close correspondence between the effects of intensity on corresponding types of azimuthal and IID sensitivity



2020 ◽  
Author(s):  
Ganlu Ouyang ◽  
Xibiao Yang ◽  
Xiangbing Deng ◽  
Wenjian Meng ◽  
Yongyang Yu ◽  
...  

Abstract Purpose: To investigate the potential value of magnetic resonance imaging (MRI) in predicting response relevance to total neoadjuvant treatment (TNT) in locally advanced rectal cancer.Methods: We analyzed MRI of 71 patients underwent TNT from 2015 to 2017 retrospectively. We categorized the response of TNT as CR (complete response) and non-CR, and high, moderate and low sensitivity. Logistic regression analysis was used to identify the best predictors of response. Diagnostic performance was assessed using receiver - operating characteristic curve analysis.Results: Post–ICT (induction chemotherapy) ∆TL (tumor length), post-CRT (concurrent chemoradiotherapy) ∆LNN (the numbers of lymph node metastases), post–CCT (consolidation chemotherapy) ∆SDWI (maximum cross-sectional area of tumor on diffusion-weighted imaging), post-CCT ADCT (the mean apparent diffusion coefficient values of tumor) and post-CCT ∆LNV (volume of lymph node) were the best CR predictors. Post-CRT EMVI (extramural vascular invasion) and post-CCT ∆ST2 (S on T2-weight) were the best significant factors for high sensitivity. Conclusions: Post-ICT ∆TL and post-CRT EMVI may an early predictor of CR and high sensitivity to TNT, respectively. The grouping scheme of CR and non–CR was more suitable for predicting response by MRI parameters than high, moderate and low sensitivity.Trial registration: retrospectively registered



Author(s):  
S.V. Shalobanov ◽  
◽  
S.S. Shalobanov ◽  
A.A. Aleksandrov ◽  
◽  
...  

The paper presents an algorithm for defects screening in a continuous dynamic system with a depth of up to dynamic block based on the structure sensitivity function and the sign analysis of integral esti-mates of the output signals deviations.



2018 ◽  
Author(s):  
Grace E. Shupe ◽  
Arran Wilson ◽  
Curtis R. Luckett

AbstractMastication behavior is a notable source of interindividual variation in texture perception and could be linked to oral sensitivity. As oral sensitivity declines so does the amount of tactile feedback relayed to the brain, resulting in less effective manipulation or food and a reduced ability to discriminate differences. To address these hypotheses, we measured masticatory behavior and related this to texture discrimination and oral sensitivity. The study was performed on 41 participants in two groups, with high (n = 20) or low (n=21) sensitivity. Oral sensitivity was measured using a battery of tests that included: oral stereognosis, lingual tactile acuity, and bite force sensitivity. Sensitivity to texture changes was measured using a series of triangle tests with confectionaries of different hardness, with masticatory patterns and behaviors being video recorded and analyzed using jaw tracking software. Overall, there was no significant difference between high and low sensitivity participants and their ability to distinguish texture changes. But, there were significantly different trends found between the groups based on their masticatory behaviors including chewing pattern and overall number of chews. But, it was found that multiple masticatory behaviors were being modulated by oral sensitivity, including overall chewing cycles used (p < 0.0001). More, specifically those in the high sensitivity group used more stochastic chewing movements, while those in the low sensitivity group were found to use crescent-shaped chewing cycles. It was also noted that in the high sensitivity group the jaw moved further distances (p < 0.0001) in all phases and moved at a higher velocity when opening (p < 0.0001) but not when closing, when compared to the low sensitivity group. These results help bolster evidence that mastication and oral sensitivity are related.





Sign in / Sign up

Export Citation Format

Share Document