scholarly journals PRESERVATION OF EMPIRICAL SUCCESS AND INTERTHEORETICAL CORRESPONDENCE: JUSTIFYING REALISM WITHOUT THE NO MIRACLES ARGUMENT

2009 ◽  
pp. 15-28
2021 ◽  
Author(s):  
Tianyi Liu ◽  
Zhehui Chen ◽  
Enlu Zhou ◽  
Tuo Zhao

Momentum stochastic gradient descent (MSGD) algorithm has been widely applied to many nonconvex optimization problems in machine learning (e.g., training deep neural networks, variational Bayesian inference, etc.). Despite its empirical success, there is still a lack of theoretical understanding of convergence properties of MSGD. To fill this gap, we propose to analyze the algorithmic behavior of MSGD by diffusion approximations for nonconvex optimization problems with strict saddle points and isolated local optima. Our study shows that the momentum helps escape from saddle points but hurts the convergence within the neighborhood of optima (if without the step size annealing or momentum annealing). Our theoretical discovery partially corroborates the empirical success of MSGD in training deep neural networks.


1986 ◽  
Vol 41 (6) ◽  
pp. 777-787
Author(s):  
Eckehard W. Mielke

Although refuted for a long time as a monstrosity, today’s concepts in elementary particle physics necessitate it on theoretical grounds: The existence of isolated elementary magnetic north- or south poles. If compared with a proton, the mass of such a monopole is estimated to be gigantic; comparable to that of an amoeba. Under the impact of the empirical success of unified gauge models, the search for monopoles has been steadily enforced with the aid of new detection methods.


Author(s):  
Samir Okasha

‘Realism and anti-realism’ is concerned with the debate between scientific realism and its converse, anti-realism or instrumentalism. Realists hold that the aim of science is to provide a true description of the world. Anti-realists hold that it is to provide a true description of the ‘observable’ part of the world. The ‘no miracles’ argument, one of the strongest arguments for scientific realism, is shown to be a plausibility argument — an inference to the best explanation. Central to the debate between realism and anti-realism is the observable/unobservable distinction and the views of realist Grover Maxwell and anti-realist Bas van Fraassen are described. The underdetermination argument is also explained.


Author(s):  
G. A. D. Briggs ◽  
J. N. Butterfield ◽  
A. Zeilinger

The twentieth century saw two fundamental revolutions in physics—relativity and quantum. Daily use of these theories can numb the sense of wonder at their immense empirical success. Does their instrumental effectiveness stand on the rock of secure concepts or the sand of unresolved fundamentals? Does measuring a quantum system probe, or even create, reality or merely change belief? Must relativity and quantum theory just coexist or might we find a new theory which unifies the two? To bring such questions into sharper focus, we convened a conference on Quantum Physics and the Nature of Reality. Some issues remain as controversial as ever, but some are being nudged by theory's secret weapon of experiment.


Erkenntnis ◽  
2016 ◽  
Vol 82 (5) ◽  
pp. 993-1014 ◽  
Author(s):  
Robert Smithson
Keyword(s):  

Analysis ◽  
2013 ◽  
Vol 73 (2) ◽  
pp. 205-211 ◽  
Author(s):  
C. Howson
Keyword(s):  

Disputatio ◽  
2017 ◽  
Vol 9 (47) ◽  
pp. 631-656 ◽  
Author(s):  
Robert Northcott

Abstract Can purely predictive models be useful in investigating causal systems? I argue “yes”. Moreover, in many cases not only are they useful, they are essential. The alternative is to stick to models or mechanisms drawn from well-understood theory. But a necessary condition for explanation is empirical success, and in many cases in social and field sciences such success can only be achieved by purely predictive models, not by ones drawn from theory. Alas, the attempt to use theory to achieve explanation or insight without empirical success therefore fails, leaving us with the worst of both worlds—neither prediction nor explanation. Best go with empirical success by any means necessary. I support these methodological claims via case studies of two impressive feats of predictive modelling: opinion polling of political elections, and weather forecasting.


Author(s):  
Kaize Ding ◽  
Jundong Li ◽  
Shivam Dhar ◽  
Shreyash Devan ◽  
Huan Liu

Spammer detection in social media has recently received increasing attention due to the rocketing growth of user-generated data. Despite the empirical success of existing systems, spammers may continuously evolve over time to impersonate normal users while new types of spammers may also emerge to combat with the current detection system, leading to the fact that a built system will gradually lose its efficacy in spotting spammers. To address this issue, grounded on the contextual bandit model, we present a novel system for conducting interactive spammer detection. We demonstrate our system by showcasing the interactive learning process, which allows the detection model to keep optimizing its detection strategy through incorporating the feedback information from human experts.


Sign in / Sign up

Export Citation Format

Share Document