The practicality of practical inference

2021 ◽  
pp. 253-290
Author(s):  
Will Small
Keyword(s):  
Author(s):  
Zhuliang Yao ◽  
Shijie Cao ◽  
Wencong Xiao ◽  
Chen Zhang ◽  
Lanshun Nie

In trained deep neural networks, unstructured pruning can reduce redundant weights to lower storage cost. However, it requires the customization of hardwares to speed up practical inference. Another trend accelerates sparse model inference on general-purpose hardwares by adopting coarse-grained sparsity to prune or regularize consecutive weights for efficient computation. But this method often sacrifices model accuracy. In this paper, we propose a novel fine-grained sparsity approach, Balanced Sparsity, to achieve high model accuracy with commercial hardwares efficiently. Our approach adapts to high parallelism property of GPU, showing incredible potential for sparsity in the widely deployment of deep learning services. Experiment results show that Balanced Sparsity achieves up to 3.1x practical speedup for model inference on GPU, while retains the same high model accuracy as finegrained sparsity.


1978 ◽  
Vol 4 ◽  
pp. 1-16
Author(s):  
Thomas Donaldson ◽  
Keyword(s):  

1997 ◽  
Vol 27 (1) ◽  
pp. 17-45 ◽  
Author(s):  
Philip Clark

There is an idea, going back to Aristotle, that reasons for action can be understood on a parallel with reasons for belief. Not surprisingly, the idea has almost always led to some form of inferentialism about reasons for action. In this paper I argue that reasons for action can be understood on a parallel with reasons for belief, but that this requires abandoning inferentialism about reasons for action. This result will be thought paradoxical. It is generally assumed that if there is to be a useful parallel, there must be some such thing as a practical inference. As we shall see, that assumption tends to block the fruitful exploration of the real parallel. On the view I shall defend, the practical analogue of an ordinary inference is not an inference, but something I shall call a practical step. Nevertheless, the practical step will do, for a theory of reasons for action, what ordinary inference does for an inferentialist theory of reasons for belief. The result is a general characterization of reasons, practical and theoretical, in terms of the correctness conditions of the relevant sorts of step.


1978 ◽  
Vol 44 (3) ◽  
pp. 441
Author(s):  
Burleigh T. Wilkins ◽  
Rex Martin

1989 ◽  
Vol 56 (1) ◽  
pp. 165-170 ◽  
Author(s):  
B. C. Postow
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document