scholarly journals Application of the infinitely many times repeated BNS update and conjugate directions to limited-memory optimization methods

2019 ◽  
Author(s):  
Jan Vlček ◽  
Ladislav Lukšan
Keyword(s):  
Optimization Methods ◽  
Conjugate Directions ◽  
Memory Optimization ◽  
Limited Memory

scholarly journals Memory Optimization Techniques in Neural Networks: A Review

2021 ◽  
Vol 10 (6) ◽  
pp. 44-48
Author(s):  
Pratheeksha P ◽  
◽  
Pranav B M ◽  
Dr. Azra Nasreen ◽  
◽  
...  
Keyword(s):  
Neural Networks ◽  
Optimization Methods ◽  
Optimization Techniques ◽  
Model Complexity ◽  
Batch Size ◽  
Network Architectures ◽  
Memory Optimization ◽  
Memory Consumption ◽  
Reduction Techniques ◽  
Complex Models

Deep neural networks have been continuously evolving towards larger and more complex models to solve challenging problems in the field of AI. The primary bottleneck that restricts new network architectures is memory consumption. Running or training DNNs heavily relies on the hardware (CPUs, GPUs, or FPGA) which are either inadequate in terms of memory or hard-to-extend. This would further make it difficult to scale. In this paper, we review some of the latest memory footprint reduction techniques which would enable faster low model complexity. Additionally, it improves accuracy by increasing the batch size and developing wider and deeper neural networks with the same set of hardware resources. The paper emphasizes on memory optimization methods specific to CNN and RNN training.

Optimization Methods in Finance

2018 ◽  
Author(s):  
Gérard Cornuéjols ◽  
Javier Peña ◽  
Reha Tütüncü
Keyword(s):  
Optimization Methods

Optimization Methods in Finance

2006 ◽  
Author(s):  
Gerard Cornuejols ◽  
Reha Tutuncu
Keyword(s):  
Optimization Methods
Sign in / Sign up

Export Citation Format

Share Document