FPGA-based acceleration of Davidon-Fletcher-Powell quasi-Newton optimization method

被引:10
作者
Liu Q. [1 ]
Sang R. [1 ]
Zhang Q. [1 ,2 ]
机构
[1] School of Electronic Information Engineering, Tianjin University, Tianjin
[2] Department of Electronics, Carleton University, Ottawa
关键词
field programmable gate array; hardware acceleration; quasi-Newton method;
D O I
10.1007/s12209-016-2870-0
中图分类号
学科分类号
摘要
Quasi-Newton methods are the most widely used methods to find local maxima and minima of functions in various engineering practices. However, they involve a large amount of matrix and vector operations, which are computationally intensive and require a long processing time. Recently, with the increasing density and arithmetic cores, field programmable gate array (FPGA) has become an attractive alternative to the acceleration of scientific computation. This paper aims to accelerate Davidon-Fletcher-Powell quasi-Newton (DFP-QN) method by proposing a customized and pipelined hardware implementation on FPGAs. Experimental results demonstrate that compared with a software implementation, a speed-up of up to 17 times can be achieved by the proposed hardware implementation. © 2016, Tianjin University and Springer-Verlag Berlin Heidelberg.
引用
收藏
页码:381 / 387
页数:6
相关论文
共 15 条
[1]  
Pallaschke D., Rolewicz S., Foundations of Mathematical Optimization[M], (2009)
[2]  
Lewis A.S., Overton M.L., Nonsmooth optimization via quasi-Newton methods[J], Mathematical Programming, 141, 1, pp. 135-163, (2013)
[3]  
Mokhtari A., Ribeiro A., A dual stochastic DFP algorithm for optimal resource allocation in wireless systems[C], In: 2013 IEEE 14th Workshop on Signal Processing Advances in Wireless Communications, (2013)
[4]  
Kuwabara S., Kohira Y., Takashima Y., An effective overlap removable objective for analytical placement[J], IEICETransaction on Fundamentals of Electronics, Communications and Computer Sciences, 6, pp. 1348-1356, (2013)
[5]  
Alaei H.K., Yazdizadeh A., Aliabadi A., Nonlinear predictive controller design for load frequency control in power system using quasi Newton optimization approach[C], In: 2013 IEEE International Conference on Control Applications, (2013)
[6]  
Ninomiya H., Robust training of multilayer neural networks using parameterized online quasi-Newton algorithm [C], In: 2011 Fourth International Conference on Machine Learning and Applications, (2011)
[7]  
De Matos G.M., Neto H.C., Memory optimized architecture for efficient Guass-Jordan matrix inversion[C], In: 2007 3rd Southern Conference on Programmable Logic, (2007)
[8]  
Boland D., Constantinides G.A., An FPGA-based implementation of the MINRES algorithm[C], In: 2008 International Conference on Field Programmable Logic and Applications, (2008)
[9]  
Roldao A., Constantinides G.A., A high throughput FPGAbased floating point conjugate gradient implementation for dense matrices[J], ACM Transactions on Reconfigurable Technology and Systems, (2010)
[10]  
Munoz D.M., Llanos C.H., dos Coelho S., Et al., Comparison between two FPGA implementation of the particle swarm optimization algorithm for highperformance embedded applications[C], In: 2010 IEEE Fifth International Conference on Bio-Inspired Computing:^Theories and Applications, (2010)