New Architecture for NN based Image Compression for optimized Power, Area and Speed

K. V. Ramanaiah*, K. Lal Kishore**, P. Gopal Reddy***
* Prof. &HODofE.C.E. Narayana Engineering College, Nellore, India.
** Registrar, JNTU Kukatpally, India.
*** Principal, Narayana Engineering College, India.
Periodicity:January - March'2008
DOI : https://doi.org/10.26634/jee.1.3.418

Abstract

Multi layered neural network (NN) architecture is proposed for compression of high-resolution image, the architecture is implemented on FPGA as it supports reconfigurability. The architecture considered has N-M-N (64-4-64) multi-layered NN structure, which achieves compression ratio of (CR) 93.75. Compression ratio is reconfigurable with change in M. The architecture is generalized and can achieve compression ratios from 2 to 99, which is reconfigurable. Performance of any neural network architecture for compression depends on training; this architecture considers general back propagation training. The training is performed offline, with known set of image samples consisting most of the properties of any standard image. The Mean Square Error (MSE) computed during every iteration of training is scaled and fed back into the network to update the weight matrix at specific points, this reduces the training time. As the weight matrix occupies more space for storage, the redundancies in the weight matrix are exploited and a storage space is created with minimum memory requirement on FPGA. Compression Ratios obtained demonstrate performance superiority of the network as compared with JPEG compression standard. Inserting noise on the compressed sets of data, tests the network performance. The hardware complexity, area requirement, speed is compared and discussed; there is a saving of 22% of space on FPGA, with 40% increase in speed, and reducing the power by 12%. The major advantage of this architecture is its reconfigurability on the architecture size that achieves different compression ratios.

Keywords

Multi layered neural network (NN), compression ratio of (CR), Mean Square Error (MSE).

How to Cite this Article?

K. Venkata Ramanaiah, K. Lal Kishore and P. Gopal Reddy (2008). New Architecture for NN based Image Compression for optimized Power, Area and Speed. i-manager’s Journal on Electrical Engineering, 1(3), Jan-Mar 2008, Print ISSN 0973-8835, E-ISSN 2230-7176, pp. 25-35. https://doi.org/10.26634/jee.1.3.418

References

[1]. D. E. Rumelhart and J. L. McClelland, Eds., Parallel Distributed Processing. Cambridge, MA: MIT Press, 1986.
[2]. R. R Lippmann, "An Introduction to computing with neural nets", IEEE ASSP Magazine, vol. 4, pp. 422, April 1987.
[3]. T. Kohonen, Self-Organization and Associative Memory, 3rded.Springer-Verlag, 1988.
[4] . D. R. Hush and B. G. Horne, "Progress in supervised neural networks: What's new since Lippmann," IEEE Signal Processing Magazine, vol. 10, no. 1, pp. 839, January 1993.
[5] . S. Haykln, Neural Networks: A Comprehensive Foundation. NewYork, NY: Macmillan, 1994.
[6] . S.Carrato, Neural networks for Image compression, Neural Networks: Adv. and Appl. 2 ed., Gelenbe Pub, North-Holland, Amsterdam, 1992, pp. 177-198.
[7] . R.D. Dony, S. Hay kin, Neural network approaches to image compression, Proc. IEEE 83 (2) (February 1995) 288-303.
[8] . M. Mougeot, R. Azencott, B. Angeniol, Image compression with back propagation: improvement of the visual restoration using dilerent cost functions. Neural Networks4 (4) (1991) 467-476.
[9] . A. Namphol, S. Chin, M. Arozullah, Image compression with a hierarchical neural network IEEE Trans. Aerospace Electronic Systems 32 (1) (January 1996) 326-337.
[10] . L.E. Russo, E.C., Real Image compression using an outer product neural network, In: Proc. ICASSP, Vol. 2, San Francisco, CA, 1992, pp. 377-380.
[11] . Benbenisti et al., New simple three-layer neural network for image compression, Opt. Eng. 36 (1997) 1814-1817
[12] . G.W. Cottrell, R Munro, D. Zlpser, Learning Internal representations from grey-scale images: an example of extenslonal programming, In: Proc. 9th Annual Cognitive Science Society Conf., Seattle, WA, 1987, pp. 461 -473.
[13] . D. Kornreich, Y. Benbenisti, H.B. Mitchell, R Schaefer, Normalization schemes in a neural network image compression algorithm. Signal Processing: Image Communication 10(1997)269-278.
[14] . D.Kornreich, Y. Benbenisti, H.B. Mitchell, R Schaefer, A high performance single-structure image compression neural network, IEEE Trans. Aerospace Electronic Systems 33 (1997) 1060}1063. Power reportO 10203040506064- 64-6464-32-6464-16-6464-8-6464-4-6464-1 -64Timing Report0510152025303540455064-64-6464-32-6464- 16-64.
[15] . H.Bourlard, Y. Kamp, Autoassociation by multilayer perceptrons and singular values decomposition, Biol. Cybernet. 59 (1988) 291 -294.
[16] . G. W. Cottrell and R Munro, "Principle Components Analysis of Images via Back Propagation," in SPIE Vol. 1001 Visual Communication And Image Processing '88 pp. 1070-1077,1988.
[17] . A.Skodras, C.Christopoulos and T. Ebrahimi, "The JPEG 2000 Still Image Compression Standard," IEEE Signal Processing Magazine, IEEE, September 2001, pp. 36-58.
[18] . M. Rabbani and R. Joshi, "An overview of the JPEG 2000 still image compression standard, "Signal Processing: Image Communication, Vol. 17, Elsevier Science B.V., 2002, pp. 3-48
[19] . J.Robinson and V. Kecman, "Combining Support Vector Machine Learning With the Discrete Cosine Transform in Image Compression," IEEE Transactions on Neural Networks, Vol. 14, No. 4, IEEE, July 2003, pp. 950-958.
[20] . Ivan Vilvovic, "An experience in Image compression using neural networks', 48th International Symposium ELMAR-2006, June 2006, Zadar, Croatia.
[21] . K.Venkata Ramanaiah, K.Lal Kishore and RGopal Reddy "Power Efficient Multilayer Neural Network for Image Compression", Information Technology Journal 6(8): 1252-1257, 2007 ISSN 1812-5638 @ 2007 Asian Network for Scientific Information.
If you have access to this article please login to view the article or kindly login to purchase the article

Purchase Instant Access

Single Article

North Americas,UK,
Middle East,Europe
India Rest of world
USD EUR INR USD-ROW
Online 15 15

Options for accessing this content:
  • If you would like institutional access to this content, please recommend the title to your librarian.
    Library Recommendation Form
  • If you already have i-manager's user account: Login above and proceed to purchase the article.
  • New Users: Please register, then proceed to purchase the article.