Neuromorphic Computing based on Resistive RAM

ABSTRACT

Resistive random access memory (RRAM) has gained significant attentions because of its excellent characteristics which are suitable for next-generation non-volatile memory applications. It is also very attractive to build neuromorphic computing chip based on RRAM cells due to non-volatile and analog properties. Neuromorphic computing hardware technologies using analog weight storage allow the scaling-up of the system size to complete cognitive tasks such as face classification much faster while consuming much lower energy. In this paper, RRAM technology development from material selection to device structure, from small array to full chip will be discussed in detail. Neuromorphic computing using RRAM devices is demonstrated, and speed & energy consumption are compared with Xeon Phi processor.

References

1. Najafabadi, M. M. et al. Deep learning applications and challenges in big data analytics. J. BIG DATA 2, 1--21 (2015).
2. Le, Q. V. in Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference on. 8595--8598 (IEEE).
3. X. Huang, et al., Optimization of TiN/TaOx/HfO2/TiN RRAM Arrays for Improved Switching and Data Retention, IEEE IMW, pp. 30--33, May 2015.
4. Rosenblatt, F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65, 386 (1958)..
5. Merolla, P. A. et al. A million spiking-neuron integrated circuit with a scalable communication network and interface. Science 345, 668--673 (2014).
6. Eryilmaz, S. B., Kuzum, D., Yu, S. & Wong, H. S. P. in 2015 IEEE International Electron Devices Meeting (IEDM). 4.1.1--4.1.4.
7. Han, S. et al. Eie: Efficient inference engine on compressed deep neural network. arXiv preprint arXiv:1602.01528 (2016).
8. Kuzum, D., Yu, S. & Wong, H. P. Synaptic electronics: materials, devices and applications. Nanotechnology 24, 382001 (2013).
9. Ohno, T. et al. Short-term plasticity and long-term potentiation mimicked in single inorganic synapses. Nat. Mater. 10, 591--595 (2011).
10. Alibart, F., Zamanidoost, E. & Strukov, D. B. Pattern classification by memristive crossbar circuits using ex situ and in situ training. Nat. Commun. 4 (2013).
11. Yu, S. et al. A low energy oxide-based electronic synaptic device for neuromorphic visual systems with tolerance to device variation. Adv. Mater. 25, 1774--1779 (2013).
12. Wong, H.-S. P. et al. Metal--oxide RRAM. Proc. IEEE 100, 1951--1970 (2012).
13. Burr, G. W. et al. Experimental demonstration and tolerancing of a large-scale neural network (165 000 Synapses) using phase-change memory as the synaptic weight element. IEEE Trans. Electron Devices 62, 3498--3507 (2015).
14. Li, X., Wu, H., Gao, B., et al. Electrode-induced digital-to-analog resistive switching in TaOx-based RRAM devices. Nanotechnology 30, 305201 (2016).
15. Kim, K.-H. et al. A functional hybrid memristor crossbar-array/CMOS system for data storage and neuromorphic applications. Nano Lett. 12, 389--395 (2011).
16. Indiveri, G., Linares-Barranco, B., Legenstein, R., Deligeorgis, G. & Prodromakis, T. Integration of nanoscale memristor synapses in neuromorphic computing architectures. Nanotechnology 24, 384010 (2013).
17. Fackenthal, R. et al. in Solid-State Circuits Conference Digest of Technical Papers (ISSCC), 2014 IEEE International. 338--339 (IEEE).
18. Yao, P., Wu, H., Gao, B., et al. Online Training on RRAM based Neuromorphic Network: Experimental Demonstration and Operation Scheme Optimization. ETDM (2017).
19. LeCun, Y. A., Bottou, L., Orr, G. B. & Müller, K.-R. in Neural networks: Tricks of the trade. 9--48 (Springer, 2012).
20. Gao, L., Chen, P.-Y. & Yu, S. Programming protocol optimization for analog weight tuning in resistive memories. IEEE Electron Device Lett. 36, 1157--1159 (2015).
21. Hertz, J., Krogh, A. & Palmer, R. G. Introduction to the theory of neural computation. Vol. 1 (Basic Books, 1991).
22. Yao, P. et al. Face classification using electronic synapses. Nat. Commun. 8, 15199 (2017).

Index Terms

• Computing methodologies

  • Machine learning

    • Machine learning approaches

• Hardware

  • Emerging technologies