Introduction to neural networks

Terry Benzschawel

A neural network is a method in artificial intelligence that teaches computers to process data in a way that is inspired by the human brain. For example, Figure 5.1 shows a diagram of the retina of the human eye and a corresponding computer system. The mathematical model for colour vision is designed to mimic the neurons in the brain and to process light energy analogously. Before introducing networks, this chapter explores the development of the artificial neuron and its functions. In addition, neurons’ activation functions are described along with their inclusion in multilayer perceptrons. Finally, the method of training neural networks using error back-propagation is introduced.

5.1 INTRODUCTION AND EARLY HISTORY

Recall from Chapter 3 the artificial neuron introduced by McCulloch and Pitts. That neuron had binary (0 or 1) inputs that were summed and measured against a threshold for a binary output signal. The McCulloch–Pitts neuron, shown in Figure 5.2, can be represented formally as:

g( x 1 , x 2 , x 3 ,, x n )=g(x)=   i=1 n x i ,y=f(g(x))={ 1,g(x)θ 0,g(x)<θ (5.1) 

In Equation 5.1 the function g(x) is a summation of the inputs, xi, and θ is called the

Sorry, our subscription options are not loading right now

Please try again later. Get in touch with our customer services team if this issue persists.

New to Risk.net? View our subscription options

You need to sign in to use this feature. If you don’t have a Risk.net account, please register for a trial.

Sign in
You are currently on corporate access.

To use this feature you will need an individual account. If you have one already please sign in.

Sign in.

Alternatively you can request an individual account here