top of page
Writer's pictureAnupam Kanoongo (Writer)

Types of Neural Networks


Types of Neural Networks ?


1. Modular Neural Networks


In this type of neural network, many independent networks contribute to the results collectively. There are many sub-tasks performed and constructed by each of these neural networks. This provides a set of inputs that are unique when compared with other neural networks. There is no signal exchange or interaction between these neural networks to accomplish any task.


The complexity of a problem is easily reduced while solving problems by these modular networks because they completely break down the sizeable computational process into small components. The computation speed also gets improved when the number of connections is broken down and reduces the need for interaction of the neural networks with each other.


The total time of processing will also depend on the involvement of neurons in the computation of results and how many neurons are involved in the process. Modular Neural Networks (MNNs) is one of the fastest-growing areas of Artificial Intelligence.


2. Feedforward Neural Network – Artificial Neuron

The information in the neural network travels in one direction and is the purest form of an Artificial Neural Network. This kind of neural network can have hidden layers and data enter through input nodes and exit through output nodes. Classifying activation function is used in this neural network. There is no backpropagation, and only the front propagated wave is allowed.

There are many applications of Feedforward neural networks, such as speech recognition and computer vision. It is easier to maintain these types of Neural Networks and also has excellent responsiveness to noisy data.

3. Radial basis function Neural Network


There are two layers in the functions of RBF. These are used to consider the distance of a center with respect to the point. In the first layer, features in the inner layer are united with the Radial Basis Function. In the next step, the output from this layer is considered for computing the same output in the next iteration. One of the applications of the Radial Basis function can be seen in Power Restoration Systems. There is a need to restore the power as reliably and quickly as possible after a blackout.


4. Kohonen Self Organizing Neural Network


In this neural network, vectors are input to a discrete map from an arbitrary dimension. Training data of an organization is created by training the map. There might be one or two dimensions on the map. The weight of the neurons may change that depends on the value.

The neuron’s location will not change while training the map and will stay constant. Input vector and small weight are given to every neuron value in the first phase of the self-organization process. A winning neuron is a neuron that is closest to the point. Other neurons will also start to move towards the point along with the winning neuron in the second phase.

The winning neuron will have the least distance, and euclidean distance is used to calculate the distance between neurons and the point. Each neuron represents each kind of cluster, and the clustering of all the points will happen through the iterations.

One of the main applications of Kohonen Neural Network is to recognize the data patterns. It is also used in medical analysis to classify diseases with higher accuracy. Data are clustered into different categories after analyzing the trends in the data.


5. Recurrent Neural Network(RNN)


The principle of Recurrent Neural Network is to feedback the output of a layer back to the input again. This principle helps to predict the outcome of the layer. In the Computation process, Each neuron will act as a memory cell. The neuron will retain some information as it goes to the next time step.

It is called a recurrent neural network process. The data to be used later will be remembered and work for the next step will go on in the process. The prediction will improve by error correction. In error correction, some changes are made to create the right prediction output. The learning rate is the rate of how fast the network can make the correct prediction from the wrong prediction.

There is much application of Recurrent Neural Networks, and one of them is the model of converting text to speech. The recurrent neural network was designed for supervised learning without any requirement of teaching signal.


6. Convolutional Neural Network


In this type of neural network, Learn-able biases and weights are given to the neurons initially. Image processing and signal processing are some of their applications in the computer vision field. It has taken over OpenCV.

The images are remembered in parts to help the network in computing operations. The photos are recognized by taking the input features batch-wise. In the computing process, the image is converted to Grayscale from HSI or RGB scale. The classification of images is done into various categories after the image is transformed. Edges are detected by finding out the pixel value change.

The technique of Image classification and signal processing are used in ConvNet. For image classification, Convolutional Neural Networks have a very high level of accuracy. That is also the reason why convolutional neural networks are dominating computer vision techniques. Prediction of yield and growth in the future of a land area are other applications of convolutional neural networks in weather and agriculture features.


7. Long / Short Term Memory


Schmidhuber and Hochreiter in 1997 built a neural network which is called long short-term memory networks (LSTMs). Its main goal is to remember things for a long time in a memory cell that is explicitly defined. Previous values are stored in the memory cell unless told to forget the values by “forget gate”.

New stuff is added through the “input gate” to the memory cell, and it is passed to the next hidden state from the cell along the vectors which is decided by the “output gate”. Composition of primitive music, writing like Shakespeare, or learning complex sequences are some of the applications of LSTMs.


Hence,

These are the different types of neural networks that are used to power Artificial Intelligence and machine learning. We hope this article has shed some light on Neural networks and the types being used for ML

If you would like to know more about Machine Learning and Artificial Intelligence, Stay tuned to this Category: Click to Open Category


Hence, in this article, we discussed briefly the Types of Neural Networks. We'll discuss the others also.

Till then Stay Tuned Stay Safe


3 views0 comments

Recent Posts

See All

Comments


bottom of page