Understanding Deep Belief Networks in Python

In this tutorial, we will be Understanding Deep Belief Networks in Python. Before reading this tutorial it is expected that you have a basic understanding of Artificial neural networks and Python programming.

So, let’s start with the definition of Deep Belief Network. It is nothing but simply a stack of Restricted Boltzmann Machines connected together and a feed-forward neural network. Now the question arises here is what is Restricted Boltzmann Machines.

Restricted Boltzmann Machines

Before stating what is Restricted Boltzmann Machines let me clear you that we are not going into its deep mathematical details. We are just learning how it functions and how it differs from other neural networks.

RBM has three parts in it i.e. One Hidden layer, One Input layer, and bias units. In the input layer, we will give input and it will get processed in the model and we will get our output. That output is then passed to the sigmoid function and probability is calculated. Now again that probability is retransmitted in a reverse way to the input layer and difference is obtained called Reconstruction error that we need to reduce in the next steps. This process will reduce the number of iteration to achieve the same accuracy as other models.

DBN is just a stack of these networks and a feed-forward neural network. Now we will go to the implementation of this.

Code in Python Programming Language

from sklearn.model_selection import train_test_split
from dbn.tensorflow import SupervisedDBNClassification
import numpy as np
import pandas as pd
from sklearn.metrics.classification import accuracy_score

We will start with importing libraries in python. There are many datasets available for learning purposes. For this tutorial, we are using https://www.kaggle.com/c/digit-recognizer.

digits = pd.read_csv("train.csv")
from sklearn.preprocessing import standardscaler
X = np.array(digits.drop(["label"], axis=1))
Y = np.array(digits["label"])
X = ss.fit_transform(X)
x_train, x_test, y_train, y_test = train_test_split(X, Y, test_size=0.25, random_state=0)
classifier = SupervisedDBNClassification(hidden_layers_structure =[256, 256], learning_rate_rbm=0.05, learning_rate=0.1, n_epochs_rbm=10, n_iter_backprop=100, batch_size=32, activation_function='relu', dropout_p=0.2)
classifier.fit(x_train, y_train)
y_pred = classifier.predict(x_test)
print('\nAccuracy of Prediction: %f' % accuracy_score(x_test, y_pred))


Accuracy of Prediction: 93.2%

Then we will upload the CSV file fit that into the DBN model made with the sklearn library. And split the test set and training set into 25% and 75% respectively. Then we predicted the output and stored it into y_pred. And in the last, we calculated Accuracy score and printed that on screen. That’s it!

5 responses to “Understanding Deep Belief Networks in Python”

  1. noman says:

    plz plz help me to witre code for classification of chest x-ray of covid-19 patient using deep belief network and autoencoder. That to identify that a person is infected or not using chest x-ray

  2. Shima says:

    thanks a lot for your learning.
    I have one question. when I run this line of the above code “from dbn.tensorflow import SupervisedDBNClassification”, the error “No module named ‘dbn'” appears. how to solve this problem?

  3. Darli says:

    thanks for this report.
    I also have this problem. Run this line of the above code “from dbn.tensorflow import SupervisedDBNClassification”, the error “No module named ‘dbn’” appears. how to solve this problem?

  4. Khan says:

    the error “No module named ‘dbn’” appears. how to solve this problem,
    you can search dbn in github. I cannot put the link here, as it is not allowed. but you can get from github download the dbn file put it in the path and you ready to go.

    • kayla says:

      I downloaded dbn and put it in the same folder of my code but I get on the same problem Import “dbn.tensorflow” could not be resolved

Leave a Reply

Your email address will not be published. Required fields are marked *