How to normalize data using NumPy or Pandas

When it comes to machine learning, working with normalized numbers may lead to faster convergence while training the models. Here we will show how you can normalize your dataset in Python using either NumPy or Pandas.

NumPy

To normalize a NumPy array, you can use:

import numpy as np

data = np.loadtxt('data.txt')

for col in range(data.shape[1]):
    data[:,col] -= np.average(data[:,col])
    data[:,col] /= np.std(data[:,col])

Here data.shape[1] is the number of columns in the dataset, and we are using NumPy to normalize the average and standard deviation of each column to 0 and 1 respectively.

Pandas

Normalizing a Pandas dataframe is even easier:

import pandas as pd

df = pd.read_csv('data.csv')

df = (df-df.mean())/df.std()

This will normalize each column of the dataframe.

About TuringBot

TuringBot is a desktop software for Symbolic Regression. By feeding your data in .TXT or .CSV format into the program, you can immediately start searching for mathematical formulas that connect the variables. If you want to learn more about what TuringBot can offer you, please visit our homepage.