QQ - How do I normalise a field in DataJet?
  • 1 Minute to read
  • Dark
    Light
  • PDF

QQ - How do I normalise a field in DataJet?

  • Dark
    Light
  • PDF

Article summary

DataJet has various statistical functions for generating and preparing data, including normalization and standardization.   These functions can be found in Engineering | Functions | Statistical:

Data Preparation

FunctionDescriptionReference
StandardizeStandardizes data around a mean of 0 and a standard deviation of 1(x - avg) / stdev
NormalizeNormalizes data to a min of 0 and a max of 1

(x - min) / range;  

range = max-min

Normalize@ZeroNormalizes data to a min of -1 and a max of 1((2.0 * (x - min)) / range) - 1
MeanCentricCentres data around the meanx - avg


Access this functionality by:

  • Selecting a source field in the Database Tree
  • Using the Engineering | Function | Designer
  • Using Engineering | Functions | Statistical menu
  • Creating a BuildBakedField method in script editor

Database Tree

Function Designer and Engineering Functions

Script Editor

{
  "method": "BuildBakedField",
  "project": "D5",
  "targetTable": "UKDeaths",
  "overwrite": true,
  "name": "stand_Totaldeaths",
  "function": "statistical",
  "p1": "STANDARDIZE(A)",
  "p2": "Totaldeaths"
}

Data Generation

DataJet also provides the ability to generate data according to various distributions: 

DistributionDescriptionReference
Normalproduces real values on a standard normal (Gaussian) distribution
Normal distribution - Wikipedia

LogNormalproduces real values on a lognormal distribution
Log-normal distribution - Wikipedia
ChiSquaredproduces real values on a chi-squared distributionChi-squared distribution - Wikipedia
Cauchyproduces real values on a Cauchy distribution.
Cauchy distribution - Wikipedia
Poissonproduces integer values on a poisson distribution.
Poisson distribution - Wikipedia
Binomialproduces integer values on a binomial distribution.
Binomial distribution - Wikipedia
Bernoulliproduces bool values on a Bernoulli distribution
Bernoulli distribution - Wikipedia
UniformIproduces integer values evenly distributed across a range

UniformRproduces real values evenly distributed across a range


Was this article helpful?