Skip to content

Mathematics

Some math topics with relation to ML

Bivariate Normal Distribution

Bivariate normal distribution – derivation by linear transformation of a random vector of two independent Gaussians

In an another post on properties of a Bivariate Normal Distribution [BVD] I have motivated the form of its probability density function [pdf] by symmetry arguments and the underlying probability density functions of its marginals, namely 1-dimensional Gaussians. In this post we will derive the probability density function by following the line of argumentation for a general Multivariate Normal Distribution… Read More »Bivariate normal distribution – derivation by linear transformation of a random vector of two independent Gaussians

Multivariate Normal Distributions – IV – Spectral decomposition of the covariance matrix and rotation of the coordinate system

In the preceding posts of this series we have considered a comprehensible definition and basic properties of a non-degenerate “Multivariate Normal Distribution” of vectors in the ℝn [N-MND]. In this post we will make a step in the direction of a numerical analysis of some given finite vector distribution with properties that indicate an underlying N-MND. We want to find… Read More »Multivariate Normal Distributions – IV – Spectral decomposition of the covariance matrix and rotation of the coordinate system

Concentric surfaces of ellipsoids

Multivariate Normal Distributions – III – Variance-Covariance Matrix and a distance measure for vectors of non-degenerate distributions

In previous posts of this series I have motivated the functional form of the probability density of a so called “non-degenerate Multivariate Normal Distribution“. In this post we will have a closer look at the matrix Σ that controls the probability density function [pdf] of such a distribution. We will show that it actually is the covariance matrix of the… Read More »Multivariate Normal Distributions – III – Variance-Covariance Matrix and a distance measure for vectors of non-degenerate distributions

Linear transformed 3-dim Z-distribution

Multivariate Normal Distributions – II – Linear transformation of a random vector with independent standardized normal components

In Machine Learning we typically deal with huge, but finite vector distributions defined in the ℝn. At least in certain regions of the ℝn these distributions may approximate an underlying continuous distribution. In the first post of this series we worked with a special type of continuous vector distribution based on independent 1-dimensional standardized normal distributions for the vector components.… Read More »Multivariate Normal Distributions – II – Linear transformation of a random vector with independent standardized normal components