Skip to content

eremo

Two CUDA/cudnn versions with Pytorch and Tensorflow in one virtual Python environment

One of the problems I recently ran into was the coexistence of Tensorflow2 [TF2] and PyTorch in the very same virtual Python environment. I just wanted to make experiments to compare the performance of some Keras-based models with the TF2-backend on one side and, on the other side, with the PyTorch-backend. My trouble resulted from a mismatch of two CUDA/cudnn… Read More »Two CUDA/cudnn versions with Pytorch and Tensorflow in one virtual Python environment

ResNet56V2 Convergence within epoch 20

AdamW for a ResNet56v2 – VI – Super-Convergence after improving the ResNetV2

In previous posts of this series I have shown that a Resnet56V2 with AdamW can converge to acceptable values of the validation accuracy for the CIFAR10 dataset – within less than 26 epochs. An optimal schedule of the learning rate [LR] and optimal values for the weight decay parameter [WD] were required. My network – a variation of the ResNetV2-structure… Read More »AdamW for a ResNet56v2 – VI – Super-Convergence after improving the ResNetV2

CAE generated face on background of a MND

Latent space distribution of a CAE for face images – I – unenforced Multivariate Normal Distributions

The analysis of face images by a trained Autoencoder and the generation of face images from statistical vectors is a classical task in Machine Learning. In this post series I want to clarify the properties of vector distributions for face images generated by a trained standard Convolutional Autoencoder [CAE] in its latent space. The dataset primarily used is the CelebA… Read More »Latent space distribution of a CAE for face images – I – unenforced Multivariate Normal Distributions

Multivariate Normal Distributions – IV – Spectral decomposition of the covariance matrix and rotation of the coordinate system

In the preceding posts of this series we have considered a comprehensible definition and basic properties of a non-degenerate “Multivariate Normal Distribution” of vectors in the ℝn [N-MND]. In this post we will make a step in the direction of a numerical analysis of some given finite vector distribution with properties that indicate an underlying N-MND. We want to find… Read More »Multivariate Normal Distributions – IV – Spectral decomposition of the covariance matrix and rotation of the coordinate system