Skip to content

GPU

PyTorch / datasets / dataloader / data transfer to GPU – III – prepared tensor datasets and preloading to GPU

In this post series we have a look at PyTorch dataloaders and Torchvision image datasets (downloaded via PyTorch modules). PyTorch DataLoaders retrieve batches of dataset elements and transfer them to neural networks [NN] on a computation device – e.g. a CUDA driven graphics card. A central dataset functions applies defined transformation operations to its elements. We analyze the impact of… Read More »PyTorch / datasets / dataloader / data transfer to GPU – III – prepared tensor datasets and preloading to GPU

Runtime vs.number of dataloader workers and batch size

PyTorch / datasets / dataloader / data transfer to GPU – II – dataloader too slow on CPU?

Editorial hint: This post has been revised and changed in parts on March, 18th/19th/22nd, 2025, after some new tests and insights. The changes did not concern the result data of the performed experiments, but their interpretation. In the last post of this mini-series we saw that some Torchvision datasets have a directly accessible property “data“. It contains image data in… Read More »PyTorch / datasets / dataloader / data transfer to GPU – II – dataloader too slow on CPU?

Examples images from the FashionMnist dataset

PyTorch / datasets / dataloader / data transfer to GPU – I – properties of some torchvision datasets

For an old fan of Tensorflow2 it is somewhat satisfactory to notice that some problems also exist in analogous form in a PyTorch environment. Anyone who has worked with visual data knows that one needs to modify, augment and transform the image data and then load them from some storage under CPU control to the GPU’s VRAM before or during… Read More »PyTorch / datasets / dataloader / data transfer to GPU – I – properties of some torchvision datasets

Installation of CUDA 12.3 and CuDNN 8.9 on Opensuse Leap 15.5 for Machine Learning

Machine Learning on a Linux system is no fun without a GPU and its parallel processing capabilities. On a system with a Nvidia card you need basic Nvidia drivers and additional libraries for optimal support of Deep Neural Networks and Linear Algebra operations on the GPU sub-processors. E.g., Keras and Tensorflow 2 [TF2] use CUDA and cuDNN-libraries on your Nvidia… Read More »Installation of CUDA 12.3 and CuDNN 8.9 on Opensuse Leap 15.5 for Machine Learning