Leiming

Leiming

在更高的地方遇见自己

Install Miniconda and Tensorflow GPU

less than 1 minute read

Published:

miniconda is a simplified version of anaconda where you can configure different environments for various development purposes. Using this software, Tensorflow with GPU support can be set up for deep learning research.

In this tutorial,2022-rehl8-miniconda-tfgpu.pdf, I go over the following steps to set miniconda and tensorflow-gpu (v2.7.0) on RHEL 8.

  • Uninstall existing anaconda
  • Install miniconda for multi-users
  • Install tensorflow-gpu with pip

You May Also Enjoy

Microsoft MX Format Emulation Tool on Ubuntu 22.04

2 minute read

Published:

Microscaling (MX) data formats are designed to reduce computational and storage costs in deep learning applications by combining a per-block scaling factor with narrow floating-point and integer types for individual elements. This approach balances hardware efficiency, model accuracy, and user convenience. Empirical results from popular benchmarks demonstrate the practicality of MX data formats as a drop-in replacement for standard FP32 in AI inference and training, with minimal user friction. Notably, MX formats have enabled the training of generative language models with sub-8-bit weights, activations, and gradients, incurring only minor accuracy losses without requiring modifications to the training process.

Setup NVIDIA Chat with RTX on Windows 11

1 minute read

Published:

“Chat with RTX” is an application that allows customization of a GPT large language model (LLM) with your specific content like documents and notes. This enables you to generate contextually relevant answers from a bespoke chatbot. The entire setup operates locally on RTX-enabled Windows PCs or workstations, ensuring quick and secure access to information.

GPU Related

less than 1 minute read

Published:

GPU-related notes