Posts by Tags

2022

2024

CentOS 9

Install NVIDIA Driver on CentOS 9

less than 1 minute read

Published:

Installing the NVIDIA driver could be non-trivial if some packages or dependencies were missing during the installation process.

Conda

Remote jupyter notebook via ssh port forwarding

1 minute read

Published:

Remote jupyter notebook can be useful when the remote computer has better computing power than the local one or the remote is a server that you can connect from different places.

Fedora 20

Jupyter Notebook

Remote jupyter notebook via ssh port forwarding

1 minute read

Published:

Remote jupyter notebook can be useful when the remote computer has better computing power than the local one or the remote is a server that you can connect from different places.

LLM

Setup NVIDIA Chat with RTX on Windows 11

1 minute read

Published:

“Chat with RTX” is an application that allows customization of a GPT large language model (LLM) with your specific content like documents and notes. This enables you to generate contextually relevant answers from a bespoke chatbot. The entire setup operates locally on RTX-enabled Windows PCs or workstations, ensuring quick and secure access to information.

Markdown

Microsoft

Microsoft MX Format Emulation Tool on Ubuntu 22.04

1 minute read

Published:

Microscaling (MX) data formats are designed to reduce computational and storage costs in deep learning applications by combining a per-block scaling factor with narrow floating-point and integer types for individual elements. This approach balances hardware efficiency, model accuracy, and user convenience. Empirical results from popular benchmarks demonstrate the practicality of MX data formats as a drop-in replacement for standard FP32 in AI inference and training, with minimal user friction. Notably, MX formats have enabled the training of generative language models with sub-8-bit weights, activations, and gradients, incurring only minor accuracy losses without requiring modifications to the training process.

Microxcaling

Microsoft MX Format Emulation Tool on Ubuntu 22.04

1 minute read

Published:

Microscaling (MX) data formats are designed to reduce computational and storage costs in deep learning applications by combining a per-block scaling factor with narrow floating-point and integer types for individual elements. This approach balances hardware efficiency, model accuracy, and user convenience. Empirical results from popular benchmarks demonstrate the practicality of MX data formats as a drop-in replacement for standard FP32 in AI inference and training, with minimal user friction. Notably, MX formats have enabled the training of generative language models with sub-8-bit weights, activations, and gradients, incurring only minor accuracy losses without requiring modifications to the training process.

NVIDIA driver

Install NVIDIA Driver on CentOS 9

less than 1 minute read

Published:

Installing the NVIDIA driver could be non-trivial if some packages or dependencies were missing during the installation process.

Nvidia

Setup NVIDIA Chat with RTX on Windows 11

1 minute read

Published:

“Chat with RTX” is an application that allows customization of a GPT large language model (LLM) with your specific content like documents and notes. This enables you to generate contextually relevant answers from a bespoke chatbot. The entire setup operates locally on RTX-enabled Windows PCs or workstations, ensuring quick and secure access to information.

SSH

Remote jupyter notebook via ssh port forwarding

1 minute read

Published:

Remote jupyter notebook can be useful when the remote computer has better computing power than the local one or the remote is a server that you can connect from different places.

Windows

Setup NVIDIA Chat with RTX on Windows 11

1 minute read

Published:

“Chat with RTX” is an application that allows customization of a GPT large language model (LLM) with your specific content like documents and notes. This enables you to generate contextually relevant answers from a bespoke chatbot. The entire setup operates locally on RTX-enabled Windows PCs or workstations, ensuring quick and secure access to information.

bootable flash drive

docker

Microsoft MX Format Emulation Tool on Ubuntu 22.04

1 minute read

Published:

Microscaling (MX) data formats are designed to reduce computational and storage costs in deep learning applications by combining a per-block scaling factor with narrow floating-point and integer types for individual elements. This approach balances hardware efficiency, model accuracy, and user convenience. Empirical results from popular benchmarks demonstrate the practicality of MX data formats as a drop-in replacement for standard FP32 in AI inference and training, with minimal user friction. Notably, MX formats have enabled the training of generative language models with sub-8-bit weights, activations, and gradients, incurring only minor accuracy losses without requiring modifications to the training process.

github

configure github repo language

less than 1 minute read

Published:

After you committed your repo, github will automatically detect the programming language you used. Sometimes, the specified the language is not the right one.

gpu

GPU Related

less than 1 minute read

Published:

GPU-related notes

linux

Linux Related

less than 1 minute read

Published:

Linux-related notes

Install Miniconda and Tensorflow GPU

less than 1 minute read

Published:

miniconda is a simplified version of anaconda where you can configure different environments for various development purposes. Using this software, Tensorflow with GPU support can be set up for deep learning research.

Use Screen in Linux

1 minute read

Published:

screen command in Linux provides the ability to launch and use multiple shell sessions from a single ssh session.

miniconda

Install Miniconda and Tensorflow GPU

less than 1 minute read

Published:

miniconda is a simplified version of anaconda where you can configure different environments for various development purposes. Using this software, Tensorflow with GPU support can be set up for deep learning research.

notes

GPU Related

less than 1 minute read

Published:

GPU-related notes

Linux Related

less than 1 minute read

Published:

Linux-related notes

opencl

reading

rocm

screen

Use Screen in Linux

1 minute read

Published:

screen command in Linux provides the ability to launch and use multiple shell sessions from a single ssh session.

tensorflow

Install Miniconda and Tensorflow GPU

less than 1 minute read

Published:

miniconda is a simplified version of anaconda where you can configure different environments for various development purposes. Using this software, Tensorflow with GPU support can be set up for deep learning research.

ubuntu