Markdown Cheatsheet
Published:
Blog posts
2024
Microsoft MX Format Emulation Tool on Ubuntu 22.04
Published:
Microscaling (MX) data formats are designed to reduce computational and storage costs in deep learning applications by combining a per-block scaling factor with narrow floating-point and integer types for individual elements. This approach balances hardware efficiency, model accuracy, and user convenience. Empirical results from popular benchmarks demonstrate the practicality of MX data formats as a drop-in replacement for standard FP32 in AI inference and training, with minimal user friction. Notably, MX formats have enabled the training of generative language models with sub-8-bit weights, activations, and gradients, incurring only minor accuracy losses without requiring modifications to the training process.
Setup NVIDIA Chat with RTX on Windows 11
Published:
“Chat with RTX” is an application that allows customization of a GPT large language model (LLM) with your specific content like documents and notes. This enables you to generate contextually relevant answers from a bespoke chatbot. The entire setup operates locally on RTX-enabled Windows PCs or workstations, ensuring quick and secure access to information.
2022
GPU Related
Published:
GPU-related notes
Remote jupyter notebook via ssh port forwarding
Published:
Remote jupyter notebook can be useful when the remote computer has better computing power than the local one or the remote is a server that you can connect from different places.
Books Read in 2022
Published:
Reading Notes
Linux Related
Published:
Linux-related notes
Install NVIDIA Driver on CentOS 9
Published:
Installing the NVIDIA driver could be non-trivial if some packages or dependencies were missing during the installation process.
Install Miniconda and Tensorflow GPU
Published:
miniconda is a simplified version of anaconda where you can configure different environments for various development purposes. Using this software, Tensorflow with GPU support can be set up for deep learning research.
2020
Use Screen in Linux
Published:
screen command in Linux provides the ability to launch and use multiple shell sessions from a single ssh session.
Create a bootable flash drive in Linux (Fedora 20)
Published:
Burn a new OS image onto a bootable flash drive.
2019
Install ROCm driver on ubuntu 18.04
Published:
You can following the installation manual
configure github repo language
Published:
After you committed your repo, github will automatically detect the programming language you used. Sometimes, the specified the language is not the right one.