CUDA

A while back I found a small bug in TensorFlow. Now that I had some free time, I decided to submit a PR. The bug was fixed quickly, but when I tried to build TensorFlow locally, I ran into quite a few gotchas. Here are my notes. 1. So Many Versions, So Confusing Before we start building, let’s go over the relevant Nvidia GPU dependencies. Nvidia has various GPU architectures. To distinguish between them, Nvidia uses Compute Capability....

I’ve been wanting to learn CUDA recently. Here are my notes on setting up the environment. Create an environment. We’re just using Conda for environment isolation here — no Python needed. $ conda create -n cuda-dev $ conda activate cuda-dev Check the CUDA version with nvidia-smi. Note that this version is the maximum CUDA version supported by the driver, not the CUDA runtime version we’ll install later. When installing, make sure the CUDA runtime version ≤ the driver version....