diff --git a/.gitignore b/.gitignore
new file mode 100644
index 0000000..24d0d7e
--- /dev/null
+++ b/.gitignore
@@ -0,0 +1,2 @@
+checkpoints/*
+!checkpoints/README.md
diff --git a/README.md b/README.md
index f9a770c..46aa03b 100644
--- a/README.md
+++ b/README.md
@@ -41,7 +41,7 @@ Grok-1 is currently designed with the following specifications:
 - **Maximum Sequence Length (context):** 8,192 tokens
 - **TPU/GPU:** NVIDIA/AMD supported only
 
-## 4. Downloading the weights
+## 3. Downloading the weights
 
 You can download the weights using a torrent client and this magnet link: