My home lab for AI models - llmlaba v1
text
My home lab for AI models - llmlaba v1
new_line
new_line
After I began learning MLOps I realized that I needed some kind of home lab, there are a lot of GPUs that I need to learn how to set up and test. 
text
After I began learning MLOps I realized that I needed some kind of home lab, there are a lot of GPUs that I need to learn how to set up and test. 
new_line
So I spent some time to do a researching which platform I could buy or build.
text
So I spent some time to do a researching which platform I could buy or build.
new_line
My requirements ware:
text
My requirements ware:
new_line
- Limited budget
text
- Limited budget
new_line
- Power supply 1 kW or higher
text
- Power supply 1 kW or higher
new_line
- Few PCIe slots to be able to install more than one gpu
text
- Few PCIe slots to be able to install more than one gpu
new_line
- Zero maintenance cost, I don't want spend a lot of time or money to maintain lab hardware, except for the GPUs
text
- Zero maintenance cost, I don't want spend a lot of time or money to maintain lab hardware, except for the GPUs
new_line
new_line
I chose the Intel Mac Pro 7.1:
text
I chose the Intel Mac Pro 7.1:
new_line
- Prices on eBay acceptable 
text
- Prices on eBay acceptable 
new_line
- Excelent cooling
text
- Excelent cooling
new_line
- 1.4 kW power supply 
text
- 1.4 kW power supply 
new_line
- 7 PCIe slots 
text
- 7 PCIe slots 
new_line
- Zero maintenance: I don't need to do anything with the Mac Pro hardware; it just works
text
- Zero maintenance: I don't need to do anything with the Mac Pro hardware; it just works
new_line
- Classic UEFI boot loader
text
- Classic UEFI boot loader
new_line
new_line
It requires a bit of OS preparation: 
text
It requires a bit of OS preparation: 
new_line
1. Install Ubuntu 24.04 (it works with the general PC ISO image)
text
1. Install Ubuntu 24.04 (it works with the general PC ISO image)
new_line
2. Set up T2 drivers
text
2. Set up T2 drivers
new_line
sudo apt install -y dkms linux-headers-$(uname -r) applesmc-t2 apple-bce lm-sensors
bash
```bash
sudo apt install -y dkms linux-headers-$(uname -r) applesmc-t2 apple-bce lm-sensors
```
code_fence
new_line
3. Install t2fanrd to manually manage fans (/etc/t2fand.conf) 
text
3. Install t2fanrd to manually manage fans (/etc/t2fand.conf) 
https://wiki.t2linux.org/guides/fan/
https://wiki.t2linux.org/guides/fan/
link
new_line
4. Fix PCIe BAR: add pci=realloc to GRUB_CMDLINE_LINUX_DEFAULT so the Linux kernel will properly initializes server GPUs without Graphics Output Protocol
text
4. Fix PCIe BAR: add pci=realloc to GRUB_CMDLINE_LINUX_DEFAULT so the Linux kernel will properly initializes server GPUs without Graphics Output Protocol
new_line
5. Install NVIDIA GPU driver:
text
5. Install NVIDIA GPU driver:
new_line
sudo apt install nvidia-driver-570
bash
```bash
sudo apt install nvidia-driver-570
```
code_fence
new_line
new_line
And it works!
text
And it works!
new_line
I was able to run server-grade Nvidia Tesla P100 (required DIY air duct), and consumer Nvidia Titan X, Titan V, GTX 1080 cards on the old Mac Pro 7.1 - even three in parallel.
text
I was able to run server-grade Nvidia Tesla P100 (required DIY air duct), and consumer Nvidia Titan X, Titan V, GTX 1080 cards on the old Mac Pro 7.1 - even three in parallel.
new_line
new_line
https://cdn-avatars.huggingface.co/v1/production/uploads/684cc105c94f57af8b956042/GjyPx_RtG5xE81POFeWEj.png
https://huggingface.co/llmlaba
llmlaba
org
resource
https://huggingface.co/llmlaba
My home lab for AI models - llmlaba v1

After I began learning MLOps I realized that I needed some kind of home lab, there are a lot of GPUs that I need to learn how to set up and test. 
So I spent some time to do a researching which platform I could buy or build.
My requirements ware:
- Limited budget
- Power supply 1 kW or higher
- Few PCIe slots to be able to install more than one gpu
- Zero maintenance cost, I don't want spend a lot of time or money to maintain lab hardware, except for the GPUs

I chose the Intel Mac Pro 7.1:
- Prices on eBay acceptable 
- Excelent cooling
- 1.4 kW power supply 
- 7 PCIe slots 
- Zero maintenance: I don't need to do anything with the Mac Pro hardware; it just works
- Classic UEFI boot loader

It requires a bit of OS preparation: 
1. Install Ubuntu 24.04 (it works with the general PC ISO image)
2. Set up T2 drivers
```bash
sudo apt install -y dkms linux-headers-$(uname -r) applesmc-t2 apple-bce lm-sensors
```
3. Install t2fanrd to manually manage fans (/etc/t2fand.conf) https://wiki.t2linux.org/guides/fan/
4. Fix PCIe BAR: add pci=realloc to GRUB_CMDLINE_LINUX_DEFAULT so the Linux kernel will properly initializes server GPUs without Graphics Output Protocol
5. Install NVIDIA GPU driver:
```bash
sudo apt install nvidia-driver-570
```

And it works!
I was able to run server-grade Nvidia Tesla P100 (required DIY air duct), and consumer Nvidia Titan X, Titan V, GTX 1080 cards on the old Mac Pro 7.1 - even three in parallel.

https://huggingface.co/llmlaba
🚀
John6666 AxionLab-official frdgk kabachuha DedeProGames mrs83 Sameer-13 Padakovec mathiasn1 Akicou victor
👍
Antigonish twilliamsjr79 AxionLab-official ianncity SCOtest DedeProGames mrs83 0wner
🔥
Lintrarius AxionLab-official enzoescipy DedeProGames CASLL Sameer-13
🤗
kostakoff
65d79ce35a6766eb1e2c0988
https://cdn-avatars.huggingface.co/v1/production/uploads/65d79ce35a6766eb1e2c0988/jQFMcYldcIHS81irODRWL.png
Carlos L.
CASLL
user
68c40887dc795c2cae6c2f0c
https://cdn-avatars.huggingface.co/v1/production/uploads/68c40887dc795c2cae6c2f0c/GZIoAgSoE4nqGK1Q9B1JA.webp
n0kovo
n0kovo
user