I started Friday with decentralized AI using Gemma-2, and it all works without blockchain. This is what I did: 
text
I started Friday with decentralized AI using Gemma-2, and it all works without blockchain. This is what I did: 
new_line
new_line
 1. Pinned Gemma-2 9B in the Interplanetary Filesystem IPFS with the LoRA fine-tuning adapters.
text
 1. Pinned Gemma-2 9B in the Interplanetary Filesystem IPFS with the LoRA fine-tuning adapters.
new_line
 2. Set up a llama-ipfs server to fetch and cache the model and adapters on the fly and inference locally.
text
 2. Set up a llama-ipfs server to fetch and cache the model and adapters on the fly and inference locally.
new_line
new_line
Now, I can use my on device AI platform across:
text
Now, I can use my on device AI platform across:
new_line
new_line
 • All my macOS automation workflows
text
 • All my macOS automation workflows
new_line
 • All my browsers
text
 • All my browsers
new_line
 • My Copilot++ in VSCode
text
 • My Copilot++ in VSCode
new_line
 • My Open Apple Intelligence (OAI, not to be confused with the other closed OAI owned by a nonprofit foundation and BigTech)
text
 • My Open Apple Intelligence (OAI, not to be confused with the other closed OAI owned by a nonprofit foundation and BigTech)
new_line
new_line
The llama-ipfs server’s RPC support lets me decentralize inferencing across all my devices, supercharging computing and energy efficiency.
text
The llama-ipfs server’s RPC support lets me decentralize inferencing across all my devices, supercharging computing and energy efficiency.
new_line
new_line
Make sure you own your AI. AI in the cloud is not aligned with you, it’s aligned with the company that owns it.
text
Make sure you own your AI. AI in the cloud is not aligned with you, it’s aligned with the company that owns it.
I started Friday with decentralized AI using Gemma-2, and it all works without blockchain. This is what I did: 

 1. Pinned Gemma-2 9B in the Interplanetary Filesystem IPFS with the LoRA fine-tuning adapters.
 2. Set up a llama-ipfs server to fetch and cache the model and adapters on the fly and inference locally.

Now, I can use my on device AI platform across:

 • All my macOS automation workflows
 • All my browsers
 • My Copilot++ in VSCode
 • My Open Apple Intelligence (OAI, not to be confused with the other closed OAI owned by a nonprofit foundation and BigTech)

The llama-ipfs server’s RPC support lets me decentralize inferencing across all my devices, supercharging computing and energy efficiency.

Make sure you own your AI. AI in the cloud is not aligned with you, it’s aligned with the company that owns it.
🔥
Csplk not-lain HalloZoolee AxelVirtual
🤯
Nerius HalloZoolee
❤️
not-lain
6646428e923866048f3e13e0
/avatars/54483699273ac58a4a6fe1fa4aab65fe.svg
Robert Sinclair
ZeroWw
user
66113b0fc2c3974380a7842d
/avatars/45b6f3e0a07a1abfd4900153bafda6dc.svg
Fernando M Lemos
fmlemos
user