Settings

Theme

A proposal for clean cloud-free AI inference network

github.com

1 points by zanfr 4 months ago · 1 comment

Reader

zanfrOP 4 months ago

A globally distributed, peer-to-peer (P2P) network for large language models (LLMs) that ensures:

* Privacy: All queries remain on local nodes unless federated updates are performed. * Censorship resistance: No central authority controls outputs. * Renewable energy utilization: Inferers only operate when powered by solar, wind, or other green energy sources. * Continuous operation: Geographic distribution ensures night/day operation. * Community-driven model selection: Nodes vote on the model to use, ensuring it fits inferer constraints.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection