Run inference on a decentralized network in an open market of trusted users.
Now entering private alpha, DM for access
OCIP · Open Source · Building in Public
Inference Exchange is entering private alpha.
We're building an open and transparent marketplace for AI inference built on the Open Confidence Inference Protocol (OCIP).
If you have Apple Silicon or use OpenAI's Python SDK feel free to reach out.
Reply or DM for access.
We've been building for a few months now, and we've been fortunate enough to secure some funding from family. Looking forward to pushing Inference Exchange to the next step.
reddit.com/r/LocalLLM/s/Ss2L…
Hi all, sharing this Reddit thread on some research I’m doing into confidential computing for the purpose of local LLM inference with consumer hardware (e.g. Apple Silicon, Nvidia GPUs). Looking to learn security best practices from the community.