Coming Soon: CIP and CTP

The public TensorWire repos have been quiet since summer. That’s because the real work moved private. Here’s a quick look at what it is. The details come when it’s ready.

CIP: Chain Inference Protocol

Big open-weight models don’t fit on one consumer GPU, and a lot of people have a couple of machines with a GPU sitting idle. CIP lets those machines serve one model together, even when the GPUs are from different vendors.

It works today. My own setup at home serves models through it every day.

CTP: Chain Training Protocol

Same idea, for training. The machines you already have, working on one training job together.

What “coming soon” means

No date. There’s a list of things that have to be true first: a stranger can set it up without my help, the performance numbers are ones I’m willing to publish with full methodology, and the security is good enough to let people I don’t know onto the network. When those are done I’ll post the numbers, the hardware they came from, and everything that broke on the way.

Running it on your own hardware will be free.

If you want to hear when it’s ready, grab the RSS feed or email me.