IOSG says private AI is gaining ground as open models close the gap in cost and accuracy
IOSG argues that private AI is moving from a niche concern to a practical choice for both enterprises and consumers, as companies grow more wary of sending sensitive data and proprietary knowledge into closed-model systems. In a long-form analysis by Jeff @IOSG, the firm lays out the tradeoff now facing the market: frontier labs still lead in general capability, but open models are improving quickly and, in some specialized domains, already outperform frontier systems on both accuracy and cost. The report traces several privacy approaches, from contractual zero-data-retention and Oblivious HTTP to trusted execution environments, end-to-end encryption, fully homomorphic encryption, and local inference. It argues that only some of these offer verifiable privacy, and those routes largely depend on open models rather than proprietary ones. IOSG also points to a recent case from Bridgewater-backed AIA Labs and Thinking Machines, where a fine-tuned Qwen3-235B model beat frontier models on expert financial tasks. Even so, the report says major gaps remain. Tool use in agent workflows, private post-training, and encrypted search are still hard to deliver at scale. IOSG’s conclusion is that privacy inference is becoming cheaper and more deployable, but the most defensible opportunities lie in the unsolved layers around training loops, tool execution, and search infrastructure.





