IOSG argues that private AI is moving from a niche concern to a practical choice for both enterprises and consumers, as companies grow more wary of sending sensitive data and proprietary knowledge into closed-model systems. In a long-form analysis by Jeff @IOSG, the firm lays out the tradeoff now facing the market: frontier labs still lead in general capability, but open models are improving quickly and, in some specialized domains, already outperform frontier systems on both accuracy and cost. The report traces several privacy approaches, from contractual zero-data-retention and Oblivious HTTP to trusted execution environments, end-to-end encryption, fully homomorphic encryption, and local inference. It argues that only some of these offer verifiable privacy, and those routes largely depend on open models rather than proprietary ones. IOSG also points to a recent case from Bridgewater-backed AIA Labs and Thinking Machines, where a fine-tuned Qwen3-235B model beat frontier models on expert financial tasks. Even so, the report says major gaps remain. Tool use in agent workflows, private post-training, and encrypted search are still hard to deliver at scale. IOSG’s conclusion is that privacy inference is becoming cheaper and more deployable, but the most defensible opportunities lie in the unsolved layers around training loops, tool execution, and search infrastructure.

IOSG argues that private AI is no longer a niche technical preference but an emerging requirement for enterprises and power users that do not want proprietary data, internal workflows, or high-value judgment calls exposed to model providers. In its report, the firm lays out how the privacy problem starts the moment a prompt leaves a user’s device and reaches a server in plaintext, and why contractual protections such as zero-data-retention terms can only go so far. The piece links that risk to corporate restrictions on ChatGPT, shadow AI leaks, and a series of legal cases in which user chats became discoverable evidence. The report also maps the trade-offs across today’s privacy stack, from contract-based retention promises and OHTTP relays to trusted execution environments, end-to-end encryption, fully homomorphic encryption, and local inference. Its central case study comes from Bridgewater’s AIA Labs and Thinking Machines, which showed that a fine-tuned open model, Qwen3-235B, beat frontier models on both accuracy and cost in financial judgment tasks. IOSG’s conclusion is narrow but clear: for execution-heavy agent workflows, trust-based setups still dominate because tool calls expose plaintext to downstream services; for high-value strategic reasoning and domain-specific alpha, verified private infrastructure around open models is becoming a practical path.