CAIS remote labor benchmark shows Fable 5 leading GPT-5.5 in paid task automation
The latest Remote Labor Index from the Center for AI Safety, developed with Scale AI, puts Fable 5 at a 16.1% automation rate on real freelance jobs, ahead of Opus 4.8 at 8.3% and GPT-5.5 at 6.3%. The benchmark uses 240 real projects sourced from verified Upwork freelancers across 23 fields and asks a simple question: would a paying client accept the result? CAIS said the frontier has advanced more than fourfold in less than eight months, up from a top score of 2.5% when the index launched. The group also said AI judging is still unreliable. Automated evaluation overstated GPT-5.5 by nearly 3x and Opus 4.8 by about 2.5x when applied to newer systems. Fable 5’s run was interrupted by U.S. government export controls and covered 218 of 240 projects, but CAIS said even if all 22 missing tasks were counted as failures, its automation rate would still be 14.6%, higher than every other model tested.








