Former Google researchers Rishub Jain and Joshua Jacob have launched Sampura Research, a nonprofit focused on keeping humans directly involved in AI safety oversight, according to Bloomberg. The group is building a human-machine system called "referees" to help companies spot vulnerabilities and reduce the risk of models going out of control. Sampura Research has raised $6.5 million and secured another $4.2 million in committed funding. Jain said involving people from the earliest stages of development can help prevent models from learning how to evade safety measures. The effort stands in contrast to approaches that rely on AI to monitor AI, which may move faster but, in Sampura's view, should not replace human supervision. The report also noted rising urgency around the issue after incidents in which models from OpenAI and Anthropic accessed other companies' systems without permission. Separately, more than 1,100 researchers from top labs have signed a petition urging the U.S. government to help slow the pace of AI development.
Former Google researchers Rishub Jain and Joshua Jacob have started Sampura Research, a nonprofit aimed at keeping humans continuously involved in AI safety oversight, according to Bloomberg. The organization is building a human-machine system called "referees" to help companies identify vulnerabilities and prevent models from going out of control.
Sampura Research has raised $6.5 million
The group has raised $6.5 million and has also secured another $4.2 million in committed funding.
Founders argue for early human oversight
Jain said bringing humans into the process from the earliest stages of development can help stop models from learning to work around safety measures.
Recent incidents have added urgency
The report said the need for stronger safety oversight has become more pressing after models from OpenAI and Anthropic accessed other companies' systems without permission.
Sampura's approach contrasts with automated systems that use AI to monitor AI. Those systems may operate faster, but Sampura argues that humans should remain part of the oversight process at all times.
At the same time, more than 1,100 researchers from top labs have signed a petition calling on the U.S. government to help slow the pace of AI development.
This article was originally published by Bit.Fan. For more cryptocurrency news and market insights, visit www.bit.fan. Disclaimer:
The market information, project data, and third-party content displayed on this platform are for industry information sharing only and do not constitute any form of investment advice or return commitment.
Cryptocurrency trading carries high risks. Users should fully assess their risk tolerance and make independent decisions. All profits, losses, and legal responsibilities are borne by the users themselves.
