Assistant Benchmark, an independent evaluation project, has started comparing personal AI assistants through real-world tasks rather than abstract benchmarks. The test setup asks agents to complete practical assignments such as booking hotels, choosing restaurants, shopping, replying to emails, and connecting third-party services. Scores are based on whether those tasks are actually completed, and each scoring category is tied to a public fixed task that must include a real execution record before a score is awarded.
At the current stage, Muse ranks first with an average score of 9.1 across seven completed categories. Instinct has been tested across 11 categories and holds an average of 8.4, while Grok Bot has completed seven categories with an average of 7.3. Muse posted perfect 10-point results in shopping, email, and third-party app connection tasks.
The benchmark should be read as a live, evolving experience board rather than a final ranking. Muse’s 9.1 only reflects the average from seven tested categories, not a full result, and each category is still being measured with only one fixed task for now. As more follow-up testing is added, both the scores and the ranking may change.
Assistant Benchmark, an independent evaluation project, has started testing personal AI assistants through real-world tasks, and Muse is currently in first place.
Benchmark uses practical assignments
According to Beating AI, the project has agents carry out tasks such as booking hotels, picking restaurants, making purchases, replying to emails, and connecting third-party services, then scores them based on actual completion. Each scoring category is tied to a public fixed task, and a score is only given when there is a real execution record.
Current scores and ranking
Muse is now first with an average score of 9.1 across seven completed scoring categories. Instinct has been tested in 11 categories and posts an average of 8.4. Grok Bot has completed seven categories with an average of 7.3.
Muse received perfect 10-point scores in shopping, email, and third-party app connection.
Results are still provisional
The list is better read as a continuously updated real-use leaderboard. Muse’s 9.1 reflects only the average across seven tested categories and does not represent a full result. Each category is also being tested with only one fixed task at this stage, so both scores and rankings may change as more follow-up tests are added.
This article was originally published by Bit.Fan. For more cryptocurrency news and market insights, visit www.bit.fan. Disclaimer:
The market information, project data, and third-party content displayed on this platform are for industry information sharing only and do not constitute any form of investment advice or return commitment.
Cryptocurrency trading carries high risks. Users should fully assess their risk tolerance and make independent decisions. All profits, losses, and legal responsibilities are borne by the users themselves.
