Claude Fable 5.1 Sets Accuracy Record at 67.2%, but Hallucinates More
As seen on the 24/7 Wall St. homepage on September 1, 2026.
Anthropic's newest model sets the accuracy record on this benchmark at 67.2%, but it gets there by answering more questions it should have skipped, which is exactly the reliability trade-off enterprise buyers are pricing.
Claude Fable 5.1 (max) attempts 93.4% of AA-Omniscience questions against Claude Opus 5's 87.8%, and records the highest accuracy we have measured at 67.2%, ahead of Claude Fable 5 at 65.4%. It hallucinates more with this higher attempt rate: of questions it didn’t get correct, https://t.co/tBdCN4DlRM
- Replies1
- Reposts0
- Likes8
Continue ReadingShow less
Claude Fable 5.1 (max) posted the highest accuracy score Artificial Analysis has ever recorded on its AA-Omniscience benchmark, reaching 67.2% against Claude Fable 5's previous mark of 65.4%.
The model gets there partly by attempting more questions, taking on 93.4% of the benchmark's queries. A higher attempt rate means the model is less willing to abstain when uncertain, which is where the reliability trade-off begins to show.
Disclosure
1 INVESTMENTS ARE NOT FDIC INSURED • ARE NOT BANK GUARANTEED • MAY LOSE VALUE Brokerage and Active investing products offered through SoFi Securities LLC, member FINRA( www.finra.org )/SIPC( www.sipc.org ). 2 The probability of a member receiving $3,000 is 0.028%. If you don’t make a selection in 45 days, you’ll no longer qualify for the promo. Members must fund their account with a minimum of $50.00 to qualify. The probability percentage is subject to decrease. Members are only eligible for the Stock Award promotion upon opening their first brokerage account; subsequent cash brokerage accounts are ineligible for the promo, including for members with multiple accounts. 3 Other fees, such as exchange fees, may apply. Please view our fee disclosure to view a full listing of fees. 4 There are limitations with fractional shares to consider before investing. During market hours fractional share orders are transmitted immediately in the order received. There may be system delays from receipt of your order until execution and market conditions may adversely impact execution prices. Outside of market hours orders are received on a not held basis and will be aggregated for each security then executed in the morning trade window of the next business day at market open. Share will be delivered at an average price received for executing the securities through a single batched order. Fractional shares may not be transferred to another firm. Fractional shares will be sold when a transfer or closure request is initiated. Please consider that selling securities is a taxable event.
SoFi Active Invest is offering a limited-time promotion. Open an account, fund it with $50 or more, and you could receive up to $1,000 in complimentary stock for Active Invest accounts. See for yourself by clicking here now. (Sponsor)
Artificial Analysis notes the model hallucinates more as a direct consequence of that elevated attempt rate. Among questions it did not answer correctly, the failure mode shifts toward confident wrong answers rather than cautious refusals.
For enterprise buyers evaluating which model to deploy in high-stakes settings, that distinction matters more than the headline accuracy number. A model that scores higher by guessing more aggressively demands tighter guardrails.