A 150M param recurrent model scores 29.5% on ARC-AGI-1 at $0.0007 per task

2 months ago by cm0002 to c/Aii

We introduce BDH-CQ, a reasoning model that combines in-context learning with recurrent latent reasoning. Inputs presented at inference time continuously update the model's recurrent memory; the model then solves a query through iterative computation in a high-dimensional latent space, without verbalizing its intermediate reasoning. We evaluate the model on the public ARC-AGI-1 evaluation set and use controlled ARC-like interventions to study what it learns from demonstrations, how consistently it applies an inferred transformation, and which concepts remain difficult. A 150M-parameter configuration reaches 29.5% pass@2 at a computed inference cost of \$0.0007 per task. This operating point breaks through the previously reported ARC-AGI-1 cost-accuracy Pareto frontier, establishing a new state of the art in benchmark cost efficiency.
Aii
Aii

@programming.dev

login for more options
391
477
276

AI related news and articles.

Rules:

  • No Videos.
  • No self promotion: Don't post links to your articles.

go to feed...