Attention

DeepMind framework ↗
Human ~95.0 · AI 51.0Humans lead +44.03 benchmarks →

At a glance

Focusing on what matters and filtering out distractors that look relevant.

Attention is focusing on what matters for the task and filtering out the rest, especially distractors that look relevant.

The hard case is not noise but a convincing decoy: a number that looks like the answer, or a line that matches the keyword but sits in the wrong group.

Human ref.
~95.0
Best AI
51.0
Gap
+44.0
Our items
15

Sub-faculties

The parts of this faculty, what our items cover today, and what is still to come

Sub-facultyItemsStatus
Distractor resistance
Reporting what was asked for while a look-alike decoy sits right next to it.
Mirrors RIAC
7
in the 5-min test
Covered
Selective attention (grouping)
Attending only to the part of what you see that the task is about, singled out by where it sits (its group, line or region), and tuning out the rest.
How it differs: In distractor resistance, a single look-alike sits next to the target. Here what lies outside the selection looks just like what's inside it, and only position tells them apart.
Mirrors ABC
5Covered
Sustained attention
Staying accurate through a long, repetitive stretch.
3Covered

Human vs AI

Best published result on each side, 0–100

Human ref.
~95.0
Best AI
51.0

Humans. Healthy adults almost always get clinical attention tests right, which is why those tests are scored on speed instead. How often a convincing decoy catches people has not been measured.

AI. A single planted lure is enough to throw frontier models, and their misses pick the lure. They also struggle when the answer depends on belonging to the right group.

Human ref. ~95.0, our estimate
Our estimate of the share of adults who would report the right number from a short note with a look-alike decoy next to it, without time pressure.
Why an estimate
No study reports this. Clinical attention tests are built so that healthy adults almost always answer correctly, and score speed instead. This task is short and untimed, so we put adults near ceiling and allow a few percent for reading slips. It is a reasoned guess, not a measurement.
Best AI 51.0
Share of RIAC questions answered correctly when one decoy number is planted next to the target, pooled across the frontier models tested (2026). It is an average over models, not the best one. About the test →

One side is an estimate, so the gap of +44.0 shows a direction, not a measured margin.

255075100Perception+13Generation-35Attention+44Learning0Memory+21Reasoning-27Metacognition-55Executivefunctions+17Problemsolving+2Socialcognition+4
Human referenceOur estimateBest published AILabel = human − AI, points

Example items

Specimens written for this page. Live items are similar but never published.

Ignore the lurespecimen · not scored

Read the note, then type the number. 12 seconds.

(a) Stimulus

Lakeside library, annual report. The reading room seats 136 people. Last year the library lent 163 e-readers to local schools. The roof was repaired in March.

(b) Question

How many people can the reading room seat?

Figure 1. A lure item. One decoy number, a digit permutation of the target, sits in the next sentence. Benchmark: RIAC. Answer: 136. Typing 163 is logged as lure capture.
RIAC benchmark page →
Stay in the right groupspecimen · not scored

Look at the checklist and answer. 25 seconds.

(a) Stimulus

Garden
[x] Mow lawn
[ ] Plant roses
[x] Fix fence
[x] Buy nails
[ ] Paint posts
House
[x] Clean gutters
[x] Mow lawn

(b) Question

In Garden, how many tasks are done, counting sub-tasks?

Figure 2. A grouping item. “Mow lawn” appears in both groups; only the lines under Garden count, sub-tasks included. Benchmark: ABC. Answer: 3 (Mow lawn, Fix fence, Buy nails). Counting House's “Mow lawn” gives 4.
ABC benchmark page →
Hold back on 3specimen · not scored

Press for every digit except 3.

(a) One digit every 1.15 s

7518294press for each, except 3
Figure 3. A short stretch of the stream. The real run is 90 digits long; the rare 3 is the one to let pass. Benchmark: Sustained attention to response task. Answer: Press for all seven digits: none of them is a 3.
Sustained attention to response task benchmark page →

Benchmarks

3 rows
BenchmarkOriginItemsBest AIHumans
RIACKaggle × Google DeepMind hackathon, 2026751%—
ABCKaggle × Google DeepMind hackathon, Attention track winner, 20265weakest—
Sustained attention to response taskSustained attention to response task (Robertson et al., 1997), 19973n/a—

In everyday life

  • Finding the right figure in a busy invoice
  • Following one conversation in a noisy room
  • Ignoring a tempting but irrelevant detail