5 mistakes pilots make on the CogScreen-AE (and how to avoid them)

Dr. Jordan 'Coach' Keller•
5 mistakes pilots make on the CogScreen-AE (and how to avoid them)

5 mistakes pilots make on the CogScreen-AE (and how to avoid them)

By Dr. Jordan 'Coach' Keller | Published February 25, 2026

Quick facts
Most common mistake Going in without seeing the interface
Most controllable factor Sleep the night before
Biggest misconception That you can memorize your way through it
What actually helps Format familiarization, not rote practice

This is part 2 of the CogScreen-AE test day series

Part 1 — CogScreen-AE test day: what to expect from start to finish
Part 2 — 5 mistakes pilots make on the CogScreen-AE ← you are here
Part 3 — Your results came back low. Here's what to do. ← publishes March 1

TL;DR

  • Format confusion on Dual Task and Backward Digit Span is the most preventable source of lost points
  • Sleep matters more than any single practice session — and the data is clear on this
  • Cramming the day before degrades the sustained attention the test directly measures
  • The CogScreen has approximately 12 versions — memorizing items backfires
  • Not understanding LRPV before you go in leaves you unable to make sense of your results

Table of contents

  1. Why most underperformance isn't about cognitive ability
  2. Mistake 1: never seeing the interface before test day
  3. Mistake 2: sacrificing sleep for one more practice session
  4. Mistake 3: cramming the day before
  5. Mistake 4: trying to memorize the test
  6. Mistake 5: not understanding what the score means
  7. The pattern worth noticing
  8. FAQ

Why most underperformance isn't about cognitive ability

When pilots describe what went wrong on test day, a pattern emerges. The ones who underperformed rarely had cognitive deficits. They walked into a test format they'd never seen, on a night of poor sleep, having spent the previous evening running through practice sessions at 11 PM. Every one of those factors is avoidable. None of them is about cognitive ability.

The CogScreen-AE measures real cognitive function — working memory, sustained attention, processing speed, executive function. But real cognitive function can be masked by format confusion, fatigue, and anxiety. A pilot with genuinely strong working memory who has never seen the Backward Digit Span interface will perform worse than their ability warrants. A pilot who slept five hours will underperform on exactly the subtests that matter most to the LRPV composite.

The goal of preparation isn't to change what you're capable of. It's to make sure the test measures what you're actually capable of — not what you're capable of while surprised, tired, and disoriented.

Here are the five specific mistakes most responsible for the gap.

Mistake 1: never seeing the interface before test day

The CogScreen-AE uses a touchscreen or mouse interface with response mechanics that are unlike standard computer use. That matters because unfamiliar interfaces create cognitive overhead — you're spending processing resources on figuring out how to respond rather than on the cognitive task itself. On a timed assessment, that overhead shows up directly in your scores.

Three subtests trip up unprepared pilots most reliably:

Dual Task requires you to simultaneously track a moving target on screen and respond to auditory memory prompts. The dual-demand structure — two cognitive streams running at the same time — is unlike anything in ordinary daily use. Pilots encountering it for the first time often freeze or split their attention in the wrong direction. That response is not a cognitive deficit. It's novelty. One prior exposure typically resolves most of it.

Backward Digit Span presents auditory digit sequences at a fixed pace and asks you to recall them in reverse order through a specific input method. The reversal requirement combined with an unfamiliar interface creates a double layer of cognitive load that has nothing to do with your actual working memory capacity. Pilots with genuinely strong working memory regularly underperform here on a first encounter simply because of the mechanics.

Manikin involves spatial orientation with a figure displayed in various rotated positions. The response format is counterintuitive if you haven't seen it. Pilots who haven't previewed the mechanics often respond incorrectly in ways that misrepresent their spatial reasoning entirely.

The fix is straightforward: familiarize yourself with these task formats before your appointment. Not to memorize answers — the test has approximately 12 different item versions, so memorized content won't appear — but to remove the "I've never seen this before" variable from your score. The CogScreen-AE subtests guide covers all 13 subtest formats in detail, including exactly what the interface asks you to do on each one.

Mistake 2: sacrificing sleep for one more practice session

Sleep is when the brain consolidates everything you've trained. You don't improve cognitive skills during a practice session — you improve them during the sleep that follows it. A well-rested brain with three weeks of preparation will outperform a fatigued brain with four weeks of preparation on the specific tasks the CogScreen measures.

This isn't general wellness advice. It's specific to the subtests that carry the most weight in the LRPV composite. Backward Digit Span and Dual Task — both heavy working memory tasks — degrade measurably on five to six hours of sleep. Processing speed, measured across multiple subtests, degrades. Sustained attention, which the Continuous Performance subtest evaluates directly, is one of the first cognitive functions to suffer under fatigue.

The trade-off is not close. One practice session at 11 PM the night before your test, at the cost of 90 minutes of sleep, is a net loss by a significant margin.

The recommendation: stop all active training 48 hours before your test. Prioritize seven to eight hours of sleep the night before your appointment, and the night before that. If you've followed a structured preparation plan — the 4-week CogScreen study plan includes a proper taper in the final week — this transition should feel natural rather than abrupt.

Mistake 3: cramming the day before

Cramming the day before is Mistake 2's close relative, and the two usually travel together. Pilots who spend the day before their test running full practice batteries are also the ones who sleep poorly that night, either because they went to bed late or because the cognitive activation makes settling down harder.

But the problem with day-before cramming goes beyond sleep. Sustained attention — one of the CogScreen's primary measurement targets — is directly sensitive to fatigue from cognitive overload. Running your brain hard the day before a cognitive assessment is roughly equivalent to running a long training flight the morning of a checkride. You show up to the evaluation already partially depleted.

What the day before your test should actually look like: light physical activity, normal meals, a 15-minute review of subtest interface mechanics (not a full practice battery), and an early night. Think about it the way you'd think about currency and currency management. You wouldn't fly an unfamiliar aircraft type for the first time on the morning of an evaluation after an all-night study session. The principle is the same here.

For a full day-by-day breakdown of the final week before your test, Part 1 of this series covers the night before and morning-of in detail.

Mistake 4: trying to memorize the test

The CogScreen-AE has approximately 12 versions with different item sets. The specific digit sequences, symbol patterns, and spatial configurations you encounter during preparation — whether in practice tools, previous test accounts, or anywhere else — are not the items you'll see on test day.

Trying to memorize answers doesn't just fail to help. It can actively hurt performance. Pilots who attempt to recall memorized sequences during Backward Digit Span — waiting for a match instead of processing the actual auditory stimulus — often perform worse than pilots who simply respond to what they hear. The test measures real-time cognitive processing. A memorized response that doesn't match the current stimulus introduces errors that genuine cognitive engagement would not.

The right frame for preparation is skill-building and interface familiarity, not content recall. Practice builds working memory capacity, processing speed, and attentional control — cognitive skills that transfer across all 12 item versions. Interface familiarity removes the novelty variable. Neither of those depends on memorizing specific items.

This is also why general brain training apps — Lumosity, BrainHQ, CogniFit — tend to fall short for CogScreen preparation specifically. They improve general cognitive function but don't replicate CogScreen task mechanics, and they're normed against general populations rather than pilots. Why generic brain games won't help you pass the CogScreen-AE covers this in full if you're weighing your preparation options.

Mistake 5: not understanding what the score means

Many pilots walk out of the CogScreen evaluation not knowing what LRPV stands for, what the relevant threshold is, or what a score below that threshold actually triggers. That gap creates two distinct problems in opposite directions.

The first is unnecessary panic. Pilots who don't understand the scoring sometimes interpret a score that's comfortably within normal range as a failure because they don't know what "normal" looks like. They spend days or weeks in avoidable distress while waiting for AME review of a result that will move through without issue.

The second is false reassurance. Pilots who don't understand the scoring sometimes interpret an ambiguous result as fine when it actually warrants follow-up. They miss the window to proactively engage their AME or consult a HIMS specialist before the FAA review process begins.

The LRPV — Logistic Regression Probability Value — is not a pass/fail score. It's a probability value that compares your cognitive profile to healthy pilots your age. A score below the review threshold triggers additional FAA review, not automatic denial. Many pilots with initially low scores ultimately receive medical certification through the standard review process or via Special Issuance.

Understanding this before you go in changes how you interpret your results on the day you receive them, and it changes the quality of the conversation you have with your AME afterward. The understanding CogScreen-AE scores guide explains the full scoring system — LRPV, component scores, pilot norms, and what each piece actually means for your certification pathway.

The pattern worth noticing

These five mistakes share a structure. None of them is about cognitive ability. Every one of them is about the gap between how pilots typically approach the evaluation and what the evaluation actually requires.

Format familiarization closes Mistake 1. Sleep discipline closes Mistakes 2 and 3. The right preparation framework — building skills rather than memorizing content — closes Mistake 4. Reading the scores guide before your appointment closes Mistake 5.

All of them are closable before you sit down at that computer.

If your results came back lower than expected — even after avoiding every one of these mistakes — the picture changes. Part 3 of this series covers exactly what a low LRPV result means, what the FAA does next, and what your actual options are. It publishes March 1: Your CogScreen-AE results came back low. Here's what to do.

From the faacogscreen.com resource library

Everything you need for CogScreen-AE preparation is here in one place:

FAQ

Is it bad to practice too much? Yes, if it crowds out sleep or creates anxiety in the final days before your test. More practice is not always better — the taper matters. Stop structured training 48 hours out and let consolidation do its work.

How many days before the test should I stop training? 48 hours before your appointment is the right cutoff for full practice sessions. A brief 15-minute review of subtest interface formats the day before is fine. Nothing intensive.

Can I bring anything into the testing room? No. No notes, no reference materials, no phone. Photo ID and corrective lenses if you use them. That's it.

What if I freeze up during a subtest? Take a breath and continue. Some hesitation is normal and the examiner has seen it. If you freeze during a practice trial, use it — that's what the practice trial is for. If you freeze during the scored portion, keep moving. Dwelling on one moment costs you the next one.

What if I realize mid-test that I'm in one of the versions I haven't practiced? All versions follow the same task structure and mechanics. The specific items differ; the cognitive demands don't. If you've prepared for the task format, you're prepared for any version of it.

The most preventable mistake is also the easiest to fix. Spend time with all 13 subtest formats before your appointment — no account needed to start.

Try 5 free questions →

More from faacogscreen.com

New guides publish every Tuesday and Friday at faacogscreen.com.

References

  • Kay, G.G. (1995). CogScreen Aeromedical Edition: Professional Manual. Psychological Assessment Resources.
  • Taylor, J.L., O'Hara, R., Mumenthaler, M.S., & Tinklenberg, J.R. (2000). Cognitive ability, expertise, and age differences in following air-traffic control instructions. Psychology and Aging, 15(4), 753–762.
  • Van Benthem, K., et al. (2024). Cognitive screening in aviation: current practice and future directions. Aviation, Space, and Environmental Medicine.
  • FAA Office of Aerospace Medicine. Neuropsychological evaluation requirements. FAA AME Guide. faa.gov/ame_guide

Ready to prepare for the CogScreen-AE?

Start training with our adaptive cognitive modules designed specifically for pilots. Get instant access to real-time scoring and performance tracking.

Start Free Trial