After-Action Reports: The Document That Makes Every Drill Worth It

The drill you did not write up, you did not really do.

A drill without an after-action report is a drill half-used. The exercise happened. People learned things in the moment. A week later, the lessons begin to fade. A month later, most participants would struggle to describe what specifically was learned. A year later, the drill is a vague memory, and the gaps it surfaced are often still open.

The after-action report (AAR) is how learning gets captured, preserved, and acted on. It is not a bureaucratic requirement. It is the artifact that makes every drill worth the time it took.

What belongs in an after-action report.

The core sections of a useful AAR are consistent, regardless of the drill type.

1. Executive summary

One paragraph. The purpose of the drill, the key findings, the top priority follow-up. Written so that a leader reading only this paragraph understands what the drill was for and what needs to happen next.

2. Drill description

What was practiced. When. Who participated. Who facilitated. What scenario was used. What the goals were.

3. Timeline of events

What happened during the drill, in rough chronological order. Not every detail. The significant decisions, actions, and transitions. Enough detail that someone who was not present could understand how the drill unfolded.

4. Strengths

Specific things the team did well. Named, attributed where appropriate. The strengths section is not optional. Identifying and naming what works is as important as identifying what does not. Teams that only hear about gaps in AARs tend to disengage over time.

5. Gaps and findings

Specific things that did not work, or that were revealed by the drill to need attention. Written in the same plain-English style as an audit finding: what was observed, why it matters, what the risk is, what the recommendation is.

6. Recommended follow-up actions

For each gap or finding, a specific action, a named owner, and a target timeline. AARs without assigned follow-up actions do not produce change.

7. Participant feedback

Brief notes on how participants experienced the drill. Was the pacing right? Was the difficulty appropriate? Did anyone experience acute distress that requires follow-up? This section protects the organization from running drills that technically cover material while harming participants.

How to run a debrief that produces a good AAR.

The AAR is drafted after the debrief. The debrief is what makes it possible.

Timing

Debrief immediately after the drill, while the experience is fresh. Gaps that are obvious five minutes after the drill become hazy by the following week. The 30 minutes invested in debrief produce far more useful content than the same 30 minutes spent alone later.

Format

A circle of chairs, not a classroom. The debrief is a conversation, not a lecture. The facilitator’s role is to elicit observations, not to deliver conclusions.

Questions that open the conversation

• What did you do that you would do again?
• What did you try that did not work as expected?
• What did you notice that surprised you?
• What was unclear about the protocol as it currently exists?
• What information did you need that you did not have?
• How did communication work among the team?
• If you ran this drill again tomorrow, what would you change in your own response?

Each question produces specific, useful observations. Questions phrased as “did you feel the drill went well?” produce vague answers. Specific questions produce usable feedback.

The role of leadership in the debrief

Leadership should participate in debriefs, not dominate them. Leaders who only speak at the end to summarize what they heard tend to produce more candid discussions than leaders who speak first and anchor the conversation around their initial reaction.

The follow-up action discipline.

An AAR with findings but no assigned actions is a document that will not produce change. Every finding in the report needs:

• A specific, actionable recommendation
• A named owner (not a committee, a person)
• A target completion date
• A tracking mechanism for verifying completion

Without these elements, the findings evaporate into organizational memory. With them, the drill becomes an engine of sustained improvement.

Tracking completion

A running log of AAR findings across multiple drills, with completion status for each, is one of the most useful program documents an organization can maintain. At the annual review, it shows exactly how many drill findings were closed, how many are still open, and where attention is most needed.

Closing findings vs. accepting risk

Some findings cannot be closed practically. A recommendation to build a second egress from a basement may be prohibitively expensive. In those cases, the finding should be explicitly documented as “accepted risk” by leadership, with the reasoning captured. Explicit acceptance is different from quiet deferral. The organization owns the decision.

The Hurricane Ian AAR pattern.

In the weeks and months after Hurricane Ian, Southwest Florida organizations that conducted formal after-action reviews produced documents that became some of the most valuable operational records they possess. The AARs covered:

• Decisions about evacuation versus shelter-in-place, and the criteria used
• How the organization maintained or lost communication during the storm
• Which staff and volunteers were available and which were not
• How facilities performed structurally
• What vendors and services failed, and what worked
• Specific lessons about protocol adequacy
• Personnel well-being during and after the event
• Community communication and aftercare

The organizations that wrote these AARs have a substantially better foundation for future severe weather events than those that did not. The writing itself is part of the learning.

Seeking knowledge is a posture. The AAR is the operational expression of that posture at the organizational level. Organizations that seek knowledge through honest review produce better futures than organizations that consume the folly of unexamined practice.

The AAR as institutional memory.

An organization that has conducted drills with AARs for five years has a priceless asset: documented institutional memory. When new leadership takes over. When the safety team changes. When the facility evolves. The AAR series tells the story of the program’s evolution in a way no single document or person can replicate.

For churches, daycares, senior living facilities, and nonprofits that turn over staff and volunteers regularly, the AAR archive is often the most durable element of the program. People come and go. The documented record stays.

The common AAR mistakes.

A few patterns to avoid:

• Writing the AAR a week after the drill. Memory degrades. Write within 48 hours.
• Making the AAR too long. A padded report gets skimmed. A concise report gets read.
• Focusing only on gaps. Participant buy-in requires naming strengths too.
• Assigning actions to committees or 'TBD.' Every action needs a named person.
• Filing the AAR without review at the next leadership meeting. Unreviewed findings do not close.
• Writing the AAR as if for an external audience. The primary audience is the team that just drilled.
• Skipping the participant feedback section. Drills that harm people but check the box are drills that should not be repeated in that format.

The P23 approach to AARs.

For drills and tabletops we facilitate for client organizations, the AAR is part of the standard deliverable. We provide:

• A structured AAR within 72 hours of the drill
• A debrief transcript or summary (with consent) that captures participant perspectives
• Specific, assigned follow-up actions with recommended timelines
• A comparison to prior drill AARs where applicable, showing trend and improvement
• An executive summary sized for board or leadership communication
• Integration with the ongoing fDoS or audit program, so findings feed the broader program

For clients running drills internally, we offer AAR templates and review of drafts as a supplementary service.

The drill that closes the loop.

A mature drill program has a closed loop. Drills produce AARs. AARs produce actions. Actions produce protocol updates. Protocol updates are tested in the next drill. Each cycle tightens the organization’s capability.

Organizations that run drills without this loop tend to stall. The same gaps surface year after year. The drill feels familiar but does not produce measurable improvement. The issue is rarely the drill itself. It is the missing AAR and follow-up discipline.

If your organization in Fort Myers, Cape Coral, Naples, or Port Charlotte is running drills without AARs, adding the AAR discipline is one of the highest-leverage improvements available. The documents themselves are short. The discipline of writing them and acting on them transforms the entire program.