T
T
T

Wildland Fire Metareview

Disclaimer: Trigger Warning

The learning products below are full of hard topics and conversations that may cause unexpected feelings or responses. These topics may be difficult to talk about and will require a conscious effort to stay open minded and self-aware, but they also offer opportunities for us as individuals and as an organization to learn, grow, and change.

Introduction

By Jaelith Hall-Rivera, Deputy Chief for State and Private Forestry and Cynthia West, Acting Deputy Chief for Research and Development

As part of our quest to be a learning organization, it is important for all levels of our organization to learn as much as we can from accidents and incidents. In an effort to facilitate that learning, we must provide tools that help us talk about and make sense of the lessons we learn. We would like to introduce a new learning and discussion tool from the Forest Service’s Innovation and Organizational Learning team (IOL), the Wildland Fire Metareview. 

After the Twisp Fire (2015), agency leadership directed the IOL team to look across multiple years of incidents and accidents to see what lessons could be learned by taking a “meta” approach to systematically reviewing past events. Looking across multiple incidents allows themes to be detected in ways that single accidents don’t allow. Their review examined accidents and incidents, including fatality incidents, in the Forest Service over a 10-year period (2007–2016). Chapter 3 of the Metareview includes the quantitative and qualitative analysis of this data. From their analysis, five themes emerged. In order to dive deeper into the learning around these themes, IOL conducted five focus groups in 2019, comprised of a cross section of Forest Service employees who work in wildland fire management and academic subject matter experts. The focus group findings are detailed in chapters 4–12. The format is intentionally presented in an open way that is intended to facilitate discussion and both individual and group learning. Each chapter highlights information from the meta-analysis and focus groups and then broadens the conversation by including learning challenges to prompt discussion among your local work group. Out of the quantitative and qualitative work of the previous chapters, chapter 13 introduces an ongoing Learning Strategy. 

As you work through the discussion tool and learning challenges, you will see the themes that emerged from the metareview effort:

  • Fatalities and injuries—Why are they continuing to occur?
  • Fiscal incentives—How does the current pay structure affect operational strategies and risk management?
  • Society—How do social and political pressures play into the wildland fire system?
  • Ecological soundness—How do ecological health and land management factors currently play into wildland fire decision making and strategy planning processes?
  • Communication/work environment—What do current successes and failures look like in the context of communication and the wildland fire work environment?

These are all great questions and ones that we as an agency continue to grapple with. We recently made positive strides in the area of fiscal incentives by implementing the pay raises funded by the Bipartisan Infrastructure Law and working with Office of Personnel Management and the Department of the Interior on the policy for the new wildland firefighter job series. We are starting to place emphasis on firefighter mental health through enhancements to our Work Environment and Performance Office programs, Employee Assistance Program contract improvements, and suicide awareness trainings, as well as the joint federal effort to develop a comprehensive wildland firefighter health and well-being program made possible by the Bipartisan Infrastructure Law. We look forward to continuing this conversation with the wildland firefighter community as we work to build and solidify the well-supported, more permanent wildland firefighting force needed to address the wildfire crisis. 

We view this metareview as one important step in our learning journey. This learning tool should be viewed in combination with other interagency wildfire safety products, such as the annual interagency safety gram and the Lessons Learned Center’s annual “Incident Review Summary.” These learning products require ongoing engagement at all levels of the organization as we continue to build on our safety journey. 

We hope you take time to use this metareview learning guide to facilitate conversation among your work group. Beginning in March 2023, IOL will host monthly webinars to introduce the content and demonstrate how this learning tool can be used to transition from singular incident learning to ongoing, multiformat, iterative, shared learning. We hope that you will share your insights with your work group, but we also encourage you to share insights across the organization during one of IOL's virtual Coffee Shop sessions. Initially, the Coffee Shop will serve as a place to meet, discuss, and share ideas about the metareview and other organizational learning efforts in a more informal setting. As time goes by, additional functions will be added, like a virtual "bulletin board" where you can share ideas and innovations for others to learn from. Each of us sharing our unique learning is a critical component of being a learning organization. Let’s continue to learn together.

Metareview: An Introduction

To help you get your bearings around what the metareview is, the intent behind it, and the many learning products available to you, we’ve put together this short 7-minute video to watch before you dive in:

The Metareview

The primary learning from the metareview process is hosted in three formats: an interactive PDF, an audiobook, and a set of StoryMaps. The content within each platform is the same. However, each product provides a different avenue for learning. Some folks may be readers, others may enjoy a more visual experience. Hopefully we have a product that suits your learning preference and needs. Below is a synopsis of each product and links to access them.

The interactive PDF features 14 chapters. While this may feel overwhelming at first, the chapters were created in a way that allows them to be used on their own or as a cohesive whole. And while you may be thinking, “This looks just like every other report,” first glances can be deceiving. Each chapter is full of hyperlinks you can click on to further your learning about different topics. At the end of each chapter is an associated learning challenge that provides an opportunity to dive deeper into chapter content. The questions can also be used as a facilitation guide if you would like to have a conversation about a chapter with your supervisor, peers, or employees. At the end of each learning challenge, you will find a hyperlink where you can provide your feedback or perspective on the content of the chapter or how your conversations went.

  • Chapters 1–3 provide a look back. They describe the driving forces behind the metareview and detail the history of the Forest Service’s organizational learning journey. You will also find an overview of the metareview process used to synthesize the learning from 341 separate unintended and intended outcome events.
  • Chapters 4–11 are the heart of the metareview and highlight “The Big 8”—the 8 biggest challenges within the wildland fire system that arose from this analysis and sensemaking. In these chapters, we address things like money as incentive to risk, real and perceived socio-political pressures, and the possibility of “safety first” being a myth. These learning challenges are meant to provide an opportunity to dive deeper into each of the 8 topics and can serve as a facilitation guide to help you talk to your peers.
  • The final three chapters ask the reader to look to the future and ask what an envisioning process might look like.

Download the PDF

Not a reader or just don't have enough time to read the metareview? Below you will find the audio-book of each metareview chapter. 

Abstract

Audio file

Chapter 1: Introduction

Audio file

Chapter 2: Learning from the Past

Audio file

Chapter 3: Conducting this Wildland Fire Metareview

Audio file

Chapter 4: clear, Stable, Long-Term Vision

Audio file

Chapter 5: Does Our Communication Lead to Trust?

Audio file

Chapter 6: Telling Our Story- Consistently Inconsistent

Audio file

Chapter 7: Socio-Political Pressures: Real and Perceived

Audio file

Chapter 8: Cost or Investment?

Audio file

Chapter 9: Is "Safety First" a Myth? 

Audio file

Chapter 10: Mental Health and Suicide - A Call to Action

Audio file

Chapter 11: The Quest for 1,000 Hours of Overtime - Money as an Incentive to Risk 

Audio file

Chapter 12: An Exercise in Envisioning 

Audio file

Chapter 13: What's Next? Continuing the Learning

Audio file

Chapter 14: Final Learning Challenge

Audio file

 

Maybe you want something more visually appealing. The metareview has that, too. Check out these StoryMaps for a version of the metareview full of photos and videos. And they still offer the same opportunities to engage and provide feedback!

Facilitators Guide

Thinking about discussing a chapter or two with your peers, supervisors, or employees, but don’t know where to start? Check out this short video that provides some suggestions and food for thought about facilitating a potentially hard or controversial conversation. 

Facilitation Challenge Material

Focus Group 

Want to know what it was like to be a focus group participant? Hear some of the focus group participants talk about their experience in the following podcast-style interviews. 

Audio 

Transcript

Audio file

Audio 

Transcript

Audio file

Audio 

Transcript

Audio file

Audio

Transcript 

Audio file

 

Audio 

Transcript

Audio file

Audio 

Transcript

Audio file

Webinars and Coffee Shop

Webinars and Coffee Shops are hosted the third Wednesday of each month. If you are interested in participating, please email us.

Have any questions or comments about the metareview or any of its learning products? Want to join as a focus group participant in future sessions?  Please feel free to EMAIL the Innovation and Organizational Learning (IOL) team. 

Multimedia

Last updated November 2, 2023