Do you know the science behind what works and doesn’t work when it comes to keeping people safe in your organisation? Each week join Dr Drew Rae and Dr David Provan from the Safety Science Innovation Lab at Griffith University as they break down the latest safety research and provide you with practical management tips.
From discussing mobile phone use while driving to the challenges of giving advice to older adults at risk of falls, this episode covers ChatGPT’s responses to a wide range of safety topics - identifying biases, inconsistencies, and areas where ChatGPT aligns or falls short of expert advice. The broader implications of relying on ChatGPT for safety advice are examined carefully, especially in workplace settings. While ChatGPT often mirrors general lay understanding, it can overlook critical organizational responsibilities, potentially leading to oversimplified or erroneous advice. This episode underscores the importance of using AI-generated content cautiously, particularly in crafting workplace policies or addressing complex safety topics. By engaging with multiple evidence-based sources and consulting experts, organizations can better navigate the limitations of AI tools.
Discussion Points:
Quotes:
“This is one of the first papers that I've seen that actually gives us sort of fair test of ChatGPT for a realistic safety application.” - Drew
“I quite like the idea that they chose questions which may be something that a lay person or even a generalist safety practitioner might ask ChatGPT, and then they had an expert in that area to analyze the quality of the answer that was given.” - David
“I really liked the way that this paper published the transcripts of all of those interactions
with ChatGPT. So exactly what question the expert asked it, and exactly the transcript of what ChatGPT provided.”- David
“In case anyone is wondering about the evidence based advice, if you think there is a nearby terrorist attack, chat GPT's answer is consistent with the latest empirical evidence, which is run. There they go on to say that the rest of the items are essentially the standard advice that police and emergency services give.” - Drew
“[ChatGPT] seems to prioritize based on how frequently something appears rather than some sort of logical ordering or consideration of what would make sense.” - Drew
“As a supplement to an expert, it's a good way of maybe finding things that you might not have considered. But as a sole source of advice or a sole source of hazard identification or a sole position on safety, it's not where it needs to be…” - David
Resources:
The Article - The Risks Of Using ChatGPT to Obtain Common Safety-Related Information and Advice
DisasterCast Episode 54: Stadium Disasters
We challenge the notion that high injury rates are punished by market forces, as we dig into this article that posits the opposite: that safety should be a performance driver. Our analysis dives deep into the credibility and methodologies of the article, emphasizing the critical role of peer review and the broader body of knowledge.
We'll also scrutinize the use of data as rhetoric versus evidence, focusing on the transparency and rigor of research methods when interviewing executives about safety practices. Is safety merely seen as a compliance issue or a strategic investment? We dissect the methodologies, including participant selection and question framing, to uncover potential biases. Finally, we critique a proposed five-step process aimed at transforming safety into a competitive advantage. From aligning on the meaning of safety to incentivizing employees, we expose significant gaps in academic rigor and alignment with established safety literature.
This conversation serves as a powerful critique of superficial analyses by those outside the safety science domain, offering listeners critical insights into the complexity of safety management and its potential alignment with organizational goals.
Discussion Points:
Quotes:
“The trouble is, then we don't know whether what they're referring to is published research that might be somewhere else that we can look for for the details, or work that they did specifically for this article, or other work that they've done that was just never published.” - Drew
“We've got to be really careful…this is using data as rhetoric, not using data as data.” - Drew
“I wouldn't be surprised that most people see safety as both a cost and as an outcome.”- Drew
“So you've got two-thirds of these companies that don't even have any safety metric, like not even an injury metric or anything that they monitor.” - David
“So we kind of assume business performance means financial performance, but that in itself is never clarified.” - David
Resources:
The Article: Safety Should Be a Performance Driver
Episode 121: Is Safety Good for Business?
From the perceived control in everyday activities like driving, to the dread associated with nuclear accidents, we discuss how emotional responses can sometimes skew our rational assessments of risk. Finally, we explore the ethical and practical challenges of balancing emotional and analytical approaches in risk communication, especially in high-stakes scenarios like terrorism and public safety. The conversation touches on real-world examples, such as the aftermath of the September 11 attacks and the controversial discussions around gun ownership. We emphasize the importance of framing and narrative in conveying risk information effectively, ensuring that it resonates with and is clearly understood by diverse audiences.
Discussion Points:
Quotes:
“Risk is analysis where we bring logic, reason, and science or data or facts, and bring it to bear on hazard management.” - David
“There may not be a perfect representation of any risk.” - Drew
“If that's the important bit, then blow it up to the entire slide and get rid of the diagram and just show us the important bit.”- Drew
“It's probably a bit unfair on humans to say that using feeling and emotion isn't a rational thing to do.” - David
“The authors are almost saying here that for some types of risks and situations, risk as a feeling is great.” - David
Resources:
The discussion provides an in-depth examination of the principles of multimedia, modality, and redundancy, all of which are crucial for optimizing learning and information retention. The episode also offers a wealth of practical strategies for interactive design and meticulous preparation, aimed at enhancing audience engagement and comprehension. These strategies include the use of visual aids, storytelling techniques, and audience participation elements to create a more dynamic and immersive experience. By adopting these methods, presenters can not only convey their message more effectively but also make the learning process more enjoyable and impactful for their audience.
The Paper’s Abstract
Active training techniques are effective because they engage learners in tasks that promote deep thought, discussion, problem-solving, social interaction, and hands-on learning. Passive training is less effective because learners are relegated to merely listening and watching as an instructor does all of the mental, social, and physical work. Bullet-point lectures may be poorly suited for meaningful training because they usually adopt a model of passive learning and they tend to combine spoken words and displayed text in ways that may actually decrease comprehension. PowerPoint can serve as a tool to promote active learning if we eliminate lengthy bullet lists and use instructional images to guide group discussions, problem-solving activities, and hands-on experiences.
Discussion Points:
Quotes:
“This is what you might call an applied literature review. It's someone taking the literature and interpreting that literature for a particular purpose.” - Drew
“There's a lot of research that says that a lot of high school and university teachers rely on fairly outdated and disproven theories about these different modes of learning.” - Drew
“If that's the important bit, then blow it up to the entire slide and get rid of the diagram and just show us the important bit.”- Drew
“if you're a learner and you see a giant pair of goggles on a PowerPoint slide with just the word “goggles”, then all you're going to be doing now is just listening to what the presenter is saying. And hopefully they're saying something about goggles.” - David
“Slides aren't there to look interesting and slides aren't there to carry the weight of the content. Think of them as visual support.” - Drew
Resources:
The Paper: No More Bullet Points
We examine whether a safe work environment truly enhances productivity and engagement or if it stifles business efficiency. Historical incidents like the Union Carbide disaster and BP's Deepwater Horizon blowout are analyzed to question if neglecting safety can still lead to profitability. Finally, we break down the misconception that good safety practices automatically translate to business profitability. We highlight the tangible benefits such as enhanced publicity, stronger client relationships, and improved employee satisfaction, and stress the importance of complex discussions about the actual costs vs. benefits of safety practices.
The Paper’s Abstract
This research addresses the fundamental question of whether providing a 15 safe workplace improves or hinders organizational survival, because there are conflicting predictions on the relationship between worker safety and organizational performance. The results, based on a unique longitudinal database covering over 100,000 organizations across 25 years in the U.S. state of Oregon, indicate that in general organizations that provide a safe workplace have significantly lower odds and 20 length of survival. Additionally, the organizations that would in general have better survival odds, benefit most from not providing a safe workplace. This suggests that relying on the market does not engender workplace safety.
Discussion Points:
Quotes:
“The sorts of things that you do to improve safety are the sorts of things that I thought should also improve productivity and reliability in the long run.” - David
“Which is science, right? That's what it's about. We think we're right until we get a new piece of information and realize that maybe we weren't as right as we thought we were.” - David
“Even though there is a reasonably high volume of research out there, it's really hard to look very directly at the question.”- Drew
“So we know from this data that it's not true that providing a safe workplace makes you more competitive.” - Drew
Resources:
The Paper: The Tension Between Worker Safety and Organization Survival
David and Drew share insights into Dr. Provan’s PhD research journey, exploring the scarce guidance and fragmented views within academic research on safety practices. They discuss the challenges of painting a clear picture of the day-to-day responsibilities of safety professionals and how this prompted an in-depth investigation into the profession. As we peel back the layers of existing literature, we touch on the difficulty and complexity of condensing a vast array of theories and studies into a cohesive academic narrative.
The varied titles and the global patchwork of research that span numerous fields are explored, and although David’s search through databases and beyond revealed a trove of about 100 relevant articles, more insights may remain hidden. The discussion culminates with a look at the strategies employed by safety professionals to wield influence, foster trust, and align safety objectives with organizational goals. David's firsthand experiences and academic findings paint a vivid picture of the complex identity and influence that safety professionals must navigate in their pivotal roles.
The Paper’s Abstract
Safety professionals have been working within organizations since the early 1900s. During the past 25 years, societal pressure and political intervention concerning the management of safety risks in organizations has driven dramatic change in safety professional practice. What are the factors that influence the role of safety professionals? This paper reviews more than 100 publications. Thematic analysis identified 25 factors in three categories: institutional, relational, and individual. The review highlights a dearth of empirical research into the practice and role of safety professionals, which may result in some ineffectiveness. Practical implications and an empirical research agenda regarding safety professional practice are proposed.
Discussion Points:
Quotes:
“I went into this going, what has been published on the safety profession? And to do that, went to a couple of the key databases and used very deliberate keyword searches…” - David
“That was probably one of the first challenges- is that this role gets called so many different things in one country, let alone globally.” - David
“The included pieces were all in peer-reviewed publications, but there's a range of quality to those publications.”- David
“This connection between the bureaucratic activities of safety professionals and the value that the people who are exposed to the risk see in having a safety team was one of the most stark research findings in the literature.” - David
“Don't learn how to do your job from a TED Talk regardless of how inspirational a new view that talk is.” - Drew
Resources:
The Paper: Bureaucracy, Influence, and Beliefs
Today’s paper, “Multiple Systemic Contributors versus Root Cause: Learning from a NASA Near Miss” by Katherine E. Walker et al, examines an incident wherein a NASA astronaut nearly drowned (asphyxiated) during an Extravehicular Activity (EVA 23) on the International Space Station due to spacesuit leakage. The paper introduces us to an innovative and efficient technique developed during Walker’s PhD research.
In this discussion, we reflect on the foundational elements of safety science and how organizations are tirelessly working to unearth better methods for analyzing and learning from safety incidents. We unpack the intricate findings of the investigation committee and discuss how root cause analysis can sometimes lead to the unintended consequence of adding more pressure within a system. A holistic understanding of how systems and individuals manage and adapt to these pressures may provide more meaningful insights for preventing future issues.
Wrapping up, our conversation turns to the merits of the SCAD technique, which champions the analysis of accidents as extensions of normal work. By examining the systemic organizational pressures that shape everyday work adaptations, we can better comprehend how deviations due to constant pressures may lead to incidents. We also critique current accident analysis techniques and emphasize the importance of design improvement recommendations.
Discussion Points:
Quotes:
“We've been doing formal investigations of accidents since the late 1700s early 1800s. Everyone, if they don't do anything else for safety, still gets involved in investigating if there's an incident that happens.” - Drew
“If you didn't have this emphasis on maximising crew time they would have been much more cautious about EVA 23” - Drew
“Saying that there's work pressure is not actually an explanation for accidents, because work pressure is normal, work pressure always exists.” - Drew
“One of the things that is absent from this technique through and they call it an accident analysis method is there is no commentary in the paper at all about how to design improvements and recommendations.” - David
Resources:
Using the Waterfall incident as a striking focal point, we dissect the investigation and its aftermath, we share personal reflections on the implementation of safety recommendations and the nuances of assessing systems designed to protect us. From the mechanics of dead man's systems to the critical evaluation of managerial decisions, our dialogue exposes the delicate balance of enforcing safety while maintaining the practicality of operations. Our aim is to contribute to the ongoing conversation about creating safer work environments across industries, recognizing the need for both technological advancements and refined human judgment.
Discussion Points:
Quotes:
“I find that some of the most interesting things in safety don't actually come from people with traditional safety or even traditional safety backgrounds.”- Drew
“Because this is a possible risk scenario, on these trains, we have what's called a ‘dead man system.” - David
“Every time you have an accident, it must have objective physical causes, and those physical causes have to come from objective organisational failures, and I think that's a fairly fair representation of how we think about accidents in safety.” - Drew
“They focused on the dead man pedal because they couldn't find anything wrong with the design of the switch, so they assumed that it must have been the pedal that was the problem” - Drew
Resources:
Using the paper, “Digital Twins in Safety Analysis, Risk Assessment and Emergency Management.” by Zio and Miqueles, published in the technical safety journal, Reliability Engineering and System Safety, we examine intricate simulations that predict traffic flows to emergency management tools that plan safe evacuation routes, and we delve into how these virtual counterparts of physical systems are redefining risk assessments and scenario planning.
As we navigate the world of operational safety, we discuss the diverse array of models—from geometric to sophisticated hybrid simulations—and their groundbreaking applications in forecasting fire spread and optimizing evacuation procedures. These digital twins aren't just theoretical concepts; they're powerful, real-time lifesavers in emergency situations, emblematic of the future of safety science.
Discussion Points:
Quotes:
"Ideally, a digital twin is a complete virtual copy of a product or service that is an electronic simulation that is completely accurate compared to that real product or service.”- Drew
“One of the first documented digital twins was in the aerospace industry - NASA [used it] during the Apollo 13 program.” - David
“this idea of having a complete digital picture of the thing that you're building is becoming fairly common, so that lends itself very much towards using it for things like digital twins.” - Drew
“we may never quite know exactly how different the digital twin is from the physical object itself. That’s the challenge.” - David
Resources:
Ben's expertise guides us through an analysis of audit reports and accident investigations, laying bare the counterfactual reasoning that often skews post-incident narratives. It's an eye-opening examination that calls for a reimagined approach to audits, one that aligns with the genuine complexities of organizational culture and safety. Together, we confront the silent failure of safety audits and management systems, debating the need for a fundamental shift in how these are designed and conducted to truly protect workers. Join us for this critical dialogue that challenges preconceptions and seeks to reforge the link between safety audits and the real work of keeping people safe.
Discussion Points:
Quotes:
"Some audits were very poorly calibrated to actually exploring and eliciting work - day-to-day work and operational risk.." - Ben
“you've got to pick and choose what to pay attention to. So unless something is really standing out as needing attention, then it can be hard to be curious and to notice these weak signals.” - David
“I'm proud to work in safety. I'm proud to call myself a sector professional. What really drove me to understand these systems was my love for safety, and I had just become so disillusioned with the amount of safety work I had to do. It wasn't helping.” - Ben
“Audits, like most activities, are very socio-political. There's a lot of vested power and conflicting interests.” - Ben
Resources:
Paper: Audit masquerade: How audits provide comfort rather than treatment for serious safety problems
Paper: How audits fail according to accident investigations: A counterfactual logic analysis
Ben Hutchinson LinkedIn
Safety isn't one-size-fits-all, especially for subcontractors who navigate multiple sites with varying rules and equipment. This episode peels back the layers on the practical safety management challenges subcontractors endure, revealing how transient work complicates the integration of safety protocols.
We scrutinize the institutional oversights and fragmented safety systems that often overlook the needs of these critical yet vulnerable players in the industry. Our conversation isn't just about identifying problems; it's an urgent call to action for better practices and a safer future for all involved in subcontracting work.
Discussion Points:
Quotes:
"Subcontracting itself is also a fairly undefined term. You can range from anything from large, labour -higher organisations to what we typically think in Australia of a small business with maybe one to four or five employees." - Drew
“All of the normal protections we put in place for safety just don't work as well when there are contract boundaries in place.” - Drew
“the subcontractor may be called in because they've got expertise in a particular type of work, but they're in an environment where they don't have expertise.” - Drew
Resources:
Your feedback is valuable to us. Should you encounter any bugs, glitches, lack of functionality or other problems, please email us on [email protected] or join Moon.FM Telegram Group where you can talk directly to the dev team who are happy to answer any queries.