The Troubles of Automating “all the Things” | J. Paul Reed

Automation

Automation is not a straightforward solution, and its unintended consequences can have significant negative impacts. Learn how to carefully consider the discretionary space, brittle edges, and human factors to ensure successful automation.

Key takeaways

Automation is not a straightforward solution and can have unintended consequences.
There is a need to consider the discretionary space, where automation is not effective and may even cause problems.
Automation can be brittle at the edges, making it prone to errors and requiring careful consideration.
The concept of checks over locks is important, as automation should not blindly follow a script, but rather consider the context and outcomes.
Automation should be treated like a product with an owner, requiring maintenance and updates.
Silo testing and validation are important considerations for automation.
Automation can be difficult to understand and troubleshoot, even for experienced developers and operations teams.
Human factors play a crucial role in automation, as people may not always understand the automation or its limitations.
Automation can have significant negative consequences, such as the loss of jobs, and therefore should be carefully considered and planned.
The idea of automation “just working” without issues is unrealistic, and a focus on incident response and debugging is necessary.
The interpredictability between agents in a system is important to consider, as automation can interact with human decision-making in complex ways.
Automation should not be seen as a replacement for human judgment and oversight, but rather as a supplement to support decision-making.
The concept of acceptable risk is important to consider, as automation can introduce new risks that may not have been previously accounted for.
The importance of version control and joint cognitive system behavior should not be overlooked in automation.
Sutton, R.K., and Staw, B.M. (1994) discuss the role of routine in organizations and how automation can disrupt this.
The concept of complexity is important to consider, as automation can create new dependencies and interactions.
The importance of authority and autonomy should not be overlooked in automation.
The idea of “safe” automation is a myth, and automation should not be seen as a risk-free solution.
The concept of “ murder” automation is a risk, and automation should be carefully considered and planned.
The importance of maintenance and updates should not be overlooked in automation.
Automation can be used to “buy time” and provide a buffer against unexpected events.
The importance of incident response and debugging is necessary for automation.
The importance of considering the element of time pressure is important to consider in automation.
The concept of acceptable risk is important to consider in automation.

The Troubles of Automating “all the Things” | J. Paul Reed

More talks