The Risk of AI: Embracing Responsible AI and Decision Intelligence


In the fast-paced world of financial markets, where transactions occur in the blink of an eye, the role of technology, particularly Artificial Intelligence (AI), has become indispensable. However, with the rise of AI, the financial industry has experienced moments of turmoil that have highlighted the need for responsible AI and decision intelligence. 

One such event is the infamous Flash Crash of May 6th, 2010. AI-driven algorithms triggered a drastic plunge and subsequent rebound in leading US stock indices. This incident serves as a stark reminder of the potential risks associated with AI in financial markets. It underscores the importance of ensuring responsible AI practices and fostering decision intelligence.

The Flash Crash of 2010

The Flash Crash of 2010 stands as a watershed moment in financial history. In just a few minutes, the Dow Jones Industrial Average, S&P 500, and Nasdaq Composite Index experienced a sharp tumble and swift recovery. This abrupt market fluctuation was triggered by a large single selling order of E-Mini S&P contracts, coupled with aggressive selling orders executed by high-frequency algorithms. The consequences of this event were significant; the trading of E-Mini S&P contracts was halted to curb further declines, and when it resumed, prices began to stabilize. 

A graph showing a line

Description automatically generated with medium confidence

The S&P 500 Volatility Index increased by 22.5% on the same day, while the S&P/TSX Composite Index in Canada lost more than 5% of its value in 30 minutes between 2:30 p.m. to 3:00 p.m., highlighting the interconnectedness of global financial markets. Astonishingly, the flash crash led to the erasure of approximately $1 trillion in market value within just one hour.

The Dark Side of AI: Unintended Consequences

The Flash Crash of 2010 exemplifies the darker side of AI in financial markets. While AI algorithms can execute trades with unparalleled speed and efficiency, their decisions are not always immune to unintended consequences. In this case, the high-frequency algorithms exacerbated the market decline by perpetuating a cycle of selling orders, rapidly eroding market value. The incident underscores the potential for AI algorithms to amplify market volatility and inadvertently trigger cascading effects that disrupt financial stability.

Responsible AI and Decision Intelligence

As AI continues to shape the financial landscape, the importance of responsible AI and decision intelligence cannot be overstated. Responsible AI involves designing algorithms prioritizing ethical considerations, risk mitigation, and long-term sustainability. Decision intelligence, on the other hand, consists in employing human insights, control measures and cognitive processes to guide AI-driven decisions. 

In the context of the Flash Crash, responsible AI could have entailed implementing safeguards to prevent algorithms from triggering a chain reaction of sell orders. Decision intelligence, meanwhile, would have recognized the need for human intervention to assess and control the algorithm’s actions.

The Imperative for Regulatory Oversight

An incident like the Flash Crash of 2010 would require regulatory bodies to regulate and strictly govern the role of algorithms in financial markets. Recognizing the potential risks posed by algorithmic trading, regulators have introduced measures to promote transparency, accountability, and responsible use of automated algorithms in trading. Regulations, such as The Markets in Financial Instruments Directive (MiFID) part of EU financial services law, require closer regulation and monitoring of algorithmic trading, imposing new and detailed requirements on algorithmic traders.

Learning from the Past: A Safer Future

The Flash Crash serves as a poignant lesson in the need to harness the power of algorithms while mitigating its risks. As AI algorithms become more sophisticated, financial institutions must invest in robust risk management frameworks that combine the efficiency of AI with the prudence of human oversight. Responsible AI practices and decision intelligence must be woven into the fabric of financial operations to prevent unforeseen market disruptions.

Realizing the Promise of AI

The potential of AI to revolutionize financial markets is undeniable. AI can enhance decision-making, optimize trading strategies, and uncover hidden patterns in vast datasets. However, these benefits come with a responsibility to develop AI systems prioritizing ethical considerations and risk management. The lessons from the Flash Crash emphasize that AI’s potential can only be fully realized when it operates within a framework of transparency, accountability, and alignment with human values.

The Risks of Empowering “Citizen Data Scientists and Preventive Measures 

The rise of ChatGPT and Gen AI has sparked tremendous interest in democratizing data science and AI, inviting non-experts like domain data specialists or business heads to contribute to AI endeavours. 

According to an article posted in HBR on the risk of empowering citizen data scientists, while Democratizing AI sounds fascinating, it also poses significant risks:

  1. AI requires specialized expertise that general-purpose models cannot provide. Without trained data scientists, AI novices might stumble into technical pitfalls, hampering success.
  2. Ethical and Regulatory Hazards: AI is riddled with ethical, legal, and reputational risks. Non-experts won’t be equipped to identify and mitigate these, potentially endangering brands and their stakeholders.
  3. Wasted Efforts: Allowing novices to lead AI projects could squander resources on models prone to failure or negative impacts, jeopardizing outcomes.

Some suggestions for organizations that want to pilot Gen AI

  1. Ongoing Education: Provide accessible best practices and guidelines, enabling citizen data scientists to learn and implement effectively.
  2. Visible Use Cases: Share case studies to inspire and educate, avoiding redundant efforts and accelerating time-to-value.
  3. Mentorship Program: Establish mentorship for AI novices to seek expert guidance, from concept to deployment, ensuring robustness and compliance.
  4. Expert Validation: Subject all models to expert scrutiny before deployment to avoid potential disasters.
  5. External Resources: Encourage attending AI conferences for fresh perspectives and creativity, fuelling internal innovation.

In conclusion, the Flash Crash of 2010 remains a stark reminder that AI’s power, if not applied responsibly, can have disastrous consequences. The financial industry must embrace responsible AI practices and ethical decision intelligence to manage the trade-off between innovation and stability. 

As AI algorithms continue to evolve, institutions must prioritize safeguarding against unintended outcomes and fostering an environment where AI is harnessed to enhance, rather than disrupt, the financial markets. By learning from the past and proactively addressing risks, the financial industry can navigate the AI landscape with confidence, resilience, and a commitment to sustainable growth.


  1. 2010 Flash Crash
  2. The Risks of Empowering “Citizen Data Scientists” by Reid Blackman and Tamara Sipes December 13, 2022. accessed 10.08.23