AI is a danger to the financial system, regulators warn for the first time | CNN Business (2024)

AI is a danger to the financial system, regulators warn for the first time | CNN Business (1)

The exterior of the U.S. Department of Treasury in Washington, DC.

New York CNN

Top federal regulators are warning for the first time that the use of artificial intelligence poses a risk to the financial system.

The Financial Stability Oversight Council, a team of leading regulators across the US government, formally classified AI on Thursday as an “emerging vulnerability.”

Sophisticated AI models have exploded in popularity in recent years, even as many prominent names within the field say the nascent technology could have disastrous effects if it grows out of control.

“AI has the potential to spur innovation and drive efficiency, but its use in financial services requires thoughtful implementation and supervision to manage potential risks,” FSOC warned in its annual report Thursday.

FSOC, created in the aftermath of the 2008 financial crisis and led by US Treasury Secretary Janet Yellen, cautioned that AI can “introduce certain risks,” including cybersecurity concerns, compliance risks and privacy issues.

Regulators also expressed concern about “complicating factors” related to generative AI models like ChatGPT.

For example, the council flagged data security, consumer protection and privacy risks posed by financial firms using generative AI. And they flagged that generative AI models can produce flawed results known as “hallucinations.”

An impenetrable black box

Another worry for regulators is that some AI models operate as “black boxes” – meaning their inner workings are impenetrable to outsiders.

FSOC said this “lack of ‘explainability’ can make it difficult to assess the system’s conceptual soundness, increasing uncertainty about their suitability and reliability.”

In other words, if banks are relying on mysterious AI models, that makes it hard to understand how sturdy their underlying systems truly are.

Relatedly, regulators expressed concern about how these AI systems could “produce and possibly mask biased or inaccurate results.” That in turn would raise worries about fair lending and other consumer protection issues, FSOC said.

The move comes just two years after regulators first classified climate change as an “emerging threat to US financial stability.”

AI investment and adoption has boomed, even as some experts warn of serious dangers with the technology. President Joe Biden recently signed an executive order instructing federal agencies to take steps to safeguard the development of AI, which is a booming area of adoption and investment.

“Errors and biases can become even more difficult to identify and correct as AI approaches increase in complexity, underscoring the need for vigilance by developers of the technology, the financial sector firms using it, and the regulators overseeing such firms,” FSOC said.

The popularity of ChatGPT and other generative AI tools, which use large language models to identify patterns in data and create text and images, has only accelerated the interest in AI.

AI is a danger to the financial system, regulators warn for the first time | CNN Business (2024)

FAQs

AI is a danger to the financial system, regulators warn for the first time | CNN Business? ›

Late last year, the Financial Stability Oversight Council, a team of leading regulators led by the Treasury secretary, for the first time formally classified AI as an “emerging vulnerability.” Experts are especially worried about how AI can turbocharge financial fraud.

Is AI a threat to finance? ›

However, hallucination, algorithmic bias and vulnerability to data quality issues present risks to the accuracy of AI predictions. If financial entities base their decisions on faulty AI predictions which are not checked, this could lead to outcomes that may result in economic losses or even disorderly market moves.

What does the US regulator warn about AI presents growing risk to financial markets? ›

AI in the News

A top banking regulator is warning about the “potential explosion” of fraud fueled by artificial intelligence and says policymakers should consider new approaches to who bears the costs of that fraud.

What are the dangers of AI? ›

Real-life AI risks

There are a myriad of risks to do with AI that we deal with in our lives today. Not every AI risk is as big and worrisome as killer robots or sentient AI. Some of the biggest risks today include things like consumer privacy, biased programming, danger to humans, and unclear legal regulation.

How AI is disrupting the banking industry? ›

AI platforms for the banking industry have the ability to analyze customer data to develop a deep understanding of customers' needs and enable FIs to design tailored experiences that meet those needs.

Which major companies are threatened by AI? ›

Here are five of the business sectors that will be most affected by the incorporation of AI tech into systems and processes:
  • Education.
  • Cybersecurity.
  • Financial services.
  • Retail.
  • Marketing.
Apr 2, 2024

Can AI ruin the stock market? ›

Security and Exchange Commission (SEC) chair Gary Gensler recently cautioned against “the possibility of AI destabilizing the global financial market if big tech-based trading companies monopolize AI development and applications within the financial sector,” the paper noted.

What is the biggest concern regarding AI in the future? ›

Dangers of Artificial Intelligence
  • Automation-spurred job loss.
  • Deepfakes.
  • Privacy violations.
  • Algorithmic bias caused by bad data.
  • Socioeconomic inequality.
  • Market volatility.
  • Weapons automatization.
  • Uncontrollable self-aware AI.

What are the risks of AI in accounting? ›

Lack of Transparency

AI-powered tools may use complex algorithms and machine learning to analyze data and make decisions, but it can be difficult for humans to understand how these decisions are made. This lack of transparency can lead to errors and bias, and can also make it difficult to detect and correct mistakes.

How does AI affect financial reporting? ›

One of the most significant impacts of AI in finance is the automation of manual tasks. AI-powered systems can generate reports, process large amounts of data, and perform administrative tasks efficiently.

What did Elon Musk say about AI? ›

"I do think it's very important that we build the AI in a way that is beneficial to humanity," he said. "The AI should not be taught to lie, it should not be taught to say things that are not true. Even if those things are politically incorrect, it should still say what it believes to be true."

Can AI take over the world? ›

The short answer to this fear is: No, AI will not take over the world, at least not as it is depicted in the movies.

Will AI replace humans? ›

Will AI replace humans? No, AI will not replace human intelligence, as it is humans who are developing AI applications through programming and algorithms. Automation makes it easier to replace manual labour, and today, in every sector, these AI technologies are making it easier to complete complex tasks.

Will AI replace humans in banking? ›

AI is never going to fully replace human employees, and is widely expected to be a boon for the workplace. About 30% of the hours employees currently work will be automated by 2030, according to a report from McKinsey. This will free up some workers to focus on more strategic projects.

Are accountants going to be replaced by AI? ›

The biggest misconception is that AI will replace accountants and auditors. It will not replace us but elevate us to the higher level of thinking and service. Basically, it takes away the mundane repetitive tasks that we never really wanted to do in the first place.

Is finance going to be replaced by AI? ›

The future of finance roles

This means that finance professionals must adapt to these changes and embrace the complementary nature of humans and technology. While some tasks may become automated or delegated to AI systems, this does not mean human jobs will be replaced entirely.

Will finance be replaced by AI? ›

The future of finance roles

This means that finance professionals must adapt to these changes and embrace the complementary nature of humans and technology. While some tasks may become automated or delegated to AI systems, this does not mean human jobs will be replaced entirely.

Will AI disrupt accounting? ›

AI is changing the work of finance professionals and accountants by automating repetitive operations, improving fraud detection, offering real-time insights, and modernizing audit processes. As the accounting industry embraces these AI technologies, professionals must adjust and develop the skills to use AI properly.

What are the risks of AI in accounting and finance? ›

Lack of Transparency

AI-powered tools may use complex algorithms and machine learning to analyze data and make decisions, but it can be difficult for humans to understand how these decisions are made. This lack of transparency can lead to errors and bias, and can also make it difficult to detect and correct mistakes.

What are the risks of AI in banking? ›

Data Privacy and Security

Banks collect large amounts of data from customers, and AI algorithms require access to this data to function effectively. If sensitive data exist, as is often the case with financial data, any security breach could have serious consequences.

Top Articles
Latest Posts
Article information

Author: Terrell Hackett

Last Updated:

Views: 5543

Rating: 4.1 / 5 (72 voted)

Reviews: 95% of readers found this page helpful

Author information

Name: Terrell Hackett

Birthday: 1992-03-17

Address: Suite 453 459 Gibson Squares, East Adriane, AK 71925-5692

Phone: +21811810803470

Job: Chief Representative

Hobby: Board games, Rock climbing, Ghost hunting, Origami, Kabaddi, Mushroom hunting, Gaming

Introduction: My name is Terrell Hackett, I am a gleaming, brainy, courageous, helpful, healthy, cooperative, graceful person who loves writing and wants to share my knowledge and understanding with you.