Consider the following scenario. Suzy is 63, recently retired, and trying to decide when to start over receiving social security And how to manage your retirement savings reduce tax burden.
she opens one AI chatbotType in the details and get a calm, well-organized and confident answer: Claim now, convert so much, here’s the logic.
The chatbot looks official and shows its work. So Suzy follows its guidance and never calls a financial planner. Maybe the advice was good. But perhaps it quietly ignored the fact that Suzie’s spouse was younger and in poor health. Social Security math can be overturned. It may also have ignored what the suggested conversion to the retirement savings plan would induce Suzy to pay higher medicare premiums After two years.
Suzy won’t know for a long time, if ever, whether this guidance was right for her. And the AI will never call back and say it was unsure.
Suji is no exception. AI chatbots have entered everyday life with remarkable speed: A 2025 Pew Research Center survey Found that 34% of US adults and 58% of people under 30 have used it chatgptAlmost double the share of two years ago.
A large number of people are asking AI about money and some are getting worried. according to a Survey of 2,000 American adults in 2025 According to Pearl.com, a professional services platform, 19% said they lost more than $100 by following an AI chatbot’s financial advice. Among Gen Z investors, that figure rose to 27%.
These are not imaginary risks. People are already paying their money for answers that are convincing – and wrong.
Get the world’s hottest discoveries delivered straight to your inbox.
As a finance professor As someone who has been following the proliferation of AI in personal finance closely, this is the part of the AI story that concerns me most. And this isn’t the part you usually hear about.
We argue about AI in the wrong way
There are two contrasting complaints about AI. One is that people trust it too much, treating chatbots like an oracle, which researchers call a trend. algorithm appreciation. the second one is People don’t trust it enough And Dmiss its useful toolsknown as a trend algorithm hatred.
I argue These are really two sides Of the same coin, and it depends on which side you look at, whether you can tell when the AI is wrong.
When an AI clearly fails, you notice and lose confidence. So you’re more likely to seek out a professional or another human being you trust sooner than you might otherwise. That’s safe failure.
Dangerous failure is the opposite. The answer is fluent, confident and wrong. You have no way of catching it, so you end up managing the problem on your own when you should have asked for help.
The trouble is that the second kind of failure is common when it comes to money.
The typical users who use chatbots for financial advice are young, with men outnumbering women.
(Image credit: Krongkaew via Getty Images)
When you mistake fluency for accuracy
Three things make financial advice particularly treacherous for AI.
First, flow is not accuracy. People naturally view confident and articulate answers as competent. But no matter how sophisticated an answer seems, it tells you almost nothing about whether it fits your situation or about the accuracy of the proposed solution. A chatbot can be word-perfect and still be wrong about your taxes, because your taxes depend on details it never asked about.
Second, AI is least reliable precisely where the stakes are highest. AI tools are Good in regular and general subjects: what one roth ira i show compound interest Works, the difference between stocks and bonds.
But financial life is full of rare, complex, one-time decisions: exercising stock options, understanding the alternative minimum tax, taking required, minimum 401(k) distributions, deciding on a Social Security strategy as a couple, drafting a divorce settlement.
I made a similar argument About AI Trading on Wall Street Three Years Ago. Because market downturns are rare, AI has little data to learn from, so it can be most confident where it has the least information.
That worry has not ended. Market watchers now caution that AI trading bots are creating new financial risksAnd the same blind spot applies to you too personal Finance. Researchers describe this unequal ability as “jagged border“- Reliable in normal cases but unreliable in abnormal cases. And in finance, abnormal cases are costly.
Third, you can’t check the work often. Financial advice is what economists call “”reliability is good,” like a mechanic’s diagnosis or a doctor’s recommendation. You often can’t tell whether the advice was good or not, sometimes for years. A bad tax move may not surface until an audit. A bad 401(k) drawdown plan Unless there is a decline in the stock market, one cannot make any deductions. Without quick feedback, the wrong-but-confident answer is never the right one.
This is why the Pearl numbers above are probably low, as they only reflect the damage observed by people.
quiet failure is worth watching
Note that the real loss in Suzy’s story is not a single dramatic mistake. The point is that a confident answer made Suzy feel no need to call a professional, so the call never happened.
The danger is not so much that you act on bad advice, but that you never take good advice. The more intuitive and more reassuring the tool is, the easier it will be to stay in do-it-yourself mode beyond the point when you need outside help.
Who is most at risk? one in Study of a large robo-advisor platform in Indiaco-author giant bulwark And I found that its users are young, predominantly male and are small retail investors and professionals. And new account sign-ups increase during periods of high market volatility.
In other words, the number of people most inclined to rely on automated advice corresponds to 27% of those Gen Zers who lost more than $100 when using a chatbot for financial advice. They reach for it only when the market becomes turbulent and a wrong move is the most costly.
There’s also an incentive worth naming. In my new analysisI’d argue that there’s a reason a tool that earns its revenue by getting your attention should sound confident and helpful: confidence keeps you on the platform. The problem is that the user it maintains this way is sometimes the same one that should have been assigned to a human.
A system designed to keep you busy is not the same as a system designed to protect your financial future, and the two may be pointing in different directions. The disruption is already underway, as money managers face what Bloomberg calls chatbot calculation. Recently a single, new AI tax tool wealth management stocks fell Because investors believe that automated advice will hurt the business.
How to be smart in using AI
These findings don’t mean people should avoid AI for money advice. When used well, these tools are a valuable and free financial teacher.
It also doesn’t mean that a financial advisor always has the right answers. Like finding any type of expert, it’s important to do your research first and make sure meet the type criteria Set by the Consumer Financial Protection Bureau. Fee transparency is also important.
But if you turn to AI, the skill is knowing where to draw the line.
Consider AI a starting point, not a decision. This is excellent for learning concepts, drafting questions, and getting oriented before the meeting. It can teach people the vocabulary to better communicate with an expert.
But pay attention to the signs that you’ve left your comfort zone and entered the area where AI is weakest and a confident answer is least trustworthy. Red flags are large dollar amounts, tax consequences, anything immutable and anything that affects the specifics of your situation rather than a general rule.
Property questions, withdrawal of retirement savings, strategies for claiming Social Security benefits, business structure and major one-time transactions all fall into this category. These are decisions that a human being is required to make, such as certified financial planner.
And remember, confidence is not competence. When the answer about your money seems most sophisticated and most certain, it is not a reason to relax. On the toughest questions, that innate confidence is exactly the sign that you should pick up the phone and talk to an expert.
This edited article has been republished Conversation Under Creative Commons license. read the original article.