ceo cancels BI tooling, replaces it with AI, breaks everything

"""so i watched this happen with a client a coupla months ago. they had their dashboards in metabase, he cancelled > handed the team claude > "dashboards are a waste and just go and ask ai". as you can guess he then called me saying he thinks he broke sth.

sales vp was pulling numbers and surprise surprise they didnt match with finance. obvi, there were a couple different definitions for "active customer" too. claude (with all my love to the tool) was hallucinating retention figures because the underlying tables hadn't been cleaned since 2022. cherry on top data team spent their days explaining why the AI was wrong instead of actually building anything"""

https://www.reddit.com/r/analytics/comments/1sqwb5l/ceo_cancels_bi_tooling_replaces_it_with_ai_breaks/?utm_source=substack&utm_medium=email