AI Limitations of Todays AI
Today's AI systems are powerful within narrow tasks but remain fragile, lack genuine understanding, and can quietly inherit the biases of their training data.
Narrow by Design
Almost every AI system in use today is built and trained for a specific type of task: recognizing images, translating text, predicting churn, playing a particular game. A model that excels at diagnosing skin lesions from photos has no built-in ability to hold a conversation, and a chatbot has no innate ability to drive a car. This is often called 'narrow AI,' and it's fundamentally different from the flexible, cross-domain intelligence humans use to learn a new skill by drawing on everything else they already know.
Fragile Outside the Training Distribution
AI models learn statistical patterns from the examples they're trained on. When they encounter something meaningfully different from those examples, sometimes described as being 'outside the training distribution,' performance can degrade suddenly and unpredictably rather than gracefully. An image classifier trained mostly on daytime photos may perform poorly at night. A self-driving system trained mostly on clear highways may struggle with an unusual construction detour. The failure isn't always obvious either: the system can still produce a confident-looking answer that happens to be wrong.
- Adversarial examples: small, deliberately crafted changes to an image that cause a classifier to misidentify it entirely
- Chatbots stating incorrect facts fluently and confidently, often called 'hallucination'
- Medical models performing worse on patient groups underrepresented in their training data
- Voice assistants misunderstanding accents or phrasing patterns not well represented in training audio
No True Understanding or Common Sense
Large language models generate text by predicting the most statistically likely next words based on patterns in their training data. This can look remarkably like understanding, but it isn't grounded the way human understanding is, in lived experience, physical intuition, or verified facts. It's why these models can write a fluent, well-structured paragraph that contains a basic factual error, or answer a simple logic puzzle inconsistently depending on how it's phrased. They're excellent pattern-completion engines, not reasoning engines with a model of the world in the way people usually mean that phrase.
Bias Reflects the Data, Not Just the Code
AI systems learn from historical data, and historical data reflects the world as it was, including its inequities. A resume-screening model trained on past hiring decisions can absorb old hiring biases. An image-generation model trained mostly on certain kinds of representation can under- or over-represent groups in its outputs. The algorithm itself doesn't need any explicit prejudice for this to happen, it only needs to accurately learn the patterns present in biased data, which is arguably what it's designed to do well.
None of this means today's AI is not useful, it clearly is, but treating it as infallible or generally intelligent leads to real mistakes. Researchers are actively working on making models more robust, more transparent about their uncertainty, and less prone to inheriting bias, but these remain open problems rather than solved ones.
Exercise: AI Applications
How are recommendation systems, like those used by streaming or shopping platforms, primarily powered?