Large Language Models (LLMs) are the core technology driving generative AI like ChatGPT. However, Meta’s Chief AI Scientist Yann LeCun states that LLMs will not achieve human-level intelligence. This article explores the limitations and future prospects of LLMs as discussed by LeCun.
1. Limitations of Large Language Models
LLMs operate by learning from hundreds of millions to billions of language models based on the statistical composition of sentences. However, LeCun points out that this approach is superficial and limited. AI cannot draw organic conclusions like humans and relies on training data from human engineers.
Generative AI can only accurately respond to prompts when provided with correct training data. This is inherently unsafe.
In other words, AI’s reasoning utilizes knowledge accumulated from extensive training data.
2. Differences between Human Intelligence and AI
LLMs do not understand logic or the physical world, lack continuous memory, and cannot infer reasonable definitions for terms. Additionally, they have limitations in hierarchical planning. This means AI cannot think and plan organically like humans.
LeCun emphasizes that AI’s understanding of logic is very limited and lacks continuous memory, highlighting that AI cannot engage in complex thinking like humans.
3. Meta’s AI Research and Future Vision
Meta is investing billions of dollars in developing its own LLMs, striving to catch up with leading AI groups. LeCun states that developing machines with human-level intelligence requires an entirely new generation of AI systems. To this end, Meta’s fundamental AI research lab, with 500 employees, is conducting extensive research.
LeCun says, “We are working to create AI that operates in a manner similar to humans. Achieving this vision may take 10 years.”
Conclusion: The Need for a New Approach to AI
The current evolution of LLMs is superficial and limited. LeCun argues for a radical alternative approach to create superintelligence. Known as one of the ‘Four Horsemen of AI’ along with Geoffrey Hinton, Yoshua Bengio, and Andrew Ng, LeCun is at the forefront of AI research.
We are exploring new approaches to create superintelligence in machines.
This implies the need for developing AI systems in a completely different manner from current LLMs.