LLMs are powerful and useful, but scaling them may be a detour rather than the road to general intelligence.
I don’t think LLMs are AGI, nor that fully scaling up LLMs is going to get you to AGI. I sort of agree with Yann LeCun that on the path to AGI, LLMs are an off-ramp. I still think we can get there by 2029 or even sooner, because the pace of progress is just insane and there are a lot of other techniques now being tried at smaller scale.
Source: Rethinking the AGI Race, with Benjamin Goertzel (eCornell Keynote)