Understanding the core terms of the AGI conversation today
AGI, or artificial general intelligence, is the ability to generalize beyond what you were trained for. If given an unfamiliar environment and goal, it should figure out how to achieve that goal through creative imagination and trial and error. Singularity, coined by Vernor Vinge and popularized by Ray Kurzweil, refers to a point where the rate of progress feels infinite to legacy humans. This happens through recursive self-improvement, where an AI makes a smarter AI. Superintelligence follows AGI. Many believe that once we achieve human-level AGI, it will optimize its own code and exceed human levels much faster than predicted, creating a steep exponential curve rather than gradual progress.
— Rethinking the AGI Race, with Benjamin Goertzel · The Keynote on AI