GPT-4 has 100 trillion parameters? OPENAI says this is a complete rumor
In an interview with The Verge, Sam Altman, CEO of OpenAI, responded to some recent topics of interest, including GPT-4 and an image that went viral on Twitter.
The image claims that GPT-3 has 175 billion parameters, that ChatGPT is based on an improved version of GPT-3 -- GPT-3.5 -- and that the upcoming GPT-4 will have 100 trillion parameters, an even greater improvement over GPT-3.
Sam Altman first responded to the timing of the GPT-4 release, saying that GPT-4 will be available at some point, when they are confident that the security issues have been resolved. As for the rumors circulating online that GPT-4 will be released in the first quarter or summer of this year, they are also rumors, and the more people expect, the more they will be disappointed.
GPT-3 was released in 2020, and thanks to the explosion of ChatGPT, GPT-4 is highly anticipated, so there are quite a lot of messages on Twitter predicting the release time of GPT-4, only that the rumors have turned into the exact release time, and many marketing numbers are actively participating in this topic.
As for the 100 trillion parameter issue, Sam Altman called it utter nonsense, but he didn't reveal how many parameters GPT-4 actually has, which is understandable if it's an order of magnitude higher, but I don't know how the Internet can spread the word that GPT-4 has up to 100 trillion parameters, which is 500 times the 175 billion of GPT-3.
Sam Altman also said they don't really have AGI at the moment, which the team expects, but just hasn't gotten around to it yet.
AGI refers to artificial general intelligence, meaning that it is at least as capable as humans in many areas. As of now ChatGPT can't do that, so Sam Altman says they don't have a true AGI yet.