Product

GPT

GPT is a generative pre-trained language model product developed by OpenAI . The name stands for "Generative Pre-trained Transformer," reflecting its architecture: it uses the Transformer neural network algorithm, introduced by Google in 2017, combined with pre-training on massive text datasets followed by fine-tuning for specific tasks .

The series has evolved through multiple iterations — from GPT-1 and GPT-2 to GPT-3, whose 175-billion-parameter version was trained on roughly 500 billion tokens of text data using a top-5 global supercomputer system at a reported cost of about $12 million . GPT-3.5 formed the basis for ChatGPT, which OpenAI launched in November 2022 after adding human feedback reinforcement learning to make outputs more aligned with human preferences . GPT-4 followed in March 2023 with multimodal capabilities, and by late 2023, OpenAI's GPT series had reached an estimated 1.5 billion active users worldwide .

Chinese venture capital observers have tracked this trajectory closely. 5Y Capital noted that ChatGPT and image-generation tools marked the first time AI capabilities crossed the public's threshold for "real AI," sparking the fastest consensus formation in recent tech cycles . By mid-2024, Yunqi Capital observed that while GPT-4's release had set a high bar, the pace of capability jumps at the frontier had slowed into a more incremental mode, even as open-source alternatives like Meta's Llama series narrowed the gap with closed models .

AI-generated — may contain errors, please verify.

GPTProduct
渲染中…
Mentioned in 62 articles

Coverage