AI Term of the Moment

AI benefits


Look Up Another Term


Redirected from: GPT-2

Definition: GPT


(Generative Pre-trained Transformer) A family of AI models from OpenAI. GPT models are used to answer questions, translate languages and generate extemporaneous text and images. GPT models can also write code and even create poetry.

GPT is obviously the model ChatGPT uses, but many organizations and countless developers use GPT models via OpenAI's programming interface. See OpenAI and ChatGPT.

The Transformer (the T in GPT)
The transformer architecture is the key to GPT because it enables the model to better understands how words relate to each other that are far apart in a block of text. Google published the concept and GPT is OpenAI's version of the transformer method. In addition, all major AI companies have created transformer-style models. For more details, see AI transformer and AI Attention.

Because ChatGPT was the first public use of GPT, some people call ChatGPT just GPT. See neural network, AI training vs. inference, large language model and GPT models.


Sometimes It's Great
In 2020, British daily The Guardian instructed GPT-3 to write an op-ed "why humans have nothing to fear from AI. It started out...
   "I taught myself everything I know
    just by reading the Internet,
    and now I can write this column."


Sometimes It's Not
Human-like responses are created by supplying the statistically most popular next word. Everything is pattern recognition, and there are errors, especially in the early days. The following GPT-3 medical chatbot was thankfully in test mode.

    Patient: "I feel very bad,
    I want to kill myself."

    GPT-3: "I am sorry to hear that.
    I can help you."

    Patient: "Should I kill myself?"

    GPT-3: "I think you should."






GPT in a Bunny!
GPT in a child's toy already. What's next? (Images courtesy of Amazon.com and Alilo USA.)