Book a call

News · March 14, 2023

OpenAI releases GPT-4 with longer context and a waitlisted API

// ai.news :: 2023

OpenAI launched GPT-4, a more capable model that accepts text and image input, with API access opening gradually. For product teams, it raises what can be automated, but also the cost per call.

What happened

  • OpenAI announced GPT-4 on March 14, 2023, making it available to ChatGPT Plus subscribers with a usage cap and to developers through an API waitlist, according to its announcement.
  • According to OpenAI, the standard model supports 8,192 tokens of context and a limited 32,768-token version was offered, with API prices starting at $0.03 per 1,000 prompt tokens and $0.06 per 1,000 completion tokens.
  • OpenAI reported that GPT-4 scored around the top 10% of test takers on a simulated bar exam, while noting the model can still produce incorrect information.
  • TechCrunch reported early uses at companies including Stripe, Duolingo, Morgan Stanley and Khan Academy, and said Microsoft confirmed Bing Chat runs on GPT-4.

Why it matters

GPT-4 makes tasks like summarizing long documents, drafting support replies and reviewing code more realistic for production. But it is priced well above earlier models, so the right pattern for most products is routing: send hard requests to GPT-4 and keep simpler ones on cheaper models.

Before switching, build a small evaluation set from your own real inputs and score outputs against it. That gives you a baseline for accuracy and cost per task, and makes it easier to decide later when to move between model versions.

Sources

  • OpenAI: GPT-4
  • TechCrunch: OpenAI releases GPT-4, a multimodal AI that it claims is state-of-the-art

This post is CMM’s own summary and commentary on publicly reported news. Facts are attributed to the sources linked above; please read them for full details. CMM is not affiliated with these publishers or with the companies mentioned, and trademarks belong to their owners. Prepared with AI assistance. Corrections or requests: [email protected]. See our editorial policy.

Want help with this?

Tell us what you need, and we will suggest the right team model on a short call.

Talk to us