GPT-3.5-Turbo

ChatGPT API

• 2023-03-01 Introducing ChatGPT and Whisper APIs
  • Officials also call it ChatGPT API.
• but can actually migrate from text-davinci-003 to gpt-3.5-turbo

  • By optimizing the entire system, ChatGPT has achieved a 90% cost reduction since December and is now passing the savings on to API users....

  • The ChatGPT model family "gpt-3.5-turbo" released today is the same model used in the ChatGPT product. Priced at $0.002 per 1k token, it is 10x cheaper than the existing GPT-3.5 model. The model is also ideal for many use cases other than chat. Early testers are moving from text-davinci-003 to gpt-3.5-turbo with just a few tweaks to the prompts.

• It's not chat-only, but it can do everything that text-davinci-003 was able to do (doc).

  • Although the chat format is designed to make multi-turn conversations easy, it’s just as useful for single-turn tasks without any conversations (such as those previously served by instruction following models like text-davinci-003).

• I think the big industrial impact is that the price of everything will drop to 1/10th of what it was before. I think it's a little too subtle to be taken as a "chat API has grown up, we can chat now!

This page is auto-translated from /nishio/GPT-3.5-Turbo using DeepL. If you looks something interesting but the auto-translated English is not good enough to understand it, feel free to let me know at @nishio_en. I'm very happy to spread my thought to non-Japanese readers.