OpenAI announced its o3 and o4-mini models just yesterday. These are the first models that have learned how to use tools through reinforcement learning, so they can significantly perform better. o3 is great at coding, math, science and visual tasks. It can analyze images, charts and graphics.
The o4-mini is smaller and more cost efficient. It is great for math, coding, and visual tasks. It performs much better than o3-mini on various tasks, including non-STEM tasks. These models can think with images. Both models can access custom tools via function calling in the API. The company also announced Codex CLI, which is a coding agent that runs in your terminal. To use it, you simply have to bring your OpenAI API key. You get various modes to choose from, including Full Auto.
[HT]