
TLDR
Fine-tuning is training a pre-built AI model further on a specific dataset to make it better at a particular task, domain, or style, without building a model from scratch.
Training an AI model from scratch requires billions of examples and millions of dollars in compute. Fine-tuning takes a model that is already powerful and trained broadly, then does additional, targeted training on a smaller dataset to specialize it.
For example, a hospital might fine-tune GPT-4o on thousands of medical notes to make it better at clinical documentation. A law firm might fine-tune a model on legal briefs to get responses that match the firm's style and terminology.
Fine-tuning changes the model's weights, meaning the improvements are baked into the model permanently rather than provided through a prompt. This makes it more efficient: you do not have to include lengthy examples in every prompt.
There are trade-offs. Fine-tuning costs money (compute and data preparation), can cause a model to forget capabilities it had before, and requires enough quality training examples to be effective. For many use cases, good prompting achieves similar results without fine-tuning.
Customer service
Fine-tune a model on thousands of resolved support tickets so it responds in your company's exact tone and handles your specific product issues correctly.
Code completion
GitHub Copilot is a fine-tuned model trained on public code repositories to suggest completions that match common coding patterns.
Medical AI
Medical AI tools are often fine-tuned on clinical data to use correct terminology, understand abbreviations, and follow documentation standards specific to healthcare.
Try prompting first. For most use cases, a well-crafted system prompt with examples achieves 80-90% of what fine-tuning would. Fine-tuning makes sense when you need consistent style, specialized vocabulary, or very high inference efficiency at scale.
OpenAI recommends at least 50 examples for initial fine-tuning, but hundreds or thousands produce better results. Data quality matters more than quantity.
Yes. OpenAI offers fine-tuning for GPT-4o mini, GPT-3.5 Turbo, and other models via their API. You upload training examples and OpenAI trains a custom version of the model for you.
Bottom line
Fine-tuning is training a pre-built AI model further on a specific dataset to make it better at a particular task, domain, or style, without building a model from scratch.