- Should we fine-tune or use retrieval?
- Often both, but rarely at once. We usually get a retrieval baseline and an evaluation set working first, then fine-tune only where the measurements show it pays — behaviour, format, latency or cost.
- We do not have enough labelled data. Is fine-tuning off the table?
- No. Synthetic data generation seeded from a small set of real examples covers many tasks, provided it is validated and held to a real evaluation set rather than trusted on faith.
- Do you use open-weight or hosted models?
- Whichever fits the constraints. Hosted models are often right early; open-weight models win when you need private deployment, per-task cost control or a model you can genuinely own.