RAG vs fine-tuning vs long context for a customer-support assistant
We're building an assistant that answers customer questions from our help centre: about 4,000 articles, roughly 6M tokens, edited every week by the support team. Volume is 30K questions a day. A: Retrieval-augmented generation. Chunk and embed the articles, retrieve the top…