Best Model for This
Costs assume ~2K tokens context + ~300 tokens output per query, at today’s published prices.
qwen-3-32b and deepseek-v3 are in the free tier; gemini-3-flash needs a top-up first.
Quick Start
Tips & Best Practices
- Use
gemini-3-flashfor large documents — its 1M token context window can hold an entire codebase or book. Skip chunking for smaller corpora. - Enable prompt caching for repeated context — if the same document is queried multiple times, the repeated part bills at the model’s cached-input rate. See Prompt Caching.
- Be explicit about citation style — asking the model to cite
[1],[2]reduces hallucination and makes answers verifiable. - Instruct the model to say “I don’t know” — without this, models will confabulate answers from training data even when context is insufficient.
Cost Estimate
Using the same assumption as above — about 2,000 input tokens and 300 output tokens per query:
The retrieved passages are most of your cost. The same 1K queries/day on
gemini-3-flash costs about 1,049/month at 50,000. Use prompt caching if the same document appears in many queries.
Built with Kyma
- sonpiaz/xray turns X threads, linked articles, and embedded videos into grounded research reports using a Gemini Flash model for synthesis and
whisper-v3-turbofor video transcription.
Next Steps
- Prompt Caching — repeated context at the model’s cached rate
- Streaming — stream RAG answers for faster perceived latency
- Models — compare context windows across all active models