LLM Hallucination Index RAG SpecialModel Insights
gemma-2-9b-it
Details
Developer
License
Gemma
Model parameters
9B
Supported context length
8k
Price for prompt token
$0.3/Million tokens
Price for response token
$0.3/Million tokens
Model Performance Across Task-Types
Chainpoll Score
Short Context
0.92
Model Insights Across Task-Types
Digging deeper, here’s a look how gemma-2-9b-it performed across specific datasets
Short Context RAG
Performance Summary
| Tasks | Dataset | Context adherence | Avg response length |
|---|---|---|---|
| Short context RAG | Drop | 0.87 | 185.8 |
| Hotpot | 0.90 | 150 | |
| MS Marco | 0.98 | 455.1 | |
| ConvFinQA | 0.95 | 232.4 | |
| Medium context RAG | Medium context RAG | NaN | NA |
| Long context RAG | Long context RAG | NaN | NA |