LLM Hallucination Index RAG SpecialModel Insights
gemma-2-27b-it
Details
Developer
License
Gemma
Model parameters
27B
Supported context length
8k
Price for prompt token
$0.8/Million tokens
Price for response token
$0.8/Million tokens
Model Performance Across Task-Types
Chainpoll Score
Short Context
0.93
Model Insights Across Task-Types
Digging deeper, here’s a look how gemma-2-27b-it performed across specific datasets
Short Context RAG
Performance Summary
| Tasks | Dataset | Context adherence | Avg response length |
|---|---|---|---|
| Short context RAG | Drop | 0.92 | 144.6 |
| Hotpot | 0.92 | 93.9 | |
| MS Marco | 0.96 | 350 | |
| ConvFinQA | 0.95 | 145.2 | |
| Medium context RAG | Medium context RAG | NaN | NA |
| Long context RAG | Long context RAG | NaN | NA |