LLM Hallucination Index RAG SpecialModel Insights
snowflake-arctic-instruct
Details
Developer
Snowflake
License
Apache 2.0
Model parameters
480B
Supported context length
4k
Price for prompt token
$2.4/Million tokens
Price for response token
$2.4/Million tokens
Model Performance Across Task-Types
Chainpoll Score
Short Context
0.85
Model Insights Across Task-Types
Digging deeper, here’s a look how snowflake-arctic-instruct performed across specific datasets
Short Context RAG
Performance Summary
| Tasks | Dataset | Context adherence | Avg response length |
|---|---|---|---|
| Short context RAG | Drop | 0.84 | 240.8 |
| Hotpot | 0.81 | 113.6 | |
| MS Marco | 0.91 | 456.5 | |
| ConvFinQA | 0.83 | 188 | |
| Medium context RAG | Medium context RAG | NaN | NA |
| Long context RAG | Long context RAG | NaN | NA |