Model Insights

dbrx-instruct

Details

Developer

Databricks

License

Databricks Open Model License

Model parameters

132B

Supported context length

32k

Price for prompt token

$1.2/Million tokens

Price for response token

$1.2/Million tokens

Model Performance Across Task-Types

Chainpoll Score

Short Context

0.88

Medium Context

0.95

Model Insights Across Task-Types

Digging deeper, here’s a look how dbrx-instruct performed across specific datasets

Short Context RAG

Medium Context RAG

This heatmap indicates the model's success in recalling information at different locations in the context. Green signifies success, while red indicates failure.

Performance Summary

Tasks	Dataset	Context adherence	Avg response length
Short context RAG	Drop	0.86	226.2
	Hotpot	0.85	307.3
	MS Marco	0.90	774.2
	ConvFinQA	0.89	324.3
Medium context RAG	Medium context RAG	0.95	NA
Long context RAG	Long context RAG	NaN	NA