Posts tagged AI Evaluation
A Metrics-First Approach to LLM Evaluation
Learn about different types of LLM evaluation metrics needed for generative applications
How to Integrate IBM watsonx with Galileo to Evaluate your LLM Applications
See how easy it is to leverage Galileo's platform alongside the IBM watsonx SDK to measure RAG performance, detect hallucinations, and quickly iterate through numerous prompts and LLMs.
Introducing Galileo Luna™: A Family of Evaluation Foundation Models
Low latency, low cost, high accuracy GenAI evaluation is finally here. No more ask-GPT and painstaking vibe checks.
Announcing LLM Studio: A Smarter Way to Build LLM Applications
LLM Studio helps you develop and evaluate LLM apps in hours instead of days.
Webinar - Announcing Galileo LLM Studio: A Smarter Way to Build LLM Applications
Webinar - Announcing Galileo LLM Studio: A Smarter Way to Build LLM Applications
Mastering RAG: How To Evaluate LLMs For RAG
Learn the intricacies of evaluating LLMs for RAG - Datasets, Metrics & Benchmarks
Tricks to Improve LLM-as-a-Judge
Unlock the potential of LLM Judges with fundamental techniques
Best Practices For Creating Your LLM-as-a-Judge
Master the art of building your AI evaluators using LLMs
Paper - Galileo ChainPoll: A High Efficacy Method for LLM Hallucination Detection
ChainPoll: A High Efficacy Method for LLM Hallucination Detection. ChainPoll leverages Chaining and Polling or Ensembling to help teams better detect LLM hallucinations. Read more at rungalileo.io/blog/chainpoll.
Mastering RAG: How To Observe Your RAG Post-Deployment
Learn to setup a robust observability solution for RAG in production
Webinar - The Future of Enterprise GenAI Evaluations
Evaluations are critical for enterprise GenAI development and deployment. Despite this, many teams still rely on 'vibe checks' and manual human evaluation. To productionize trustworthy AI, teams need to rethink how they evaluate their solutions.
LLM Hallucination Index: RAG Special
The LLM Hallucination Index ranks 22 of the leading models based on their performance in real-world scenarios. We hope this index helps AI builders make informed decisions about which LLM is best suited for their particular use case and need.
Mastering Data: Generate Synthetic Data for RAG in Just $10
Learn to create and filter synthetic data with ChainPoll for building evaluation and training dataset
Best LLMs for RAG: Top Open And Closed Source Models
Top Open And Closed Source LLMs For Short, Medium and Long Context RAG
Is Llama 3 better than GPT4?
Llama 3 insights from the leaderboards and experts
Galileo Luna: Breakthrough in LLM Evaluation, Beating GPT-3.5 and RAGAS
Research backed evaluation foundation models for enterprise scale
Enough Strategy, Let's Build: How to Productionize GenAI
At GenAI Productionize 2024, expert practitioners shared their own experiences and mistakes to offer tools and techniques for deploying GenAI at enterprise scale. Read key takeaways from the session on how to productionize generative AI.
Mastering RAG: How to Select an Embedding Model
Unsure of which embedding model to choose for your Retrieval-Augmented Generation (RAG) system? This blog post dives into the various options available, helping you select the best fit for your specific needs and maximize RAG performance.
Mastering RAG: Improve RAG Performance With 4 Powerful RAG Metrics
Unlock the potential of RAG analysis with 4 essential metrics to enhance performance and decision-making. Learn how to master RAG methodology for greater effectiveness in project management and strategic planning.
Practical Tips for GenAI System Evaluation
It’s time to put the science back in data science! Craig Wiley, Sr Dir of AI at Databricks, joined us at GenAI Productionize 2024 to share practical tips and frameworks for evaluating and improving generative AI. Read key takeaways from his session.
Survey of Hallucinations in Multimodal Models
An exploration of type of hallucinations in multimodal models and ways to mitigate them.
Solving Challenges in GenAI Evaluation – Cost, Latency, and Accuracy
Learn to do robust evaluation and beat the current SoTA approaches
Mastering Agents: Metrics for Evaluating AI Agents
Identify issues quickly and improve agent performance with powerful metrics
LLM-as-a-Judge vs Human Evaluation
Understand the tradeoffs between LLMs and humans for generative AI evaluation