LMSYS Series
LMSYS is THE defining leaderboard to compare raw capabilities of various LLMs. It has so far collected over 1,000,000 human pairwise comparisons to rank LLMs in Elo-scale.
We are creating cookbooks that help you get the best value of of LMSYS leaderboard for production use cases, by leveraging Portkey's Gateway, Observability, and Prompt Management features.
Cookbooks
- Comparing the Top 10 LMSYS models using a single function.
- RAG Benchmark Over LMSYS Models (coming soon!)