azureml-examples/sdk/python/foundation-models/meta-llama-3.1/litellm.ipynb at main · Azure…
Official community-driven Azure Machine Learning examples, tested with GitHub Actions. - Azure/azureml-examples
LiteLLM Breaking in Prod? What are LiteLLM Alternatives
LiteLLM seems to be breaking in Prod. It worked well during dev and light load tests. But as soon as it crossed certain requests per second, things started to break. **Common Issues with LiteLLM**: ...
ncecere/terraform-provider-litellm
litellm terraform provider (⭐ 37)
Current status of LiteLLM (Python SDK) + Langfuse v3 integration?
Hi everyone, I'm planning to upgrade to Langfuse v3 but I've seen several GitHub issues mentioning compatibility problems with LiteLLM. I've read that the native `litellm.success_callback = ["langfuse...
LiteLLM - Phoenix
LiteLLM is an open-source platform that provides a unified interface to manage and access over 100 LLMs from various providers.
openinference-instrumentation-litellm · PyPI
OpenInference liteLLM Instrumentation
LiteLLM: Free Open Source Gateway to Manage All Your LLM Providers
4 days ago · LiteLLM addresses this problem by acting as a unified gateway in front of all your LLM providers. It standardizes API calls, centralizes authentication, enforces usage controls, and provides …
LiteLLM
The LiteLLM proxy has streamlined our management of LLMs by standardizing logging, the OpenAI API, and authentication for all models, significantly reducing operational complexities.
BerriAI/litellm-pgvector
No description (⭐ 57)
litellm · PyPI
Jul 27, 2023 · LiteLLM follows the Google Python Style Guide. Our automated checks include: All these checks must pass before your PR can be merged. Need for simplicity: Our code started to get …
What is LiteLLM and How to Use it - Codecademy
LiteLLM is an open-source Python library that acts as a unified interface for Large Language Models (LLMs). It allows us to connect with multiple AI providers such as OpenAI, Anthropic, Google Gemini, …
Your AI App Will Never Crash Again: Building High Availability with LiteLLM
1 day ago · The standout feature of LiteLLM is its built-in router, designed specifically for high availability (HA). It allows you to define fallback mechanisms directly in your code or via a centralized proxy server.
LiteLLM Alternative
I have used LiteLLM in a few projects, as its just a win to have someone else manage the adding of new providers each time, but I really would prefer to replace. I see lots of things about it pulling ...
LiteLLM: A Guide With Practical Examples - DataCamp
Sep 23, 2025 · LiteLLM is an open-source Python library that works as a universal translator for AI models. Instead of learning different APIs for each provider, you use one interface that connects to …
How to Use LiteLLM with OpenAI, Claude, Gemini & More
1 day ago · Use LiteLLM to access GPT, Claude, Gemini, Grok, and more through Puter's OpenAI-compatible API. One API key, any model, no separate provider keys needed.
BerriAI/liteLLM-proxy
No description (⭐ 191)
A gentle introduction to LiteLLM - Medium
Jul 11, 2025 · Born out of the illustrious Y Combinator program, LiteLLM is a lightweight, powerful abstraction layer that unifies LLM API calls across providers — whether you’re calling OpenAI, …
Some rough edges we hit running LiteLLM in production
We have been using LiteLLM proxy in production for a while. Overall, solid project. Easy multi provider abstraction, good defaults, very active community. For prototyping and early stage setups, it wo...
GitHub - BerriAI/litellm: Python SDK, Proxy Server (AI Gateway) to call ...
You can use LiteLLM through either the Proxy Server or Python SDK. Both gives you a unified interface to access multiple LLMs (100+ LLMs). Choose the option that best fits your needs: Who Uses It? …
Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching
Points: 140 | Comments: 34 | Author: ij23