HomeExplorellmops

Llmops Collection

Repositories tagged with "llmops"

EPIC

⭐59.5kHP

◆

📦Normal

★★★★

llm-app

pathwaycom

Jupyter Notebookchatbothugging-face

“Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.”

litellm

BerriAI

Pythonai-gatewayanthropic

“Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]”

composio

ComposioHQ

TypeScriptagentic-aiagents

“Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.”

langfuse

TypeScriptanalyticsautogen

“🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23 ”

mlflow

“The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.”

llm-action

liguodongiot

HTMLllmllm-inference

“本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）”

serve

jina-ai

Pythoncloud-nativecncf

“☁️ Build multimodal AI applications with cloud-native stack”

promptfoo

“Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.”

opik

comet-ml

Pythonevaluationhacktoberfest

“Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.”

SuperAGI

TransformerOptimus

Pythonagentsagi

“<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.”

RagaAI-Catalyst

raga-ai-hub

Pythonagentic-aiagentic-ai-development

“Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view ”

ragas

vibrantlabsai

Pythonevaluationllm

“Supercharge Your LLM Application Evaluations 🚀”

OpenLLM

bentoml

Pythonbentomlfine-tuning

“Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.”

gateway

Portkey-AI

TypeScriptai-gatewaygateway

“A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.”

tensorzero

“TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.”

bisheng

dataelement

TypeScriptagentai

“BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.”