🦍 The API and AI Gateway

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Deploy serverless AI workflows at scale. Firebase for AI agents

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

The platform for LLM evaluations and AI agent testing

Your autonomous engineering team in a CLI. Point Zeroshot at an issue, walk away, and return to production-grade code. Supports Claude Code, OpenAI Codex, OpenCode, and Gemini CLI.

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

AIConfig is a config-based framework to build generative AI applications.

Python SDK for running evaluations on LLM generated responses

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

The context API for AI agents

[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI

Production operations framework for AI-powered SaaS. The architectural patterns, failure modes, and operational playbooks that determine whether your AI systems scale profitably or fail expensively.

Quality Control for AI Artifact Management

🔍 AI observability skill for Claude Code. Debug LangChain/LangGraph agents by fetching execution traces from LangSmith Studio directly in your terminal.

Miscellaneous codes and writings for MLOps

[🚧🚧🚧WIP🚧🚧 🚧]Rework of webapp-conversation

Deployment of RAG + LLM model serving on multiple K8s cloud clusters