Pezzo

What is Pezzo?

Pezzo is an open-source, cloud-native LLMOps platform for teams that build applications with large language models. It brings prompt management, versioning, delivery, collaboration, observability, troubleshooting, caching, and operational monitoring into one development environment. The project provides clients for Node.js and Python and lists LangChain support for prompt management, observability, and caching.

Developers can run the stack locally with Docker Compose or work from the source repository. The documented development setup requires Node.js 18 or later and Docker, with infrastructure services started through the included Compose configuration.

How to Use Pezzo

1. Install the repository dependencies with npm.
2. Create the required environment files from the provided examples.
3. Start the infrastructure dependencies with Docker Compose.
4. Run the Pezzo server and console during development.
5. Connect an application through a supported client to manage prompts and inspect model activity.

Core Features

• Prompt management: Keeps prompts and their changes in a shared operational system.
• Version management and delivery: Supports controlled prompt versions and delivery of AI changes.
• Observability: Records activity so teams can monitor LLM application behavior.
• Troubleshooting: Helps investigate issues across prompts and model operations.
• Caching: Provides caching through the listed Node.js, Python, and LangChain clients.
• Self-hosted development: Includes Docker Compose configuration for running the stack locally.

Use Cases

• LLM application operations: Engineering teams can manage prompts and monitor production behavior from one platform.
• Prompt collaboration: Multiple contributors can organize and deliver prompt changes without scattering versions across code and documents.
• Model troubleshooting: Developers can inspect operational data when an AI workflow behaves unexpectedly.
• Self-hosted LLMOps: Teams can deploy the open-source stack within their own environment.

Frequently Asked Questions

Is Pezzo open source?

Yes. The repository describes Pezzo as an open-source LLMOps platform and publishes it under the Apache 2.0 license.

Which application clients are listed?

The repository lists Node.js, Python, and LangChain clients for prompt management, observability, and caching.