Prompt engineering tools

Collaborate with your team on prompt development and version control your LLM-powered features.

Model testing

Quantify the performance of your prompts. Test your prompt on evaluation data gathered from production or generated automatically using an LLM. Specify criteria and success metrics, then compare performance between versions in an evaluation report.

Deployment

Keep your production models up to date without having to re-deploy. Tag your production and test environment prompts and set up your backend code to always pull the latest from Gantry.

Monitoring

Once your app is live, you can configure alerts on metrics you choose to detect performance degradations, data drift, and data quality issues. Send data from production (inputs, outputs, predictions, and implicit / explicit user feedback) back to Gantry to make sense of the full picture.

Analytics to improve your AI-powered product

Easily find failure cases, underperforming cohorts, and novel user behaviors. Add these interesting cases to an evaluation dataset to progressively validate your prompts on the latest production data.

Sign up

Gantry is currently invite-only. Contact us to get access.

📘

Onboarding

When you sign up for Gantry, we will walk you through creating an application step-by-step in our onboarding.

After completing the onboarding, you can build applications directly from the UI.

Follow the tutorial below to learn how.