What is Gantry?
Gantry is an AI Application Platform that allows you to build, maintain, monitor, improve, and govern your AI-powered products. Gantry helps you build reliable and personalized AI products by providing:
Analytics to improve your AI-powered product
Easily find failure cases, underperforming cohorts, and novel user behaviors. Add these interesting cases to an evaluation dataset to progressively validate your prompts on the latest production data.
Prompt engineering tools
Collaborate with your team on prompt development and version control your LLM-powered features.
Model testing
Quantify the performance of your prompts. Test your prompt on evaluation data gathered from production or generated automatically using an LLM. Specify criteria and success metrics, then compare performance between versions in an evaluation report.
Deployment
Keep your production models up to date without having to re-deploy. Tag your production and test environment prompts and set up your backend code to always pull the latest from Gantry.
Monitoring
Once your app is live, you can configure alerts on metrics you choose to detect performance degradations, data drift, and data quality issues. Send data from production (inputs, outputs, predictions, and implicit / explicit user feedback) back to Gantry to make sense of the full picture.
Sign up
Gantry is currently invite-only. Contact us to get access.
Updated 5 months ago