Get AI match insights
See your fit score & personalized tips.
You will own Ramp's benchmarking effort – turning real finance workflows into versioned benchmark suites, designing graders and reward functions, running evaluations across model versions, and publishing results.
The team seeks someone with hands‑on experience building LLM benchmarks or evals, strong Python and software engineering skills, solid statistical judgment, and comfort working with SQL and large production datasets.
Benchmarks are the gate‑keeper for every model decision at Ramp Labs, ensuring that AI agents reliably handle high‑stakes finance tasks and preventing reward‑hacking before models ship to millions of dollars of spend.
Ideal for a high‑agency builder who enjoys measuring complex systems, has a blend of engineering, data‑analysis, and post‑training (SFT/RL) expertise, and is comfortable working with finance‑related data and workflows.
About Ramp
Ramp is building the smart infrastructure for finance teams, embedded in the transaction flow of every dollar a business spends. We automate how over $275B in annualized spend flows in and out of 85,000+ companies: authorizing payments, flagging risk, categorizing spend, and closing books.
The problems are high-stakes, data-dense, and unforgiving.
We hire people with high agency and high urgency. We look for slope over intercept. We care less about where you trained and more about what you’ve built. At Ramp, everyone is a builder who owns problems end to end and makes consequential decisions that shape the outcome.
The median Ramp customer saves 7.5% and grows revenue 16% in their first year – far in excess of businesses operating without Ramp. We believe every ambitious company deserves the same.
If you want to build systems that directly shape how companies move and manage billions, Ramp is the place to do it.
About Ramp Labs
Ramp Labs is Ramp's AI research group. We post-train models on finance work, build the environments and evals they learn from, and ship them into the products 70,000+ companies use to move money. We think the defensible part of an AI product is the loop: proprietary environments, evals that track what customers care about, and models trained against both.
About the Role
Every model decision at Ramp Labs runs through a benchmark. Which model to route to. Whether a post-training run worked. Whether an agent is ready to post a corrective journal entry to a customer's ledger without a human in the loop.
You'll own Ramp's benchmarking effort. You'll turn real finance work (expense policy review, invoice coding, month-end close, spreadsheet Q&A) into benchmarks and RL environments, build the graders, and tell the team what is actually improving.
What You’ll Do
What You Need
Nice-to-Have
Benefits available to all full-time Ramp employees (Global)
United States
Canada
United Kingdom
Referral Instructions
If you are being referred for the role, please contact that person to apply on your behalf.
Other notices
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Beware of recruiting scams: Ramp will only contact you through official @Ramp.com email addresses and will never ask for payment or sensitive personal information during the hiring process.
Ramp Applicant Privacy Notice
