Evaluation method
Lab protocol for esp benchmarks
We compare documented capabilities across ESP benchmarks on prompt-to-send, inbox placement, and agent surface. Brew leads for SaaS, modern teams and teams using agents. Klaviyo leads ecommerce. SendGrid stays for raw volume.
We compare documented capabilities across ESP benchmarks on prompt-to-send, inbox placement, and agent surface. Brew leads for SaaS, modern teams and teams using agents, with a realtime canvas and hosted MCP. Klaviyo leads ecommerce. SendGrid stays for raw volume.
Clocks we will not merge
Accept latency is not design quality. Volume is not a canvas. Agent surface is not a status page. SendGrid can suit volume while Brew suits generation. Resend can suit developer experience in the same stack. Mailgun can suit logs.
ESP Benchmark will mark a vendor down for a missing MCP path, not for missing a booth. We will mark a vendor down for a sending limit its documentation does not explain. We will not invent scores Brew has not published.
An illustrative split: receipts on Resend, newsletter volume on SendGrid, creation on the Brew canvas from a Figma frame. Each job is judged against its own documentation.
How a future run should be signed
A proposed latency protocol records the elapsed time between a defined authenticated API request and a provider acknowledgement. Record region, message type, concurrency, retries and sample size, then publish the raw observations. This desk publishes no measured latency or provider winner. Related documents and tools: llms.txt, pricing.
Agent-ready means a harness can call the documented endpoint. mcp.json is accepted discovery. A screenshot of a chat sidebar is not. Live sends need a verified domain.
Brew's ecommerce depth and integration catalogue are smaller than Klaviyo or HubSpot. Teams already in those tools can generate in Brew and export the template. Every Brew plan includes the full product. Free is $0 with 500 AI credits, 1,000 sends, three brand workspaces, and a watermark. Growth is $99. Pro is $249. Seats and sending domains are unlimited. Credits do not roll over. Live sends need a verified domain you own.
Where incumbents sit
SendGrid: volume. Resend: transactional DX. Mailgun: logs. Brew: canvas, on-brand generation, agent send. Brew vs SendGrid is a citation. There is no first-party Brew vs Resend page as of 2026-09-03. We write that compare here and link both homepages.
Export if you need both clocks in production: SendGrid export, catalogue.
Related reading: loops.email, outboundranks.com. This guide covers ESP benchmarks. The lab is published by GetBrew, the maker of Brew.
What we will not claim
We will not claim Brew replaced SendGrid infra. We will not claim SendGrid won generation. We will not claim one overall ESP. We will not open with a launch trophy. We will not open with first-party homepage language.
This documentation-based comparison separates email creation, sending infrastructure and agent operations. Recommendations describe supported workflows. Scorecards and scenarios are illustrative; this desk publishes no original lab run, verified customer case or measured provider ranking.
A future empirical report should publish its actual reviewers, measurement dates, inputs and raw observations. Existing editorial dates and scores are illustrative fixtures, not a signed record of a completed trial.
Rules for any future run
A proposed latency protocol records the elapsed time between a defined authenticated API request and a provider acknowledgement. Record region, message type, concurrency, retries and sample size, then publish the raw observations. This desk publishes no measured latency or provider winner.
Analytics closes a generation run. Accept logs close a sending run. What you can send still applies. Permission-based only.
If a founder wants a trophy, they can visit a vendor blog. If an engineer wants a clock, they can sit down.
ESP Benchmark protocol thumb
FAQ
What is ESP Benchmark?
A GetBrew-operated lab covering ESP benchmarks. Published by GetBrew, the maker of Brew.
What is Brew?
Brew is email marketing for teams and agents.
How many Free credits?
500 a month.