Home / Directory / AI SaaS tooling / AI penetration testing / RunSybil

RunSybil

AI offensive security company from San Francisco whose agent, Sybil, pentests apps and infrastructure before major releases and on a continuous basis. RunSybil raised a $40 million Series A led by Khosla Ventures in March 2026.

7.4/10
Overall Score
Conditional recommend

RunSybil pairs an AI hacking agent with former red team leaders, which gives fast-moving software companies pentest results before a launch instead of weeks after.

Best for

AI and developer-tool companies that ship often and want pentests ahead of big releases, including new MCP servers and APIs.

Not ideal for

Buyers who want a self-serve tool with a public price, or teams looking only for a cheap compliance checkbox.

Verdict

RunSybil is an offensive security company with hubs in San Francisco and New York, founded in 2023 by Ari Herbert-Voss, the first security hire at OpenAI, and Vlad Ionescu, who led offensive red teams at Meta. Companies such as Notion, Carta, Baseten, and Turbopuffer use its AI agent, Sybil, to probe their applications and infrastructure, chain vulnerabilities, and turn findings into detection rules. It earns attention because it is built for teams that ship AI features quickly, testing things like new MCP servers before launch rather than on a yearly pentest calendar.

Score Breakdown

How RunSybil scores in the categories that matter to its buyers.

Buyer outcomes

Depth on modern app stacks
8.1
Speed before releases
7.9
Findings into detections
7.6
Pricing transparency
6.2

Company & commercial

Innovation & product leadership
7.7
Project management & communication
7.3
Pricing
7.1
Contract fairness
7.2

Pricing

RunSybil does not publish prices. Engagements are scoped with the team before a quote.

Sybil is offered as continuous offensive testing and as targeted pentests before launches, mergers, and audits. Customers say pricing sits on par with top pentest firms.

The Field at a Glance

How RunSybil compares with other AI penetration testing vendors we reviewed, by Overall Score and relative typical engagement cost.

6 7 8 9 Overall Score $ $$ $$$ $$$$ Relative typical engagement cost XBOW Ethiack Terra Security RunSybil 7.4
RunSybil XBOW Ethiack Terra Security

RunSybil scores 7.4 in AI penetration testing, under XBOW (7.8) and Ethiack (7.7), and ahead of Terra Security (7.3). Relative cost lands upper for this subcategory.

Use-case matrix

Use caseFitNotes
Pre-launch pentestsStrongNotion used it to pressure-test systems before a major release.
New MCP servers and APIsStrongFound two chained high-severity issues in a Carta MCP server before launch.
M&A security reviewsStrongCarta also used it for a review during an acquisition.
Turning findings into detectionsMixedCarta feeds findings into its detection patterns; this takes in-house work.
Self-serve testingWeakEngagements are scoped with the team.
Budget compliance pentestsWeakPriced like a top pentest firm, not a scanner.

Review Excerpts

Excerpts from company materials and customer stories for RunSybil, plus a representative buyer view drawn from public information. Paid reviews and pay-for-play sites were excluded.

How it's used

“RunSybil was an excellent partner for us. They pressure-tested our systems ahead of a major release and delivered fast, high-quality results at a competitive price on par with top pen-testing firms.”

Dana Bost, Senior Technical Program Manager, Notion · source
What people like

“We wanted a world-class partner for Turbopuffer’s ongoing pentesting needs, and we couldn’t be happier with our relationship with RunSybil. Quick turnaround, attention to detail, and fun to work with…”

Simon Eskildsen, CEO, Turbopuffer · source
What people like

“RunSybil’s expertise was instrumental in enhancing our security posture, providing us with critical insights for a confident launch.”

Philip Howes, CTO, Baseten · source
What people don't like

“Engagements are scoped and quoted by the team, so a small company cannot price a test from the website.”

Application security lead at a fintech company
Representative buyer view

Where customer reviews couldn't be found, our analysts attempted to give a voice to buyer sentiment, drawing on real information from review sites, forums, and product documentation.

Based on: RunSybil’s website

Company Facts

Founded
2023 (CB Insights)
Headquarters
Palo Alto, California, United States (CB Insights)
Total funding raised
$40M (CB Insights)
Key investors
Conviction Partners, Menlo Ventures, Elad Gil, Jeff Dean, Nikesh Arora (CB Insights)
Website
runsybil.com

Key Leadership

Ari Herbert-Voss

Ari Herbert-Voss

Co-founder and CEO

Methodology

This page is an independent evaluation of RunSybil for buyers comparing options in AI penetration testing. AI Industry Reviews accepts no sponsorships, advertising, or pay-for-placement fees. RunSybil did not pay for this review.

What we scored

The headline number is an Overall Score on a 0-10 scale. Eight criteria sit under it in two groups.

  • Buyer outcomes (for AI penetration testing)
    • Depth on modern app stacks
    • Speed before releases
    • Findings into detections
    • Pricing transparency
  • Company & commercial
    • Innovation & product leadership
    • Project management & communication
    • Pricing
    • Contract fairness

Pricing measures whether the price looks fair for the value delivered, including packaging and renewal friction that show up in real buying cycles.

Score Composition

InputWeightWhat it covers
Reviews40%A proprietary read of what practitioners say about likes, complaints, and day-to-day use, including public review sites, forums, and private chat rooms. Paid reviews and pay-for-play sites are out of scope.
Product35%Hands-on look at screens and workflows.
Pricing15%Whether the price looks fair for what you get.
Docs & training10%Docs, tutorials, and training material.

How we balanced the evidence

The Overall Score is the simple average of the eight criteria. Recommendation language follows that score and the use-case matrix above.

Scope

RunSybil is graded here as AI penetration testing. Criteria scores can move as more review volume and product checks are added.

← Back to AI penetration testing