Answer engine optimization is a different discipline than SEO. When someone asks ChatGPT, Perplexity, or Google’s AI Mode a question in your category, what gets surfaced is whoever has done the work to be known, trusted, and well represented in the systems that power those answers.

Plenty of agencies now claim that work. Almost every services page in marketing grew an “AI search” line item in the past year. Very few of those agencies rebuilt anything underneath it.

You could resolve that with one of the many “best AEO agencies” rankings floating around, but most of those are published by an agency that happens to sit at #1, which makes them marketing, not research. What you actually need is a way to evaluate any AEO agency, including us, on the merits. That’s this guide.

What a Real AEO Program Requires

Before evaluating anyone, it helps to be precise about the job. A capable AEO agency can do five things.

  • Audit how your organization currently appears in AI-generated answers across major platforms (ChatGPT, Gemini, Perplexity, Claude, Bing Copilot)
  • Identify which queries your organization is or isn’t showing up for, and why
  • Build a content and technical strategy that improves your AI visibility over time
  • Measure and report on AI impressions, share of voice, and sentiment in AI-generated answers
  • Operate continuously rather than as a one-off engagement

Most agencies can do one or two of these. A handful can do most of them. Very few do all five with any consistency, and the gap rarely shows up in the pitch deck. It shows up three months into the engagement.

The Capabilities That Separate Real from Cosmetic

Operating model. Was the agency built to work with AI agents, or did it add AI tooling to an existing workflow? This matters more than it sounds. Agencies built around agentic systems produce consistent work at a pace and price that retrofitted shops have trouble matching. The AI-native vs. traditional agency comparison covers exactly what to look for and which questions expose the difference.

Identity strategy. AI systems reward consistency. An organization that describes itself the same way across its site, its content, its structured data, and its third-party mentions is easier for a retrieval system to recognize and trust than one whose story shifts page to page. Ask any prospective agency how they establish that consistency before content production starts. If the answer is a keyword list, they’re thinking in SEO.

Measurement. This is the clearest single signal of genuine capability. Ask the agency to show you, live, how they’d measure your AI visibility. Real programs track impressions, share of voice, and sentiment in AI answers using purpose-built monitoring tools. Cosmetic programs report traffic and rankings and call it AEO.

Content quality. AI search rewards depth, accuracy, and authority. It increasingly discounts volume. An agency whose pitch centers on how many pages they can produce per month is optimizing for a metric that stopped mattering. Ask to see actual content they’ve shipped, and judge whether you’d trust it as a reader.

Continuous operation. AI platforms change weekly. Models get retrained, citation patterns shift, new surfaces appear. A quarterly-report agency can’t keep up with a channel that moves this fast. Ask what happens between reports.

Questions to Ask in the First Call

A few questions do most of the filtering work.

“Show me how we appear in AI answers today.” A capable agency can audit this before the call or during it. If they need six weeks to tell you where you stand, they’re learning on your budget.

“Which tools do you use for AI visibility monitoring, and can we see the dashboard?” Named tools and a live view, or hedging. You’ll know within a minute.

“How does your content process work, and who reviews what ships?” You’re listening for two things. A clear system, and a human with their name on the output.

“What would make us a bad fit for you?” Agencies with a real methodology know its limits. Agencies selling everything to everyone don’t have one.

“How do you handle it when an AI platform cites us inaccurately?” This separates people who watch the channel from people who sell it. There are real answers to this question, and they’re specific.

Red Flags Worth Walking Away From

The AEO market has its share of manipulation dressed up as strategy. Some patterns to avoid in any agency you evaluate.

Guaranteed AI mentions. Nobody controls what a model says. Anyone guaranteeing placement is either lying or planning to do something that gets you penalized later.

Volume packages. Fixed bundles of “optimized content built to rank in AI search” at a flat price are the new link farms. The economics only work if nobody reviews anything.

Self-published rankings. Be skeptical of any “best agencies” or “best platforms” list published by a company that appears on it, in any industry. Chatbots currently have trouble telling self-reviews from independent ones, and some companies exploit that. It works until the platforms catch on, and the platforms are catching on. An agency willing to game AI answers for itself will game them for you, with your domain carrying the risk.

Synthetic word of mouth. Paid Reddit seeding, planted forum mentions, and review-site manipulation all fall under the same heading. Microsoft now has a name for the adjacent prompt-injection tactic, “AI recommendation poisoning,” and platforms are actively penalizing the whole family. Short-term mentions, long-term liability.

AEO as a line item. If AI search is one bullet among twelve services, it will get one-twelfth of the attention. The discipline is young enough that it rewards focus.

Where Soulcraft Fits

Full disclosure first. Soulcraft is an AEO agency, this guide lives on our site, and you can weight everything above accordingly. The criteria are real either way, and we’d rather you apply them to us than take our word for anything.

What we do. We’re an AI-native agency built around agentic systems. Before any content is created, we generate a soul.md, a structured identity document that tells every system, every agent, and every piece of content exactly who the company is. That identity layer runs through everything downstream, which is what makes the content coherent and recognizable to the AI systems evaluating it. We monitor AI visibility, share of voice, and sentiment continuously, and the systems operate between meetings rather than around them.

Who we fit. Series A through C companies with lean marketing teams, typically in AI, crypto, tech, CPG, or health and wellness, at $2,500 to $10,000 per month.

Who we don’t fit. Companies that need a campaign agency, a product launch moment, or experiential work. Enterprises that need twelve-stakeholder coordination. If AEO is a checkbox rather than a channel for you, a generalist will serve you better and cost you less.

Talk to us about your AEO strategy. We’ll tell you where you stand, what it would take to change it, and honestly whether we’re the right ones to do it.