How to measure whether you are winning the answer

What measuring answer engine results means

Google does not report whether you hold a featured snippet. Search Console counts a snippet as an impression at position 1 and a People Also Ask appearance as an impression at whatever position the box sat, and it labels neither. So measuring answer results means combining what Search Console can tell you with a check you run by hand.

The hand check is a fixed list of questions, the ones your customers ask, searched in the same way each month in a private browser window, with the holder of each box written down. Twenty to thirty questions is enough. The list does not change, which is what makes the count comparable from one month to the next, and it is the same method used for counting mentions in AI answers.

The Search Console side adds three things the hand check cannot see: how many people searched each question, whether your position moved, and how the click rate changed. A rising position with a falling click rate on a question search usually means you took the box, since people are reading the answer without clicking. That is a win even though one number went down.

What unmeasured answer work looks like at a land brokerage

A ranch and land brokerage sells a handful of properties a year, so ordinary traffic counts tell it very little. Buyers search questions for months before they ever call, things like how much an acre of irrigated ground costs in the Wood River Valley, what a water right is, whether a property has to perc before it can be built on, and what the minimum lot size is in Blaine County.

The brokerage had answers written for those questions and no way to tell whether they landed. The monthly report it received showed sessions and page views, which moved up and down for reasons no one could explain. Nobody had written down which questions were being tracked, so there was nothing to compare a month against. When a broker saw the firm’s own answer in a box one morning, there was no record of when it had appeared or whether it was still there a week later.

Without the fixed list, answer work becomes a matter of opinion. With it, the count either went from four questions to eleven or it did not.

A worked example: tracking 24 questions for a Hailey land brokerage

Wood River Land Company brokers ranch and recreational ground out of Hailey. A list of 24 buyer questions was fixed in month one and checked by hand each month in a private window, with the holder of each box recorded. Search Console figures for the same queries were pulled beside them.

The click rate fell and that was the expected result. More people saw the firm’s answer, more of them got what they came for without clicking, and the ones who did click were further along. The form count, which is the number the owner cares about, went from two to nine.

Here is how the brokerage described the water rights question before, on a page about buying ground.

Water is often the single most important consideration when purchasing agricultural or recreational property in Idaho, and understanding the water rights attached to a parcel requires careful due diligence. Our brokers have decades of combined experience navigating these issues and will guide you through the process of evaluating any property’s water situation.

Here is the rewrite that took the box in month three.

A water right in Idaho is a legal permit to use a set amount of water from a specific source for a specific purpose, and it is attached to the land, not to the owner. It carries a priority date, and in a dry year older rights are filled before newer ones. The Idaho Department of Water Resources holds the record for every right.

The tracked list is the record that tied that rewrite to the box appearing. Without it, the appearance would have been an anecdote a broker mentioned once.

How to check your own answer results

1. Write a fixed list of 20 to 30 questions your customers ask. Do not change the list once you start, or the counts stop comparing.
2. Once a month, in a private browser window, search each question and record three things: whether a box appeared, whose site it came from, and whether yours was in the People Also Ask questions.
3. In Google Search Console, open Performance, set the date range to the last month, and click Queries. Use the filter to show queries containing a question word. Record total impressions, average position and click rate for that filtered set.
4. Switch to the Pages tab with the same filter to see which of your pages the question traffic reaches.
5. Record the calls and forms from those pages. Your form plugin logs the page, and a call tracking number on the guide pages will separate those calls from the rest.
6. Put the six numbers in one row of a spreadsheet each month. The count of boxes held is the headline number.

Expect the first movement about four to six weeks after a page is rewritten, since Google has to recrawl the page before it can lift the new passage. The wider search side is measured separately, in Search Console.

What we do about measuring answer results

You get a fixed list of tracked questions agreed with you at the start, checked by hand every month in a clean browser, with the holder of every box recorded so you can see exactly what changed and when. Search Console impressions, position and click rate for those question searches are pulled alongside the hand check, and the calls and forms from the pages that answer them are counted. The report says which questions were won, which were lost, and what is being rewritten next. You will see the count of answer boxes held move month over month rather than a traffic chart you cannot act on. Reporting like this comes with every Hazer search plan.

Questions people ask about AEO: how to measure whether you are winning the answer