Google’s Robby Stein Identifies 5 SEO Factors For AI Mode
Google’s Robby Stein identifies five key SEO factors for AI Mode and explains how they impact search visibility.
Google’s Robby Stein, VP of Product for Google Search, has clarified how AI Mode evaluates content quality and why long-standing search signals still matter. In a recent interview, he explained that AI Mode sits on top of 25 years of search quality work, not apart from it, and then named five SEO-focused factors that influence whether content is surfaced in AI answers.
How AI Mode Manages Hallucinations
Stein was asked how Google keeps AI Mode from hallucinating and ensures that AI responses stay consistent with Google’s core quality standards. He stressed that the guardrails come from Google’s existing search systems, not from an entirely new stack.
The interviewer asked:
“These models are non-deterministic and they hallucinate occasionally… how do you protect against that? How do you make sure the core experience of searching on Google remains consistent and high quality?”
Robby Stein answered:
And of course it makes mistakes at times, but I think just the quality of the model has gotten so strong that those are much less likely to happen now.”
“Yeah, I mean, the good news is this is not new. While AI and generative AI in this way is frontier, thinking about quality systems for information is something that’s been happening for 20, 25 years.
And so all of these AI systems are built on top of those. There’s an incredibly rigorous approach to understanding, for a given question, is this good information? Are these the right links? Are these the right things that a user would value?
What’s all the signals and information that are available to know what the best things are to show someone. That’s all encoded in the model and how the model’s reasoning and using Google search as a tool to find you information.
So it’s building on that history. It’s not starting from scratch because it’s able to say, oh, okay, Robbie wants to go on this trip and is looking up cool restaurants in some neighborhood.
What are the things that people who are doing that have been relying on on Google for all these years? We kind of know what those resources are we can show you right there. And so I think that helps a lot.
And then obviously the models, now that you release the constraint on layout, obviously the models over time have also become just better at instruction following as well. And so you can actually just define, hey, here are my primitives, here are my design guidelines. Don’t do this, do this.
And of course it makes mistakes at times, but I think just the quality of the model has gotten so strong that those are much less likely to happen now.”
In practice, that means relevance, trust, link quality, and historic user satisfaction signals help determine which sources AI Mode can rely on. Accuracy is improved by grounding model reasoning in the same quality judgments that decide which results appear and get clicked in classic Search.
How Google Measures Helpfulness In AI Mode
When asked how Google knows whether AI Mode is delivering the “best possible” experience, Stein described a multi-layered evaluation that mirrors traditional search quality measurement.
The interviewer asked:
“And Robbie, as search is evolving, as the results are changing and really, again, becoming dynamic, what signals are you looking at to know that the user is not only getting what they want, but that is the best experience possible for their search?”
Stein answered:
“Yeah, there’s a whole battery of things. I mean, we look at, like we really study helpfulness and if people find information helpful.
And you do that through evaluating the content kind of offline with real people. You do that online by looking at the actual responses themselves.
And are people giving us thumbs up and thumbs downs?
Are they appreciating the information that’s coming?
And then you kind of like, you know, are they using it more? Are they coming back? Are they voting with their feet because it’s valuable to you.
And so I think you kind of triangulate, any one of those things can lead you astray.
There’s lots of ways that, interestingly, in many products, if the product’s not working, you may also cause you to use it more.
In search, it’s an interesting thing.
We have a very specific metric that manages people trying to use it again and again for the same thing.
We know that’s a bad thing because it means that they can’t find it.
You got to be really careful.
I think that’s how we’re building on what we’ve learned in search, that we really feel good that the things that we’re shipping are being found useful by people.”
So success in AI Mode is still defined by genuine task completion and reduced friction, not just engagement time or query volume. That continuity means AI Mode is judged by whether users actually get what they came for.
The 5 Quality Factors That Matter For AI Mode
For SEOs, Stein’s most practical comments came when he was asked whether traditional best practices still help you show up in AI answers. He answered by listing five concrete quality factors AI Mode looks at when judging content:
- Is your content directly answering the user’s question?
- Is it high quality?
- Does it load quickly?
- Is it original?
- Does it cite sources?
Stein answered:
“The core mechanic is the model takes your question and reasons about it, tries to understand what you’re trying to get out of this.
It then generates a fan-out of potentially dozens of queries that are being Googled under the hood. That’s approximating what information people have found helpful for those questions.
There’s a very strong association to the quality work we’ve done over 25 years.
Is this piece of content about this topic?
Has someone found it helpful for the given question?
That allows us to surface a broader diversity of content than traditional Search, because it’s doing research for you under the hood.
The short of it is the same things apply.
- Is your content directly answering the user’s question?
- Is it high quality?
- Does it load quickly?
- Is it original?
- Does it cite sources?
If people click on it, value it, and come back to it, that content will rank for a given question and it will rank in the AI world as well.”
Taken together, those five factors map cleanly to long-standing SEO fundamentals that include clear intent matching, depth and clarity, performance, uniqueness, and transparent attribution. The user behavior piece “click on it, value it, and come back to it” reinforces that AI visibility is still tied to real-world engagement signals, not just clever prompts or LLM-specific tricks.
What This Means For Your SEO Strategy
Stein’s comments line up closely with Google’s broader message: AI Mode is an evolution of search, not a separate channel with its own alien rules. The same systems that judge whether content is relevant, trustworthy, and helpful in classic SERPs now guide which sources AI Mode reads from and cites.
For practitioners, that suggests a clear path forward:
- Focus on answering specific user questions directly and thoroughly.
- Maintain strong technical performance so pages load quickly.
- Publish genuinely original, differentiated content rather than derivative rewrites.
- Cite and reference sources clearly where appropriate.
If your pages already perform well against those criteria and users consistently find them valuable, Stein’s guidance indicates you are positioned not just for traditional rankings but for AI Mode visibility as well.
Watch the interview starting about the one hour and twenty-three-minute mark here:
Video 1
