ChatGPT Integrates SerpApi To Scrape Google Search Results

OpenAI’s ChatGPT is now integrated with SerpApi for web scraping, which gives you access to live Google search information.

Recent reports have revealed that OpenAI’s ChatGPT utilizes a small portion of Google search data, obtained via a company that scrapes web pages, SerpApi, for its response to events of the moment, like news and sports. This information was first reported in the SEO community and confirmed by an article in The Information.

OpenAI’s Relationship to SerpApi

According to The Information:

“OpenAI is getting the data from SerpApi, an eight-year-old web-scraping firm, which listed OpenAI as a customer on its website as recently as May last year. It removed the reference for reasons that couldn’t be learned.”

SerpApi is a specialist in the extraction of live results from search engines, providing AI algorithms access to the most current data that goes beyond their initial training cutoffs.

It is not only ChatGPT using this method; other AI tools, such as Perplexity, depend on scraped results from search results to improve the quality of answers and speed.

Mixed Findings on ChatGPT’s Search Results

A recent Ahrefs study concluded that:

“83.39% of ChatGPT’s chosen results don’t appear in Google’s search results at all for the same fan-out queries.

There are, however, many instances where ChatGPT’s results correspond to Google’s top search results, indicating a partial overlap between the AI’s original information and the indexing of Google.

Utilizing scraped Google search results can help ChatGPT deliver more frequent, appropriate, relevant and contextually-relevant responses, particularly in the context of rapidly changing topics. 

But the difference that was highlighted by Ahrefs suggests that the output of AI can differ from the results from Google, highlighting the difficulty of creating content using AI.

Bottom Line

As AI services continue to draw on real-time data from search engines and sources, transparency over data sources and accuracy is of utmost importance. Understanding how models such as ChatGPT combine and analyze data from websites such as Google allows us to provide realistic expectations to users who rely on AI-generated responses.

Forum discussion at X.