Major publishers are reconsidering whether Google should continue to have unrestricted access to their website content.
For many years, publishers allowed Google’s crawler to scan their articles and add them to search results. In return, Google Search sent large numbers of visitors to news and media websites. This traffic helped publishers earn revenue through advertising, subscriptions and other digital products.
The relationship is now becoming more complicated as Google expands AI-powered search features. These features can provide complete summaries directly on the search results page. Users may receive the information they need without opening the original article.
As a result, some publishers are experiencing lower search traffic and fewer website visits. This can reduce advertising impressions, subscription opportunities and direct engagement with readers.
Several major media companies are now discussing whether they should limit or completely block Google’s crawler. They are also considering paid content agreements, registration walls and stronger controls over how AI systems use their articles.
However, blocking Google is not a simple decision. Google remains an important source of website discovery. A publisher that blocks its main crawler may also lose visibility in traditional search results, not only in AI-generated answers.
This creates a difficult choice. Publishers want to protect the value of their original content, but they also do not want to disappear from the world’s largest search platform.
The discussion shows that website crawling is no longer only a technical SEO issue. It is becoming an important business and brand strategy decision. Companies must decide where their content can appear, how it can be used and whether the platform provides enough value in return.
For digital marketers, this change highlights the importance of reducing dependence on one traffic source. Businesses should continue investing in SEO, but they should also build direct relationships through email marketing, social media, mobile apps, communities and strong brand recognition.
Analytics will also become more important. Brands should monitor search traffic, AI visibility, engagement, conversions and revenue instead of measuring success through website visits alone.
As AI changes online discovery, publishers and businesses will need a more balanced content strategy. The goal will be to remain visible across search and AI platforms while protecting valuable content and building audiences they can reach directly.